When doing a crawl of about 3500 urls to a depth of 1 I find that, after
dumping the segment data, the Content-Length field only exists in Content
Metadata for about half of the urls that were crawled. Does nutch calculate
the content length, or does it simply display the header value if it is
present?

Kevin