Java Mailing List Archive

http://www.java2.5341.com/

Home » nutch-user.lucene »

write out fetch results without map-reduce

AJ Chen

2008-07-01


Author LoginPost Reply
I'm trying to use latest nutch code base to write a fetcher that does not
use map-reduce operations. After fetching a list of urls, CrawlDatum and
Content are available to output to file. What's the most direct way to write
the fetch results to file without going through map-reduce operations? Use
SequenceFile class directly? It writes in binary. Any existing class for
writing results in plain text?
thanks,

AJ
©2008 java2.5341.com - Jax Systems, LLC, U.S.A.