Java Mailing List Archive

http://www.java2.5341.com/

Home » nutch-user.lucene »

How to authenticate with cookies?

Yoav Shapira

2008-05-05

Replies: Find Java Web Hosting

Author LoginPost Reply
Hi,

I'm using Nutch to crawl an intranet site that is behind form
authentication. I know Nutch doesn't support form authentication yet
(right?), but I think this site would also work with cookies. I have
the right set of cookie names and values, at least for testing, but I
don't know how to have Nutch use these cookies with every HTTP
requests during its crawl.

I saw a reference to a "protocol-httpclient" plugin. Is that true / relevant?

Any help on configuring Nutch to use cookies for authentication would
be appreciated.

--
Thanks,

Yoav
©2008 java2.5341.com - Jax Systems, LLC, U.S.A.