Java Mailing List Archive

Home » nutch-user.lucene »

Nutch is not crawling all outlinks

Pravin Karne


Author LoginPost Reply
Nutch is not crawling all outlinks even with following property

<description>The maximum number of outlinks that we'll process for a page.
If this value is nonnegative (>=0), at most outlinks
will be processed for a page; otherwise, all outlinks will be processed.

Any help regarding this.

Thanks in advance.

This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.
©2008 - Jax Systems, LLC, U.S.A.