Open-source crawlers

Full-featured, flexible and extensible. Run on any platform. Crawl what you want, how you want.

Available Crawlers


HTTP Collector

Web crawler for the Internet or Intranet.

Download   More Info


Filesystem Collector

Crawl data from local disk, FTP, SFTP, WebDAV, HDFS, ...

Download   More Info


Why chose Norconex Collectors? Click here or on a feature to learn more.

More features: HTTP Collector | Filesystem Collector

User Feedback

Real feedback from real Github users. Click a quote to view its origin.

Copyright © 2013-2020 Norconex Inc.