Updated: 02/28/2000

Harvest-NG

Harvest-NG is a collection of Perl modules and scripts which provide a powerful web crawling and summarizing agent. The code is aimed at providing an open source, standards compliant, tool for fetching content from a wide variety of information sources, summarising it into a set of resource descriptions, and storing these in an easily accessible database from which search services can be built and statistical information compiled.

• Categories
  • CGI and Perl →
  • Scripts and Programs →
  • Searching →
  • Web Indexing
• Platforms
  • Linux
• Licenses
  • Freeware