We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Describe fetcher.server.delay.force and fetcher.max.crawl.delay.force
Fixed package name for protocol classes
Setting the default limit of the http.content to -1, and generated archetype to 65536
http.content.limit is implemented, and -1 value is for disabling it.
Edited broken links for urlfiters.json and parsefilters.json
add http cookies to config wiki
Updated Configuration (markdown)
Fix links to code in Wiki, fixes #344
https://github.com/DigitalPebble/storm-crawler/issues/323
Added description of default configuration
WIKI - removed reference to abstract indexing bolt
more than one config per command line
fixed links to external
Created Configuration (markdown)