Skip to content
Julien Nioche edited this page Oct 20, 2017 · 4 revisions

The following network protocols are implemented in storm-crawler:

File

HTTP/S

See HTTPProtocol for the effect of metadata content on protocol behaviour.

Feature grid

Features HTTPClient OKhttp Selenium
Basic authentication N N N
proxy (w. credentials?) Y / Y Y / N ?
interruptible / trimmable #463 N / Y Y / Y Y / N
cookies Y N N
response headers Y Y N
HEAD method #485 Y N N
verbatim response header Y Y N
verbatim request header N Y N
navigation and javascript N N Y
Clone this wiki locally