forked from apache/incubator-stormcrawler
-
Notifications
You must be signed in to change notification settings - Fork 0
Protocols
Julien Nioche edited this page Oct 20, 2017
·
4 revisions
The following network protocols are implemented in storm-crawler:
See HTTPProtocol for the effect of metadata content on protocol behaviour.
Features | HTTPClient | OKhttp | Selenium |
---|---|---|---|
Basic authentication | N | N | N |
proxy (w. credentials?) | Y / Y | Y / N | ? |
interruptible / trimmable #463 | N / Y | Y / Y | Y / N |
cookies | Y | N | N |
response headers | Y | Y | N |
HEAD method #485 | Y | N | N |
verbatim response header | Y | Y | N |
verbatim request header | N | Y | N |
navigation and javascript | N | N | Y |