Scrapy-rotating-proxies

Latest version: v0.6.2

Safety actively analyzes 630052 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

0.3.1

------------------

* fixed OverflowError during backoff computation.

0.3

----------------

* redirects with empty bodies are no longer considered bans
(thanks Diga Widyaprana).
* ``ROTATING_PROXY_BAN_POLICY`` option allows to customize ban detection
for all spiders.

0.2.3

------------------

* ``max_proxies_to_try`` request.meta key allows to override
``ROTATING_PROXY_PAGE_RETRY_TIMES`` option per-request.

0.2.2

------------------

* Update default ban detection rules: scrapy.exceptions.IgnoreRequest
is not a ban.

0.2.1

------------------

* changed ``ROTATING_PROXY_PAGE_RETRY_TIMES`` default value - it is now 5.

0.2

----------------

* improved default ban detection rules;
* log ban stats.

Page 2 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.