Warning
Zyte API is replacing Smart Proxy Manager. See Migrating from Smart Proxy Manager to Zyte API.
Using Smart Proxy Manager with Scrapy Cloud#
To employ Smart Proxy Manager in Scrapy Cloud projects the Crawlera addon is used. Go to Settings > Addons > Crawlera to activate.
Settings#
CRAWLERA_URL |
proxy URL (default: |
CRAWLERA_ENABLED |
tick the checkbox to enable Smart Proxy Manager |
CRAWLERA_APIKEY |
Smart Proxy Manager API key |
CRAWLERA_MAXBANS |
number of bans to ignore before closing the spider (default: |
CRAWLERA_DOWNLOAD_TIMEOUT |
timeout for requests (default: |