Warning

Zyte API is replacing Smart Proxy Manager. It is no longer possible to sign up to Smart Proxy Manager. If you are an existing Smart Proxy Manager user, see Migrating from Smart Proxy Manager to Zyte API.

Using Smart Proxy Manager with Scrapy Cloud#

To employ Smart Proxy Manager in Scrapy Cloud projects, use the Crawlera add-on. Open your project, select Addons Setup on the sidebar, and enable Crawlera.

Settings#

CRAWLERA_URL

proxy URL (default: http://proxy.zyte.com:8011)

CRAWLERA_ENABLED

tick the checkbox to enable Smart Proxy Manager

CRAWLERA_APIKEY

Smart Proxy Manager API key

CRAWLERA_MAXBANS

number of bans to ignore before closing the spider (default: 20)

CRAWLERA_DOWNLOAD_TIMEOUT

timeout for requests (default: 190)