What is Smart Proxy Manager#

Warning

Zyte API is replacing Smart Proxy Manager. See Migrating from Smart Proxy Manager to Zyte API.

Zyte Smart Proxy Manager (formerly Crawlera) enables scalable web scraping by routing your requests through a pool of IP addresses. Smart Proxy introduces delays and discards IPs wherever necessary to evade anti-crawling measures and maximize success rate.

A standard Proxy API is used to access Smart Proxy Manager that is controlled using special HTTP headers prefixed by X-Crawlera like in X-Crawlera-Cookies: disable.

Getting Started#

To use Smart Proxy Manager you need to follow these steps:

1. Sign up (or login)#

To get started, you need to sign up for a Smart Proxy Manager subscription. You can start your free 14-day trial here. You will need a credit card to subscribe, but you won’t be charged if you cancel in the first 14 days and 10,000 requests. For detailed instructions check out Subscribing to Smart Proxy Manager

2. Get API Key#

Once subscribed to the free trial, you can integrate Smart Proxy Manager with your system using an API key you can download here

Or, login to Scrapy Cloud. Select “Smart Proxy Manager” under “Tools” on the left and click on “Setup”. You’ll find your API key on the Setup page under “Here is the API key”.

3. Using Smart Proxy Manager#

To use Smart Proxy Manager in your own projects you can take a look at the different programming language examples in the Smart Proxy Manager Integrations section.

See Smart Proxy Manager API for a detailed description of the Smart Proxy Manager API.

Smart Proxy Manager plans#

Smart Proxy Manager has 4 plans with different features available on each plan.

  • Starter

  • Basic

  • Advanced

  • Enterprise

Most of the features described in the documentation are available in all plans. The documentation is explicit when a specific feature is reserved only for some specific plans.

You can see which features are available in each plan on the website: https://zyte.com/smart-proxy-manager/#spm-pricing

The “C plans” known as C10, C50, C100, and C200 have been discontinued at the beginning of 2020 and replaced by the Starter, Basic and Advanced plans.

Check out Smart Proxy Manager Account & Billing for more details.