Zyte API is replacing Smart Proxy Manager. See Migrating from Smart Proxy Manager to Zyte API.

Sending POST request with Zyte Smart Proxy Manager#

Zyte Smart Proxy Manager(formerly Crawlera) can process POST requests, and they’re considered as a single request, like GET requests. This is commonly used for crawling search results after filling a form.

An example for filling this form https://httpbin.org/forms/post is below, make sure to replace <API_KEY>:

curl -U <API_KEY>: -x proxy.zyte.com:8011 "https://httpbin.org/post"\
-X POST -d "custname=Scrapinhub"\
-d "custtel=+55 555 5555"\
-d "custemail=no@mail.com"\
-d "size=large"\
-d "topping=bacon"\
-d "topping=cheese"\
-d "topping=onion"\
-d "delivery=13:00"\
-d "comments=hurry!"

This response is received:

    "args": {},
    "data": "",
    "files": {},
    "form": {
        "comments": "hurry",
        "custemail": "no@mail.com",
        "custname": "Scrapinhub",
        "custtel": " 55 555 5555",
        "delivery": "13:00",
        "size": "large",
        "topping": [
    "headers": {
        "Accept": "*/*",
        "Content-Length": "146",
        "Content-Type": "application/x-www-form-urlencoded",
        "Host": "httpbin.org",
        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:89.0) Gecko/20100101 Firefox/89.0",
        "X-Amzn-Trace-Id": "Root=1-615e0cf8-0f13a6381a213276088f1471"
    "json": null,
    "origin": "",
    "url": "https://httpbin.org/post"