Warning

Zyte API is replacing Smart Proxy Manager. See Migrating from Smart Proxy Manager to Zyte API.

Sending POST request with Zyte Smart Proxy Manager

Zyte Smart Proxy Manager (formerly Crawlera) can process POST requests, and they’re considered as a single request, like GET requests. This is commonly used for crawling search results after filling a form.

An example for filling this form https://httpbin.org/forms/post is below, make sure to replace <API_KEY>:

curl -U <API_KEY>: -x proxy.zyte.com:8011 "https://httpbin.org/post"\
-X POST -d "custname=Scrapinhub"\
-d "custtel=+55 555 5555"\
-d "custemail=no@mail.com"\
-d "size=large"\
-d "topping=bacon"\
-d "topping=cheese"\
-d "topping=onion"\
-d "delivery=13:00"\
-d "comments=hurry!"

This response is received:

{
    "args": {},
    "data": "",
    "files": {},
    "form": {
        "comments": "hurry",
        "custemail": "no@mail.com",
        "custname": "Scrapinhub",
        "custtel": " 55 555 5555",
        "delivery": "13:00",
        "size": "large",
        "topping": [
        "bacon",
        "cheese",
        "onion"
        ]
    },
    "headers": {
        "Accept": "*/*",
        "Content-Length": "146",
        "Content-Type": "application/x-www-form-urlencoded",
        "Host": "httpbin.org",
        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:89.0) Gecko/20100101 Firefox/89.0",
        "X-Amzn-Trace-Id": "Root=1-615e0cf8-0f13a6381a213276088f1471"
    },
    "json": null,
    "origin": "154.127.48.211",
    "url": "https://httpbin.org/post"
}