Downloading from Scrapy Cloud#
Downloading from the Zyte dashboard#
To download your job data from the Zyte dashboard:
Open the details page of your job (
Open the Items tab (
On the right-hand side, select Download → <format>.
Download from a URL#
Download links from the Zyte dashboard are transparent. Given a job ID and your API key, you can build one manually, for example to automate downloads.
For JSON, JSON Lines and XML, download URLs follow this pattern:
https://storage.scrapinghub.com/items/<job ID>?apikey=<API key>&format=<format>
<job ID> is the job ID, e.g.
<API key> is your Zyte dashboard API key.
<format> is the output file format, one of:
For CSV, the download URL is similar, but you:
Must specify a comma-separated list of fields to export as well, in the
fieldsquery string parameter.
Can use the
include_headersquery string parameter to indicate whether you want the file names in the first row (
1) or not (
https://storage.scrapinghub.com/items/<job ID>?apikey=<API key>&format=csv&fields=key,name,price,url&include_headers=1