Web Scraping Copilot requirements

Web Scraping Copilot requires Visual Studio Code 1.109+.

Tip

All other requirements can be installed and set up with the help of Web Scraping Copilot, but are listed below for reference.

Minimum requirements

The core features require a Scrapy project and a Python virtual environment that meets the following requirements:

• Python 3.10+

• Scrapy 2.7.0+

• itemadapter 0.13.0+

• zyte-common-items 0.29.0+

Code generation requirements

Code generation requires:

• GitHub Copilot and its chat extension.

  While any GitHub Copilot plan is technically supported, the limited requests of the Free plan can run out quickly, so Pro or better is recommended.

• The following additional packages in your virtual environment:

  • web-poet 0.22.0+

  • scrapy-poet 0.26.0+ (requires setup)

  • pytest 7.0.0+