Set up an AI web scraping project

Set up a project for AI-assisted web scraping:

1. Install Web Scraping Copilot.

2. On the Web Scraping Copilot sidebar view, select Start building › Create new project.

3. On the Create new Scrapy project page, set the Scrapy project name to copilot-tutorial, select a projects folder, and click Create.

Your new copilot-tutorial workspace will be created and set up with the following folders and files:

copilot-tutorial/
├── .venv/
│   └── …
├── copilot_tutorial/
│   ├── pages/
│   │   └── __init__.py
│   ├── spiders/
│   │   └── __init__.py
│   ├── __init__.py
│   ├── items.py
│   ├── middlewares.py
│   ├── pipelines.py
│   └── settings.py
└── scrapy.cfg

You have now everything you need to start generating parsing code with AI.