Tutorial for Agentic Web Data¶
With Agentic Web Data, you can write better web scraping code faster:
Create a new folder and start your coding agent from it:
mkdir agentic-web-data-tutorial cd agentic-web-data-tutorial
Then start your coding agent from that folder.
mkdir agentic-web-data-tutorial cd agentic-web-data-tutorial claude
mkdir agentic-web-data-tutorial cd agentic-web-data-tutorial codex
mkdir agentic-web-data-tutorial cd agentic-web-data-tutorial copilot
Prompt your coding agent to:
Scrape books.toscrape.com
Your coding agent will take care of the rest, interacting with you only when needed. For example:
It will ask you how to get a detail page to analyze. You can, for example, choose to Explore the site to let it find a detail page on its own.
It will analyze detail pages and propose fields to extract with example data, and you can adjust the extracted data schema to fit your preferences.
It will also later on give you the option to open a browser review, a local web app where you can review data extracted with the earlier schema and provide feedback to the model about it.