Make websites accessible for AI agents with easy browser automation.

scrapy
scrapy/scrapyFrameworks
A fast high-level web crawling and scraping framework.
- python
- scraping
- crawling
- framework
- crawler
- hacktoberfest
- web-scraping
- web-scraping-python
More in Web Scraping
119.1kupdated today0.13.13
An adaptive scraping framework whose selectors relocate elements after page changes, with stealth fetchers and spiders.
89.5kupdated 2d ago0.5
An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.
86.2kupdated 2d ago0.9.5
A fast and token-efficient browser automation SDK to extract data and perform self-healing actions on web pages.
25.8kupdated todaystagehand-server-v3/v3.7.7
A tool for gathering text and metadata from the web, with built-in content filtering.
7kupdated 1d ago2.3.1