scrapy

scrapy/scrapyFrameworks

A fast high-level web crawling and scraping framework.

  • python
  • scraping
  • crawling
  • framework
  • crawler
  • hacktoberfest
  • web-scraping
  • web-scraping-python

More in Web Scraping

browser-use

Make websites accessible for AI agents with easy browser automation.

119.1kupdated today0.13.13

scrapling

An adaptive scraping framework whose selectors relocate elements after page changes, with stealth fetchers and spiders.

89.5kupdated 2d ago0.5

crawl4ai

An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.

86.2kupdated 2d ago0.9.5

stagehand

A fast and token-efficient browser automation SDK to extract data and perform self-healing actions on web pages.

25.8kupdated todaystagehand-server-v3/v3.7.7

trafilatura

A tool for gathering text and metadata from the web, with built-in content filtering.

7kupdated 1d ago2.3.1

feedparser

Universal feed parser.

2.5kupdated 18d ago6.0.14

markdownify

Convert HTML to Markdown, with customizable tag handling.

2.3kupdated 3mo ago1.2.3
All 8 in Web Scraping
Esc

Type to search every entry. ↑↓ to move, Enter to open.