crawl4ai

unclecode/crawl4aiFrameworks

An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.

  • ai
  • ai-agents
  • crawler
  • data-extraction
  • llm
  • markdown
  • mcp
  • open-source

More in Web Scraping

browser-use

Make websites accessible for AI agents with easy browser automation.

119.1kupdated today0.13.13

scrapling

An adaptive scraping framework whose selectors relocate elements after page changes, with stealth fetchers and spiders.

89.5kupdated 2d ago0.5

scrapy

A fast high-level web crawling and scraping framework.

65kupdated 2d ago2.19.0

stagehand

A fast and token-efficient browser automation SDK to extract data and perform self-healing actions on web pages.

25.8kupdated todaystagehand-server-v3/v3.7.7

trafilatura

A tool for gathering text and metadata from the web, with built-in content filtering.

7kupdated 1d ago2.3.1

feedparser

Universal feed parser.

2.5kupdated 18d ago6.0.14

markdownify

Convert HTML to Markdown, with customizable tag handling.

2.3kupdated 3mo ago1.2.3
All 8 in Web Scraping
Esc

Type to search every entry. ↑↓ to move, Enter to open.