All projects
Repositories in this selection 42 · UTC 2026-11-03
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Ffirecrawl / firecrawlTools for gathering web data for AI agents.TypeScriptAGPL-3.0 · Share derivative sourceInsufficient rank history197,92910,458——2026-11-02
2—Uunclecode / crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtfPythonApache-2.0 · PermissiveInsufficient rank history86,7779,043——2026-11-02
3—Sscrapy / scrapyScrapy, a fast high-level web crawling & scraping framework for Python.PythonBSD-3-Clause · PermissiveInsufficient rank history65,19012,095——2026-11-02
4—Ddgtlmoon / changedetection.ioAuthor description: Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!PythonApache-2.0 · PermissiveInsufficient rank history35,4612,194——2026-11-02
5—CCloakHQ / CloakBrowserStealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.PythonMIT · PermissiveInsufficient rank history32,6932,719——2026-11-01
6—SScrapeGraphAI / Scrapegraph-aiPython scraper based on AIPythonMIT · PermissiveInsufficient rank history32,4373,313——2026-10-06
7—Bbrowserbase / stagehandThe SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.TypeScriptMIT · PermissiveInsufficient rank history25,9091,805——2026-11-02
8—Llexmount / moliAuthor description: Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in RustRustApache-2.0 · PermissiveInsufficient rank history22,222610——2026-11-02
9—EEvil0ctal / Douyin_TikTok_Download_API🚀 Self-hosted Douyin, TikTok, Bilibili data collection and watermark-free video download API, supports AI agent calling through MCP and offline voice-to-text, and one-click deployment with Docker. | Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.PythonApache-2.0 · PermissiveInsufficient rank history21,1122,938——2026-11-02
10—MMODSetter / SurfSenseAir-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9PythonApache-2.0 · PermissiveInsufficient rank history16,7171,597——2026-11-02
11—Yyusufkaraaslan / Skill_SeekersConvert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detectionPythonMIT · PermissiveInsufficient rank history15,2661,548——2026-09-30
12—Sseleniumbase / SeleniumBase📊 APIs for Web Scraping, Browser Automation, and E2E Testing. CDP Mode bypasses bot-detection and handles CAPTCHAs. Adds stealth to Playwright. Includes an MCP server.PythonMIT · PermissiveInsufficient rank history13,2231,610——2026-11-03
13—Jjo-inc / camofox-browserStealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.JavaScriptMIT · PermissiveInsufficient rank history12,1191,225——2026-11-02
14—Jjhy / jsoupjsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.JavaMIT · PermissiveInsufficient rank history11,4152,317——2026-11-03
15—NNopeCHALLC / nopecha-extensionAutomated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.UnknownMIT · PermissiveInsufficient rank history11,089234——2026-10-02
16—Ppinchtab / pinchtabHigh-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.GoMIT · PermissiveInsufficient rank history10,542791——2026-10-27
17—Aapify / crawlee-pythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.PythonApache-2.0 · PermissiveInsufficient rank history9,637820——2026-11-02
18—Mmherrmann / heliumLighter web automation with PythonPythonMIT · PermissiveInsufficient rank history8,319514——2026-10-22
19—Llorien / awesome-web-scrapingList of libraries, tools and APIs for web scraping and data processing.JavaScriptNOASSERTION · Restricted / unknownInsufficient rank history8,207969——2026-10-27
20—Aalirezamika / autoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for PythonPythonMIT · PermissiveInsufficient rank history8,068833——2026-07-29
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.