All projects
Repositories in this selection 5 · UTC 2026-11-04
CompareRankProjectStarFork30-day trend7-day net changeLast pushSign in to save
1—Uunclecode / crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtfPythonApache-2.0 · PermissiveInsufficient rank history86,7779,043——2026-11-02
2—Llexmount / moliAuthor description: Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in RustRustApache-2.0 · PermissiveInsufficient rank history22,222610——2026-11-02
3—Aapify / crawlee-pythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.PythonApache-2.0 · PermissiveInsufficient rank history9,637820——2026-11-02
4—MMontFerret / ferretDeclarative data automation language and Go runtime for structured extraction workflows.GoApache-2.0 · PermissiveInsufficient rank history6,021325——2026-11-02
5—Oomkarcloud / botasaurusThe All in One Framework to Build Undefeatable ScrapersTypeScriptMIT · PermissiveInsufficient rank history5,812505——2026-11-02
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.