RepoTrending RepoTrending
Weekly digest
#758 trending today Python BSD-3-Clause Created Feb 2010

scrapy / scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Open on GitHub
Stars
65k
64,982 total
Today
+21
#758 today
This week
–
Data collecting since Oct 23
This month
–
Data collecting since Oct 23

Stars since we started watching

Total stars per day

65k 65k 65k 65k Oct 23Oct 24 Best day: +21 65k 65k 65k 65k Oct 23Oct 24 Best: +21

Related repos

D4Vinci / Scrapling+133

🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Python
apify / crawlee+13

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both head…

TypeScript
gocolly / colly+2

Elegant Scraper and Crawler Framework for Golang

Go
firecrawl / firecrawl+349

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

TypeScript