Scrapy, a fast high-level web crawling & scraping framework for Python.
7 daysStars65.3k24h gain+20Score12.2
Find trending repositories by name or description.
Scrapy, a fast high-level web crawling & scraping framework for Python.
Python library of web-related functions
A service daemon to run Scrapy spiders
HTTP API for Scrapy spiders
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
爬虫管理系统,爬虫管理平台,分布式爬虫管理平台, 流程编排,openclaw龙虾,AI助手,可视化操作,完整监控,灵活的Python环境管理,,环境隔离,资源占用小,支持 Scrapy 等主流爬虫框架,支持 Selenium、Playwright、DrissionPage 等浏览器自动化工具,支持node环境下的js逆向代码,支持windows分布式调度