Back to trending
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python9,142 stars747 forksApache-2.0
apifyautomationbeautifulsoupcrawlercrawlingheadlessheadless-chromeparselpipplaywrightpythonscraperscrapingseleniumweb-crawlerweb-crawlingweb-scraping
Rankings
Daily
#5439
0
Weekly
#9965
0
Monthly
#14192
0
Engagement
Total stars
Daily new stars
Get badge
Add a Trending Repos badge to your README
This repository is tracked by Trending Repos. The badge upgrades automatically the moment it cracks the top 100 — set it once and forget it.
Markdown — paste into your README
[](https://trending-repos.com/repositories/apify/crawlee-python)HTML
<a href="https://trending-repos.com/repositories/apify/crawlee-python"><img src="https://trending-repos.com/badge/apify/crawlee-python.svg" alt="Trending Repos" /></a>Raw image URL
https://trending-repos.com/badge/apify/crawlee-python.svg