Alternatives

Products that do what Crawlee for Python v1.0 does

Crawlee for Python is now out of beta with new features!

1
Crawlee▲229
Build reliable web scrapers and robots, fast!
2022
2CO
Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language▲116
2019 · github.com
3
CloverCities▲161
The no-code solution for web 1.0 homepages
2022
4
LLM SEO Index Crawler Check▲157
Check if your website can get crawled by ChatGPT
2025
5
Codebay▲242
Learning Python on phone with AI tutoring
2023
6MF
My first python web app - What do you want to do this year?▲70
2013 · thisyr.com
7
Crawly▲234
Uptime, performance, SSL certificate and asset monitoring.
2018
8AH
Apifier – hosted web crawler for developers▲101
2015 · apifier.com
9
WebAutomation.io▲154
The biggest marketplace of readymade no code web scrapers
2021
10PP
Practical Python Projects book release▲88
Hi everyone! I just released the Practical Python Projects book! (https://practicalpython.yasoob.me) I am happy to announce the first version as a release candidate. I have poured a lot of love into writing this book and would love to hear what you guys think. (A limited 100% off and discount coupons at the end) This is not a pure beginner book. The book does assume some background Python knowledge. You need to know the basics like methods, functions, classes, and such. If I use something that is not typically covered in beginner Python books, I will explain it before I use it.…
2021 · practicalpython.yasoob.me
11
AI Search Crawler Check▲181
Check if your robots.txt allows ChatGPT, Google Gemini
Sep 2025
12
Hello Web App▲173
Learn how to build a web app with Python and Django
2018
13P3
Python 3.5 Async Web Crawler Example▲28
2016 · github.com
14
Crawl AI▲116
Build Your Own AI With One Prompt
2025
15
PayPI Beta▲98
Sell your API, with just a link.
2021
16VW
Voyager – write a web crawler/scraper as a state machine in Rust▲110
2020 · github.com
17PD
Python Developer Job Board▲26
Today I release my 3. Job Board, running on my product https://www.boardengine.io, for Python Developers: https://pythonjob.xyz
2019
18
RunPython.Live▲89
Run Python code in browser
2021
19
Crawly▲80
Uptime, SSL certificate, missing assets, status pages
2020
20SE
Search Engine and Crawler in Python▲21
2017 · openstar.pw
21UO
Updates on Burr (OS) – a full-stack AI agent framework▲8
Hey HN, In the months since we initially released Burr (https://news.ycombinator.com/item?id=39917364), we have been hard at work. We wanted to share some of the most exciting changes we’ve made to build Burr out as a full-stack development framework for AI agents. In case you don’t recall, Burr is an open-source python library that makes it easier to build and debug GenAI applications & agents by representing them as graphs of simple python objects/functions. Burr only abstracts away system-level concerns (state persistence, debugging, observability), and does not…
2024 · burr.dagworks.io
22RO
Rio – Open Source Web Apps in Pure Python, No JS/HTML/CSS Needed▲6
Hey HN, Over the past 10 months, my friends and I created an open source project called Rio to help Python developers build modern web apps without needing HTML, CSS, or JavaScript. Whether you're working on a simple internal tool or a complex multi-page app, Rio lets you stay in the Python ecosystem without needing to learn frontend frameworks. With Rio, the UI is defined using Python components, inspired by React and Flutter. Instead of writing HTML/CSS, you compose reusable UI elements in Python and let Rio handle rendering and state updates. The backend and frontend stay seamlessly…
2025 · rio.dev
23PT
Python Testing Crawler – spider your Flask or Django website in tests▲5
2020 · github.com
24IC
I created a tiny web crawler for Python▲5
2024 · github.com

Ranked by how close each launch is in meaning, then by votes. Refine with a description →