Dev tools · alternatives · 2026

24 alternatives to Python 3.5 Async Web Crawler Example

Python3.5 async crawler example with aiohttp and asyncio - mehmetkose/tangrowth

Tangrowth is a Python 3.5 example project demonstrating how to build an asynchronous web crawler using the aiohttp and asyncio libraries. It is designed for developers learning asynchronous programming patterns in… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Python 3.5 Async Web Crawler Example launched in 2016; newer entries below may have overtaken it.

1
HTTP/2 Python-Asyncio Web Microframework▲173
2018 · gitlab.com · its alternatives →
2
WebRTC implementation for Python using Asyncio▲216
WebRTC and ORTC implementation for Python using asyncio - jlaine/aiortc
2018 · github.com · its alternatives →
3
PyDoll – Async Python scraping engine with native CAPTCHA bypass▲136
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions. - GitHub - autoscrape-labs/pydoll: Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
2025 · github.com · its alternatives →
4
Asynchronous HTTP/2 client for Python 2.7▲94
Tornado HTTP/2 Client. Contribute to vladmunteanu/th2c development by creating an account on GitHub.
2018 · github.com · its alternatives →
5
Crawlee – Web scraping and browser automation library for Node.js▲282
Hey HN, This is Jan, founder of Apify, a web scraping and automation platform. Drawing on our team's years of experience, today we're launching Crawlee [1], the web scraping and browser automation library for Node.js that's designed for the fastest development and maximum reliability in production. For details, see the short video [2] or read the announcement blog post [3]. Main features: - Supports headless browsers with Playwright or Puppeteer - Supports raw HTTP crawling with Cheerio or JSDOM - Automated parallelization and scaling of crawlers for best performance - Avoids blocking using…
2022 · crawlee.dev · its alternatives →
6
ScrapeOwl▲389
Simple and powerful web scraping API
2020 · scrapeowl.com · its alternatives →
7
Bringing multithreading to Python's async event loop▲82
This project explores the integration of multithreading into the asyncio event loop in Python. While this was initially built with enhancing CPU utilization for FastAPI servers in mind, the approach can be used with more general async programs too. If you’re interested in diving deeper into the details, I’ve written a blog post about it here: https://www.neilbotelho.com/blog/multithreaded-async.html
2024 · github.com · its alternatives →
8
AIOGram▲66
Fully asynchronous Python 3.6 library for Telegram Bot API
2018 · github.com · its alternatives →
9
A framework for building Slack bots in Python▲114
I started building a couple of years ago because I found no easy existing solution to build Slack bots that can be composed from/organized into plugins. Existing libraries like Bolt make it pretty easy to develop Slack bots, but hard to organize and scale the code base of your bot. I was also missing some crucial features such as scheduling actions for your bot. So I wrote my own framework! I recently rewrote the complete framework to make use of asyncio and the newest Slack SDK Let me know what you think!
2022 · github.com · its alternatives →
10
Robyn – A fast, extensible async Python web server with a Rust runtime▲103
Robyn is a Super Fast Async Python Web Framework with a Rust runtime. - sparckles/Robyn
2023 · github.com · its alternatives →
11
Parallelise pipelines of Python async iterables▲71
Utility function to parallelise pipelines of Python asyncio iterators/generators - michalc/asyncio-buffered-pipeline
2020 · github.com · its alternatives →
12
Dead easy Python for executing many HTTP requests asynchronously▲46
Dead easy interface for executing many HTTP requests asynchronously. Also provides helper functions for executing embarrassingly parallel async coroutines. - joshlk/many_requests
2020 · github.com · its alternatives →
13
Whirlwind – Async concurrent hashmap for Rust▲140
Hey HN, this is Will and David from Fortress (https://news.ycombinator.com/item?id=41426998). We use a lot of async Rust internally, and created this library out of a need for an async-aware concurrent hashmap since there weren’t many available in the Rust ecosystem. Whirlwind is a sharded HashMap with a fully asynchronous API. Just as dashmap is a replacement for std::sync::RwLock, whirlwind aims to be a replacement for tokio::sync::RwLock. It has a similar design and performance characteristics to dashmap, but seems to perform better in read-heavy workloads with tokio's…
2024 · github.com · its alternatives →
14
Kreuzberg – Modern async Python library for document text extraction▲197
I'm excited to showcase Kreuzberg! Kreuzberg is a modern Python library built from the ground up with async/await, type hints, and optimized I/O handling. It provides a unified interface for extracting text from documents (PDFs, images, office files) without external API dependencies. Key technical features: - Built with modern Python best practices (async/await, type hints, functional-first) - Optimized async I/O with anyio for multi-loop compatibility - Smart worker process pool for CPU-bound tasks (OCR, doc conversion) - Efficient batch processing with concurrent…
2025 · github.com · its alternatives →
15
Async UI: A Rust UI Library Where Everything is a Future▲173
2022 · wishawa.github.io · its alternatives →
16
Ruia▲4
Async Python 3.6+ web scraping framework based on asyncio.
2019 · github.com · its alternatives →
17
Asyncpal: Preemptive concurrency and parallelism for sporadic workloads▲28
Hi HN ! Alex here. I'm excited to show you Asyncpal (https://github.com/pyrustic/asyncpal), a Python library for parallelism [1] and preemptive concurrency [2] tailored for sporadic workloads [3]. I've been working on a private project where it would be convenient to have asynchronous versions of some operations without using `async/await` [4]. Besides `async/await`, which represents cooperative concurrency via the `asyncio` package, Python also provides preemptive concurrency through its `threading` package. Additionally, the `concurrent.futures` package builds…
2024 · github.com · its alternatives →
18
Aiopandas – Async .apply() and .map() for Pandas, Faster API/LLMs Calls▲62
Lightweight Pandas monkey-patch that adds async support to map, apply, applymap, aggregate, and transform, enabling seamless handling of async functions with controlled max_parallel execution. - telekinesis-inc/aiopandas
2025 · github.com · its alternatives →
19
A Python Spider System with Web UI▲159
A Powerful Spider(Web Crawler) System in Python. Contribute to binux/pyspider development by creating an account on GitHub.
2014 · github.com · its alternatives →
20
Apify SDK – A scalable web crawling and scraping library for JavaScript▲78
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headf
2018 · github.com · its alternatives →
21
Python Source Code Refactoring Toolkit via AST▲110
AST-based fragmental source code refactoring toolkit for Python - isidentical/refactor
2021 · github.com · its alternatives →
22
Sukhoi – A flexible and extensible Webcrawler in Python▲131
Minimalist and powerful Web Crawler. Contribute to untwisted/sukhoi development by creating an account on GitHub.
2017 · github.com · its alternatives →
23
Runloom – Go-style coroutines for Python free-threaded▲47
Real Goroutines for Python 3.13t+ free-threaded. Contribute to robertsdotpm/runloom development by creating an account on GitHub.
Jul 2026 · github.com · its alternatives →
24
Voyager – write a web crawler/scraper as a state machine in Rust▲110
crawl and scrape web pages in rust. Contribute to mattsse/voyager development by creating an account on GitHub.
2020 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →