Dev tools · alternatives · 2026

24 alternatives to Parallelise pipelines of Python async iterables

Utility function to parallelise pipelines of Python asyncio iterators/generators - michalc/asyncio-buffered-pipeline

Parallelise pipelines of Python async iterables is a developer tool that enables concurrent processing of Python async iterables through parallel pipelines. It is designed for Python developers working with… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Parallelise pipelines of Python async iterables launched in 2020; newer entries below may have overtaken it.

1
Bringing multithreading to Python's async event loop▲82
This project explores the integration of multithreading into the asyncio event loop in Python. While this was initially built with enhancing CPU utilization for FastAPI servers in mind, the approach can be used with more general async programs too. If you’re interested in diving deeper into the details, I’ve written a blog post about it here: https://www.neilbotelho.com/blog/multithreaded-async.html
2024 · github.com · its alternatives →
2
Asyncpal: Preemptive concurrency and parallelism for sporadic workloads▲28
Hi HN ! Alex here. I'm excited to show you Asyncpal (https://github.com/pyrustic/asyncpal), a Python library for parallelism [1] and preemptive concurrency [2] tailored for sporadic workloads [3]. I've been working on a private project where it would be convenient to have asynchronous versions of some operations without using `async/await` [4]. Besides `async/await`, which represents cooperative concurrency via the `asyncio` package, Python also provides preemptive concurrency through its `threading` package. Additionally, the `concurrent.futures` package builds…
2024 · github.com · its alternatives →
3
WebRTC implementation for Python using Asyncio▲216
WebRTC and ORTC implementation for Python using asyncio - jlaine/aiortc
2018 · github.com · its alternatives →
4
HTTP/2 Python-Asyncio Web Microframework▲173
2018 · gitlab.com · its alternatives →
5
Pyper – Concurrent Python Made Simple▲156
Hello and happy new year! We're excited to introduce the Pyper package for concurrency & parallelism in Python. Pyper is a flexible framework for concurrent / parallel data processing, following the functional paradigm. Source code can be found on [github](https://github.com/pyper-dev/pyper) Key features: Intuitive API: Easy to learn, easy to think about. Implements clean abstractions to seamlessly unify threaded, multiprocessed, and asynchronous work. Functional Paradigm: Python functions are the building blocks of data pipelines. Let's you write clean, reusable…
2025 · github.com · its alternatives →
6
Asynchronous HTTP/2 client for Python 2.7▲94
Tornado HTTP/2 Client. Contribute to vladmunteanu/th2c development by creating an account on GitHub.
2018 · github.com · its alternatives →
7
Pipelines – Language for scripting parrallel pipelines with Python▲69
An experimental programming language for data flow - calebwin/pipelines
2019 · github.com · its alternatives →
8
Whirlwind – Async concurrent hashmap for Rust▲140
Hey HN, this is Will and David from Fortress (https://news.ycombinator.com/item?id=41426998). We use a lot of async Rust internally, and created this library out of a need for an async-aware concurrent hashmap since there weren’t many available in the Rust ecosystem. Whirlwind is a sharded HashMap with a fully asynchronous API. Just as dashmap is a replacement for std::sync::RwLock, whirlwind aims to be a replacement for tokio::sync::RwLock. It has a similar design and performance characteristics to dashmap, but seems to perform better in read-heavy workloads with tokio's…
2024 · github.com · its alternatives →
9
Kreuzberg – Modern async Python library for document text extraction▲197
I'm excited to showcase Kreuzberg! Kreuzberg is a modern Python library built from the ground up with async/await, type hints, and optimized I/O handling. It provides a unified interface for extracting text from documents (PDFs, images, office files) without external API dependencies. Key technical features: - Built with modern Python best practices (async/await, type hints, functional-first) - Optimized async I/O with anyio for multi-loop compatibility - Smart worker process pool for CPU-bound tasks (OCR, doc conversion) - Efficient batch processing with concurrent…
2025 · github.com · its alternatives →
10
Async tasks in 350 lines of C▲146
Tasks are a primitive for asynchronous programming and an alternative to working with threads directly. Instead of creating a thread, performing work, then waiting on it using synchronization primitives, you only define a unit of work and let a scheduler decide when and where to execute it. The threads that the scheduler uses are created once and reused for many tasks throughout the program's lifetime. In most cases, creating and executing a task requires not even a single syscall and is a significantly faster operation than creating a thread, resulting in lower latency. Furthermore, tasks…
2024 · github.com · its alternatives →
11
Coerce – Actor runtime for Rust using async/await and tokio channels▲155
Actor runtime and distributed systems framework for Rust - LeonHartley/Coerce-rs
2019 · github.com · its alternatives →
12
Teena - Unix in Python, powered by Tornado▲58
Python ports of useful syscalls, using asynchronous I/O. - zacharyvoase/teena
2012 · github.com · its alternatives →
13
Async UI: A Rust UI Library Where Everything is a Future▲173
2022 · wishawa.github.io · its alternatives →
14
Dead easy Python for executing many HTTP requests asynchronously▲46
Dead easy interface for executing many HTTP requests asynchronously. Also provides helper functions for executing embarrassingly parallel async coroutines. - joshlk/many_requests
2020 · github.com · its alternatives →
15
Python 3.5 Async Web Crawler Example▲28
Python3.5 async crawler example with aiohttp and asyncio - mehmetkose/tangrowth
2016 · github.com · its alternatives →
16
Forkrun – NUMA-aware shell parallelizer (50×–400× faster than parallel)▲151
forkrun is the culmination of a 10-year-long journey focused on "how to make shell parallelization fast". What started as a standard "fork jobs in a loop" has turned into a lock-free, CAS-retry-loop-free, SIMD-accelerated, self-tuning, NUMA aware shell-based stream parallelization engine that is (mostly) a drop-in replacement for xargs -P and GNU parallel. On my 14-core/28-thread i9-7940x, forkrun achieves: * 200,000+ batch dispatches/sec (vs ~500 for GNU Parallel) * ~95–99% CPU utilization across all 28 logical cores, even when the workload is non-existant (bash no-ops / `:`)…
Mar 2026 · github.com · its alternatives →
17
Neco – Coroutine Library for C▲145
Concurrency library for C (coroutines). Contribute to tidwall/neco development by creating an account on GitHub.
2024 · github.com · its alternatives →
18
Async – Claude code and Linear and GitHub PRs in one opinionated tool▲107
Hi, I’m Mikkel and I’m building Async, an open-sourced developer tool that combines AI coding with task management and code review. What Async does: - Automatically researches coding tasks, asks clarifying questions, then executes code changes in the cloud - Breaks work into reviewable subtasks with stack diffs for easier code review - Handles the full workflow from issue to merged PR without leaving the app Demo here: https://youtu.be/98k42b8GF4s?si=Azf3FIWAbpsXxk3_ I’ve been working as a developer for over a decade now. I’ve tried all sorts of AI tools out there including…
2025 · github.com · its alternatives →
19TC
Team – Coroutines and async semantics for C++▲35
2014 · team.s4y.us · its alternatives →
20
Axax – Async iterator extensions for JavaScript▲74
Async Iterator Extensions for JavaScript e.g. map, reduce, filter, flatMap, etc. - jamiemccrindle/axax
2018 · github.com · its alternatives →
21
Pipelex – Declarative language for repeatable AI workflows▲122
We’re Robin, Louis, and Thomas. Pipelex is a DSL and a Python runtime for repeatable AI workflows. Think Dockerfile/SQL for multi-step LLM pipelines: you declare steps and interfaces; any model/provider can fill them. Why this instead of yet another workflow builder? - Declarative, not glue code: you state what to do; the runtime figures out how. - Agent-first: each step carries natural-language context (purpose, inputs/outputs with meaning) so LLMs can follow, audit, and optimize. Our MCP server enables agents to run pipelines but also to build new pipelines on demand. - Open…
Oct 2025 · github.com · its alternatives →
22
Robyn – A fast, extensible async Python web server with a Rust runtime▲103
Robyn is a Super Fast Async Python Web Framework with a Rust runtime. - sparckles/Robyn
2023 · github.com · its alternatives →
23
Crudlet.js – A common, streamable interface for synchronizing data▲94
utility library for async iterable iterators. Contribute to crcn/mesh.js development by creating an account on GitHub.
2015 · github.com · its alternatives →
24
Await-Tree – Visualize Async Rust Task Execution in Real-Time▲28
Generate accurate and informative tree dumps of asynchronous tasks. - risingwavelabs/await-tree
2025 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →