AI · alternatives · 2026
24 alternatives to Faster FastAPI with simdjson and io_uring on Linux 5.19
A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine. FastAPI would have bottleneck-ed the inference of our lightweight UForm neural networks recently trending on HN under the title "Beating OpenAI CLIP with 100x less data and compute". (Thank you all for the kind words!) So I wrote another library. It has been a while since I have…
This library accelerates FastAPI applications on Linux 5.19 by leveraging simdjson for faster JSON parsing and io_uring for improved network I/O performance. It targets developers building machine learning inference… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Faster FastAPI with simdjson and io_uring on Linux 5.19 launched in 2023; newer entries below may have overtaken it.
- 1
Develop APIs fast + automatically detect endpoints
2025 · fastrequest.apidog.com · its alternatives →
- 2
Here's a project I've been working on for the last few months. It's a new (I think) algorithm, that allows to adjust smoothly - and in real time - how many calculations you'd like to do during inference of an LLM model. It seems that it's possible to do just 20-25% of weight multiplications instead of all of them, and still get good inference results. I implemented it to run on M1/M2/M3 GPU. The mmul approximation itself can be pushed to run 2x fast before the quality of output collapses. The inference speed is just a bit faster than Llama.cpp's, because the rest of implementation…
2024 · asciinema.org · its alternatives →
- 3
- 4
FastOpenAPI is a library for generating and integrating OpenAPI schemas using Pydantic v2 and various frameworks (AioHttp, Django, Falcon, Flask, Quart, Sanic, Starlette, Tornado). - mr-fatalyst/fastopenapi
2025 · github.com · its alternatives →
- 5
Faster user-land reimplementations for several common builtin native JavaScript functions. - codemix/fast.js
2014 · github.com · its alternatives →
- 6
- 7
- 8
🌙 The minimal & fast library for functional user interfaces - kbrsh/moon
2017 · github.com · its alternatives →
- 9
⏰ Day.js 2kB immutable date-time library alternative to Moment.js with the same modern API - iamkun/dayjs
2018 · github.com · its alternatives →
- 10
FastAPI framework, high performance, easy to learn, fast to code, ready for production
2019 · fastapi.tiangolo.com · its alternatives →
- 11AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 12
This project explores the integration of multithreading into the asyncio event loop in Python. While this was initially built with enhancing CPU utilization for FastAPI servers in mind, the approach can be used with more general async programs too. If you’re interested in diving deeper into the details, I’ve written a blog post about it here: https://www.neilbotelho.com/blog/multithreaded-async.html
2024 · github.com · its alternatives →
- 13
Hello HN! I want to introduce fastgron, my new project. fastgron is a JSON to GRON converter, built to be incredibly fast – it's 40 times faster than Gron. GRON is a tool for making JSON greppable, but it can slow down with larger files. With fastgron, even a 200MB JSON file can be converted in just 1 second. Key features include streaming conversion for memory efficiency and an optimized path reconstruction for faster operations. It leverages C++ and the simdjson and fast_io libraries for speed. I welcome all feedback, suggestions, or questions. Thank you!
2023 · github.com · its alternatives →
- 14
An ultra fast WSGI server for Python 3. Contribute to jamesroberts/fastwsgi development by creating an account on GitHub.
2021 · github.com · its alternatives →
- 15
A generator for OpenAPI 3. Contribute to egorsmkv/openapi3-generator development by creating an account on GitHub.
2020 · github.com · its alternatives →
- 16
- 17
Read the full blogpost at https://rach.codes/blog/Introducing-Bhumi (click on reader to see the technical breakdown!) AI inference should be fast, but in practice it’s painfully slow. Inference bottlenecks slow down LLM-powered chatbots and AI workflows everywhere. I built Bhumi to fix that. Bhumi is a Python library designed for developers, yet its performance-critical core is implemented in Rust (via PyO3) for near-native speed. This hybrid approach delivers up to 2.5x faster response times across providers like OpenAI, Anthropic, and Gemini—without changing the…
2025 · bhumi.trilok.ai · its alternatives →
- 18
First HTTP programming language
2025 · httl.dev · its alternatives →
- 19
Hi HN! For the past few weeks, I've been working on bringing io_uring to Java. It started as an experiment, but slowly it became more than just that, and now trying to turn it into a proper library. After hearing talks about virtual threads and io_urings performance I wanted to build something that was faster than Java provides out of the box. I ended up creating two APIs: - A direct one that closely mirrors io_uring's behavior - A blocking one built with Virtual Threads in mind for remote files. This is the link to the project if you are interested…
2025 · github.com · its alternatives →
- 20
- 21
Fast JSON parser and validator for Go. No custom structs, no code generation, no reflection - valyala/fastjson
2018 · github.com · its alternatives →
- 22
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy - ijl/orjson
2018 · github.com · its alternatives →
- 23
Hi HN, We’ve all accepted the "Python tax"—you trade execution speed for developer happiness. But what if that trade-off was a thing of the past? I just came across BustAPI, and it’s basically a "cheat code" for Python web services. It’s not just another wrapper; it’s a hybrid engine that embeds a Rust (Actix-Web) core directly into the Python runtime. Is this the end of the "slow Python" era? The benchmarks are pretty shocking. I’d love to see someone stress-test this against a production-grade Go or Node.js setup. Repo: https://github.com/GrandpaEJ/BustAPI Benchmarks:…
Dec 2025 · github.com · its alternatives →
- 24
I've been working on Fast LiteLLM - a Rust acceleration layer for the popular LiteLLM library - and I had some interesting learnings that might resonate with other developers trying to squeeze performance out of existing systems. My assumption was that LiteLLM, being a Python library, would have plenty of low-hanging fruit for optimization. I set out to create a Rust layer using PyO3 to accelerate the performance-critical parts: token counting, routing, rate limiting, and connection pooling. The Approach - Built Rust implementations for token counting using tiktoken-rs - Added lock-free data…
Nov 2025 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →