nowfound

AI · March 6, 2023

Faster FastAPI with simdjson and io_uring on Linux 5.19

A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine. FastAPI would have bottleneck-ed the inference of our lightweight UForm neural networks recently trending on HN under the title "Beating OpenAI CLIP with 100x less data and compute". (Thank you all for the kind words!) So I wrote another library. It has been a while since I have…

Faster FastAPI with simdjson and io_uring on Linux 5.19 launched on March 6, 2023 with 290 votes, #101 of 5,007 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 3 years on.

Visit github.com ↗Alternativestop 2% of March 2023

In plain words

This library accelerates FastAPI applications on Linux 5.19 by leveraging simdjson for faster JSON parsing and io_uring for improved network I/O performance. It targets developers building machine learning inference servers or other latency-sensitive REST APIs where local request-response times matter. The library uses pre-registered buffers and file descriptor pooling to reduce overhead compared to standard FastAPI implementations.

written from the facts on this page · September 2026

From the sources

Web Serving and Remote Procedure Calls at 50x lower latency and 70x higher bandwidth than FastAPI, implementing JSON-RPC & REST over io_uring ☎️ - unum-cloud/UCall

In the maker’s words, at launch

A few months ago, I benchmarked FastAPI on an i9 MacBook Pro. I couldn't believe my eyes. A primary REST endpoint to `sum` two integers took 6 milliseconds to evaluate. It is okay if you are targeting a server in another city, but it should be less when your client and server apps are running on the same machine.…

Does a similar job

all alternatives →

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 17d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 16d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 18d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 20d ago · stillwet.art

  • Onepin▲384

    AI voiceover with every name, price and date said right

    AI · 30d ago · onepin.ai

  • A real-time world model you can explore and change

    AI · 28d ago · world.pixverse.video

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, March 2023

the whole month →
  • GPT-4▲1,160

    More accurate, less cringe, smoother & useful daily chats!

    AI · 2023 · openai.com

  • Collato▲972

    One AI search to find anything instantly, across all apps

    AI · 2023

  • Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.

    AI · 2023 · typingmind.com

  • Meet the internet again

    Work · 2023 · apps.apple.com

  • Sequoia▲726

    Personalized men's sexual health with on-demand experts

    Life & fun · 2023 · sequoia.health

  • BI

    I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…

    AI · 2023 · genmon.github.io