LLM Gateway

In plain words

LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface. It routes, manages, and analyzes requests across different LLM providers, eliminating the need to learn separate APIs for each service. The tool is designed for developers and teams who work with various AI models and want to streamline their integration process and simplify model switching.

written from the facts on this page · September 2026

From the sources

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

Route, manage, and analyze LLM requests across OpenAI, Anthropic, Google, and 40+ providers through one unified, OpenAI-compatible API. Free and open source.

Stop juggling API keys and provider dashboards. Route requests across 200+ models, track costs in real-time, and switch providers without changing your code. Keep your existing OpenAI SDK code—just change the base URL and you're live. Access 40+ providers through one integration—no vendor lock-in, switch models instantly. Compare latency, cost, and quality across models to pick the best fit for each use case. One dashboard for all your provider keys—no more scattered credentials or exposed secrets. Run on your own infrastructure for full control, or let us handle it—your choice. See requests, tokens, total spend, and average cost per 1K tokens across 7 or 30 days. Break down usage and spend…from llmgateway.io

In the maker’s words, at launch

I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing…

• 
  OpenRouter Model FusionApr 2026 · openrouter.ai · ▲144

  Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…

• 
  FastRouter.ai21d ago · fastrouter.ai · ▲364

  Route requests to the right LLM for cost, latency & quality

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  TrueFoundry AI GatewayDec 2025 · truefoundry.com · ▲315

  Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

• 
  Any-LLM – Lightweight router to access any LLM Provider2025 · github.com · ▲125

  We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai&#x2F;gpt-4" to "anthropic&#x2F;claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!

• 
  Open Source AI Gateway2025 · ai-gateway.dev · ▲11

  Talk to multiple LLMs thru a unified API

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  Clueso▲1,300

  Create stunning product videos in minutes with AI

  AI · 2025 · clueso.io

• 
  Trickle - Magic Canvas ▲1,064

  Hey HN! Introducing Trickle Magic Canvas: the world’s first Agentic Canvas, where you can visually co-create apps and websites with AI, from idea to production. Why is a canvas better? Most AI tools today rely on linear chats or text prompts. We believe that limits creativity and clarity. Canvas changes the game. 1. Every version & page at a glance. Each page and sub-page lives on a timeline. You can quickly browse, edit, and preview progress like a living, visual document — no more digging through chat logs or scattered states. 2. The canvas is the context. Unlike linear chats, you can…

  AI · 2025 · trickle.so

• TB
  Tinder but it's only pictures of my wife and I can only swipe right▲1,030

  Life & fun · 2025 · trytender.app

• 
  Ten years of running every day, visualized▲958

  Today marks ten years, 3653 consecutive days, of running at least one mile every day under the USRSA rules [1]. To celebrate, I built an interactive dashboard that turns a decade of GPX files into charts you can explore. Running has truly changed my life: I've made lifelong friends, explored beautiful places, and more importantly invested into my own health and fitness, which I'm starting to see the positive benefits as I get older. The stack is pretty simple: a NextJS app, with a Postgres database to keep all my running data, and all the stats are pre-computed and cached in Redis, so I…

  Dev tools · 2025 · nodaysoff.run

• 
  Draw a fish and watch it swim with the others▲935

  Made this website as an exercise in vibe-coding and GCP. It was posted about a few times around the internet, on sites like Morning Brew (https:&#x2F;&#x2F;www.morningbrew.com&#x2F;issues&#x2F;business-buzzkill), MetaFilter (https:&#x2F;&#x2F;www.metafilter.com&#x2F;209703&#x2F;Draw-A-Fish), boingboing.net, etc. I think it's cute! I built a basic CNN trained against penises and swastikas, and then anything that doesn't hit the 63% confidence score gets sent to a mod queue, a vibe-coded fish-tinder…

  AI · 2025 · drawafish.com

• 
  Use Their ID – Use your local UK MP’s ID for the Online Safety Act▲862

  Hi HN - I made a site that takes a UK postcode, grabs the local MP's information and generates an AI mockup of what their ID might look like. It's a small, silly protest at the stupidity of the Online Safety Act that just came into force. edit - My open AI credits got hugged to death, please use a known postcode (like one from Kier Starmer's constituency, WC2B6NH) in the meantime.

  AI · 2025 · use-their-id.com