AI · alternatives · 2026
24 alternatives to Open Source AI Gateway
Talk to multiple LLMs thru a unified API
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.
- 1
LLM Gatewayfree tier▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
- 2
- 3
Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…
Apr 2026 · openrouter.ai · its alternatives →
- 4
Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…
Dec 2025 · truefoundry.com · its alternatives →
- 5
Use AI models without managing keys or billing
Dec 2025 · docs.netlify.com · its alternatives →
- 6
One unified API for all AI models like Gemini, GPT-4, DALL-E
2023 · getmerlin.in · its alternatives →
- 7
Vibe-check many open-source and proprietary LLMs at once
2024 · its alternatives →
- 8
Calculate and compare the cost of the latest LLM APIs
2024 · docsbot.ai · its alternatives →
- 9
Clevrr Computer▲195Computer use but with OpenAI and Gemini models
2024 · github.com · its alternatives →
- 10
ModelRiver▲37Connect once to every major AI model. Run AI workflows in the background while your backend controls what AI sees.
Jan 2026 · modelriver.com · its alternatives →
- 11
OpenAI-compatible gateway aggregating 8 free LLM providers
May 2026 · freellms.vercel.app · its alternatives →
- 12
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com · its alternatives →
- 13
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com · its alternatives →
- 14
- 15
- 16
Provides the same proxy OpenAI API for different LLM models
2024 · github.com · its alternatives →
- 17
Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant - Stream29/ProxyAsLocalModel
2025 · github.com · its alternatives →
- 18
ReliAPI▲87Stop losing money on failed OpenAI and Anthropic API calls.
Dec 2025 · kikuai-lab.github.io · its alternatives →
- 19
- 20
- 21
Scenario: Your company’s IT department says “good news, you have access to azure, aws, openai, mistral, and together AI, here are the API keys”. You think “yippee I can access many models”, but some models like the gpt-oss or Mistral are available on some or all of those platforms? That’s where this app comes in: run it and it will check all the providers that you have configured and then you can search across those providers to see which providers have the model you want available. Built on top of mozilla.ai any-llm library. Check out the link for a GIF showing it in action.
2025 · github.com · its alternatives →
- 22
LLM API▲7Access all AI models you need through a single, reliable API
2025 · llmapi.in · its alternatives →
- 23
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking. - mozilla-ai/otari
Jul 2026 · github.com · its alternatives →
- 24
Dev tool that worries about your LLM API failures.
Aug 2026 · llmrouter.dpdns.org · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →