AI · alternatives · 2026
24 alternatives to OSS app to find LLMs across multiple LLM providers (Azure, AWS, etc.)
Scenario: Your company’s IT department says “good news, you have access to azure, aws, openai, mistral, and together AI, here are the API keys”. You think “yippee I can access many models”, but some models like the gpt-oss or Mistral are available on some or all of those platforms? That’s where this app comes in: run it and it will check all the providers that you have configured and then you can search across those providers to see which providers have the model you want available. Built on top of mozilla.ai any-llm library. Check out the link for a GIF showing it in action.
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 1 we have checked on their own sites, 1 of them free or with a free tier.
- 1
LLM Gatewayfree tier▲296I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…
2025 · llmgateway.io · its alternatives →
- 2
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com · its alternatives →
- 3
Hey HN, We've been building a multi-model API for LLMs called OpenRouter since we launched the Window AI extension in April this year [0]. The events of the last week make it clear the LLM landscape is unpredictable, so LLM aggregators are picking up interest. Unlike others, we're making a router on top of a public, explorable dataset. We recently built a way to rank and visualize this data, including the token counts we see going to and from different models, both open-sourced (like Llama, Mistral, finetunes, and variants) and closed-sourced (OpenAI, Anthropic). The API supports - 50+…
Apr 2026 · openrouter.ai · its alternatives →
- 4
- 5
LM Studio▲209Discover, download, and run local LLMs (incl. DeepSeek R1)
2025 · lmstudio.ai · its alternatives →
- 6
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com · its alternatives →
- 7
Vibe-check many open-source and proprietary LLMs at once
2024 · its alternatives →
- 8
Talk to multiple LLMs thru a unified API
2025 · ai-gateway.dev · its alternatives →
- 9
Calculate and compare the cost of the latest LLM APIs
2024 · docsbot.ai · its alternatives →
- 10
Aggregate uptime monitoring across OpenAI, Claude, and more
Apr 2026 · tools.lamatic.ai · its alternatives →
- 11
- 12
- 13
- 14
Token Harbor▲85The easiest way to access frontier AI models.
Aug 2026 · tokenharbor.ai · its alternatives →
- 15
MakeHub.ai▲118LLM Provider arbitrage to get the best performance for the $
2025 · makehub.ai · its alternatives →
- 16
Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.
2025 · github.com · its alternatives →
- 17LT
Introducing Lailaims: An open source client-side web app that lets you test multiple LLM providers (GPT-4, Claude, Gemini, Mistral, DeepSeek) side-by-side in one interface. Your data stays private - everything runs locally in your browser! Video example: https://vimeo.com/1084976999/8687b63f85
2025 · lailaims.pages.dev · its alternatives →
- 18
- 19
Your LLM tests, without the provider
2d ago · llmtest.managed-code.com · its alternatives →
- 20
Axis One▲78I’ve been building a small hardware box that runs local LLMs like Mistral, Qwen and Llama, and exposes an OpenAI compatible API on your local network. There’s no cloud, no login system and no telemetry. I built it because a lot of small firms want ChatGPTbstyle tools but can’t use cloud AI for privacy or compliance reasons, and most don’t want to deal with GPU servers, drivers, Docker or model configs. The aim is to make local AI feel as simple as plugging in a router. Right now the box boots into a very simple web UI where you choose a model and start using it. The API follows the OpenAI…
Nov 2025 · axis-one-psi.vercel.app · its alternatives →
- 21
ModelRiver▲37Connect once to every major AI model. Run AI workflows in the background while your backend controls what AI sees.
Jan 2026 · modelriver.com · its alternatives →
- 22
LLM API▲7Access all AI models you need through a single, reliable API
2025 · llmapi.in · its alternatives →
- 23
Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…
2024 · github.com · its alternatives →
- 24
Perssua▲61Real-time guidance from any LLM (including local ones)
Nov 2025 · perssua.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →