AI · alternatives · 2026
24 alternatives to any-llm
A lightweight router to access any LLM provider
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1AL
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com · its alternatives →
- 2
- 3AL
any-llm is a library that provides unified access to multiple LLM providers. switching between providers like OpenAI, Anthropic, Google, Mistral, and even Ollama is just a string change. This demo makes it easy to look at and compare responses from different models. Interesting to see how ChatGPT, Claude, Gemini, and local models each reason through the same problems. Let us know what you think!
2025 · github.com · its alternatives →
- 4
- 5
- 6
AskCodi▲230Custom LLMs, without training. Use via openai compatible api
Nov 2025 · askcodi.com · its alternatives →
- 7RY
Hey HN, we've just finished building a dynamic router for LLMs, which takes each prompt and sends it to the most appropriate model and provider. We'd love to know what you think! Here is a quick(ish) screen-recroding explaining how it works: https://youtu.be/ZpY6SIkBosE Best results when training a custom router on your own prompt data: https://youtu.be/9JYqNbIEac0 The router balances user preferences for quality, speed and cost. The end result is higher quality and faster LLM responses at lower cost. The quality for each candidate LLM is predicted ahead of time…
2024 · unify.ai · its alternatives →
- 8
- 9
- 10AC
Hey HN, I'm excited to share AnyLM, a desktop app I've been working on. I love tinkering with local LLMs (via Ollama and LMStudio) but often found myself wishing for a more polished, unified UI similar to what ChatGPT offers, where all my conversations are in one place. Out of that frustration I've built AnyLM, which aims to solve that by providing a single, native application (currently for Windows, with macOS and more planned) to interact with your local models from LM Studio/Ollama but also models from api providers like OpenAI, Anthropic and Google. This has been a fun (and…
2025 · anylm.app · its alternatives →
- 11AR
Hi HN — we're the team behind Arch (https://github.com/katanemo/archgw), an open-source proxy for LLMs written in Rust. Today we're releasing Arch-Router (https://huggingface.co/katanemo/Arch-Router-1.5B), a 1.5B router model for preference-based routing, now integrated into the proxy. As teams integrate multiple LLMs - each with different strengths, styles, or cost/latency profiles — routing the right prompt to the right model becomes a critical part of the application design. But it's still an open problem. Most routing systems fall into two…
2025 · its alternatives →
- 12
Dev tool that worries about your LLM API failures.
Aug 2026 · llmrouter.dpdns.org · its alternatives →
- 13
- 14
Talk to multiple LLMs thru a unified API
2025 · ai-gateway.dev · its alternatives →
- 15
One API for every LLM — tuned per task, BYOK
May 2026 · multiroute.ai · its alternatives →
- 16
- 17AF
Really excited to release our universal model router for LLM models. We monitor usage across all your LLM models and now make it even easier to switch between them, no more time rebuilding your app when a new model is released.
2024 · twitter.com · its alternatives →
- 18OA
Scenario: Your company’s IT department says “good news, you have access to azure, aws, openai, mistral, and together AI, here are the API keys”. You think “yippee I can access many models”, but some models like the gpt-oss or Mistral are available on some or all of those platforms? That’s where this app comes in: run it and it will check all the providers that you have configured and then you can search across those providers to see which providers have the model you want available. Built on top of mozilla.ai any-llm library. Check out the link for a GIF showing it in action.
2025 · github.com · its alternatives →
- 19SA
Hi HN, We’re building https://www.switchpoint.dev – a drop-in replacement for OpenAI’s API that reduces LLM cost by smartly routing across models (e.g., Claude, Gemini, GPT-4) depending on subject and difficulty of the task. Why we built this: LLM costs are spiraling—especially for products doing retrieval, agentic reasoning, or even just high-volume chat. We were frustrated with paying GPT-4 rates when most queries didn’t need it. So we built a router that: - Starts with cheaper/free models (like Llama 8B, 4o-mini, 2.0 flash) - Streams responses and upgrades on failure - Acts…
2025 · switchpoint.dev · its alternatives →
- 20
Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default. - Northwood-Systems/millwright
Jul 2026 · github.com · its alternatives →
- 21
- 22IG
2024 · columns.ai · its alternatives →
- 23
- 24
World's first fully automatic LLM router creator
Oct 2025 · switchpoint.dev · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →