Alternatives
Products that do what AnyResponses does
Open Responses-compatible gateway for every LLM provider
- 1AL
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com
- 2
- 3
- 4OR
2025 · github.com
- 5
- 6
OpenAI-compatible gateway aggregating 8 free LLM providers
May 2026 · freellms.vercel.app
- 7
- 8IB
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com
- 9
- 10
- 11
- 12
The AI Compute Gateway - One API. Every AI Model. Contribute to radium0090/Compute-Gateway development by creating an account on GitHub.
20d ago · github.com
- 13
Trace LLM requests + costs with OpenTelemetry monitoring
Oct 2025
- 14AL
any-llm is a library that provides unified access to multiple LLM providers. switching between providers like OpenAI, Anthropic, Google, Mistral, and even Ollama is just a string change. This demo makes it easy to look at and compare responses from different models. Interesting to see how ChatGPT, Claude, Gemini, and local models each reason through the same problems. Let us know what you think!
2025 · github.com
- 15
- 16
- 17
- 18
- 19
- 20SO
Henry, Matt and James here – we’re building an open source toolkit that makes it easy to integrate an LLM-powered copilot that talks to your API into software products. It works by calling API endpoints which you choose to expose to it. This lets the chatbot complete tasks within your software in response to natural language queries. It’s also open source, so you don’t have to send user data to another 3rd party. We support Llama 2, but we haven’t fine-tuned Llama 2 yet (coming soon) so highest accuracy is seen with GPT-4 or fine-tuned GPT-3.5 (much faster). We started working together 2…
2023 · github.com
- 21
- 22
Access GLM, Kimi and more via one OpenAI-compatible API
Apr 2026 · chinawhapi.com
- 23
Dev tool that worries about your LLM API failures.
Aug 2026 · llmrouter.dpdns.org
- 24AP
Hey HN! We've run our privacy-focused open-source inference company for a while now, and we're launching a flat monthly subscription similar to Anthropic's. It should work with Cline, Roo, KiloCode, Aider, etc — any OpenAI-compatible API client should do. The rate limits at every tier are higher than the Claude rate limits, so even if you prefer using Claude it can be a helpful backup for when you're rate limited, for a pretty low price. Let me know if you have any feedback!
2025 · synthetic.new
Ranked by how close each launch is in meaning, then by votes. Refine with a description →