Alternatives
Products that do what Zydit API Gateway does
Providing Free Of Cost LLM APIs to users since 2026.
- 1
- 2
- 3IB
Hey HN, I am proud to show you guys that I have built an open source alternative to Azure OpenAI services. Azure OpenAI services was born out of companies needing enhanced security and access control for using different GPT models. I want to build an OSS version of Azure OpenAI services that people could self host in their own infrastructure. "How can I track LLM spend per API key?" "Can I create a development OpenAI API key with limited access for Bob?" "Can I see my LLM spend breakdown by models and endpoints?" "Can I create 100 OpenAI API keys that my students could use in a classroom…
2023 · github.com
- 4
- 5
- 6SS
Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k/month. Most developers only need 15-25 tok/s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5/mo for smaller models. The LLMs are completely private (we don't log any traffic). The API is OpenAI-compatible (we run vLLM), so you just swap the base URL. Currently offering a few models.
Apr 2026 · sllm.cloud
- 7
- 8
- 9
- 10
OpenAI-compatible gateway aggregating 8 free LLM providers
May 2026 · freellms.vercel.app
- 11
- 12AL
We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai/gpt-4" to "anthropic/claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!
2025 · github.com
- 13
- 14
- 15AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com
- 16TO
Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2024 · github.com
- 17IW
Hey HN, I built browser-use, an open-source alternative to OpenAI’s Operator for browser-use systems, and here’s why I think it’s better: Flexibility: You can use any LLM with our tool – Gemini, Anthropic, Qwen, Llama, DeepSeek, and more. As new models improve, so does your agent. Open Source: No need to pay $200/month or endure long waitlists – it’s free and accessible to everyone today. Custom Automation: Our Python package allows you to build actual web automations. Your LLM can gain new tools, like file uploads. Cost: Our system is 30x cheaper than Operator, e.g., when used with…
2025 · github.com
- 18
- 19
- 20
- 21
- 22LR
Hi! My OpenAI costs started going up recently and I hated how I couldn't figure out which model was costing me more? The OpenAI usage page (https://platform.openai.com/account/usage) gives a nice overall breakdown, but it doesn't go into detail about cost / model, token usage, and # requests. So I reverse engineered their API to make a better dashboard, and then made it free to use. Try it out and let me know what you think. Also please tell me what other features you wish existed here https://platform.openai.com/account/usage but doesn't yet.
2023 · llm.report
- 23
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →