Alternatives
Products that do what FreeGate does
Free multi-provider LLM proxy with automatic failover
- 1
- 2
- 3
- 4
- 5
Trace LLM requests + costs with OpenTelemetry monitoring
Oct 2025
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14OA
Hi HN! I built OpenGem, an open-source, load-balanced proxy for the Gemini API that requires absolutely no paid API keys. GitHub: https://github.com/arifozgun/OpenGem The Context: Like many developers, I was constantly hitting "429 Quota Exceeded" errors while building AI agents and processing large payloads on free tiers. I wanted to build freely without calculating API costs for every test request. How it works: I reverse-engineered the official Gemini CLI authentication to get standard API access. However, a single free Google account quota depletes quickly. To solve…
Feb 2026 · github.com
- 15
- 16OS
Hi HN, Matvey, Ildar, Joey, and Dominik here. If you're building LLM agents that use tools, you're probably worried about prompt injection attacks that can hijack those tools. We were too, and found that solutions like prompt-based filtering or secondary "guard" LLMs can be unreliable. Our thesis is that agent security should be handled at the network level between the agent and the LLM, just like a traditional web application firewall. So we built Archestra Platform: an open-source gateway that acts as a secure proxy for your AI agents. It's designed to be a deterministic firewall against…
Oct 2025 · archestra.ai
- 17
- 18
- 19AG
Hi HN My name is Salman and I work on Arch GW - the intelligent gateway designed to protect, observe, and personalize LLM applications with your APIs. https://github.com/katanemo/arch Our team built Envoy Proxy at Lyft, and re-imagined it with the belief that: Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests including secure handling, intelligent routing, robust observability, and integration with backend (API) systems for personalization – all outside business logic. Engineered with purpose-built LLMs, Arch…
2024 · docs.archgw.com
- 20IM
Hi guys, For my startup at www.mithrin.ai which is about create AI Chatbot Agents for websites, I wanted to create some free tools to attract traffic to the site and decided to create specialized chatbots powered by LLMs, similar to OpenAI's Custom GPTs. I realized that by using gpt-4o-mini, I could create quite powerful alternatives to GPTs that are free to the public for a very small cost (given how cheap the model api cost is). I've employed some throttling to prevent abuse and to avoid being charged too much. Then I integrated this with my main service and allowed users to use the…
2024 · mithrin.ai
- 21OA
Scenario: Your company’s IT department says “good news, you have access to azure, aws, openai, mistral, and together AI, here are the API keys”. You think “yippee I can access many models”, but some models like the gpt-oss or Mistral are available on some or all of those platforms? That’s where this app comes in: run it and it will check all the providers that you have configured and then you can search across those providers to see which providers have the model you want available. Built on top of mozilla.ai any-llm library. Check out the link for a GIF showing it in action.
Sep 2025 · github.com
- 22MY
LLM observability is an absolute must-have for anyone running something in prod (or prod-like). While all the observability startups are great, you're essentially sending all your OpenAI usage history - prompts, generations, chats - to a random third party. So this script deploys a basic proxy in your Azure account, catches all incoming OpenAI requests, stores logs in your own resource group, and comes with visualizations premade (charts, timelines, chat history, cost estimation, etc). Thanks for any thoughts and feedback!
2023 · github.com
- 23
Contain LiteLLM, Bifrost, Portkey.. behind one control plane
14d ago · agnos-llm-gateway.site
- 24SA
Hi HN, We’re building https://www.switchpoint.dev – a drop-in replacement for OpenAI’s API that reduces LLM cost by smartly routing across models (e.g., Claude, Gemini, GPT-4) depending on subject and difficulty of the task. Why we built this: LLM costs are spiraling—especially for products doing retrieval, agentic reasoning, or even just high-volume chat. We were frustrated with paying GPT-4 rates when most queries didn’t need it. So we built a router that: - Starts with cheaper/free models (like Llama 8B, 4o-mini, 2.0 flash) - Streams responses and upgrades on failure - Acts…
2025 · switchpoint.dev
Ranked by how close each launch is in meaning, then by votes. Refine with a description →