AI · alternatives · 2026

24 alternatives to Aurko

An ai-gateway that cuts llm api costs by 40-70%.

Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.

1. 1
   Auriko ▲389

   Trading desk for LLM calls

   Jul 2026 · auriko.ai · its alternatives →

2. 2
   Proxy 1.0▲718

   Your AI Assistant that actually gets things done

   2025 · convergence.ai · its alternatives →

3. 3
   TrueFoundry AI Gateway▲315

   Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

   Dec 2025 · truefoundry.com · its alternatives →

4. 4
   ZenMux▲382

   An enterprise-grade LLM gateway with automatic compensation

   Feb 2026 · zenmux.ai · its alternatives →

5. 5
   Arch▲314

   Hey HN — I’m Adil from Katanemo (with Salman, Shuguang, and Meiyu) We previously shared an early version of this project as ArchGW. Based on customer feedback, the scope expanded from “LLM routing and model access” into something broader: delivery infrastructure for agentic applications. We renamed it to Plano and reworked the architecture accordingly. The problem On-the-ground AI practitioners will tell you that calling an LLM is not the hard part. The really hard part is delivering agentic applications to production quickly and reliably, then iterating without rewriting system code every…

   2024 · github.com · its alternatives →

6. 6
   Tokenwise▲143

   A smart LLM proxy that shows where you're overpaying

   Jun 2026 · tokenwisehq.com · its alternatives →

7. 7
   LLM Gatewayfree tier▲296

   I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

   2025 · llmgateway.io · its alternatives →

8. 8
   Aureo.io▲89

   MLOps platform with predictive and conversational AI

   2023 · aureo.io · its alternatives →

9. 9
   FastRouter.aifree tier, from $199/mo▲364

   Route requests to the right LLM for cost, latency & quality

   22d ago · fastrouter.ai · its alternatives →

10. 10
    TensorZero▲307

    Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

    2025 · github.com · its alternatives →

11. 11
    Any-LLM – Lightweight router to access any LLM Provider▲125

    We built any-llm because we needed a lightweight router for LLM providers with minimal overhead. Switching between models is just a string change : update "openai&#x2F;gpt-4" to "anthropic&#x2F;claude-3" and you're done. It uses official provider SDKs when available, which helps since providers handle their own compatibility updates. No proxy or gateway service needed either, so getting started is pretty straightforward - just pip install and import. Currently supports 20+ providers including OpenAI, Anthropic, Google, Mistral, and AWS Bedrock. Would love to hear what you think!

    2025 · github.com · its alternatives →

12. 12
    Inferock Bench▲295

    Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts. - inferock/inferock-bench

    Aug 2026 · github.com · its alternatives →

13. 13
    Aegisora▲93

    The narrow control plane for AI agent tool and API calls.

    Aug 2026 · aegisora-ai.vercel.app · its alternatives →

14. 14
    ReliAPI▲87

    Stop losing money on failed OpenAI and Anthropic API calls.

    Dec 2025 · kikuai-lab.github.io · its alternatives →

15. 15
    GoModel – an open-source AI gateway in Go▲217

    Hi, I’m Jakub, a solo founder based in Warsaw. I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others. I built it for my startup to solve a few problems: - track AI usage and cost per client or team - switch models without changing app code - debug request flows more easily - reduce AI spendings with exact and semantic caching How is it different? - ~17MB docker image - LiteLLM's image is more than 44x bigger ("docker.litellm.ai&#x2F;berriai&#x2F;litellm:latest" ~…

    Apr 2026 · github.com · its alternatives →

16. 16
    ArchGW – An intelligent edge and service proxy for agents▲118

    Hey HN! This is Adil, Salman and Jose and and we’re behind archgw [1]. An intelligent proxy server designed as an edge and AI gateway for agents - one that natively know how to handle prompts, not just network traffic. We’ve made several sweeping changes so sharing the project again. A bit of background on why we’ve built this project. Building AI agent demos is easy, but to create something production-ready there is a lot of repeat low-level plumbing work that everyone is doing. You’re applying guardrails to make sure unsafe or off-topic requests don’t get through. You’re clarifying vague…

    2025 · github.com · its alternatives →

17. 17
    Callio▲101

    Connect any API with AI Agent under 1 minute

    Feb 2026 · callio.dev · its alternatives →

18. 18
    CtrlAI▲104

    Transparent proxy that secures AI agents with guardrails

    Mar 2026 · github.com · its alternatives →

19. 19
    RouKey▲98

    Route each task to the smartest AI for the job

    2025 · expireddomains.com · its alternatives →

20. 20
    A lightweight AI gateway to 100+ models, in TS▲37

    We are Rohit & Ayush, we created Portkey this year March to help tackle some challenges we had seen while building apps based on GPT3, 3.5, 4, and the DevOps principles we brought to the scene to help tackle them. We believe, a solid, performant, and reliable gateway lays the foundation to help build the next level of LLM apps. It decreases excessive reliance on any one company and takes the focus back to building instead of spending time fixing the nitty gritties of different providers and making them work together. Features: Blazing fast (9.9x faster) with a tiny footprint (~45kb…

    2024 · github.com · its alternatives →

21. 21
    Arch-Router – 1.5B model for LLM routing by preferences, not benchmarks▲66

    Hi HN — we're the team behind Arch (https:&#x2F;&#x2F;github.com&#x2F;katanemo&#x2F;archgw), an open-source proxy for LLMs written in Rust. Today we're releasing Arch-Router (https:&#x2F;&#x2F;huggingface.co&#x2F;katanemo&#x2F;Arch-Router-1.5B), a 1.5B router model for preference-based routing, now integrated into the proxy. As teams integrate multiple LLMs - each with different strengths, styles, or cost&#x2F;latency profiles — routing the right prompt to the right model becomes a critical part of the application design. But it's still an open problem. Most routing systems fall into two…

    2025 · its alternatives →

22. 22
    Promptly▲13

    An AI Cost Optimization Infrastructure for LLM Applications

    Mar 2026 · getpromptly.in · its alternatives →

23. 23
    An open-source AI Gateway with integrated guardrails▲21

    Hi HN, I've been developing Portkey Gateway, an open-source AI gateway that's now processing billions of tokens daily across 200+ LLMs. Today, we're launching a significant update: integrated Guardrails at the gateway level. Key technical features: 1. Guardrails as middleware: We've implemented a hooks architecture that allows guardrails to act as middleware in the request&#x2F;response flow. This enables real-time LLM output evaluation and transformation. 2. Flexible orchestration: The gateway can now route requests based on guardrail verdicts. This allows for complex logic like fallbacks…

    2024 · github.com · its alternatives →

24. 24BA
    Butter, a muscle memory cache for LLMs▲23

    Hi HN, Erik here. Today we launch Butter, an OpenAI-compatible API proxy that caches LLM generations and serves them deterministically on revisit. Since April, we’ve been working on this concept of “muscle memory,” or deterministic replay, for agent systems performing automations. You may recall our first post in May, launching a python package called Muscle Mem: https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=43988381 Since then, the product has evolved entirely, now taking the form of an LLM Proxy. For a deep dive into this process, check out:…

    2025 · docs.butter.dev · its alternatives →

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →