nowfound

AI · free · 2026

24 free alternatives to LLM Gateway

LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface.

LLM Gateway has a free plan (its own site, checked September 2026). Below are 24 products that do a similar job and cost nothing to start: 18 free outright and 6 with a free plan and paid upgrades. Each price was read from the product's own site. They are ranked by how close each is in meaning, then by launch-day votes.

  1. 1

    Run multiple models side-by-side, analyze their strengths, and fuse the best answer.

    Apr 2026 · openrouter.ai · price checked November 2026

  2. 2
    FastRouter.aiFree plan, paid from $199/mo▲364

    Route requests to the right LLM for cost, latency & quality

    Sep 2026 · fastrouter.ai · price checked October 2026

  3. 3
    TensorZeroFree▲307

    TensorZero is an open-source platform for building LLM applications at scale.

    2025 · github.com · price checked November 2026

  4. 4
    TrueFoundry AI GatewayFree plan, paid from $25/mo▲315

    Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

    Dec 2025 · truefoundry.com · price checked November 2026

  5. 5
    OpenLLMFree plan, paid from $30/mo▲113

    Take your AI tokens anywhere

    26d ago · openllm.sh · price checked November 2026

  6. 6
    Any-LLMFree▲125

    Any-LLM is a lightweight router that lets developers switch between language model providers by changing a single string in their code.

    2025 · github.com · price checked November 2026

  7. 7

    This project replicates mechanistic interpretability research on large language models using sparse autoencoders, building on published work from Anthropic, OpenAI, and DeepMind.

    2024 · github.com · price checked November 2026

  8. 8
    ArchFree▲314

    Arch is an infrastructure tool for developers to build personalized AI agents quickly.

    2024 · github.com · price checked November 2026

  9. 9
    BricksLLMFree▲200

    BricksLLM is an open-source API gateway that allows organizations to self-host a secure alternative to Azure OpenAI services.

    2023 · github.com · price checked November 2026

  10. 10
    GoModelFree▲217

    GoModel is an open-source AI gateway written in Go that sits between applications and AI model providers like OpenAI and Anthropic.

    Apr 2026 · github.com · price checked November 2026

  11. 11
    secret-llamaFree▲547

    This is a free in-browser chatbot that runs Llama 3 and Mistral 7B locally using WebGPU technology, eliminating the need for installations or external dependencies.

    2024 · github.com · price checked November 2026

  12. 12
    BerriAIFree▲193

    Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!

    2023 · litellm.ai · price checked November 2026

  13. 13
    OllamaFree▲284

    Ollama lets users run large language models locally on Mac computers.

    2023 · github.com · price checked November 2026

  14. 14
    traceAIFree▲263

    Open-source LLM tracing that speaks GenAI, not HTTP.

    Apr 2026 · github.com · price checked November 2026

  15. 15
    experientialFree▲222

    Experiential is an open source model gateway that unifies access to self-hosted, open source, and commercial AI models through a single control plane.

    Aug 2026 · github.com · price checked November 2026

  16. 16
    Context GatewayFree▲219

    Context Gateway is an open-source proxy that sits between AI coding agents and language models, compressing tool outputs to reduce token usage and improve quality.

    Mar 2026 · github.com · price checked November 2026

  17. 17
    ModelRiverFree plan, paid from $49/mo▲37

    Connect once to every major AI model. Run AI workflows in the background while your backend controls what AI sees.

    Jan 2026 · modelriver.com · price checked November 2026

  18. 18
    LlamaGymFree▲239

    Fine-tune LLM agents with online reinforcement learning

    2024 · github.com · price checked November 2026

  19. 19
    LLMFree▲45

    LLM is an open-source Rust crate and command-line tool for running large language models like LLaMA and GPT-NeoX on CPUs.

    2023 · github.com · price checked November 2026

  20. 20

    [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications

    2024 · github.com · price checked November 2026

  21. 21
    OtariFree▲20

    Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    Jul 2026 · github.com · price checked November 2026

  22. 22
    IQ RoutingFree plan, paid from $6/mo▲100

    Route every LLM call to the cheapest model that holds quality. Chatbots, RAG, agent loops, and finance. Cut spend 40 to 80 percent, measured on our own traffic, live in thirty seconds.

    Aug 2026 · iq-routing.com · price checked November 2026

  23. 23
    SwiftAIFree▲74

    SwiftAI is an open-source Swift library for iOS and macOS that enables developers to build language model features using Apple's on-device LLMs when available, with automatic fallback to cloud…

    2025 · github.com · price checked November 2026

  24. 24
    SuperflowsFree▲37

    Henry, Matt and James here – we’re building an open source toolkit that makes it easy to integrate an LLM-powered copilot that talks to your API into software products. It works by calling API endpoints which you choose to expose to it. This lets the chatbot complete tasks within your software in response to natural language queries. It’s also open source, so you don’t have to send user data to another 3rd party. We support Llama 2, but we haven’t fine-tuned Llama 2 yet (coming soon) so highest accuracy is seen with GPT-4 or fine-tuned GPT-3.5 (much faster). We started working together 2…

    2023 · github.com · price checked November 2026

Free tools by topic

All alternatives to LLM Gateway, paid too →About LLM Gateway →

Free means the product’s own site says it is free or offers a free plan, as read on the date shown. Plans change; check the site before you rely on one.