nowfound

Dev tools · free · 2026

24 free alternatives to liteLLM Proxy Server

liteLLM Proxy Server is an open-source tool that provides a single API endpoint to access over 50 large language models from providers including OpenAI, Azure, Cohere, Anthropic, and Hugging Face.

Below are 24 products that do a similar job and cost nothing to start: 19 free outright and 5 with a free plan and paid upgrades. Each price was read from the product's own site. They are ranked by how close each is in meaning, then by launch-day votes.

  1. 1
    BerriAIFree▲193

    Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!

    2023 · litellm.ai · price checked November 2026

  2. 2
    LLM GatewayFree plan▲286

    LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface.

    2025 · llmgateway.io · price checked September 2026

  3. 3
    LitellmFree▲62

    Litellm is a lightweight library that provides a simplified interface for calling multiple large language model APIs, including OpenAI, Cohere, and Azure.

    2023 · github.com · price checked November 2026

  4. 4
    GoModelFree▲217

    GoModel is an open-source AI gateway written in Go that sits between applications and AI model providers like OpenAI and Anthropic.

    Apr 2026 · github.com · price checked November 2026

  5. 5
    Context GatewayFree▲219

    Context Gateway is an open-source proxy that sits between AI coding agents and language models, compressing tool outputs to reduce token usage and improve quality.

    Mar 2026 · github.com · price checked November 2026

  6. 6
    LangfuseFree plan, paid from $29/mo▲771

    Open source tracing and analytics for LLM applications

    2023 · langfuse.com · price checked November 2026

  7. 7
    OpenLLMFree plan, paid from $30/mo▲113

    Take your AI tokens anywhere

    26d ago · openllm.sh · price checked November 2026

  8. 8
    Any-LLMFree▲125

    Any-LLM is a lightweight router that lets developers switch between language model providers by changing a single string in their code.

    2025 · github.com · price checked November 2026

  9. 9

    This web app experiment tests whether large language models can replace traditional code by handling every HTTP request directly.

    2025 · github.com · price checked November 2026

  10. 10
    Free LLM APIFree▲86

    Access 1 billion tokens per month for free

    Apr 2026 · github.com · price checked November 2026

  11. 11
    GPT RouterFree▲211

    Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

    2023 · github.com · price checked November 2026

  12. 12

    We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.

    2023 · github.com · price checked November 2026

  13. 13
    Agents.jsonFree▲212

    Agents.json is an open specification that enables large language models to discover and invoke APIs using natural language.

    2025 · github.com · price checked November 2026

  14. 14

    Run multiple models side-by-side, analyze their strengths, and fuse the best answer.

    Apr 2026 · openrouter.ai · price checked November 2026

  15. 15
    BricksLLMFree▲200

    BricksLLM is an open-source API gateway that allows organizations to self-host a secure alternative to Azure OpenAI services.

    2023 · github.com · price checked November 2026

  16. 16

    Sherlock is a man-in-the-middle proxy that intercepts and displays all API requests between LLM tools and their services.

    Jan 2026 · github.com · price checked November 2026

  17. 17
    TrueFoundry AI GatewayFree plan, paid from $25/mo▲315

    Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…

    Dec 2025 · truefoundry.com · price checked November 2026

  18. 18
    traceAIFree▲263

    Open-source LLM tracing that speaks GenAI, not HTTP.

    Apr 2026 · github.com · price checked November 2026

  19. 19

    Llama2 Embeddings FastAPI Server is a self-hosted REST API that converts text strings into embedding vectors using Llama2 and similar language models.

    2023 · github.com · price checked November 2026

  20. 20

    This is a wiki system designed for AI agents that uses markdown files and Git as its core storage layer, with BM25 full-text search and SQLite indexing on top.

    Apr 2026 · github.com · price checked November 2026

  21. 21
    LangfuseFree▲143

    Langfuse is an open-source observability and analytics platform for large language model applications.

    2023 · github.com · price checked November 2026

  22. 22

    Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant

    2025 · github.com · price checked November 2026

  23. 23
    OpenLLMetryFree▲154

    OpenLLMetry is an open-source set of extensions built on OpenTelemetry that provides observability for large language model applications.

    2023 · github.com · price checked November 2026

  24. 24
    OpenLITFree▲62

    OpenLIT is an open-source observability tool built on OpenTelemetry for monitoring Large Language Model applications.

    2024 · github.com · price checked November 2026

All alternatives to liteLLM Proxy Server, paid too →About liteLLM Proxy Server →

Free means the product’s own site says it is free or offers a free plan, as read on the date shown. Plans change; check the site before you rely on one.