24 free alternatives to liteLLM Proxy Server
liteLLM Proxy Server is an open-source tool that provides a single API endpoint to access over 50 large language models from providers including OpenAI, Azure, Cohere, Anthropic, and Hugging Face.
Below are 24 products that do a similar job and cost nothing to start: 19 free outright and 5 with a free plan and paid upgrades. Each price was read from the product's own site. They are ranked by how close each is in meaning, then by launch-day votes.
- 1
BerriAIFree▲193Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!
2023 · litellm.ai · price checked November 2026
- 2
LLM GatewayFree plan▲286LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface.
2025 · llmgateway.io · price checked September 2026
- 3
LitellmFree▲62Litellm is a lightweight library that provides a simplified interface for calling multiple large language model APIs, including OpenAI, Cohere, and Azure.
2023 · github.com · price checked November 2026
- 4
GoModelFree▲217GoModel is an open-source AI gateway written in Go that sits between applications and AI model providers like OpenAI and Anthropic.
Apr 2026 · github.com · price checked November 2026
- 5
Context GatewayFree▲219Context Gateway is an open-source proxy that sits between AI coding agents and language models, compressing tool outputs to reduce token usage and improve quality.
Mar 2026 · github.com · price checked November 2026
- 6
LangfuseFree plan, paid from $29/mo▲771Open source tracing and analytics for LLM applications
2023 · langfuse.com · price checked November 2026
- 7
OpenLLMFree plan, paid from $30/mo▲113Take your AI tokens anywhere
26d ago · openllm.sh · price checked November 2026
- 8
Any-LLMFree▲125Any-LLM is a lightweight router that lets developers switch between language model providers by changing a single string in their code.
2025 · github.com · price checked November 2026
- 9

This web app experiment tests whether large language models can replace traditional code by handling every HTTP request directly.
2025 · github.com · price checked November 2026
- 10
Free LLM APIFree▲86Access 1 billion tokens per month for free
Apr 2026 · github.com · price checked November 2026
- 11
GPT RouterFree▲211Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
2023 · github.com · price checked November 2026
- 12

We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.
2023 · github.com · price checked November 2026
- 13
Agents.jsonFree▲212Agents.json is an open specification that enables large language models to discover and invoke APIs using natural language.
2025 · github.com · price checked November 2026
- 14
OpenRouter Model FusionFree plan▲144Run multiple models side-by-side, analyze their strengths, and fuse the best answer.
Apr 2026 · openrouter.ai · price checked November 2026
- 15
BricksLLMFree▲200BricksLLM is an open-source API gateway that allows organizations to self-host a secure alternative to Azure OpenAI services.
2023 · github.com · price checked November 2026
- 16

Sherlock is a man-in-the-middle proxy that intercepts and displays all API requests between LLM tools and their services.
Jan 2026 · github.com · price checked November 2026
- 17
TrueFoundry AI GatewayFree plan, paid from $25/mo▲315Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented. We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future. The…
Dec 2025 · truefoundry.com · price checked November 2026
- 18
traceAIFree▲263Open-source LLM tracing that speaks GenAI, not HTTP.
Apr 2026 · github.com · price checked November 2026
- 19
Llama2 Embeddings FastAPI ServerFree▲178Llama2 Embeddings FastAPI Server is a self-hosted REST API that converts text strings into embedding vectors using Llama2 and similar language models.
2023 · github.com · price checked November 2026
- 20

This is a wiki system designed for AI agents that uses markdown files and Git as its core storage layer, with BM25 full-text search and SQLite indexing on top.
Apr 2026 · github.com · price checked November 2026
- 21
LangfuseFree▲143Langfuse is an open-source observability and analytics platform for large language model applications.
2023 · github.com · price checked November 2026
- 22

Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant
2025 · github.com · price checked November 2026
- 23
OpenLLMetryFree▲154OpenLLMetry is an open-source set of extensions built on OpenTelemetry that provides observability for large language model applications.
2023 · github.com · price checked November 2026
- 24
OpenLITFree▲62OpenLIT is an open-source observability tool built on OpenTelemetry for monitoring Large Language Model applications.
2024 · github.com · price checked November 2026
All alternatives to liteLLM Proxy Server, paid too →About liteLLM Proxy Server →
Free means the product’s own site says it is free or offers a free plan, as read on the date shown. Plans change; check the site before you rely on one.