# Free alternatives to liteLLM Proxy Server

liteLLM Proxy Server: liteLLM Proxy Server is an open-source tool that provides a single API endpoint to access over 50 large language models from providers including OpenAI, Azure, Cohere, Anthropic, and Hugging Face.

24 products that do a similar job and cost nothing to start: 19 free outright, 5 with a free plan. Closest in meaning first. Each price was read from the product's own site on the date shown.

Page: https://nowfound.app/free-alternatives/litellm-proxy-server-50-llm-models-error-handling-caching
All alternatives, paid too: https://nowfound.app/alternatives/litellm-proxy-server-50-llm-models-error-handling-caching.md
About liteLLM Proxy Server: https://nowfound.app/launch/litellm-proxy-server-50-llm-models-error-handling-caching.md

| # | Product | Price | Checked | What it does |
|---|---|---|---|---|
| 1 | [BerriAI](https://nowfound.app/launch/berriai) | Free | 2026-11-22 | Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - \`completion\` and \`embedding\`; and guarantees consistent input/output formats… |
| 2 | [LLM Gateway](https://nowfound.app/launch/llm-gateway) | Free plan | 2026-09-08 | LLM Gateway is an open-source API platform that lets users access multiple AI models through a single unified interface. |
| 3 | [Litellm](https://nowfound.app/launch/litellm-simple-library-to-standardize-openai-cohere-azure-ll) | Free | 2026-11-21 | Litellm is a lightweight library that provides a simplified interface for calling multiple large language model APIs, including OpenAI, Cohere, and Azure. |
| 4 | [GoModel](https://nowfound.app/launch/gomodel-an-open-source-ai-gateway-in-go) | Free | 2026-11-20 | GoModel is an open-source AI gateway written in Go that sits between applications and AI model providers like OpenAI and Anthropic. |
| 5 | [Context Gateway](https://nowfound.app/launch/context-gateway) | Free | 2026-11-21 | Context Gateway is an open-source proxy that sits between AI coding agents and language models, compressing tool outputs to reduce token usage and improve qual… |
| 6 | [Langfuse](https://nowfound.app/launch/langfuse) | Free plan, paid from $29/mo | 2026-11-21 | Open source tracing and analytics for LLM applications |
| 7 | [OpenLLM](https://nowfound.app/launch/openllm) | Free plan, paid from $30/mo | 2026-11-20 | Take your AI tokens anywhere |
| 8 | [Any-LLM](https://nowfound.app/launch/any-llm-lightweight-router-to-access-any-llm-provider) | Free | 2026-11-21 | Any-LLM is a lightweight router that lets developers switch between language model providers by changing a single string in their code. |
| 9 | [Why write code if the LLM can just do the](https://nowfound.app/launch/why-write-code-if-the-llm-can-just-do-the-thing-web-app-expe) | Free | 2026-11-21 | This web app experiment tests whether large language models can replace traditional code by handling every HTTP request directly. |
| 10 | [Free LLM API](https://nowfound.app/launch/free-llm-api) | Free | 2026-11-20 | Access 1 billion tokens per month for free |
| 11 | [GPT Router](https://nowfound.app/launch/gpt-router) | Free | 2026-11-21 | Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability. |
| 12 | [A fully open-source (Apache 2.0)implementation](https://nowfound.app/launch/a-fully-open-source-apache-2-0-implementation-of-llama) | Free | 2026-11-22 | We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it m… |
| 13 | [Agents.json](https://nowfound.app/launch/agents-json-openapi-specification-for-llms) | Free | 2026-11-21 | Agents.json is an open specification that enables large language models to discover and invoke APIs using natural language. |
| 14 | [OpenRouter Model Fusion](https://nowfound.app/launch/openrouter-model-fusion) | Free plan | 2026-11-21 | Run multiple models side-by-side, analyze their strengths, and fuse the best answer. |
| 15 | [BricksLLM](https://nowfound.app/launch/i-built-an-oss-alternative-to-azure-openai-services) | Free | 2026-11-21 | BricksLLM is an open-source API gateway that allows organizations to self-host a secure alternative to Azure OpenAI services. |
| 16 | [A MitM proxy to see what your LLM tools are](https://nowfound.app/launch/a-mitm-proxy-to-see-what-your-llm-tools-are-sending) | Free | 2026-11-21 | Sherlock is a man-in-the-middle proxy that intercepts and displays all API requests between LLM tools and their services. |
| 17 | [TrueFoundry AI Gateway](https://nowfound.app/launch/truefoundry-ai-gateway) | Free plan, paid from $25/mo | 2026-11-21 | Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern bec… |
| 18 | [traceAI](https://nowfound.app/launch/traceai) | Free | 2026-11-20 | Open-source LLM tracing that speaks GenAI, not HTTP. |
| 19 | [Llama2 Embeddings FastAPI Server](https://nowfound.app/launch/llama2-embeddings-fastapi-server) | Free | 2026-11-21 | Llama2 Embeddings FastAPI Server is a self-hosted REST API that converts text strings into embedding vectors using Llama2 and similar language models. |
| 20 | [A Karpathy-style LLM wiki your agents maintain](https://nowfound.app/launch/a-karpathy-style-llm-wiki-your-agents-maintain-markdown-and) | Free | 2026-11-20 | This is a wiki system designed for AI agents that uses markdown files and Git as its core storage layer, with BM25 full-text search and SQLite indexing on top. |
| 21 | [Langfuse](https://nowfound.app/launch/langfuse-open-source-observability-and-analytics-for-llm-app) | Free | 2026-11-21 | Langfuse is an open-source observability and analytics platform for large language model applications. |
| 22 | [Use Third Party LLM API in JetBrains AI](https://nowfound.app/launch/use-third-party-llm-api-in-jetbrains-ai-assistant) | Free | 2026-11-21 | Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant |
| 23 | [OpenLLMetry](https://nowfound.app/launch/openllmetry-opentelemetry-based-observability-for-llms) | Free | 2026-11-21 | OpenLLMetry is an open-source set of extensions built on OpenTelemetry that provides observability for large language model applications. |
| 24 | [OpenLIT](https://nowfound.app/launch/openlit-open-source-llm-observability-with-opentelemetry-40167461) | Free | 2026-11-21 | OpenLIT is an open-source observability tool built on OpenTelemetry for monitoring Large Language Model applications. |
