liteLLM

What it does

Simplify using LLM APIs from OpenAI, Azure, Cohere, Anthropic, Replicate, Google 🤩 TLDR • Call all LLM APIs using the chatGPT format - completion(model, messages) • Consistent outputs and exceptions for all LLM APIs • Logging and Error Tracking for all models

LiteLLM is the open-source AI gateway that puts your full AI stack behind one OpenAI-compatible key. Track and cap LLM spend, route to the right model, and self-host anywhere — even air-gapped. 140+ providers, 1,892 models.

“LiteLLM gives NVIDIA engineers a single, consistent way to access more than 100 AI model endpoints .” “LiteLLM streamlines the complexities of managing multiple LLM models.” “LiteLLM has let my team provide the latest LLM models to our users, usually within a day of them being released… it has saved us months of work .” “If we decide to switch the backend model, it’s a simple configuration update in the gateway; no code changes, procurement cycles, or repetitive security reviews required.” “After the company began using router provider LiteLLM, the costs of some advanced AI tasks such as coding fell by as much as 56% .” Put every model, agent, and MCP behind one API and one login. We…from litellm.ai

• 
  Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O2023 · github.com · ▲62

  I built this library because langchain was too bloated and I needed a simple abstraction to call multiple LLM APIs. litellm has two functions - completion(), embedding()

• 
  LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI, etc. API Calls2023 · litellm.ai · ▲5

  Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!

• 
  liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching2023 · github.com · ▲140

  Hello hacker news, I’m the maintainer of liteLLM() - package to simplify input/output to OpenAI, Azure, Cohere, Anthropic, Hugging face API Endpoints: https://github.com/BerriAI/litellm/ We’re open sourcing our implementation of liteLLM proxy: https://github.com/BerriAI/litellm/blob/main/cookbook/proxy-... TLDR: It has one API endpoint /chat/completions and standardizes input/output for 50+ LLM models + handles logging, error tracking, caching, streaming What can liteLLM proxy do? - It’s a central place to…

• 
  LLM Gateway2025 · llmgateway.io · ▲296

  I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

• 
  A fully open-source (Apache 2.0)implementation of llama2023 · github.com · ▲158

  We believe that AI should be fully open source and part of the collective knowledge. The original LLaMA code is GPL licensed which means any project using it must also be released under GPL. This "taints" any other code and prevents meaningful academic and commercial use. Lit-LLaMA solves that for good.

• 
  l1m.io2025 · l1m.io · ▲135

  The simplest API to get structured data from any LLM

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 29d ago · hemory.com

• 
  Resend▲1,325

  An entire collection of pre-built components with a much faster development experience.

  Dev tools · 2023 · resend.com

• 
  STORI AI▲1,316

  Your ideas become visually compelling branded social posts

  AI · 2023 · storiai.com

• 
  Kombai▲1,079

  A new AI model that you can prompt with UI designs

  AI · 2023 · kombai.com

• 
  User Persona Generator▲1,014

  Understand your audience without 50 interviews

  AI · 2023 · founderpal.ai

• 
  Lottielab▲869

  Create and ship lottie animations to sites and apps faster

  Dev tools · 2023 · lottielab.com

• 
  LLMs can generate valid JSON 100% of the time▲854

  Outlines is a Python library that focuses on text generation with large language models. Brandon and I are not LLM experts and started the project a few months ago because we wanted to understand better how the generation process works. Our original background is probabilistic, relational and symbolic programming. Recently we came up with a fast way to generate text that matches a regex (https://blog.normalcomputing.ai/posts/2023-07-27-regex-guide...). The basic idea is simple: regular expressions have an equivalent Deterministic-Finite Automaton (DFA) representation. We…

  AI · 2023 · github.com