Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O

In plain words

Litellm is a lightweight library that provides a simplified interface for calling multiple large language model APIs, including OpenAI, Cohere, and Azure. It offers two core functions: completion() for generating text and embedding() for creating embeddings. Designed as a leaner alternative to more complex frameworks, litellm enables developers to work with different LLM providers through a standardized, straightforward abstraction layer without unnecessary overhead.

written from the facts on this page · September 2026

From the sources

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] - BerriAI/litellm

• 
  liteLLM2023 · litellm.ai · ▲120

  One library to standardize all LLM APIs

• 
  LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI, etc. API Calls2023 · litellm.ai · ▲5

  Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!

• 
  liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching2023 · github.com · ▲140

  Hello hacker news, I’m the maintainer of liteLLM() - package to simplify input/output to OpenAI, Azure, Cohere, Anthropic, Hugging face API Endpoints: https://github.com/BerriAI/litellm/ We’re open sourcing our implementation of liteLLM proxy: https://github.com/BerriAI/litellm/blob/main/cookbook/proxy-... TLDR: It has one API endpoint /chat/completions and standardizes input/output for 50+ LLM models + handles logging, error tracking, caching, streaming What can liteLLM proxy do? - It’s a central place to…

• 
  Wordllama – Things you can do with the token embeddings of an LLM2024 · github.com · ▲370

  After working with LLMs for long enough, I found myself wanting a lightweight utility for doing various small tasks to prepare inputs, locate information and create evaluators. This library is two things: a very simple model and utilities that inference it (eg. fuzzy deduplication). The target platform is CPU, and it’s intended to be light, fast and pip installable — a library that lowers the barrier to working with strings semantically. You don’t need to install pytorch to use it, or any deep learning runtimes. How can this be accomplished? The model is simply token embeddings that are…

• 
  LLM Gateway2025 · llmgateway.io · ▲296

  I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang... anything that speaks /v1/chat/completions. Single Go binary, one YAML config file, no infrastructure. It does the things you'd expect from this kind of gateway... semantic routing via a three-layer cascade (keyword heuristics, embedding similarity, LLM classifier) that picks the best model when clients omit the model field, weighted round-robin load balancing across local inference servers with health checks and failover. The part I think is most…

• 
  l1m.io2025 · l1m.io · ▲135

  The simplest API to get structured data from any LLM

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  Clustr▲1,526

  The reality check for your crypto portfolio

  Commerce · 2023 · clustr.io

• 
  Workout.lol – a web app to easily create a workout routine▲993

  Hey everyone, I here is a small open-source project I've been working on lately. I'd love to hear your thoughts and improvement ideas :) GitHub: [github.com/Vincenius/workout-lol](https://github.com/Vincenius/workout-lol)

  Dev tools · 2023 · workout.lol

• HN
  Hacker News user blogroll▲937

  I saw this [0] pretty cool thread by user revskill, and wanted a quicker way to search through it, but also to keep them all in one place so I can read them at my leisure whenever I get time. Right now is like 60 lines of Ruby using Nokogiri, but I will certainly look into it further down the line and improve the list. There's a cronjob checking the thread every 12 hours but I will eventually shut that down and it will become static after that. There are some really awesome blogs in there. I really recommend going through the list, it made my day. [0] "Could you share your personal blog…

  Life & fun · 2023 · dm.hn

• 
  Lazy▲928

  One ⌘ shortcut to capture anything straight to Notion

  AI · 2023 · lazy.so

• 
  Anytype - Public Beta▲907

  Anytype is built on the open-source AnySync protocol: a local-first protocol based on CRDTs. Users of Anytype can create spaces - graph-based databases with modular UI. Each space has unique access rights. Today, Anytype's beta is in single-player mode. Multiplayer mode, which will support local-first collaboration between multiple users, will be launched in the first half of 2024. Anytype fulfils the seven ideals of local first software from here - https://www.inkandswitch.com/local-first/ , our team felt these things are important to all of us: • No spinners: your work…

  Commerce · 2023 · anytype.io

• 
  n8n 1.0▲786

  Workflow automation for technical people

  Dev tools · 2023 · n8n.io