Alternatives
Products that do what liteLLM does
One library to standardize all LLM APIs
- 1LO
Needed a simple way to call multiple LLM providers. LiteLLM provides 2 functions - `completion` and `embedding`; and guarantees consistent input/output formats across all providers. That's it!
2023 · litellm.ai
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
Trace LLM requests + costs with OpenTelemetry monitoring
Oct 2025
- 13
- 14
- 15LC
Hey, folks here is a peek into Jujutsu. We at Poozle are working with hundreds of APIs and it has been always frustrating to 1. Search the API in the documentation or ask ChatGPT 2. Then copy it to the postman and understand/test the API 3. Generate code to integrate into the codebase We thought how about having all of this at one place. We currently fine-tuned LLM on public REST APIs to reduce hallucination and then combined it with ChatGPT and Postman. I look forward to feedback, feature requests and discussions!
2023 · loom.com
- 16AL
Hi HN! I wanted to share my freshly finished open-source project. It is similar to ChatGPT Code Interpreter, but the interpreter runs locally and it can use open-source models like Llama 2. It allows you to work with sensitive data without uploading it to the cloud. Either you use a local LLM (like Llama 2), or an API (like GPT-4). For the latter case, there is an approval mechanism in the UI, which separates your local data from the remote services. I would be very interested in your valuable feedback!
2023 · github.com
- 17
- 18AC
Hi HN, we're Ashpreet, Eli and Yash and we're excited to share Phidata: a collection of AI Apps built with open-source tools. While helping teams build AI products, we built templates for spinning up LLM Apps quickly. Today we're open-sourcing our templates for building: - RAG LLM Apps - Autonomous LLM Apps - Multimodal LLM Apps - Data Engineering LLM Apps Templates are built with FastApi for serving, Streamlit for prototyping, PgVector for vectors and PosgreSQL for storage. Run them locally using docker and in production on AWS - with 1 command. - Github:…
2023 · github.com
- 19LO
Hey HN, Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone. The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of…
2024
- 20LS
LLMStack is a low-code platform that can be used to build LLM apps, chatbots and integrate AI experiences into existing products/workflows. It comes with everything out of the box that one needs to build LLM apps locally. It can also be used in a multi-tenant setting, making it available for everyone to use in an enterprise. Some highlights of the platform: - Chain multiple LLM models allowing for complex pipelines - Includes a vector database and necessary connectors to help enrich LLM responses with private data - App templates tailored to specific use cases to quickly build LLM apps…
2023 · github.com
- 21RA
Hey, we're excited to share ReLLM! ReLLM provides developers with an API to quickly add permission sensitive context for LLM's such as chatGPT. ReLLM goes a step further and also encrypts all of your plain text data at rest. The Motivation: We built ReLLM, because while developing a different application we realized there was not a great way to provide our users context for their GPT questions that was limited to only the data they are allowed to see. ReLLM is fully functional with 2 API endpoints. One to embed data, and one to invoke chat with GPT.
2023 · rellm.ai
- 22LT
Introducing Lailaims: An open source client-side web app that lets you test multiple LLM providers (GPT-4, Claude, Gemini, Mistral, DeepSeek) side-by-side in one interface. Your data stays private - everything runs locally in your browser! Video example: https://vimeo.com/1084976999/8687b63f85
2025 · lailaims.pages.dev
- 23CF
Over this past month I had the idea to build a 100% open-source MIT-licensed tool to simplify sharing code with LLMs, without the vendor lock-in you get from most SDKs. Right now, it’s way too hard to export your data or work freely with models like o1 PRO or Grok 3, especially since they don’t even have API access. So I built OpenRepoPrompt, an open-source tool from wildberry-source that serializes files and folders into XML for LLMs. I coded/designed from 12PM -> 11PM on Saturday and 8AM -> 11PM on Sunday. There are still tons of features missing (I'm working on better file filtering…
2025 · github.com
- 24LO
Hi HN! I built LLM OneStop (https://www.llmonestop.com), a unified interface for accessing multiple AI language models in one place. The main problem I wanted to solve: constantly switching between different AI platforms, managing multiple subscriptions, and losing conversation context when comparing outputs across models. Key features: Switch between GPT-4, Claude, Gemini, Llama, and other models mid-conversation Compare responses side-by-side Single interface instead of juggling multiple tabs/subscriptions Free tier available to try it out (no credit card needed) "Connect"…
Nov 2025 · llmonestop.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →