Dev tools · alternatives · 2026

24 alternatives to ragapi – an API for using LLMs on your own data

ragapi is an API tool that lets developers use large language models with their own data. Launched in September 2023, it's designed for teams building applications that need to combine LLM capabilities with custom… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. ragapi – an API for using LLMs on your own data launched in 2023; newer entries below may have overtaken it.

1
Tilores Identity RAG▲323
Customer data search, unification and retrieval for LLMs
2024 · tilores.io · its alternatives →
2
LLMWare▲358
Dev tool to make AI apps to deploy privately or locally
2024 · llmware.ai · its alternatives →
3
Ragas – Open-source library for evaluating RAG pipelines▲121
Ragas is an open-source library for evaluating and testing RAG and other LLM applications. Github: https://docs.ragas.io/en/stable/, docs: https://docs.ragas.io/. Ragas provides you with different sets of metrics and methods like synthetic test data generation to help you evaluate your RAG applications. Ragas started off by scratching our own itch for evaluating our RAG chatbots last year. Problems Ragas can solve - How do you choose the best components for your RAG, such as the retriever, reranker, and LLM? - How do you formulate a test dataset…
2024 · github.com · its alternatives →
4
Turn any website into a knowledge base for LLMs▲305
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
5
RAGstack▲111
Deploy a private ChatGPT alternative hosted within your VPC
2023 · github.com · its alternatives →
6
LiquidIndex 2.0▲134
I'm building LiquidIndex, an RAG API service that makes it easy to add personalized context to AI apps. Instead of building a whole system to upload, process, and search through a user’s files or notes, you just call a few APIs. It handles the hard parts - like connecting to Notion or Google Drive, breaking the data into usable pieces, and making it searchable. Then, when you want to answer a question using that data, you just query it, and it gives you the most relevant results - optionally with an LLM-generated answer. No pipelines, no infrastructure, no headaches. Here are the core APIs:…
2025 · liquidindex.dev · its alternatives →
7
RAGaaS▲75
The API for building production-ready AI apps with your data
2025 · sitegpt.ai · its alternatives →
8
My LLM CLI tool can run tools now, from Python code or plugins▲529
LLM 0.26 is out with the biggest new feature since I started the project: support for tools. You can now use the LLM CLI tool—and Python library—to grant LLMs from …
2025 · simonwillison.net · its alternatives →
9
Agents.json – OpenAPI Specification for LLMs▲212
Hey HN, we’re building an open specification that lets agents discover and invoke APIs with natural language, built on the OpenAPI standard. agents.json clearly defines the contract between LLMs and API as a standard that's open, observable, and replicable. Here’s a walkthrough of how it works: https://youtu.be/kby2Wdt2Dtk?si=59xGCDy48Zzwr7ND. There’s 2 parts to this: 1. An agents.json file describes how to link API calls together into outcome-based tools for LLMs. This file sits alongside an OpenAPI file. 2. The agents.json SDK loads agents.json files as tools for an LLM that…
2025 · github.com · its alternatives →
10
AnythingLLM – Open-Source, All-in-One Desktop AI Assistant▲368
Hey HN! This is Tim from AnythingLLM (https://github.com/Mintplex-Labs/anything-llm). AnythingLLM is an open-source desktop assistant that brings together RAG (Retrieval-Augmented Generation), agents, embeddings, vector databases, and more—all in one seamless package. We built AnythingLLM over the last year iterating and iterating from user feedback. Our primary mission is to enable people with a layperson understanding of AI to be able to use AI with little to no setup for either themselves, their jobs, or just to try out using AI as an assistant but with *privacy by…
2024 · github.com · its alternatives →
11
Demystifying Advanced RAG Pipelines▲131
I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…
2023 · github.com · its alternatives →
12
Llama2 Embeddings FastAPI Server▲178
Author here. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days. It's very quick and easy to set up and totally self-contained and self-hosted. You can easily add new models to it by simply adding the HuggingFace URL to the GGML format model weights. Two models are included by default, and these are automatically downloaded the first time it's run. It lets you not only submit text strings and get back the embeddings, but also to compare two…
2023 · github.com · its alternatives →
13
LLMWare – Small Specialized Function Calling 1B LLMs for Multi-Step RAG▲51
Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…
2024 · github.com · its alternatives →
14
How we leapfrogged traditional vector based RAG with a 'language map'▲162
TL;DR: Vector-based RAG performs poorly for many real-world applications like codebase chats, and you should consider 'language maps'. Part of our mission at Mutable.ai is to make it much easier for developers to build and understand software. One of the natural ways to do this is to create a codebase chat, that answer questions about your repo and help you build features. It might seem simple to plug in your codebase into a state-of-the-art LLM, but LLMs have two limitations that make human-level assistance with code difficult: 1. They currently have context windows that are too small to…
2024 · twitter.com · its alternatives →
15
Dabarqus▲92
Add PDF chat to your LLM app in less than 9 lines of code
2024 · dabarqus.com · its alternatives →
16
RAGatouille, a simple lib to use&train top retrieval models in RAG apps▲15
Hey HN! If you’re at all interested in LLMs/LLM-apps, you’ve probably heard of RAG: Retrieval-Assisted Generation, i.e. retrieving relevant documents to give to your LLM as context to answer user queries. Today, I’m releasing RAGatouille v0.0.1, whose aim is to make it as easy as can be to improve your RAG pipelines by leveraging state-of-the-art Information Retrieval research. As of right now, there’s quite a big gap between common everyday practice and the IR literature, and a lot of the gap is because there just aren’t good ways to quickly try out and leverage SotA IR techniques.…
2024 · github.com · its alternatives →
17
Ragas – Open-source library for evals and testing RAG systems▲15
Ragas is an open-source library designed for evaluating and testing RAG (Retrieval-Augmented Generation) and other LLM applications. It offers a diverse set of metrics and methods, including synthetic test data generation, to help you assess your RAG applications. Ragas was initially developed to address our own needs for evaluating RAG chatbots last year. ### Problems Ragas Can Solve: - How can you select the best components for your RAG, such as the retriever, reranker, and LLM? - How can you create a test dataset without incurring significant expenses and time? We believe there's a need…
2024 · github.com · its alternatives →
18TL
Tiny LLMs – Browser-based private AI models for a wide array of tasks▲142
2023 · tinyllms.vercel.app · its alternatives →
19
Verta RAG System▲84
Go from dataset to custom RAG prototype in 5 minutes
2024 · cloudera.com · its alternatives →
20
l1m.io▲135
The simplest API to get structured data from any LLM
2025 · l1m.io · its alternatives →
21
LLM Explorer▲152
Find your best LLM for a local inference
2023 · its alternatives →
22
SapienAPI▲87
Reinventing product discovery using LLMs
2023 · its alternatives →
23
Use LLMs to Interact with APIs▲35
Recently featured in a LangChain blog https://blog.langchain.dev/empowering-development-with-flowt... , use LLMs to construct an API first runnable workflow with an IDE experience.
2024 · github.com · its alternatives →
24
RAGstack – private ChatGPT for enterprise VPCs, built with Llama 2▲84
Hey hacker news, We’re the cofounders at Psychic.dev (http://psychic.dev) where we help companies connect LLMs to private data. With the launch of Llama 2, we think it’s finally viable to self-host an internal application that’s on-par with ChatGPT, so we did exactly that and made it an open source project. We also included a vector DB and API server so you can upload files and connect Llama 2 to your own data. The RAG in RAGstack stands for Retrieval Augmented Generation, a technique where the capabilities of a large language model (LLM) are augmented by retrieving information…
2023 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →