nowfound

AI · alternatives · 2026

24 alternatives to Launching a new home-grown embedding LLM for RAG

Hi HN! Vectara is a "batteries included" retrieval augmented generation platform. You can upload your rich text documents like PDFs, HTML pages, word docs, etc, or semi-structured JSON and Vectara handles the text and metadata extraction, segmentation, vector embedding, and vector storage, and keyword storage. You can ask a question or perform a search in the UI or via our APIs and Vectara will automatically handle the vectorization, structured metadata filtering, vector+keyword retrieval, hybrid blending, and generative summarization of the results. We're focusing on building and…

Vectara is a retrieval augmented generation platform that handles document processing, vector embedding, and storage for users who want to build AI applications. Users upload documents like PDFs and Word files, and the… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Launching a new home-grown embedding LLM for RAG launched in 2023; newer entries below may have overtaken it.

  1. 1

    I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…

    2023 · github.com · its alternatives →

  2. 2IM

    As a grad student (and an ADHDer), I had trouble doing literature review systematically. To combat this, I made a website that finds similar papers using the meaning of the thing I am looking for. I used MixedBread's [^1] embedding model to generate vectors from the abstracts. I store and search similar vectors using Milvus [^2] and finally use Gradio [^3] to serve the frontend. I update the vector database weekly by pulling the metadata dataset from Kaggle [^4]. To speed up the search process on my free oracle instance, I binarise the embeddings and use Hamming distance as a metric. I would…

    2024 · papermatch.mitanshu.tech · its alternatives →

  3. 3

    REST API simplifies Retrieval Augmented Generation

    2024 · vectara.com · its alternatives →

  4. 4

    I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...

    2024 · embedding.io · its alternatives →

  5. 5
    RAGstack▲111

    Deploy a private ChatGPT alternative hosted within your VPC

    2023 · github.com · its alternatives →

  6. 6

    Hey there HN! We’re Antonio, Luca, and Yuhang, and we’re excited to introduce Fast GraphRAG, an open-source RAG approach that leverages knowledge graphs and the 25 years old PageRank for better information retrieval and reasoning. Building a good RAG pipeline these days takes a lot of manual optimizations. Most engineers intuitively start from naive RAG: throw everything in a vector database and hope that semantic search is powerful enough. This can work for use cases where accuracy isn’t too important and hallucinations are tolerable, but it doesn’t work for more difficult queries that…

    2024 · github.com · its alternatives →

  7. 7

    Not all improvements come from adding complexity — sometimes it's about removing it. PageIndex takes a different approach to RAG. Instead of relying on vector databases or artificial chunking, it builds a hierarchical tree structure from documents and uses reasoning-based tree search to locate the most relevant sections. This mirrors how humans approach reading: navigating through sections and context rather than matching embeddings. As a result, the retrieval feels transparent, structured, and explainable. It moves RAG away from approximate "semantic vibes" and toward explicit reasoning…

    2025 · github.com · its alternatives →

  8. 8

    After working with LLMs for long enough, I found myself wanting a lightweight utility for doing various small tasks to prepare inputs, locate information and create evaluators. This library is two things: a very simple model and utilities that inference it (eg. fuzzy deduplication). The target platform is CPU, and it’s intended to be light, fast and pip installable — a library that lowers the barrier to working with strings semantically. You don’t need to install pytorch to use it, or any deep learning runtimes. How can this be accomplished? The model is simply token embeddings that are…

    2024 · github.com · its alternatives →

  9. 9
    Vectorize▲246

    Build RAG pipelines that are optimized for your data.

    2024 · vectorize.io · its alternatives →

  10. 10

    TL;DR: Vector-based RAG performs poorly for many real-world applications like codebase chats, and you should consider 'language maps'. Part of our mission at Mutable.ai is to make it much easier for developers to build and understand software. One of the natural ways to do this is to create a codebase chat, that answer questions about your repo and help you build features. It might seem simple to plug in your codebase into a state-of-the-art LLM, but LLMs have two limitations that make human-level assistance with code difficult: 1. They currently have context windows that are too small to…

    2024 · twitter.com · its alternatives →

  11. 11

    Improved vector search with open-source AI embeddings editor

    2023 · its alternatives →

  12. 12CR

    Hey folks! I wanted to share one of the latest projects I worked on, called Vectara Portal. It's an application that allows users of our platform (https://vectara.com/) to create shareable pages that let you and other users (privately, if you wish) chat with, search through, or get answers from your documents. This began as a side project resulting from a question over lunch: "How do we put the power of our platform into the hands of users, without requiring them to code?" One hackathon weekend later, plus a few more days' worth of improvements, Portal was born. It's…

    2024 · portal.demo.vectara.com · its alternatives →

  13. 13

    Ragas is an open-source library for evaluating and testing RAG and other LLM applications. Github: https://docs.ragas.io/en/stable/, docs: https://docs.ragas.io/. Ragas provides you with different sets of metrics and methods like synthetic test data generation to help you evaluate your RAG applications. Ragas started off by scratching our own itch for evaluating our RAG chatbots last year. Problems Ragas can solve - How do you choose the best components for your RAG, such as the retriever, reranker, and LLM? - How do you formulate a test dataset…

    2024 · github.com · its alternatives →

  14. 14

    The Virtual Feature Store. Turn your existing data infrastructure into a feature store. - featureform/featureform

    2021 · github.com · its alternatives →

  15. 15

    Author here. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days. It's very quick and easy to set up and totally self-contained and self-hosted. You can easily add new models to it by simply adding the HuggingFace URL to the GGML format model weights. Two models are included by default, and these are automatically downloaded the first time it's run. It lets you not only submit text strings and get back the embeddings, but also to compare two…

    2023 · github.com · its alternatives →

  16. 16

    We’ve recently open-sourced Model2vec, a method to distill sentence transformers into static embeddings that outperform all previous approaches by a large margin on MTEB. Our new models set a new state-of-the-art for static embeddings. Main features: - Our best model (potion-base-8M) has only 8M parameters, which is ~30mb on disk - Inference is ~500x faster than the distilled base model (bge-base), on a CPU - New models can be distilled in 30 seconds on a CPU without requiring a dataset - just a vocabulary - Numpy-only inference: The packaged can be install the package with minimal…

    2024 · github.com · its alternatives →

  17. 17

    Rank a list of documents according to their relevance to a query primarily and your custom instructions secondarily. We evaluated the model on instructions for recency, document type, source, and metadata, and it can generalize to other instructions as well. The reranker supports multilinguality. Th

    2025 · docs.contextual.ai · its alternatives →

  18. 18VD

    Discover, evaluate, and access relevant embeddings in your go-to framework. Skip all the infra for scraping, cleaning, indexing, and updating high-quality embeddings.

    2023 · embedding.store · its alternatives →

  19. 19

    Dive deep into AI Retrieval Augmented Generation (RAG)

    2024 · ragaboutit.com · its alternatives →

  20. 20QP

    Hey HN! We've just launched Quilt, a robust RAG (Retrieval-Augmented Generation) UI that revolutionizes how you interact with your documents. Key features: - Multi-user setup with private/public document collections - Advanced hybrid RAG pipeline combining full-text & vector search - Smart citations with in-browser PDF preview and highlights - Fully customizable settings and prompts through the UI Making an account is free, no need to even use a strong password: this is only to ensure your documents are separate from the rest. We're keen to hear your thoughts and feedback. What features…

    2024 · quilt.fly.dev · its alternatives →

  21. 21
  22. 22

    Hi HN! I lead product at Vectara and we've just released a new LLM in our platform that outperforms GPT4 and Gemini 1.5 Pro on RAG tasks. Vectara is a Retrieval Augmented Generation (RAG) platform primarily deployed as a SaaS service which includes a generous free tier so you can try it for free. The way we've been able to offer a "better but cheaper" is that we focus a lot of our attention on taking smaller models (which can be hosted in a cost efficient way) and fine tuning them to specific tasks: in this case RAG. This ends up with a model that is less capable of arbitrary tasks like…

    2024 · vectara.com · its alternatives →

  23. 23

    Hi HackerNews, Lately, I have seen an explosion in posts offering paid APIs/services to get unstructured data into LLMs (i.e. langchain extract, ragflow, unstructured, unstract, just to name a few) and I have been largely disappointed by them, either because they fail to implement multimodal support, fail to give good context for "really tricky" PDFs / Word docs / Powerpoints, or are just plain difficult to use. In light of all these posts I figured I'd share my solution that has been working smoothly for me and my clients. I put it up on GitHub for free so you can check it…

    2024 · github.com · its alternatives →

  24. 24

    Built an automated system to run a deep search of ArXiv and carefully find all the precise papers that exist on a complex topic. It's different from simple RAG because it searches, classifies, and adapts based on relevant papers it uncovers, and then continues until it finds every paper on a topic (trying to mimic the human research process). Benchmarked 10x higher accuracy and total retrieval compared to Google Scholar for a median search (whitepaper on website). Also knows when it is complete, and misses virtually nothing (< 3% or so, once it's converged). Website has a free trial and a…

    2024 · app.undermind.ai · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →