Alternatives
Products that do what Demystifying Advanced RAG Pipelines does
I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8AO
I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference. Using Llama 3, Mistral, and Gemini, this setup allows secure, private NLP on your own machine. Perfect for researchers, data scientists, and developers who need to process sensitive data without cloud dependencies. Built with Llama C++, LangChain, and Streamlit, it supports quantized models and provides a sleek UI for document processing. Check it out, contribute, or suggest new features!
2024 · github.com
- 9AW
I've been presenting at local meetups about Context Engineering, RAG, Skills, etc.. I even have a vbrownbag coming up on LinkedIn about this topic so I figured I would make a basic example that uses bedrock so I can use it in my talks or vbrownbags. Hopefully it's useful.
Apr 2026 · github.com
- 10BL
Hello everyone! I am Jan, CTO and one of the creators of Pathway, the real-time data processing framework. I’m excited to share Pathway’s ready-to-use AI Pipelines, configurable with just YAML! These frameworks offer out-of-the-box solutions for AI search, RAG, and more—optimized for real-time indexing and in-memory processing. What makes it simple? YAML templates! The pipeline templates are fully customizable using YAMLs to fit your needs, from changing the data sources to the choice of the LLM model, all without touching Pathway’s Python code. Thanks to the Pathway data processing engine,…
2024 · pathway.com
- 11MI
Hi HN! I lead product at Vectara and we've just released a new LLM in our platform that outperforms GPT4 and Gemini 1.5 Pro on RAG tasks. Vectara is a Retrieval Augmented Generation (RAG) platform primarily deployed as a SaaS service which includes a generous free tier so you can try it for free. The way we've been able to offer a "better but cheaper" is that we focus a lot of our attention on taking smaller models (which can be hosted in a cost efficient way) and fine tuning them to specific tasks: in this case RAG. This ends up with a model that is less capable of arbitrary tasks like…
2024 · vectara.com
- 12PR
Hi HN, While building RAG agents, I noticed a lot of token budget was wasted on formatting overhead (HTML tags, JSON structure, whitespace). Existing solutions felt too heavy (often requiring torch/transformers), so I wrote this lightweight, zero-dependency library to solve it. It includes strategies for context packing, PII redaction, and tool output compression. Benchmarks show it can save ~15% of tokens with negligible latency overhead (<0.5ms). Happy to answer any questions!
Dec 2025 · github.com
- 13
Smarter RAG with Agentic Retrieval & Context-Aware MCP
Sep 2025
- 14
- 15IM
When your embedding provider is good, but could be better for your use-case.
2024 · zoplabs.com
- 16OO
Hi HN, I built OpenFable, an open-source retrieval engine that implements the FABLE algorithm (https://arxiv.org/abs/2601.18116) for RAG pipelines. I'm using it in another project and thought that others might benefit. Most RAG systems chunk documents into flat segments and retrieve by vector similarity. This works for simple lookups but breaks when answers span multiple sections, when relevant content is buried in a subsection, or when you need to control how many tokens you're sending to an LLM. OpenFable takes a different approach: when you ingest a document, it uses…
Apr 2026 · github.com
- 17AO
Hi, We are building an open-source framework for loading and structuring LLM context to create accurate and explainable LLM answers using knowledge graphs and vector stores. We built the tool with four main concepts in mind: 1. Loader -> uses dlt in the backend to load and structure the data 2. Cognify step -> creates a graph with summaries, labels and factoids that are interconnected across the documents and stored as a representation in the vector store 3. Optimizer -> Uses DSPy to optimize LLM queries, and we plan to extend it to most of the knobs we can turn, like chunking etc. 4. Search…
2024 · github.com
- 18TA
In this post, we document the results of some experiments comparing vanilla Graph RAG (just a single pass of text2cypher) vs. a router agent Graph RAG approach that can call vector search tools alongside text2cypher. The routing agent uses an LLM to decide which vector search tool to call, depending on the terms identified in the question, and it works quite well. The results show that recent frontier LLMs like `gpt-4.1` and the trusty workhorse `gemini-2.0-flash` produce great quality Cypher reliably and reproducibly, with some prompt engineering to ensure that the graph schema is formatted…
2025 · blog.kuzudb.com
- 19PP
Hello HN! We’ve been working hard on Vanna, our RAG framework for SQL generation and we’ve been updating our documentation. Please have a look — we have a ton of Jupyter notebooks for any combination of desired use cases. At it’s heart, we have abstractions that help you: - “train” a RAG “model” i.e. add metadata for the retrieval augmentation system to reference when constructing the LLM prompt (yes, we know that the terms “train” and “model” are somewhat confusing and we’re open to changing those terms if you can suggest better ones) - “ask” questions, which will generate SQL, run it,…
2023 · github.com
- 20
- 21PA
We're excited to release PaperQA2, an open source RAG library specialized to work with the scientific literature. We've seen some really compelling results with it (https://paper.wikicrow.ai), like superhuman performance at question answering and summarization when compared with expert scientists. PaperQA2 is a major overhaul of our prior PaperQA system, it includes automatically obtained rich metadata for each paper, a CLI to work with local papers directly, a local full-text search engine for keywords searches over PDF files, a state-of-the-art algorithm for LLM-based re-ranking…
2024 · github.com
- 22
- 23AE
Hey folks, Elias here. Excited to unveil my latest project. Why I Built This: Traditional keyword search isn't cutting it. I've used LLM-embeddings to provide more nuanced, relevant results. How It Works: LLM-embedding similarity on curated datasets for semantically similar results. No need to iterate over keywords any more. Current Datasets: - YC Companies - Show HN Posts, - Ask HN Posts - ProductHunt Startups - Github Top 200k Repos Use Cases: - Validate a product idea's existence - Check if someone already Asked HN something - Have fun - search random terms and see what pops up Want to…
2023 · payperrun.com
- 24QA
I've built an aggregator for free Large Language Models that provides answer generation services. The project aims to make powerful AI accessible to everyone as I believe free LLMs may become a significant trend. Currently supported models: Qwen Series - Qwen 32B: Alibaba's 32B parameter model for Chinese/English content - Qwen 2.5 7B Instruct: Lightweight, responsive daily assistant DeepSeek Series - DeepSeek V3 0324: Specialized in long-text and domain knowledge - DeepSeek R1: Focused on mathematical and logical reasoning Google Series - Gemini 2.5 Pro: Google's latest multimodal…
2025 · qwq32.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →