LettuceDetect – Lightweight hallucination detector for RAG pipelines
Hallucinations are still a major blocker for deploying reliable retrieval-augmented generation (RAG) systems, especially in complex domains like medical or legal. Most existing hallucination detectors rely on full LLM inference (expensive, slow), or struggle with long-context inputs. I built LettuceDetect — an open-source, encoder-only framework that detects hallucinated spans in LLM-generated answers based on the retrieved context. No LLMs needed, and it much more efficiently. Highlights: - Token-level hallucination detection (unsupported spans flagged based on retrieved evidence) - Built…
LettuceDetect – Lightweight hallucination detector for RAG pipelines launched on April 19, 2025 with 10 votes, #3,208 of 7,818 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
LettuceDetect is an open-source hallucination detector for retrieval-augmented generation systems. It identifies unsupported spans in LLM-generated answers by comparing them against retrieved context using an encoder-only framework, without requiring LLM inference. Built on ModernBERT to handle long contexts up to 4K tokens, it achieves 79.22% F1 on benchmark tests. The tool is designed for high-stakes domains like medical and legal where reliable outputs are critical.
written from the facts on this page · September 2026
From the sources
Span-level grounding verification for RAG, code, and tool-grounded AI outputs. - KRLabsOrg/LettuceDetect
In the maker’s words, at launch
Hallucinations are still a major blocker for deploying reliable retrieval-augmented generation (RAG) systems, especially in complex domains like medical or legal. Most existing hallucination detectors rely on full LLM inference (expensive, slow), or struggle with long-context inputs. I built LettuceDetect — an…
Does a similar job
all alternatives →
Open-source model and scorecard for measuring hallucinations in LLMs2023 · vectara.com · ▲65Hi all! This morning, we released a new Apache 2.0 licensed model on HuggingFace for detecting hallucinations in retrieval augmented generation (RAG) systems. What we've found is that even when given a "simple" instruction like "summarize the following news article," every LLM that's available hallucinates to some extent, making up details that never existed in the source article -- and some of them quite a bit. As a RAG provider and proponents of ethical AI, we want to see LLMs get better at this. We've published an open source model, a blog more thoroughly describing our methodology (and…
Hallucination DetectorNov 2025 · hallucinationdetector.co · ▲9Real-time Hallucination Detection for LLMs
Demystifying Advanced RAG Pipelines2023 · github.com · ▲131I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…
Spanda – Sub-microsecond LLM epistemic uncertainty in RustSep 2026 · github.com · ▲13Zero-cost epistemic uncertainty quantification & hallucination detection for LLMs (90,000x faster than Semantic Entropy) - Adarshent/Spnda
ChainForge, a visual tool for prompt engineering and LLM evaluation2023 · chainforge.ai · ▲177Hi HN! We’re been working hard on this low-code tool for rapid prompt discovery, robustness testing and LLM evaluation. We’ve just released documentation to help new users learn how to use it and what it can already do. Let us know what you think! :)
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, April 2025
the whole month →
Hi everyone, I built PyXL — a hardware processor that executes a custom assembly generated from Python programs, without using a traditional interpreter or virtual machine. It compiles Python -> CPython Bytecode -> Instruction set designed for direct hardware execution. I’m sharing an early benchmark: a GPIO test where PyXL achieves a 480ns round-trip toggle — compared to 14-25 micro seconds on a MicroPython Pyboard - even though PyXL runs at a lower clock (100MHz vs. 168MHz). The design is stack-based, fully pipelined, and preserves Python's dynamic typing without static type restrictions.…
Dev tools · 2025 · runpyxl.com
The Unsure Calculator is an online tool that lets you calculate with numbers you’re not sure about.
Life & fun · 2025 · filiph.github.io
https://the-pocket.github.io/Tutorial-Codebase-Knowledge/
AI · 2025 · github.com
