Athina AI
Monitor LLMs and automatically detect hallucinations in prod
Athina AI launched on March 7, 2024 with 509 votes, #35 of 4,270 launches that month and more than 95% of that year's launches. The site was still online in September 2026, 2 years on.
In plain words
Athina AI is a monitoring platform that helps developers track large language models in production environments. It provides visibility into retrieval-augmented generation (RAG) pipelines and includes over 40 preset evaluation metrics designed to automatically detect hallucinations and measure model performance. The tool is intended for teams building and maintaining LLM applications who need to ensure reliability and accuracy in live deployments.
written from the facts on this page · September 2026
From the sources
Athina helps developers monitor and evaluate LLMs in production. Get complete visibility into RAG pipeline and 40+ preset eval metrics to detect hallucinations and measure performance
Athina is a collaborative AI development platform designed for your team to build, test and monitor AI features. Athina enables both non-technical & technical users to collaborate on experiments, evaluating datasets, managing prompts and flows. Compare datasets side-by-side and interact with your datasets in powerful ways using SQL. Humans are able to pick up on nuances that automated evals might not be able to. Athina is designed for human QA teams to work side-by-side with AI evaluations. Everything in Athina works with or without your code. Engineers are able to run prompts, flows, and evaluations programmatically, while non-technical users can use the UI. AI traces have different…from athina.ai
Does a similar job
all alternatives →
Open-source model and scorecard for measuring hallucinations in LLMs2023 · vectara.com · ▲65Hi all! This morning, we released a new Apache 2.0 licensed model on HuggingFace for detecting hallucinations in retrieval augmented generation (RAG) systems. What we've found is that even when given a "simple" instruction like "summarize the following news article," every LLM that's available hallucinates to some extent, making up details that never existed in the source article -- and some of them quite a bit. As a RAG provider and proponents of ethical AI, we want to see LLMs get better at this. We've published an open source model, a blog more thoroughly describing our methodology (and…
RagMetrics2025 · ragmetrics.ai · ▲13We built live AI evaluation to detect hallucinations, grounding issues, and drift as outputs are generated. This helps teams move GenAI from pilots into production.
LLM Sandbox by Dioptra2023 · dioptra.ai · ▲101Everything you need to evaluate & improve prompts and LLMs
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, March 2024
the whole month →
🌐 The Internet Computer! Free, Open-Source, and Self-Hostable. - HeyPuter/puter
Dev tools · 2024 · github.com
Microlaunch▲1,115Launch and get feedback on both the idea and product
Dev tools · 2024 · microlaunch.net
