DeepEval – Evaluation and Unit Testing for LLMs
The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.
DeepEval – Evaluation and Unit Testing for LLMs launched on September 25, 2023 with 18 votes, #1,402 of 4,228 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 3 years on.
In plain words
DeepEval is an evaluation and unit testing framework designed for large language models. It enables developers to test and validate LLM outputs systematically, similar to traditional software testing. The tool is built for machine learning engineers and developers who need to ensure their language model applications perform reliably. DeepEval stands out as a specialized testing solution addressing the challenge of measuring LLM quality and consistency across different prompts and use cases.
written from the facts on this page · September 2026
Does a similar job
all alternatives →
I implemented evals metrics for LLMs that runs locally on your machine2023 · github.com · ▲22The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.
DeepEval – Unit Testing for LLMs (Open Science)2023 · github.com · ▲6The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.
TensorZero2025 · github.com · ▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗
