Evidently AI

In plain words

Evidently AI is an open-source framework that helps developers evaluate, test, and monitor applications powered by large language models. It includes over 100 built-in checks covering tasks from classification to retrieval-augmented generation, supporting both offline evaluations and live monitoring. Users can add custom metrics and LLM judges to fit their specific needs. The tool is designed for developers building AI-powered applications who need systematic ways to assess and track performance.

written from the facts on this page · September 2026

From the sources

Evidently is an open-source framework to evaluate, test and monitor AI-powered apps. 📚 100+ built-in checks, from classification to RAG. 🚦 Both offline evals and live monitoring. 🛠 Easily add custom metrics and LLM judges.

Ensure your AI is production-ready. Test LLMs and monitor performance across AI applications, RAG systems, and multi-agent workflows. Open-source.

You can’t trust what you don’t test. Make sure your AI is safe, reliable and ready — on everyfrom evidentlyai.com

• 
  Evidently AI2021 · evidentlyai.com · ▲299

  Open-source monitoring for machine learning models

• 
  ItoAug 2026 · ito.ai · ▲449

  I'm Evan and I made Ito.ai It's code review that actually runs your code. The result is that it finds more bugs with a smaller false positive rate. You get screenshots, videos, and run logs. I built Ito because manual verification sucks and I thought I could automate it. I've been a professional developer for 15 years and now more than ever, I'm just spending time making sure things work. I looked into all of the other agentic testing tools that click around a url you give them and frankly, they sucked. They just didn't work. I figured to be able to actually testing things you need to run…

• 
  Langtrace AI2024 · langtrace.ai · ▲119

  Improve your LLM apps with open-source observability tool

• 
  AgentaNov 2025 · agenta.ai · ▲362

  Open-source prompt management & evals for AI teams

• 
  Promptly AI2024 · ▲376

  No-code platform for generative AI apps and workflows

• 
  Confident AI2024 · confident-ai.com · ▲86

  all-in-one LLM evaluation platform

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 16d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  Wordware▲9,848

  Your tool for building AI agents with natural language

  AI · 2024 · wordware.ai

• 
  If YouTube had actual channels▲2,741

  If Youtube had actual channels.

  Life & fun · 2024 · ytch.xyz

• 
  Me.bot▲1,627

  The inspiring companion for your life

  AI · 2024 · me.bot

• 
  Upmetrics AI▲1,197

  Business plan & financial forecast using AI

  Work · 2024 · upmetrics.co

• 
  Jupitrr AI▲1,195

  Jupitrr AI turns raw talking videos into scroll-stopping content for coaches and consultants. Research, script, record, edit, and publish in one app.

  AI · 2024 · jupitrr.com

• 
  InstantDB – A Modern Firebase▲1,145

  Hey there HN! We’re Joe and Stopa, and today we’re open sourcing InstantDB, a client-side database that makes it easy to build real-time and collaborative apps like Notion and Figma. Building modern apps these days involves a lot of schleps. For a basic CRUD app you need to spin up servers, wire up endpoints, integrate auth, add permissions, and then marshal data from the backend to the frontend and back again. If you want to deliver a buttery smooth user experience, you’ll need to add optimistic updates and rollbacks. We do these steps over and over for every feature we build, which can…

  Dev tools · 2024 · github.com