RagMetrics

What it does

Building with LLMs? Prove your product works.LLM Judge helps you define what “good” looks like, then runs the tests automatically—saving you time and giving you instant insights you can share with users, teams, or investors.

Evaluate GenAI quality with confidence. RagMetrics provides LLM evaluation, hallucination detection, AI agent monitoring, and real-time performance metrics for AI teams. Compare Claude, GPT-4, and custom models.

RagMetrics validates GenAI agent responses, detects hallucinations, and accelerates deployment with rapid GenAI evaluations, scoring, and monitoring. Over 45% of companies are stuck in pilot mode, waiting on validation. Only 6% of lagging companies ship new AI features under 3 months. Integrates with all commercial LLM Foundational models, or it can be configured to work with your own. With over preconfigured criteria and flexibility to configure your own, you can measure what is relevant for you and your system. Monitor and trace the behaviors of your agents. Detect if they start to hallucinate or drift from their mandate. Choose the implementation model that fits your needs -- cloud,…from ragmetrics.ai

• 
  Athina AI2024 · athina.ai · ▲509

  Monitor LLMs and automatically detect hallucinations in prod

• 
  LLM StatsOct 2025 · llm-stats.com · ▲293

  I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

• 
  Open-source model and scorecard for measuring hallucinations in LLMs2023 · vectara.com · ▲65

  Hi all! This morning, we released a new Apache 2.0 licensed model on HuggingFace for detecting hallucinations in retrieval augmented generation (RAG) systems. What we've found is that even when given a "simple" instruction like "summarize the following news article," every LLM that's available hallucinates to some extent, making up details that never existed in the source article -- and some of them quite a bit. As a RAG provider and proponents of ethical AI, we want to see LLMs get better at this. We've published an open source model, a blog more thoroughly describing our methodology (and…

• 
  traceAIApr 2026 · github.com · ▲273

  Open-source LLM tracing that speaks GenAI, not HTTP.

• 
  RagaAI Catalyst2025 · raga.ai · ▲125

  Observe, evaluate and debug AI agents

• 
  Argmin AIJul 2026 · argminai.com · ▲32

  Hey, HN community! We've built Argmin AI after shipping LLM features where the demo worked, then the bill and latency got unpredictable in production. Prompts expanded, context grew, retrieval got noisy, retries appeared, and agent workflows added loops. Argmin AI optimizes LLM-related expenses as a system: 1. prompt and context efficiency 2. model selection and routing 3. RAG inefficiencies and caching opportunities 4. agent workflows (tool calls, retries, loop control) Changes are validated with evals and guardrails (tests, gates, judges), tailored to your quality definition and goals.…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• IM
  I'm an airline pilot – I built interactive graphs/globes of my flights▲1,539

  Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!

  Life & fun · 2025 · jameshard.ing

• 
  Chronicle: Cursor for Slides▲1,212

  Stunning presentations with AI. No design skills required.

  AI · 2025 · chroniclehq.com

• 
  Bubble for native mobile apps (beta)▲1,026

  Build native mobile apps for iOS and Android without code.

  Dev tools · 2025 · bble.io

• 
  Twenty▲989

  Build your Enterprise CRM with an AI-friendly SDK

  Dev tools · 2025 · twenty.com

• 
  Pally - AI Relationship Management▲949

  All your connections, across all your socials.

  AI · 2025 · pally.com

• 
  Workout.cool – Open-source fitness coaching platform▲827

  I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…

  Dev tools · 2025 · github.com