Deepchecks LLM Evaluation

What it does

Continuously validate LLM-based applications including LLM hallucinations, performance metrics, and potential pitfalls throughout the entire lifecycle from pre-deployment and internal experimentation to production.🚀

Comprehensive guide to evaluating LLMs. Metrics, fairness, safety, deployment best practices & frameworks

Large Language Models (LLMs) have emerged as pivotal technologies in the rapidly evolving landscape of artificial intelligence, revolutionizing how we interact with digital systems-captivating the imagination of researchers, developers, businesses, and society. From automating customer service to enhancing natural language understanding and generating human-like text, the applications of LLMs span an increasingly broad and diverse range of fields. This exponential growth in LLM applications underscores a burgeoning interest in these technologies, not only for their potential to streamline and enhance various processes but also for their ability to drive innovation in areas previously…from deepchecks.com

• 
  Langfuse2023 · langfuse.com · ▲771

  Open source tracing and analytics for LLM applications

• 
  Langtrace AI2024 · langtrace.ai · ▲119

  Improve your LLM apps with open-source observability tool

• 
  LLM StatsOct 2025 · llm-stats.com · ▲293

  I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

• 
  Deepmark AI2023 · github.com · ▲97

  LLM benchmarking tool for task-specific metrics on your data

• 
  Confident AI2024 · confident-ai.com · ▲86

  all-in-one LLM evaluation platform

• 
  I implemented evals metrics for LLMs that runs locally on your machine2023 · github.com · ▲22

  The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Flowla▲1,119

  Digital sales rooms that wow buyers

  Growth · 2023 · flowla.com

• 
  Passionfroot Discovery▲962

  Discover & book top creators to promote your product

  Growth · 2023 · passionfroot.me

• 
  Re:catch▲939

  If Google Form & Calendly had a baby

  Growth · 2023 · recatch.cc

• 
  Pitch 2.0▲886

  Create, share and analyze presentations faster than ever

  Work · 2023 · pitch.com

• 
  LeadDelta 3.0▲883

  CRM built for modern teams & creators powered by AI

  AI · 2023 · leaddelta.com

• 
  SpeedVitals▲829

  Hi HN, I’m Kashish, one of the co-founders of SpeedVitals, a platform for testing & monitoring website performance with a major emphasis on Core Web Vitals. Until now, our platform has only focused on Synthetic/Lab testing, such as Lighthouse tests and TTFB tests. But now, we have developed a Real-User Monitoring platform that doubles up as a Web Analytics tool. One major feature we have that most RUM tools lack is Performance Audits. Just like Lighthouse audits work on Lab test data, our audits work across all the real-user visits and gives suggestions on what task to prioritize first.…

  Dev tools · 2023 · speedvitals.com