I implemented evals metrics for LLMs that runs locally on your machine

In plain words

This is a local evaluation metrics tool for large language models that runs on users' own machines. It's designed for developers and researchers who need to assess LLM performance without relying on external services. The tool offers the advantage of privacy and offline functionality, allowing users to evaluate their models directly on their hardware rather than sending data to third-party platforms.

written from the facts on this page · September 2026

• 
  DeepEval – Evaluation and Unit Testing for LLMs2023 · github.com · ▲18

  The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.

• 
  Confident AI2024 · confident-ai.com · ▲86

  all-in-one LLM evaluation platform

• 
  Find the best local LLM for your hardware, ranked by benchmarksMay 2026 · github.com · ▲283

  Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm

• 
  LLM StatsOct 2025 · llm-stats.com · ▲293

  I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

• 
  TensorZero2025 · github.com · ▲307

  Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…

• 
  Deepmark AI2023 · github.com · ▲97

  LLM benchmarking tool for task-specific metrics on your data

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 19d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 19d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 21d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 22d ago · stillwet.art

• 
  Beam.win▲379

  Run AI agents on one Mac and use its windows on another

  AI · 5d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 23d ago · fastrouter.ai

• 
  Beeper Mini – iMessage client for Android▲1,521

  Hi HN! I’m proud to share that we have built a real 3rd party iMessage client for Android. We did it by reverse engineering the iMessage protocol and encryption system. It's available to download today (no waitlist): https:&#x2F;&#x2F;play.google.com&#x2F;store&#x2F;apps&#x2F;details?id=com.beeper.ima and there's a technical writeup here: https:&#x2F;&#x2F;blog.beeper.com&#x2F;p&#x2F;how-beeper-mini-works. Unlike every other attempt to build an iMessage app for Android (including our first gen app), Beeper Mini does not use a Mac server relay in the cloud. The app connects directly to Apple…

  Work · 2023 · beeper.com

• 
  Heynote – A dedicated scratchpad for developers▲1,063

  Hey! I made Heynote entirely for my own use case. For many years, I always had an Emacs instance running with the scratch buffer open, even long after I had abandoned Emacs as my programming editor in favor of more recent IDE:s. The simplicity of having just one big scratch buffer appeals to me, but I still want to separate the different things I jot down somehow (without using tabs or similar). Previously, my solution was to insert a bunch of blank lines between the notes, but hitting C-A would still select the entire buffer. That's why I came up with the concept of "blocks", which turned…

  Work · 2023 · heynote.com

• 
  LogoFast▲988

  Make beautiful logos with AI, fast & free

  AI · 2023 · logofa.st

• 
  FuseBase▲939

  Client collaboration platform for professional services

  Dev tools · 2023 · thefusebase.com

• 
  Beep! 2.0▲871

  Fastest tool to assign and share visual tasks with your team

  Work · 2023 · justbeepit.com

• 
  Inbox Zero▲821

  Clean Up Your Inbox In Minutes Newsletter management, AI automation, and email analytics. Inbox Zero is the open-source email app that puts you back in control of your inbox.

  AI · 2023 · getinboxzero.com