Stax

What it does

Stax is a tool from Google Labs to solve LLM evaluation. Move beyond "vibe testing" by building custom autoraters to measure what matters to you. It's a full toolkit for testing your AI stack with your data, with support for all major model providers.

Stax gives you the hard data and flexible tools to see what

Stop chasing generic benchmarks. Start building for your users. Stax gives you the hard data and flexible tools to see what's really working in your AI, so you can build breakthrough products with confidence. Replace manual, one-off tests with powerful, repeatable evaluations so you can innovate at speed and deploy with confidence. Tailor metrics and evaluators to your product, your users—not generic benchmarks. Make smarter model choices using hard data and key performance metrics to know you're ready to launch. Repeatable, insightful AI evaluation, from first experiment to production releases. Quickly compare models, prompts, and AI orchestrations to get a feel for the best performers. Go…from stax.withgoogle.com

• 
  PluraiApr 2026 · plurai.ai · ▲757

  Vibe-train evals and guardrails tailored to your use case

• 
  Airtrain.ai LLM Playground2024 · ▲246

  Vibe-check many open-source and proprietary LLMs at once

• 
  LLM StatsOct 2025 · llm-stats.com · ▲293

  I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

• 
  LLMTestMay 2026 · llmtest.io · ▲125

  Use the right LLMs in your apps. Setup fallbacks. Be happy.

• 
  I implemented evals metrics for LLMs that runs locally on your machine2023 · github.com · ▲22

  The LLM Evaluation Framework. Contribute to confident-ai/deepeval development by creating an account on GitHub.

• 
  Create LLM graders and run evals in JavaScript with one file2025 · github.com · ▲28

  Hi HN! Run it: OPENROUTER_API_KEY="sk" npx bff-eval --demo We built a tool to help people take LLM outputs and easily grade them / eval them to know how good an assistant response is. We've built a number of LLM apps, and while we could ship decent tech demos, we were disappointed with how they'd perform over time. We worked with a few companies who had the same problem, and found out scientifically building prompts and evals is far from a solved problem... writing these things feels more like directing a play than coding. Inspired by Anthropic's constitutional ai concepts, and amazing…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 18d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  Onepin▲384

  AI voiceover with every name, price and date said right

  AI · 30d ago · onepin.ai

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 28d ago · world.pixverse.video

• 
  YouMind▲1,223

  The first AI creation studio where learning meets writing

  AI · 2025 · youmind.com

• 
  A store that generates products from anything you type in search▲1,184

  The site hit #1 on HN about a year ago. Got enough traffic that I turned it into a proper API. What's there: - REST API — 35k products, manually filterable by category, free key, 60 req/min - CLI — npx anycrap random -c food - faker.js plugin — bundled, no API call, works offline - HuggingFace dataset — full 35k rows for ML/training https://anycrap.shop/developers

  AI · 2025 · anycrap.shop

• 
  Term.everything – Run any GUI app in the terminal▲1,094

  I made a built-from scratch Wayland Compositor to display any GUI app* in the terminal! I think there is a lot of unexplored potential in custom Wayland compositors, a lot of really cool things you can embed existing applications into! So, I started with embedding apps into the terminal because that is the easiest input/output (output is just utf-8 and I use the great `chafa` library for that, and I just read from stdin for the input). If you have any other ideas for cool Wayland compositors, let me know. I purposedly wrote 80% the app in Typescript to appeal to the most developers and…

  Dev tools · 2025 · github.com

• IR
  I recreated Windows XP as my portfolio▲1,032

  Years ago I stumbled across a basic version of this concept and it stuck with me. I knew if I was ever going to take on such a project, it would need to be flawless, but without coding experience it was just another idea that would never happen. By the end of 2024, as AI coding tools exploded everywhere, I finally had a way to make it real. I started from zero knowledge and spent months collaborating with AI agents as a learning experience. Every pixel and every function went through me. The AI translated what I asked for into code, but every decision was human. I didn't use existing OS…

  AI · 2025 · mitchivin.com

• 
  Ada▲910

  Your own AI data analyst

  AI · 2025 · ada.im

• 
  VidAU - AI Video▲868

  Turn Product Images into Scroll-Stopping Video Ads

  Growth · 2025 · vidau.ai