JuryArena

What it does

Choosing the right LLM for production shouldn't be based on intuition. JuryArena runs arena-style trials on your real prompts — an AI-jury watches two models go head-to-head, picks the winner, and saves every result as a reviewable trace. No ground truth needed. Open source and self-hostable.

LLM arena evaluation using LLM-as-a-Judge. Contribute to elementshq/jury-arena development by creating an account on GitHub.

JuryArena is an open-source evaluation tool for comparing multiple LLMs in an arena format using your actual production prompts . You can relatively compare model response quality in a way close to real-world tasks, without defining ground truth or scoring rubrics in advance. Dataset (JSONL / ZIP) │ ▼ New Evaluation ├─ Select candidate models (e.g. GPT-4o vs Claude Sonnet) ├─ Select judge model(s) (up to 3) ├─ Set max matches (e.g. 100) └─ Choose rating system (Elo or Glicko-2) │ ▼ Arena Loop ×N matches 1. Model A & B each respond to the same prompt 2. Judge LLM picks the winner → "A" | "B" | "tie" 3. Ratings update → next pair selected by rating proximity │ ▼ Rankings · Match history ·…from github.com

• 
  DesignArena – crowdsourced benchmark for AI-generated UI/UX2025 · designarena.ai · ▲89

  I’ve been using AI to generate some repetitive frontend (guilty), and while most outputs felt vibe-coded, some results were surprisingly good. So I cleaned it up and made a ranking game out of it with friends, and you can check it out here: https://www.designarena.ai/vote /vote: Your prompt will be answered by four random, anonymous models. You pick the one you prefer and crown the winner, tournament-style. /leaderboard: See the current winning models, as dictated by voter preferences. /play: Iterate quickly by seeing four models respond to the same input and…

• 
  Humans vs LLMs2025 · aipageready.com · ▲138

  Hi HN, We just launched [AI Page Ready](https://aipageready.com) — a tool to check if your web pages are discoverable and understandable by AI tools like ChatGPT, Claude, Gemini, and Perplexity. It runs 40+ checks across six areas: Discoverability & Crawlability, Structured Data & Semantics, Content Quality, Answer-Ready Formatting, Accessibility & Rendering, and Deep AI LLM-specific checks. Would love your feedback — especially if you work in eCommerce, SEO, content, SaaS, or are trying to get traffic from AI tools. (Also open to ideas on what else to add to the tool!)

• 
  PromptArena - Where Prompts Compete!2025 · promptarena.ai · ▲15

  Find & Try Awesome Prompts on the Most Popular LLM Models!🔥

• 
  Create LLM graders and run evals in JavaScript with one file2025 · github.com · ▲28

  Hi HN! Run it: OPENROUTER_API_KEY="sk" npx bff-eval --demo We built a tool to help people take LLM outputs and easily grade them / eval them to know how good an assistant response is. We've built a number of LLM apps, and while we could ship decent tech demos, we were disappointed with how they'd perform over time. We worked with a few companies who had the same problem, and found out scientifically building prompts and evals is far from a solved problem... writing these things feels more like directing a play than coding. Inspired by Anthropic's constitutional ai concepts, and amazing…

• 
  Prompt-Engineering Tool: AI-to-AI Testing for LLM2023 · github.com · ▲37

  Spelltest framework simulates conversations between AI ‘synthetic users' in an environment to test and refine LLM-based applications. It ensures your app converse with utmost accuracy and relevance. Post-chat, Spelltest assesses responses, providing qualitative and quantitative feedback on performance. Suitable for both chat and completion modes. When to use: - After modifying your prompt. - When your LLM provider updates. - As a CI step for you repo. All feedback and collaborations appreciated!

• 
  RagMetrics2025 · ragmetrics.ai · ▲13

  We built live AI evaluation to detect hallucinations, grounding issues, and drift as outputs are generated. This helps teams move GenAI from pilots into production.

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 19d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 20d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 22d ago · stillwet.art

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 5d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 23d ago · fastrouter.ai

• 
  Lightfield▲901

  AI-native CRM that builds itself and does work for you

  AI · Mar 2026 · lightfield.app

• 
  Tobira.ai▲728

  A network where AI agents find deals for their humans

  AI · Mar 2026 · tobira.ai

• 
  Claude Import Memory▲716

  Switch from ChatGPT to Claude with import memory feature

  AI · Mar 2026 · claude.com

• 
  Littlebird▲709

  Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.

  AI · Mar 2026 · littlebird.ai

• 
  Viktor.com▲702

  Your AI Coworker that proactively executes tasks

  AI · Mar 2026 · viktor.com

• 
  Jupid▲659

  File your taxes with Claude Code

  Commerce · Mar 2026 · jupid.com