nowfound

AI · March 23, 2026

LLM Debate Benchmark

Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance. - lechmazur/debate

LLM Debate Benchmark launched on March 23, 2026 with 9 votes, #1,237 of 23,380 launches that month and more than 75% of that year's launches.

What it does

This benchmark measures how well large language models perform in adversarial, multi-turn debates across a wide range of topics. Strong performance requires more than a polished opening: models need broad knowledge, accurate facts under pressure, strong rebuttal, and the ability to remain coherent and responsive over several rounds. Each matchup runs twice on the same motion with sides swapped . A three-model judge panel decides each debate's winner and margin. The published leaderboard uses Bradley-Terry ratings built from complete side-swapped matchups. One side-swapped matchup means two debates on the same motion with PRO and CON roles reversed. The raw judge table contains 20,634 stored…from github.com

Does a similar job

all alternatives →
  • How I topped the HuggingFace open LLM leaderboard on two gaming GPUsMar 2026 · dnhkng.github.io · ▲495

    I found that duplicating a specific block of 7 middle layers in Qwen2-72B, without modifying any weights, improved performance across all Open LLM Leaderboard benchmarks and took #1. As of 2026, the top 4 models on that leaderboard are still descendants. The weird finding: single-layer duplication does nothing. Too few layers, nothing. Too many, it gets worse. Only circuit-sized blocks of ~7 layers work. This suggests pretraining carves out discrete functional circuits in the layer stack that only work when preserved whole. The whole thing was developed on 2x RTX 4090s in my basement. I'm…

  • LLM StatsOct 2025 · llm-stats.com · ▲293

    I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

  • AI Debate ArenaNov 2025 · aidebatearena.app · ▲7

    Ever wish you could get the best arguments for both sides of a debate? I built an AI-powered debate platform that pits language models against each other on controversial topics. Each AI is randomly assigned a side (pro/con). You vote before and after to see if you were persuaded. Most content today presents lopsided arguments. They provide strong points for one side, weak ones for the other. This project aims to surface the strongest arguments from both sides, using LLMs to simulate a fair debate. With enough usage, I want to use it to benchmark LLMs. My hypothesis is that randomly…

  • IM
    I made a competitive debating game(like chess.com but for debating)2025 · crs-prod-rankeddebate-l4dnggfaca-nn.a.run.app · ▲17

    Got tired of my debates with my friend's ending in "I'm right bc I said so" so I made a platform where you can debate with your friend's(or a bot, recently added feature) about whatever you want, and after the debate is done a LLM judges who's more sound in logic. Gain points and climb the leaderboard! Feedback and criticism would be appreciated(there's a discord in there if you wanna talk more in depth) p.s.: I decided to use google acc sign in since it makes the whole thing easier to manage(live chatroom feature, etc.). I don't actually do anything with your emails

  • LLM Clash2024 · ▲10

    Have your LLM debate other LLMs in real-time!

  • LLM Deceptiveness and Gullibility Benchmark2024 · github.com · ▲7

    Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics. - lechmazur/deception

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 19d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Source: Show HN post ↗

Launched alongside, March 2026

the whole month →
  • AI-native CRM that builds itself and does work for you

    AI · Mar 2026 · lightfield.app

  • Tobira.ai▲728

    A network where AI agents find deals for their humans

    AI · Mar 2026 · tobira.ai

  • Switch from ChatGPT to Claude with import memory feature

    AI · Mar 2026 · claude.com

  • Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.

    AI · Mar 2026 · littlebird.ai

  • Your AI Coworker that proactively executes tasks

    AI · Mar 2026 · viktor.com

  • Jupid▲659

    File your taxes with Claude Code

    Commerce · Mar 2026 · jupid.com