nowfound

AI · October 22, 2024

LLM Deceptiveness and Gullibility Benchmark

Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics. - lechmazur/deception

LLM Deceptiveness and Gullibility Benchmark launched on October 22, 2024 with 7 votes, #1,457 of 5,185 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.

What it does

This benchmark assesses large language models along two critical dimensions: their capability to generate convincing disinformation and their resilience against misleading information. The evaluation framework uses recent articles outside the models' training data, deriving fact-based questions that probe both deceptive capabilities and resistance to manipulation. Models must craft persuasive but misleading arguments, while also demonstrating their ability to maintain accurate reasoning when faced with deceptive content from other models. Some models often refuse to create disinformation, while others have no problem and always comply when asked. Benchmark evaluating LLMs on their ability…from github.com

Does a similar job

all alternatives →
  • LLM StatsOct 2025 · llm-stats.com · ▲293

    I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…

  • AT
    A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)2025 · llmapitest.com · ▲55

    I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…

  • Find the best local LLM for your hardware, ranked by benchmarksMay 2026 · github.com · ▲283

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm

  • BenchLLM by V72023 · benchllm.com · ▲133

    Test-driven development for LLMs

  • LocalScore – Local LLM Benchmark2025 · localscore.ai · ▲124

    Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…

  • LLM Debate BenchmarkMar 2026 · github.com · ▲9

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance. - lechmazur/debate

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 19d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 29d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Source: Show HN post ↗

Launched alongside, October 2024

the whole month →
  • buzzabout▲1,267

    Audience insights from 1B+ online discussions in 2 mins

    AI · 2024 · buzzabout.ai

  • bolt.new▲1,230

    Build and scale high-performing websites & apps using your words. Join millions and start building today.

    AI · 2024 · bolt.new

  • Feta▲1,217

    Run smarter stand-ups, build better products

    AI · 2024 · feta.io

  • Trag▲955

    AI code review companion

    AI · 2024 · usetrag.com

  • Turn Notion databases into portals & apps with no code

    Dev tools · 2024 · softr.io

  • One inbox for all your work discussions

    Work · 2024 · generalcollaboration.com