Killed by LLM – I catalogued AI benchmarks we thought would last years
Killed by LLM – I catalogued AI benchmarks we thought would last years launched on January 2, 2025 with 17 votes, #835 of 6,141 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
Killed by LLM is a catalog documenting AI benchmarks that became obsolete faster than expected. It tracks benchmarks researchers believed would remain relevant for years but were surpassed by large language models in significantly shorter timeframes. The project is for AI researchers, machine learning practitioners, and those interested in understanding how quickly AI capabilities have advanced. It serves as a historical record of benchmark obsolescence in the rapidly evolving AI landscape.
written from the facts on this page · September 2026
From the sources
Killed 1 month ago, Abstract reasoning challenge consisting of visual pattern completion tasks. Each task presents a sequence of abstract visual patterns and requires selecting the correct completion. Created by François Chollet as part of a broader investigation into measuring intelligence. It was 5 years and 1 months old. Killed 4 months ago, A dataset of 12K challenging competition mathematics problems from AMC, AIME, and other math competitions. Problems range from pre-algebra to olympiad-level and require complex multi-step reasoning. Each problem has a detailed solution that tests mathematical reasoning capabilities. It was 3 years and 6 months old. Killed 7 months ago, A curated…from r0bk.github.io
Does a similar job
all alternatives →
LLM StatsOct 2025 · llm-stats.com · ▲293I was overspending on GPT-4o. It was really hard to compare different models I could switch to, so I built this LLM comparison tool. It shows leaderboards, pricing, and performance data across 100+ LLMs (including all major providers and open-source models). Key features: - Live pricing comparisons - Benchmark Scores (MMLU, HumanEval, GPQA, etc.) - Context length vs cost analysis - Speed/throughput tests across providers - Quality vs price visualizations - Open source (all data verifiable) Try it out: https://llmstats.com I'd like to know your opinion :) Tech stack: Next.js,…
Death by AI2022 · deathbyai.com · ▲160I recently created a simple but efficient tool to help document writers generate a list of acronyms and definitions. Here comes chatGPT. At home, it’s all fun and games until I realize this thing might be able to do exactly what my “dumb” website does: "Give me the list of acronyms used in the previous text and their definitions"... It had a good-looking answer. Of course... At first I was bummed, but quickly realized that even though the output looked neat, it was also not reliable (missing some acronyms, adding some that were not in the original text, albeit related to it). Anyway, the…
Find the best local LLM for your hardware, ranked by benchmarksMay 2026 · github.com · ▲283Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. - Andyyyy64/whichllm
LocalScore – Local LLM Benchmark2025 · localscore.ai · ▲124Hey Folks! I've been building an open source benchmark for measuring local LLM performance on your own hardware. The benchmarking tool is a CLI written on top of Llamafile to allow for portability across different hardware setups and operating systems. The website is a database of results from the benchmark, allowing you to explore the performance of different models and hardware configurations. Please give it a try! Any feedback and contribution is much appreciated. I'd love for this to serve as a helpful resource for the local AI community. For more check out: - Website:…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 23d ago · stillwet.art
FastRouter.ai▲364Route requests to the right LLM for cost, latency & quality
AI · 24d ago · fastrouter.ai
Source: Show HN post ↗
Launched alongside, January 2025
the whole month →
Hello! I'm Byran. I spent the past ~6 months engineering a laptop from scratch. It's fully open-source on GH at: https://github.com/Hello9999901/laptop
Dev tools · 2025 · byran.ee
- TITetris in a PDF▲1,289
I realized that the PDF engines of modern desktop browsers (PDFium and PDF.js) support JavaScript with enough I/O primitives to make a basic game like Tetris. It was a bit tricky to find a union of features that work in both engines, but in the end it turns out that showing/hiding annotation "fields" works well to make monochrome pixels, and keyboard input can be achieved by typing in a text input box. All in all it's quite janky but a nice reminder of how general purpose PDF scripting can be. The linked PDF is all ASCII so you can just open it in a text editor, or have a look at…
Life & fun · 2025 · th0mas.nl
21st.dev▲1,211I originally built this app to organize and reuse interesting React + Tailwind components I came across on Twitter, inspired by the shadcn/ui approach. Later, a friend started contributing their own components, and it got me thinking—this could grow into something bigger, like an NPM for design engineers to share and use components. Would love to hear your thoughts!
Dev tools · 2025 · 21st.dev
Create lifelike, personalized AI avatars from text prompts
AI · 2025 · jogg.ai
CSS library based on Counter Strike 1.6 UI.
Life & fun · 2025 · cs16.samke.me