nowfound

AI · August 2, 2025

PG

Predict GPT-5 skills with a community AI benchmark

I’m Andrew, co-founder of Recall. Over the past few days I’ve been building Predict, a playground where anyone can: - propose skills we should measure in language models—live examples include difficult math, memory-manipulation resistance, code generation, and empathy under bad news - write evals (graded prompts) for those skills - forecast which models will score highest once GPT-5 is released Why this exists Benchmarks leak into training data quickly; scores are unreliable and labs still declare progress. The prediction tool aims keeps the target moving by letting the crowd define both the…

Predict GPT-5 skills with a community AI benchmark launched on August 2, 2025 with 13 votes, #983 of 8,530 launches that month and more than 75% of that year's launches.

Alternativestop 12% of August 2025

In plain words

Predict is a collaborative benchmarking platform where users propose skills to measure in language models, write evaluation prompts for those skills, and forecast which models will perform best when GPT-5 releases. The platform addresses benchmark reliability issues by keeping evaluations crowdsourced and secret until GPT-5 launches, after which all prompts, responses, and scores are published with blockchain verification. It is designed for researchers, AI enthusiasts, and anyone interested in defining meaningful language model assessments.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

I’m Andrew, co-founder of Recall. Over the past few days I’ve been building Predict, a playground where anyone can: - propose skills we should measure in language models—live examples include difficult math, memory-manipulation resistance, code generation, and empathy under bad news - write evals (graded prompts) for…

Does a similar job

all alternatives →
  • Recall Predict2025 · predict.recall.network · ▲11

    Ungameable, community-powered AI benchmarks

  • GPT-42023 · openai.com · ▲1,160

    More accurate, less cringe, smoother & useful daily chats!

  • Fully client-side GPT2 prediction visualizer2023 · perplexity.vercel.app · ▲153

    Hi HN! I've found this visualization tool immensely helpful over the years for getting an intuition for how an LLM "sees" some piece of text, and with a bit of elbow grease decided to move all compute to client side so I could make it publicly available. I've found it particularly useful for - Understanding exactly how repetition and patterns affect a small LM's ability to predict correctly - Understanding different tokenization patterns and how it affects model output - Getting a general sense of how "hard" different prediction tasks are for GPT-style models Known problems (that I probably…

  • Product Prediction2021 · ▲255

    I asked GPT-3 to guess what the top makers will build next

  • gpt-realtime-1.5 by OpenAIFeb 2026 · developers.openai.com · ▲300

    Tighter instruction adherence in speech agents

  • Next-token prediction in JavaScript2024 · github.com · ▲88

    What inspired this project today was watching this amazing video by 3Blue1Brown called "But what is a GPT?" on Youtube (https://www.youtube.com/watch?v=wjZofJX0v4M - I highly recommend watching it). I added it to the repo for reference. When it clicked in my head that "knowing a fact" is nearly synonymous with predicting a word (or series of words), I wanted to put it to the test, because it seemed so simple. I chose JavaScript because I can exploit the way it structures objects to aid in the modeling of language. For example: "I want to be at the beach", "I will do it later",…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, August 2025

the whole month →
  • Trace▲1,555

    Workflow Automations for the Human 👾 AI Workforce

    AI · 2025 · trace.so

  • I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https://kilopx.com/

    Work · 2025 · benholmen.com

  • Job boards are dead. Your network is alive

    AI · 2025 · contra.com

  • Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…

    AI · 2025 · github.com

  • I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https://visualrambling.space/moving-objects-in-3d/ feel free to visit and let me know what you think!

    Life & fun · 2025 · visualrambling.space

  • For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https://github.com/dnlzro/horizon [1] https://html.energy/html-day/2025/index.html

    Dev tools · 2025 · sky.dlazaro.ca