ModelRed
Hi everyone, We built ModelRed to test AI models and apps for security issues. Ran 4,182 attack probes against 9 leading models to see what would break. Leaderboard: https://modelred.ai (no signup, just check it out) Claude scored 9.5/10 but still failed on medical/financial prompts. Mistral Large scored 3.3/10. The gap between best and worst is huge. We test for prompt injections, data leaks, jailbreaks, risky tool calls, domain specific hacks, basically everything that goes wrong when your LLM has access to real data and APIs. The platform runs these tests…
ModelRed launched on November 11, 2025 with 10 votes, #1,014 of 9,796 launches that month and more than 50% of that year's launches. The site was not reachable when checked in September 2026.
What it does
ModelRed continuously tests AI applications for security vulnerabilities. Run thousands of attack probes against your LLMs to catch prompt injections, data leaks, and jailbreaks before production. Get a simple 0-10 security score, block CI/CD deployments when thresholds drop, and access an open marketplace of attack vectors contributed by security researchers. Works with OpenAI, Anthropic, AWS, Azure, Google, and custom endpoints. Python SDK available. Stop hoping your AI is secure—know it is.
In the maker’s words, at launch
Hi everyone, We built ModelRed to test AI models and apps for security issues. Ran 4,182 attack probes against 9 leading models to see what would break. Leaderboard: https://modelred.ai (no signup, just check it out) Claude scored 9.5/10 but still failed on medical/financial prompts. Mistral Large…
Does a similar job
all alternatives →
Opper AIJul 2026 · opper.ai · ▲229Hey HN! After the Car Wash Test post got quite a big discussion going (400+ comments, https://news.ycombinator.com/item?id=47128138), I spent the past few weeks building a tool so anyone can run these kinds of questions and get structured results. No signup and free to use. You type a question, define answer options, pick up to 50 models at a time from a pool of 200+, and they all answer independently under identical conditions. No system prompt, structured output, same setup for every model. You can also run a debate round where models see each other's reasoning and get a…
FabraixMay 2026 · fabraix.com · ▲196We built Adversarial Cost to Exploit (ACE), a benchmark that measures the token expenditure an autonomous adversary must invest to breach an LLM agent. Instead of binary pass/fail, ACE quantifies adversarial effort in dollars, enabling game-theoretic analysis of when an attack is economically rational. We tested six budget-tier models (Gemini Flash-Lite, DeepSeek v3.2, Mistral Small 4, Grok 4.1 Fast, GPT-5.4 Nano, Claude Haiku 4.5) with identical agent configs and an autonomous red-teaming attacker. Haiku 4.5 was an order of magnitude harder to break than every other model; $10.21 mean…
We post-trained a model that pen tests instead of refusingJun 2026 · argusred.com · ▲93Anthropic and OpenAI's publicly available models are explicitly guard-railed so that they refuse offensive tasks. And their cyber-focussed models are gated for enterprises. This leaves SMEs and mid market open to major vulnerabilities. AI can be used as both an adversarial and defensive tool in the world of cyber. A worst case outcome is if only the adversaries have access. Meanwhile, most existing AI cyber tools are just wrappers. The problem is that they still have all the guardrails on from the foundation model where they will inherit its refusals. For this project we've post-trained a…
Model Kombat by HackerRank2025 · astra.hackerrank.com · ▲129I'm Vivek, co-founder/CEO of HackerRank (YC S11); You may know us as a hiring tool for developers/companies. Over the years, we have built up deep expertise in generating programming challenges, and we are now using that to make coding models better. Our first launch is Model Kombat -- an arena where you can directly compare anonymized coding models, side by side, on real problems. * Pick an arena (Java, Python, etc.) * Each battle has 3 rounds: see the problem + two model outputs -> vote on which you’d actually prefer * Leaderboards + problem statements are updated weekly. We…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗ · launch text quoted in part
Launched alongside, November 2025
the whole month →
Guideflow▲1,338Create interactive product demos and step-by-step guides in seconds with Guideflow, the leading AI-powered demo automation tool.
AI · Nov 2025 · guideflow.com
Hardware and software projects by Ali Roberts
Life & fun · Nov 2025 · bitsnpieces.dev
Welltory▲1,028Measure your wellness. Use data to feel great every day.
Work · Nov 2025 · welltory.com
TrustMRR▲833LLM Gateway is a b2b artificial intelligence based in United States, founded in 2025. $259,539/month in verified Stripe revenue. $78,764 MRR. Ahrefs Domain Rating 52/100. growing 55% month-over-month. Track LLM Gateway's verified metrics on TrustMRR.
Growth · Nov 2025 · trustmrr.com
Boing▲782Life & fun · Nov 2025 · boing.greg.technology