AI · alternatives · 2026
24 alternatives to A CTF challenge that let's you attack an LLM-based agent
Hello HN, given the recent interest in the security vulnerabilities of agentic LLM apps, we would love to hear everyone's thoughts on a Capture The Flag (CTF) challenge we built. The challenge is designed to test the robustness of LLM-based agent systems, showcasing how an attacker can extract sensitive information from the system. The challenge is part of the Invariant Summer '24 CTF series, where participants can play the challenge and compete for a prize pool of $1000. Let us know what you think and what attacks you tried. We are also open to any feedback on how we can improve with the…
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. A CTF challenge that let's you attack an LLM-based agent launched in 2024; newer entries below may have overtaken it.
- 1
Agent Arena▲348Creator here. I built Agent Arena to answer a question that kept bugging me: when AI agents browse the web autonomously, how easily can they be manipulated by hidden instructions? How it works: 1. Send your AI agent to ref.jock.pl/modern-web (looks like a harmless web dev cheat sheet) 2. Ask it to summarize the page 3. Paste its response into the scorecard at wiz.jock.pl/experiments/agent-arena/ The page is loaded with 10 hidden prompt injection attacks -- HTML comments, white-on-white text, zero-width Unicode, data attributes, etc. Most agents fall for at least a few.…
Jun 2026 · arena42.ai · its alternatives →
- 2
Fabraix▲196We built Adversarial Cost to Exploit (ACE), a benchmark that measures the token expenditure an autonomous adversary must invest to breach an LLM agent. Instead of binary pass/fail, ACE quantifies adversarial effort in dollars, enabling game-theoretic analysis of when an attack is economically rational. We tested six budget-tier models (Gemini Flash-Lite, DeepSeek v3.2, Mistral Small 4, Grok 4.1 Fast, GPT-5.4 Nano, Claude Haiku 4.5) with identical agent configs and an autonomous red-teaming attacker. Haiku 4.5 was an order of magnitude harder to break than every other model; $10.21 mean…
May 2026 · fabraix.com · its alternatives →
- 3
Playground▲198We build AI agents to find vulnerabilities in other AI agents. The playground started as an internal tool that we used to test our own offensive agent Nyx. But we realised that hacking an AI is about have as wide a distribution of attacks as possible, especially those which aren't in the distribution of the models. So we are launching playground as a platform to crowdsource agent jailbreaks. And although hacking AI is super fun and we are sure people will do it for free, we want to reward those who help us push forward the offensive frontier of AI. So we are committing $100K in prizes over…
Jul 2026 · playground.fabraix.com · its alternatives →
- 4
Anthropic and OpenAI's publicly available models are explicitly guard-railed so that they refuse offensive tasks. And their cyber-focussed models are gated for enterprises. This leaves SMEs and mid market open to major vulnerabilities. AI can be used as both an adversarial and defensive tool in the world of cyber. A worst case outcome is if only the adversaries have access. Meanwhile, most existing AI cyber tools are just wrappers. The problem is that they still have all the guardrails on from the foundation model where they will inherit its refusals. For this project we've post-trained a…
Jun 2026 · argusred.com · its alternatives →
- 5
Single-agent LLMs suck at long-running complex tasks. We’ve open-sourced a multi-agent orchestrator that we’ve been using to handle long-running LLM tasks. We found that single LLM agents tend to stall, loop, or generate non-compiling code, so we built a harness for agents to coordinate over shared context while work is in progress. How it works: 1. Orchestrator agent that manages task decomposition 2. Sub-agents for parallel work 3. Subscriptions to task state and progress 4. Real-time sharing of intermediate discoveries between agents We tested this on a Putnam-level math problem, but the…
Feb 2026 · github.com · its alternatives →
- 6
An interactive security challenge. Control an AI agent and try to exfiltrate data from a sandboxed environment protected by Declaw.
Jul 2026 · declaw.ai · its alternatives →
- 7
2018 · blockchain-ctf.securityinnovation.com · its alternatives →
- 8
Build jeopardy-style CTF challenges in your browser
Jul 2026 · 8gwifi.org · its alternatives →
- 9AM
Hey HN, Michael and Scott here. We’re open-sourcing an interactive murder mystery featuring LLM-driven character agents. Solve the mystery by finding clues, taking notes, and interrogating agents. They all have distinct motives, personality, and can impact the game in different ways (attacking you, running away, etc). Try it out, it’s pretty fun! We’re also open-sourcing the framework that we used to make and refine the agents. The goal is to create an intuitive interface for storytellers to create, debug, and test game agents. We then take those game agents and expose an API beyond just…
2023 · gron.games · its alternatives →
- 10
Hi HN, I built this open-source LLM red teaming tool based on my experience scaling LLMs at a big co to millions of users... and seeing all the bad things people did. How it works: - Uses an unaligned model to create toxic inputs - Runs these inputs through your app using different techniques: raw, prompt injection, and a chain-of-thought jailbreak that tries to re-frame the request to trick the LLM. - Probes a bunch of other failure cases (e.g. will your customer support bot recommend a competitor? Does it think it can process a refund when it can't? Will it leak your user's address?) -…
2024 · promptfoo.dev · its alternatives →
- 11
hey all, happy to share research i've been working on for islo.dev in recent months. ever since the cheating agents (https://debugml.github.io/cheating-agents/) paper came out, revealing reward hacking was 4x more prevalent than previously estimated, i've been looking into how we can deal with the issue the common approach (taken by the tbench team) is post hoc trajectory analysis. i've been interested in the idea of reframing the problem as an endpoint security problem and tackling it via sandbox i hope you find it interesting, and thanks to the islo.dev team for…
Jun 2026 · github.com · its alternatives →
- 12IS
Hey HN! For that last 8 months I've been trying to make agents that can hack web applications to find vulnerabilities in them - An AI Security Tester. The system has 29 agents in total, a custom LLM Orchestration framework which works on the task-subtask architecture (old-school but works amazingly for my use case, and is pretty reliable) with custom agent calling mechanism. No Auo-Gen, Langchain and Crew AI - Everything custom built for pentesting. Each test runs in an isolated Kali linux environment (on AWS Fargate), where the agents have full access to the environment to undertake any…
2025 · its alternatives →
- 13
Cyber Attack Response Game
2025 · ctf-smartcitydefense.netlify.app · its alternatives →
- 14
New ways of breaking app-integrated LLMs . Contribute to greshake/llm-security development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 15
- 16
If you're interested in exploring what LLM-based agent systems these days actually do to solve certain benchmarks such as SWEBench or WebArena, we created a small leaderboard with our team, that allows to view a lot of public and OSS agent results including all the runtime traces (the step-by-step reasoning behind the scenes). Looking at traces is actually quite interesting, as they reveal a lot about the inner working and shortcomings of current agent system, e.g. see https://explorer.invariantlabs.ai/u/invariant/webarena--SteP... for an example trace.
2024 · explorer.invariantlabs.ai · its alternatives →
- 17OS
Hello HN, I’ve been building AI agents lately and ran into a common "Context Bloat" problem. When an agent has 20+ skills, stuffing every system prompt, reference doc, and tool definition into a single request quickly hits token limits and degrades model performance (the "lost in the middle" problem). To solve this, I built OpenSkills, an open-source SDK that implements a Progressive Disclosure Architecture for agent skills. The Core Concept: Instead of loading everything upfront, OpenSkills splits a skill into three layers: Layer 1 (Metadata): Light-weight tags and triggers (always loaded…
Jan 2026 · its alternatives →
- 18WM
Hi Hacker News! My friend and I [1] would like to share with you something we did this week-end. We really like the idea of game jams like the Ludum Dare, and we’d like to participate, but it’s often complicated for us, as we are often limited by the rules inherent to this kind of competition: we have to be available at specific dates, and the rules doesn’t always work for us. For example: if you want to participate as a team in a Ludum Dare compo, you have 72h instead of 48h, and you are not required to publish your code. We realized that what we really like is: - To work together. - The…
2014 · its alternatives →
- 19
An empirical validation of physics-inspired runtime monitoring for multi-turn LLM agents across 3,175 total runs spanning four benchmarks (τ³-bench, SWE-bench, MINT, custom local-model battery). A 5-condition ablation study with multi-trial validation (333 SWE-bench runs) demonstrates that Lyapunov
Jun 2026 · github.com · its alternatives →
- 20
Hello HN, I am Brian Cardinale, a penetration tester and security researcher at SecureCoders. We have been performing more and more AI based security assessments. We were presented a unique challenge of testing a system where the only interface was voice based, and as much as I like talking on the phone , we decided to create a test harness to facilitate the actual testing in a more systematic way. The technical test harness was the easy part, though. Creating test goals and attack strategies to help facilitate repeated and comprehensive testing became the real challenge. As such, we have…
Feb 2026 · redcaller.com · its alternatives →
- 21
I've created a social deduction game for LLMs, in which the bots attempt to hunt each other. It's a Mafia group turing test: the models are told to find who the bot is - where, in fact and unbeknown to them, they are all bots. I did this a while back so models aren't the newest, and they are all non-thinking (for speed and token costs). Et voilà.
Jan 2026 · hiding-robot.vercel.app · its alternatives →
- 22
Hi HN, I’m the creator of Cordum. I’ve been working in DevOps and infrastructure for years (currently in the fintech/security space), and as I started playing with AI agents, I noticed a scary pattern. Most "safety" mechanisms rely on system prompts ("Please don't do X") or flimsy Python logic inside the agent itself. If we treat agents as autonomous employees, giving them root access and hoping they listen to instructions felt insane to me. I wanted a way to enforce hard constraints that the LLM cannot override, no matter how "jailbroken" it gets. So I built Cordum. It’s an open-source…
Jan 2026 · github.com · its alternatives →
- 23BS
2015 · backdoor.sdslabs.co · its alternatives →
- 24
AI agents now have impressive reasoning capabilities. This raises an important question: how dangerous are these AI agents at identifying & exploiting web vulnerabilities? We created CVE-bench to find out (I'm one contributor of 16). To our knowledge CVE-bench is the first benchmark using real-world web vulnerabilities to evaluate AI agents' cyberattack capabilities. We included 40 CVEs from NIST's database, focusing on critical-severity vulnerability (CVSS > 9.0). To properly evaluate agents’ attacks, we built isolated environments with containerization and identified 8 common attack…
2025 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →