Mutant-AI
Expand eval coverage & use red agents to break AI systems
Mutant-AI launched on August 13, 2026 with 2 votes, #5,788 of 23,274 launches that month.
What it does
An open-source Python library for automated LLM red teaming, synthetic dataset augmentation, and behavioral evaluation of LLMs, RAGs, and AI Agents.
Stop testing with static prompts. Mutant-AI autonomously generates behaviorally diverse datasets and uncovers vulnerabilities before they reach production. A single user intent can be expressed in a hundred different ways. If your evaluations only test the happy path, you are blind to edge cases and vulnerabilities. Mutant-AI solves this. It is an agentic system that multiplies a single scenario into a diverse, adversarial evaluation dataset automatically. Vulnerabilities often hide deep within conversational context. A single prompt might fail to break a guardrail, but a multi-turn social engineering attack can slowly manipulate the agent into non-compliance. The Red Team Engine…from mutant.aiankit.com
Does a similar job
all alternatives →
Open-source eval framework for AI agentsMay 2026 · github.com · ▲2aligned to the OWASP Agentic Security Initiative Top 10
Automated red teaming for your LLM app2024 · promptfoo.dev · ▲23Hi HN, I built this open-source LLM red teaming tool based on my experience scaling LLMs at a big co to millions of users... and seeing all the bad things people did. How it works: - Uses an unaligned model to create toxic inputs - Runs these inputs through your app using different techniques: raw, prompt injection, and a chain-of-thought jailbreak that tries to re-frame the request to trick the LLM. - Probes a bunch of other failure cases (e.g. will your customer support bot recommend a competitor? Does it think it can process a refund when it can't? Will it leak your user's address?) -…
RLM-based local debugger for AI agent tracesJun 2026 · github.com · ▲27We built HALO (Hierarchal Agent Loop Optimizer), an open-source tool for debugging and optimizing AI agents using their execution traces. It’s a loop. Run your agent, feed the traces to HALO, get the report, apply the fixes, then re-run your agent. HALO takes in OTEL compliant traces from AI agents using tracing frameworks such as Langfuse, Arize/OpenInference, or even just plain JSONL. It uses an RLM (Recursive Language Model) to more efficiently break trace analysis into smaller subproblems in order to find recurring patterns across large amounts of data and fix systemic issues that…
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 29d ago · world.pixverse.video
Source: Product Hunt launch ↗
Launched alongside, August 2026
the whole month →- TL
Life & fun · Aug 2026 · louisabraham.github.io
Clipto MCP▲655Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…
Work · Aug 2026 · clipto.com
Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…
Life & fun · Aug 2026 · toneyalexander.github.io
Astute▲606Automate your B2B brand going viral, with new media creators
AI · Aug 2026 · company-app.joinastute.com