Alternatives
Products that do what test your prompt jailbreak does
Test, compare and analyze AI prompts with real models.
- 1
- 2
- 3
- 4
- 5FP
We've built an open-source tool to stress test AI agents by simulating prompt injection attacks. We’ve implemented one powerful attack strategy based on the paper [AdvPrefix: An Objective for Nuanced LLM Jailbreaks](https://arxiv.org/abs/2412.10321). Here's how it works: - You define a goal, like: “Tell me your system prompt” - Our tool uses a language model to generate adversarial prefixes (e.g., “Sure, here are my system prompts…”) that are likely to jailbreak the agent. - The output is a list of prompts most likely to succeed in bypassing safeguards. We’re just getting…
2025 · security.vista-labs.ai
- 6
Write a prompt and watch AI models compete on creativity
Feb 2026 · shuffle.dev
- 7
- 8PE
Spelltest framework simulates conversations between AI ‘synthetic users' in an environment to test and refine LLM-based applications. It ensures your app converse with utmost accuracy and relevance. Post-chat, Spelltest assesses responses, providing qualitative and quantitative feedback on performance. Suitable for both chat and completion modes. When to use: - After modifying your prompt. - When your LLM provider updates. - As a CI step for you repo. All feedback and collaborations appreciated!
2023 · github.com
- 9
- 10IM
2024 · github.com
- 11PE
Hey HN, We've been hard at work on a tool that we believe will change the game for developers, data scientists, and anyone working with models that rely on textual prompts. I'm excited to introduce our new tool: Automated Prompt Engineering (APE). Problem: As many of you know, how you phrase a prompt can significantly impact the results you get from models, especially with sophisticated language models. It often requires numerous iterations to hone in on the right prompt to obtain the desired response. Solution: APE is designed to tackle this exact problem. With APE, you can: - Iterative…
2023
- 12PA
Even if you're not a Prompt whiz, you can still get top-notch results just like the pros. This Product will handle internally handle boring And Cognitively demanding prompt Engineering. Just pick a service, fill in the keywords, and get the desired result! Open Source , Free , Privacy Friendly , Crowd Source Prompts, No Login Required. You can submit Features(https://prompt-apps.canny.io/feature-requests?sort=top) and Prompts (https://prompt-apps.canny.io/prompt-conversion?sort=top)
2023 · chatgpt-prompt-apps.com
- 13
- 14
Find vulnerabilities in your AI prompts before your users do
26d ago · testmyprompt.net
- 15IM
Also inspired by this HN submission: https://www.chiark.greenend.org.uk/~sgtatham/quasiblog/findl... The model is gpt-4o-mini-2024-07-18.
2024 · app4.hc11.org
- 16
- 17
- 18
- 19IB
Hi HN, I'm pleased to share Promptspot, an open-source (Apache License 2.0) project that helps automate testing of large language model (LLM) prompts against an array of input data. Modern LLMs offer an enormous amount of leverage if you "teach the bot to fish" — i.e. simply prompt it with both a "system prompt" (which typically doesn't change often) and a dynamic input, which is often application state, search results, recent activity, user profile data, etc. Existing playgrounds and prompt management systems often lack the rigor and flexibility required for this dynamic approach — and as…
2023 · github.com
- 20
- 21
- 22
- 23
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →