AI · alternatives · 2026
24 alternatives to Promptfoo – CLI for testing & improving LLM prompt quality
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. - promptfoo/promptfoo
Promptfoo is a command-line tool for testing and evaluating large language model prompts. It helps developers and teams systematically assess prompt quality through automated testing. The tool is designed for anyone… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Promptfoo – CLI for testing & improving LLM prompt quality launched in 2023; newer entries below may have overtaken it.
- 1
Prompto▲202Interact with various LLMs in your browser
2024 · prompto.asanchez.dev · its alternatives →
- 2
Hey HN! We’re Kevin and Steve. We’re building PromptTools (https://github.com/hegelai/prompttools): open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. Evaluating prompts, LLMs, and vector databases is a painful, time-consuming but necessary part of the product engineering process. Our tools allow engineers to do this in a lot less time. By “evaluating” we mean checking the quality of a model's response for a given use case, which is a combination of testing and benchmarking. As examples: - For generated…
2023 · github.com · its alternatives →
- 3
PromptPerf▲139Instantly test and compare AI prompts results across models
2025 · promptperf.dev · its alternatives →
- 4
PromptForge▲474PromptForge: Open-source AI prompt engineering workbench with systematic evaluation I built PromptForge after getting frustrated with the manual trial-and-error approach to prompt engineering. Most tools are just text editors, but I wanted something that brings software engineering discipline to prompt development. Key technical features: - AI-assisted prompt generation (stop starting from scratch) - Systematic evaluation engine that auto-generates test suites - Multi-model support (Claude, GPT-4, Azure OpenAI) - Go backend with SQLite for performance and simplicity - One-line Docker…
2025 · github.com · its alternatives →
- 5
- 6
Repo Prompt▲280Automate assembling the perfect context for your project
Jan 2026 · repoprompt.com · its alternatives →
- 7
Agenta▲362Open-source prompt management & evals for AI teams
Nov 2025 · agenta.ai · its alternatives →
- 8
TensorZero▲307Hi HN! We're Gabriel & Viraj, and we're excited to open source TensorZero. To be a little cheeky, TensorZero is an open-source platform that helps LLM applications graduate from API wrappers into defensible AI products. 1. Integrate our model gateway 2. Send metrics or feedback 3. Unlock compounding improvements in quality, cost, and latency It enables a data & learning flywheel for LLMs by unifying: • Inference: one API for all LLMs, with <1ms P99 overhead • Observability: inference & feedback → your database • Optimization: better prompts, models, inference strategies • Experimentation:…
2025 · github.com · its alternatives →
- 9
- 10
Promptspot▲125Open-source 'unit testing' stack for your prompts and data
2023 · github.com · its alternatives →
- 11
Interactive prompt for command-line applications. Contribute to manifoldco/promptui development by creating an account on GitHub.
2017 · github.com · its alternatives →
- 12
- 13
- 14
Hello HN, We built Promptrepo to make finetuning accessible to product teams — not just ML engineers. Last week, OpenAI’s CPO shared how they use fine-tuning for everything from customer support to deep research, and called it the future for serious AI teams. Yet most teams I know still rely on prompting, because fine-tuning is too technical, while the people who have the training data (product managers and domain experts) are often non-technical. With Promptrepo, they can now: - Add training examples in Google Sheets - Click a button to train - Deploy and test instantly - Use OpenAI,…
2025 · promptrepo.com · its alternatives →
- 15
Hi HN! We’re been working hard on this low-code tool for rapid prompt discovery, robustness testing and LLM evaluation. We’ve just released documentation to help new users learn how to use it and what it can already do. Let us know what you think! :)
2023 · chainforge.ai · its alternatives →
- 16
The #1 website for Artificial Intelligence and Prompt Engineering. Search the world's best AI prompts for models like Stable Diffusion, ChatGPT, Midjourney...
2022 · prompthero.com · its alternatives →
- 17
Spelltest framework simulates conversations between AI ‘synthetic users' in an environment to test and refine LLM-based applications. It ensures your app converse with utmost accuracy and relevance. Post-chat, Spelltest assesses responses, providing qualitative and quantitative feedback on performance. Suitable for both chat and completion modes. When to use: - After modifying your prompt. - When your LLM provider updates. - As a CI step for you repo. All feedback and collaborations appreciated!
2023 · github.com · its alternatives →
- 18
Hi HN, I've been working on an experimental tool that helps you use GPT to work on your codebase. I'd love to improve the tool if there's interest. New ideas welcome! I think this could also be useful for experimenting with other types of recursive prompts. It’s a little bit Swiss Army knife and a little bit skynet: https://github.com/ferrislucas/promptr From the README: Promptr is a CLI tool for operating on your codebase using GPT. Promptr dynamically includes one or more files into your GPT prompts, and it can optionally parse and apply the changes that GPT suggests to…
2023 · github.com · its alternatives →
- 19
PromptLayer is the prompt management platform for AI teams. Version prompts, run LLM evals, and monitor agents in production with tracing, logs, and regression sets.
2023 · promptlayer.com · its alternatives →
- 20
Nowadays, a common AI tech stack has hundreds of different prompts running across different LLMs. Three key problems: - Choices, picking from 100s of LLMs the best LLM for that 1 prompt is gonna be challenging, you're probably not picking the most optimized LLM for a prompt you wrote. - Scaling/Upgrading, similar to choices but you want to keep consistency of your output even when models depreciate or configurations change. - Prompt management is scary, if something works, you'll never want to touch it but you should be able to without fear of everything breaking. So we launched Prompt…
2024 · jigsawstack.com · its alternatives →
- 21
Prompt Engineering Toolkit for Developers & Creators
2025 · prompto.cc · its alternatives →
- 22
Find & Try Awesome Prompts on the Most Popular LLM Models!🔥
2025 · promptarena.ai · its alternatives →
- 23
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. - comet-ml/opik
2024 · github.com · its alternatives →
- 24
The context manager and skills library for marketing teams
Apr 2026 · promptr.ai · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →