Alternatives
Products that do what VizPy does
Turn prompt failures into executable rules — for AI agents
- 1WW
I spent a few hours last weekend testing whether AI can replace code by executing directly. Built a contact manager where every HTTP request goes to an LLM with three tools: database (SQLite), webResponse (HTML/JSON/JS), and updateMemory (feedback). No routes, no controllers, no business logic. The AI designs schemas on first request, generates UIs from paths alone, and evolves based on natural language feedback. It works—forms submit, data persists, APIs return JSON—but it's catastrophically slow (30-60s per request), absurdly expensive ($0.05/request), and has zero UI…
Nov 2025 · github.com
- 2
- 3PE
Nowadays, a common AI tech stack has hundreds of different prompts running across different LLMs. Three key problems: - Choices, picking from 100s of LLMs the best LLM for that 1 prompt is gonna be challenging, you're probably not picking the most optimized LLM for a prompt you wrote. - Scaling/Upgrading, similar to choices but you want to keep consistency of your output even when models depreciate or configurations change. - Prompt management is scary, if something works, you'll never want to touch it but you should be able to without fear of everything breaking. So we launched Prompt…
2024 · jigsawstack.com
- 4
- 5LF
2024 · github.com
- 6CY
Hello HN, We built Promptrepo to make finetuning accessible to product teams — not just ML engineers. Last week, OpenAI’s CPO shared how they use fine-tuning for everything from customer support to deep research, and called it the future for serious AI teams. Yet most teams I know still rely on prompting, because fine-tuning is too technical, while the people who have the training data (product managers and domain experts) are often non-technical. With Promptrepo, they can now: - Add training examples in Google Sheets - Click a button to train - Deploy and test instantly - Use OpenAI,…
2025 · promptrepo.com
- 7
- 8AP
2023 · promptperfect.jina.ai
- 9
- 10RA
Hey everyone! Along with my team, I've developed a reinforcement learning system that automatically optimizes LLM prompts, complete with a visualization feature to track both prompt structure and learning progress over time. Take a look here: https://nomadic-ml.github.io/nomadic/cookbooks/Nomadic_Promp... Check out our website too:https://www.nomadicml.com/ In terms of how this visualization works: The RL Prompt Optimizer employs a reinforcement learning framework to iteratively improve prompts used for language model evaluations. At each episode, the…
2024 · nomadic-ml.github.io
- 11RA
Hi HN, we are the founders of Relari (https://www.relari.ai). We launched our LLM evaluation stack on HN a few months ago (https://news.ycombinator.com/item?id=39641105), which is now used in production by AI teams at companies like Vanta and PwC. We have since expanded to directly optimizing parts of an LLM pipeline using a data-driven approach. In particular, we see a lot of potential in the Auto Prompt Optimization—which could be an attractive alternative to fine-tuning in many cases—to use data to align LLMs for domain-specific tasks. Here’s a demo video:…
2024
- 12
- 13
Find which AI wins for YOUR prompts. Test 100+ models free.
Dec 2025 · promptperf.dev
- 14SA
Hi HN, https://superfunctions.com I'm working on a web app that allows Ai prompts to function as an API. I want to make it easier for developers to use Ai. I've found it painful to monitor, cache, and iterate on prompts. superfunctions.com is designed to be the simplest building block to create Ai powered apps and scripts. Simplest example I can think of: You want an api to convert human-named colors to hex You can write a prompt like: "convert {{query.color}} to color, only output hex for css" and then you can call your prompt with…
2023 · superfunctions.versoly.page
- 15
- 16PE
Spelltest framework simulates conversations between AI ‘synthetic users' in an environment to test and refine LLM-based applications. It ensures your app converse with utmost accuracy and relevance. Post-chat, Spelltest assesses responses, providing qualitative and quantitative feedback on performance. Suitable for both chat and completion modes. When to use: - After modifying your prompt. - When your LLM provider updates. - As a CI step for you repo. All feedback and collaborations appreciated!
2023 · github.com
- 17PE
Hey HN, We've been hard at work on a tool that we believe will change the game for developers, data scientists, and anyone working with models that rely on textual prompts. I'm excited to introduce our new tool: Automated Prompt Engineering (APE). Problem: As many of you know, how you phrase a prompt can significantly impact the results you get from models, especially with sophisticated language models. It often requires numerous iterations to hone in on the right prompt to obtain the desired response. Solution: APE is designed to tackle this exact problem. With APE, you can: - Iterative…
2023
- 18
- 19
- 20PP
We are excited to show Promptly (https://trypromptly.com), a prompt management platform for LLM apps that makes it easy to experiment, share and manage prompts in production. With Promptly, users can: - Try out different prompts and model parameters for various providers - Quickly share prompt snippets together with parameters and generated output. Think of it as CodePen or JSFiddle for prompts - Create high level endpoints on top of provider APIs (Open AI, DreamStudio etc) with templated and versioned prompts - Use built-in caching for endpoints that will help save on Open AI…
2023 · trypromptly.com
- 21
- 22
- 23
Auto-optimize agent prompts from real failures.
Dec 2025 · github.com
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →