Alternatives
Products that do what Evaliphy does
Test your AI like Rest Of Your Product | No ML overhead
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9DA
Write a task in plain English. An AI agent runs it on a simulator on your Mac and tells you if a real user could complete it. Save the successful run as a regression check you can replay later.
23d ago · app.deltix.ai
- 10
- 11CL
Hi HN! Run it: OPENROUTER_API_KEY="sk" npx bff-eval --demo We built a tool to help people take LLM outputs and easily grade them / eval them to know how good an assistant response is. We've built a number of LLM apps, and while we could ship decent tech demos, we were disappointed with how they'd perform over time. We worked with a few companies who had the same problem, and found out scientifically building prompts and evals is far from a solved problem... writing these things feels more like directing a play than coding. Inspired by Anthropic's constitutional ai concepts, and amazing…
2025 · github.com
- 12AE
I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…
Feb 2026 · ai-evals.io
- 13WH
Hey guys, I'm investing a ton of time on writing unit tests, for both enterprise and personal projects. I came up with the idea to make extension for AI-generated tests and cases within a VS Code. Happy to hear feedback, both positive and negative.
2024 · marketplace.visualstudio.com
- 14ET
Hey Hacker News, For the last 2 months, I've been working on a testing agent to free developers from the endless maintenance of end-to-end tests. You just push up a PR, and our agent analyzes the code changes and automatically visits the preview to test things out like a real human! We also support describing tests in English (or even in the PR description), and we'll go through your site whenever you want via a GitHub action to test and make sure various core flows continue to work as expected. We are looking for early testers and are giving out a generous free tier! Just sign up on the…
2025 · playmatic.ai
- 15TT
Today I am introducing HN to my sideproject 'testeranto'. It is a test framework for TS projects which leverages Aider to automatically fix broken tests. tl;dr: https://www.youtube.com/watch?v=WvU5xMqGi6Q
2025 · npmjs.com
- 16
- 17OS
Hey HN! We built EvalKit, a library you embed to capture agent actions and a UI where domain experts give feedback, evaluate and improve AI agents. We experienced, in large agentic systems, prompt-engineering or auto-prompt improvement tool can get accuracy from 0 to 50% but for increasing accuracy to 100% we had to work with domain experts. Example -> In a law ai agent, lawyers are needed because law is complex and lawyers have a deeper context compared to non-lawyers. Other evaluation tools in the market focus on the experience of the developer and we are focusing on making as easy as…
2025 · github.com
- 18
- 19FS
Hey HN, Bootstrapped founder here. I've got a bit of a story for you. We started desplega.ai to build a sophisticated AI platform that could automate E2E testing. We spent the last few months talking to dozens of QA leaders, and trying to learn what are their actual challenges. We've got one consistent feedback from large teams: their daily reality is a living hell of slow, clunky tools. We're talking about teams at major companies still managing tests on spreadsheets. Or they're stuck in a Jira instance so customized and slow you can “make a full pot of coffee” while a page loads (and…
Sep 2025 · tester.desplega.ai
- 20
- 21AT
Hi Hacker News! We're launching Zalor, an agent testing platform. Agents often break when you tweak system prompts, swap models, or add tools. Zalor automatically generates test scenarios and evaluates your agent so you know it's reliable before deploying to production. We currently support the OpenAI Agents SDK and are onboarding other frameworks. A GitHub integration is coming so you can get feedback on every update. Looking forward to hearing feedback from people building agents.
Mar 2026 · agents.zalor.ai
- 22
- 23
Deterministic offline release evidence for AI agents
Jul 2026 · iisacc-justmoong.github.io
- 24BE
Hey HN, We're excited to introduce Braintrust, a platform for running and tracking AI evaluations (“evals”) [1]. At my previous startup Impira and leading AI at Figma, we had this recurring problem where we never knew if changes we made to our products would improve or regress key user scenarios. We built some tooling to solve this problem and after talking to other developers learned that it was a widespread issue. Specifically, it’s challenging to establish a great dev loop that lets you systematically improve and ship high quality AI products. We worked with the teams at Zapier, Coda, and…
2023
Ranked by how close each launch is in meaning, then by votes. Refine with a description →