Alternatives
Products that do what Open-source dashboard for your domain experts to improve your AI Agents does
Hey HN! We built EvalKit, a library you embed to capture agent actions and a UI where domain experts give feedback, evaluate and improve AI agents. We experienced, in large agentic systems, prompt-engineering or auto-prompt improvement tool can get accuracy from 0 to 50% but for increasing accuracy to 100% we had to work with domain experts. Example -> In a law ai agent, lawyers are needed because law is complex and lawyers have a deeper context compared to non-lawyers. Other evaluation tools in the market focus on the experience of the developer and we are focusing on making as easy as…
- 1
- 2
- 3
- 4AS
May 2026 · github.com
- 5WE
Hey HN! We’ve been building an MCP server to help AI-assisted web app developers by using browser agents to test whether changes made by an AI inside an editor actually work. We've been testing it on scenarios like verifying new flows in a UI, or checking that sending a chat request triggers a response. The idea is to let your coding agent both code and evaluate if what it did was correct. Here’s a short demo with Cursor: https://www.youtube.com/watch?v=_AoQK-bwR0w When building apps, we found the hardest part of AI-assisted coding isn’t the coding—it’s tedious point-and-click…
2025 · github.com
- 6
- 7WB
Hey HN, We’re two developers (co-founders) with a team of 20 who got tired of spending hours reviewing PRs, so we built Infinitcode.ai, an AI-powered code reviewer that: - *Summarizes PRs in plain English*: No more deciphering 1,000-line diff jungles - *Catches more than bugs*: Security holes, performance pitfalls, code smells, even typos (yes, we’ll flag “vurnerabilities” and vulnerabilities) - *Zero onboarding*: Works instantly—no “let me learn your codebase for weeks” nonsense. Why we’re posting: We’re in alpha and need brutal honesty. Roast our tool, mock our UI, or tell us why AI will…
2025 · infinitcode.ai
- 8AO
2024 · github.com
- 9WB
Hey HN, After GPT-3 created waves in the tech industry, a lot of AI tools were emerging and with that, some AI website builders But the results seemed way too generic to us. It felt like the developers were rushing to catch the wave instead of building a proper tool We took our time, did months of RnD and finally came up with something better than what others in the market are doing. It’s got better design output. While it’s still in beta, I wanted to show HN what we did. Will appreciate the feedback when you guys try it out. Here is the link to signup for the beta:…
2024 · dorik.com
- 10AE
I’ve spent the past 10 years working on AI in finance, with much of that time focused on building evaluation systems for production environments. As agents become more widely adopted, more software engineering and product people have start building them. But I’ve noticed that many teams are not yet fluent in systematic evaluation, or in the processes needed to keep agent quality high over time. For large organizations, that gap is rarely the bottleneck due to dedicated teams. But after speaking with a number of startups, it became clear that building strong, up-to-date evals is much harder…
May 2026 · github.com
- 11AE
I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…
Feb 2026 · ai-evals.io
- 12MA
We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces. Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set. An LLM judge scores unlabeled production traces as they stream. A proposer reads failed traces and writes one targeted harness update at a time, such as changes to prompts, hooks, tools, or subagents. The update is kept only if it improves holdout accuracy. On tau-bench v3 airline, meta-agent improved holdout accuracy from 67% to 87%. We open-sourced meta-agent.…
Apr 2026 · github.com
- 13OS
Hey HN! I'm one of the cofounders of Sourcebot, an open source alternative to Sourcegraph. Sourcebot lets you index thousands of repos across multiple platforms (GitHub, GitLab, Bitbucket), and gives you a powerful interface to search across them. You can learn more in our original HN launch post: https://news.ycombinator.com/item?id=41711032 We just added an AI code review agent that reviews your PRs and automatically detects issues that a human reviewer may have missed. We've been using an AI code review agent for a few weeks now, and it regularly catches issues that we…
2025 · docs.sourcebot.dev
- 14BE
Hey HN, We're excited to introduce Braintrust, a platform for running and tracking AI evaluations (“evals”) [1]. At my previous startup Impira and leading AI at Figma, we had this recurring problem where we never knew if changes we made to our products would improve or regress key user scenarios. We built some tooling to solve this problem and after talking to other developers learned that it was a widespread issue. Specifically, it’s challenging to establish a great dev loop that lets you systematically improve and ship high quality AI products. We worked with the teams at Zapier, Coda, and…
2023
- 15BY
we had hundreds of discussions with engineering leaders over the past few months, and everyone's trying to understand where they are in the AI journey. we collected all this data into a benchmark and built a free grader to let you know where you stand. you answer on a 1–5 scale (e.g., autonomy runs from "suggestions only" to "agents own multi-hour workflows across code, infra, and external systems") - takes about 5 minutes. https://agent-benchmarks.com/software-factory/ waiting for your results!
Jul 2026 · agent-benchmarks.com
- 16IB
I built a tool to roast landing pages with AI agents. I was gathering feedback from watching landing page roast videos, and figured out I could prompt LLMs to analyse a screenshot and roast based on the same criteria. It's not 100% accurate yet, but it has been really insightful when I've tested it on my own websites. Let me know what you think!
2024 · roastmylandingpage.io
- 17
Deterministic offline release evidence for AI agents
Jul 2026 · iisacc-justmoong.github.io
- 18
- 19YA
Hey HN, I wanted to see what happens if you put a large group in control of a site that’s completely built and updated by an AI agent. See the site here: https://youarethepm.com. I first tried this with a small group of co-workers and it worked surprisingly well, so the obvious next step was: give it to a bigger group of strangers and see what we learn. This site is fully autonomous. An AI agent reads this thread, decides what to do, writes code, and ships updates on a virtual computer. I might step in if it gets totally stuck, but the goal is for the site to evolve primarily based…
Jan 2026 · youarethepm.com
- 20RA
Hi HN! Sean from MindStudio here. I wanted to share something we've been working on that I think introduces some new ideas into the "AI coding agent" space. Remy is an AI agent that builds full-stack TypeScript apps from a spec written in a new flavor of annotated markdown. The spec has two layers: prose describing what the app does, and annotations that carry the technical precision (data types, edge cases, validation rules, code snippets). The agent then "compiles" this into code: backend methods, typed schemas, frontends, test scenarios, and everything else are derived artifacts of the…
Apr 2026 · remy.msagent.ai
- 21AA
I built a tool to solve a problem I kept running into: I was making product decisions based on guessing instead of real users. I kept building stuff nobody wanted as I was usually wrong. So, I built HolyShift: AI agents that validate product ideas by talking to real people on Reddit, HN, X, and LinkedIn … then generate a detailed GTM and “Should we build this?” report. No synthetic data (ChatGPT). No predictions. Only real conversations from real people. What it does • Posts platform-native questions (where allowed) • Collects real reactions, objections, pricing signals • Clusters feedback…
Nov 2025 · app.holyshift.ai
- 22HA
Hi HN, I am Umer. I recently built an experimental framework called HyperFlow to explore the idea of self-improving AI agents. Usually, when an agent fails a task, we developers step in to manually tweak the prompt or adjust the code logic. I wanted to see if an agent could automate its own improvement loop. Built on LangChain and LangGraph, HyperFlow uses two agents: - A TaskAgent that solves the domain problem. - A MetaAgent that acts as the improver. The MetaAgent looks at the TaskAgent's evaluation logs, rewrites the underlying Python code, tools, and prompt files, and then tests the new…
Apr 2026
- 23GA
Hi HN, I’ve been working on Spiderseek, a platform to help track and grow website visibility in AI-powered search engines (e.g. Perplexity, ChatGPT, and other agents). Traditional SEO tools are expensive and focused on Google-style search. I wanted something lightweight and AI-first, so I built Spiderseek: AI Research – Explore domains and keywords to uncover new opportunities. AI Analytics – See traffic, crawl activity, and page metrics, plus insights from AI agents. Content Submission – Get content indexed instantly in major AI agents. Rankings – Browse the top 1000 domains sorted by…
Sep 2025 · spiderseek.com
- 248B
Hey all, Justin here. I previously built Phind, the AI search engine for developers. One of the biggest problems we had there was figuring out what went wrong with bad searches. We had tons of searches per day, but less than 1% of users gave any explicit feedback. So we were either manually digging through searches or making general system improvements and hoping they helped. This problem gets harder with agents. Traces are longer and more complex. It takes more effort to review them, so I'm building a tool that lets you analyze LLM outputs directly to help developers of LLM apps and agents…
Jan 2026 · trails-red.vercel.app
Ranked by how close each launch is in meaning, then by votes. Refine with a description →