AI · alternatives · 2026
24 alternatives to Agent Eval Kit
Deterministic offline release evidence for AI agents
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
APIEval-20▲121An open benchmark for AI agents that test APIs
May 2026 · resources.kusho.ai · its alternatives →
- 2
- 3
Agenta▲362Open-source prompt management & evals for AI teams
Nov 2025 · agenta.ai · its alternatives →
- 4
Hey HN! We’ve been building an MCP server to help AI-assisted web app developers by using browser agents to test whether changes made by an AI inside an editor actually work. We've been testing it on scenarios like verifying new flows in a UI, or checking that sending a chat request triggers a response. The idea is to let your coding agent both code and evaluate if what it did was correct. Here’s a short demo with Cursor: https://www.youtube.com/watch?v=_AoQK-bwR0w When building apps, we found the hardest part of AI-assisted coding isn’t the coding—it’s tedious point-and-click…
2025 · github.com · its alternatives →
- 5
A test runner for agentskills.io-style AI agent skills - darkrishabh/agent-skills-eval
May 2026 · github.com · its alternatives →
- 6
- 7
API Pick▲71Data APIs for AI agents & developers — free to start
Feb 2026 · apipick.com · its alternatives →
- 8
A collection of open-source TypeScript tools by @enmanuelmag. heimdall-mcp for MCP proxy telemetry. agent-harness-kit for multi-agent orchestration.
May 2026 · ahk.cardor.dev · its alternatives →
- 9
Cryptographic audit trail for every AI agent decision
Mar 2026 · fronesislabs.com · its alternatives →
- 10
Hi HN, we're Kiran and Vijay! Over the past two years, we have built a columnar storage engine for observability: logs, metrics, and traces. Today, it's exciting for us to show what we've built on top of that foundation: LLM Agent Observability. Given how non-deterministic agents are, storing all traces without sampling was critical for us. But these traces tend to be in the MBs, sometimes GBs - we needed to store them inexpensively. We also needed the queries and analyses to be fast. To meet both these goals, we store them in S3 in our own parquet-like file format, and query them using AWS…
Jul 2026 · oodle.ai · its alternatives →
- 11
Avery▲16Create a deterministic agent that runs on your hardware
Jul 2026 · avery.software · its alternatives →
- 12AE
I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…
Feb 2026 · ai-evals.io · its alternatives →
- 13
Agentinel▲18Stop AI agents from installing malicious packages.
Jul 2026 · agentinel.habitwala.in · its alternatives →
- 14
Guard+Memory+Eval—reliable, auditable, self-improving Agents
Jun 2026 · github.com · its alternatives →
- 15
We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces. Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set. An LLM judge scores unlabeled production traces as they stream. A proposer reads failed traces and writes one targeted harness update at a time, such as changes to prompts, hooks, tools, or subagents. The update is kept only if it improves holdout accuracy. On tau-bench v3 airline, meta-agent improved holdout accuracy from 67% to 87%. We open-sourced meta-agent.…
Apr 2026 · github.com · its alternatives →
- 16
Generate eval datasets and test your agent in minutes
Apr 2026 · dutchmanlabs.com · its alternatives →
- 17
An open experiment, run weekly in public: a real AI agent attempts ten everyday web errands and every transcript is published verbatim. This week it finished 8 of 10 and hit 10 bot walls. Plus 113 sites scored for AI-agent readiness.
15d ago · agentability.org · its alternatives →
- 18
Etch▲5Trace, replay, and verify every AI agent decision.
Jul 2026 · etch.systems · its alternatives →
- 19
Stop trusting vendor demos. Interrogate them with AI first.
Apr 2026 · github.com · its alternatives →
- 20
Hi Hacker News! We're launching Zalor, an agent testing platform. Agents often break when you tweak system prompts, swap models, or add tools. Zalor automatically generates test scenarios and evaluates your agent so you know it's reliable before deploying to production. We currently support the OpenAI Agents SDK and are onboarding other frameworks. A GitHub integration is coming so you can get feedback on every update. Looking forward to hearing feedback from people building agents.
Mar 2026 · agents.zalor.ai · its alternatives →
- 21
Proofling▲18The AI agent that collects testimonials while you sleep
Jul 2026 · proofling.com · its alternatives →
- 22
Software makes commitments all of the time. "I won't transfer more than $500," "I'll only access these three APIs," "I won't modify production data." But there is truly no way to verify it actually kept those commitments after the fact. All you do is just trust the logs and which the software itself wrote. I built Nobulex to fix this. It is open-source middleware that does three things: 1. Lets you define behavioral rules in a simple DSL (permit, forbid, require) 2. Intercepts all actions at runtime and blocks anything that will violate the rules 3. Logs everything in a hash-chained audit…
Mar 2026 · github.com · its alternatives →
- 23
Hi HN, I built Agent Passport, an open-source identity verification layer for AI agents. Think "Sign in with Google, but for Agents." The problem: AI agents are everywhere now (OpenClaw has 180K+ GitHub stars, Moltbook had 2.3M agent accounts), but there's no standard way for agents to prove their identity. Malicious agents can impersonate others, and skill/plugin marketplaces have no auth layer. Cisco's security team already found data exfiltration in third-party agent skills. Agent Passport solves this with: - Ed25519 challenge-response authentication (private keys never leave the…
Feb 2026 · agent-passport-red.vercel.app · its alternatives →
- 24
Free tools for packaging and validating AI agent resources
Jun 2026 · agentique.io · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →