nowfound

AI · alternatives · 2026

24 alternatives to Agent-skills-eval – Test whether Agent Skills improve outputs

A test runner for agentskills.io-style AI agent skills - darkrishabh/agent-skills-eval

Agent-skills-eval is a testing tool designed to measure whether Agent Skills enhance the quality of outputs. Available on GitHub, it enables developers and AI researchers to evaluate the effectiveness of skill… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.

  1. 1
    Atla▲492

    Automatically detect errors in your AI agents

    2025 · atla-ai.com · its alternatives →

  2. 2
    Tessl▲260

    I'm Guy, the founder behind Snyk — now building Tessl, a package manager for agent skills. We’ve recently witnessed that most teams still treat skills as static artifacts: markdown files, created or copied from repo to repo. This approach offers a strong initial boost, but quickly creates debt: - Skills are duplicated, and updates never roll out. - Poor quality skills go unseen, misguiding agents instead of helping. - Skill knowledge grows stale, and don’t keep up with the systems and practices they describe. Without a way to evaluate skills, teams have no clear way to understand how good a…

    Feb 2026 · tessl.io · its alternatives →

  3. 3
    Scorecard▲391

    Evaluate, Optimize, and Ship AI Agents

    2025 · scorecard.io · its alternatives →

  4. 4
    Prefactor▲580

    Evaluate your AI Agents in real-time

    Jul 2026 · prefactor.tech · its alternatives →

  5. 5

    An open benchmark for AI agents that test APIs

    May 2026 · resources.kusho.ai · its alternatives →

  6. 6
    Skillkit▲252

    It's an open-source project that lets you create, translate, and work with multiple agents at the same time, and more.

    Feb 2026 · agenstskills.com · its alternatives →

  7. 7

    Hey HN! We’ve been building an MCP server to help AI-assisted web app developers by using browser agents to test whether changes made by an AI inside an editor actually work. We've been testing it on scenarios like verifying new flows in a UI, or checking that sending a chat request triggers a response. The idea is to let your coding agent both code and evaluate if what it did was correct. Here’s a short demo with Cursor: https://www.youtube.com/watch?v=_AoQK-bwR0w When building apps, we found the hardest part of AI-assisted coding isn’t the coding—it’s tedious point-and-click…

    2025 · github.com · its alternatives →

  8. 8
    EarlyAI▲356

    AI Agent for test code generation

    2024 · startearly.ai · its alternatives →

  9. 9
    AgentR▲139

    Hiring evaluation built for the AI cheating era

    2025 · agentr.global · its alternatives →

  10. 10

    Scan AI agent Skills for risks before you install them

    17d ago · agentguard-sigma-five.vercel.app · its alternatives →

  11. 11

    An evaluation and evolution tool for Agent Skills. - alibaba/skill-up

    Jul 2026 · github.com · its alternatives →

  12. 12

    Security-scored directory for AI skills and agent tools

    Feb 2026 · skillshield.io · its alternatives →

  13. 13

    Skills with 210k GitHub Data & Translate/Refine &Benchmark

    Mar 2026 · skills-refiner.com · its alternatives →

  14. 14

    I’ve spent the past 10 years working on AI in finance, with much of that time focused on building evaluation systems for production environments. As agents become more widely adopted, more software engineering and product people have start building them. But I’ve noticed that many teams are not yet fluent in systematic evaluation, or in the processes needed to keep agent quality high over time. For large organizations, that gap is rarely the bottleneck due to dedicated teams. But after speaking with a number of startups, it became clear that building strong, up-to-date evals is much harder…

    May 2026 · github.com · its alternatives →

  15. 15

    high quality AI skills marketplace. every skill is reviewed by a person and shows the same prompt answered without and with the skill. curated by @skeptrune.

    Sep 2026 · skillbay.sh · its alternatives →

  16. 16AS
  17. 17

    Deterministic offline release evidence for AI agents

    Jul 2026 · iisacc-justmoong.github.io · its alternatives →

  18. 18AE

    I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…

    Feb 2026 · ai-evals.io · its alternatives →

  19. 19

    Hi HN! Run it: OPENROUTER_API_KEY="sk" npx bff-eval --demo We built a tool to help people take LLM outputs and easily grade them / eval them to know how good an assistant response is. We've built a number of LLM apps, and while we could ship decent tech demos, we were disappointed with how they'd perform over time. We worked with a few companies who had the same problem, and found out scientifically building prompts and evals is far from a solved problem... writing these things feels more like directing a play than coding. Inspired by Anthropic's constitutional ai concepts, and amazing…

    2025 · github.com · its alternatives →

  20. 20

    Generate eval datasets and test your agent in minutes

    Apr 2026 · dutchmanlabs.com · its alternatives →

  21. 21

    Hey HN! We built EvalKit, a library you embed to capture agent actions and a UI where domain experts give feedback, evaluate and improve AI agents. We experienced, in large agentic systems, prompt-engineering or auto-prompt improvement tool can get accuracy from 0 to 50% but for increasing accuracy to 100% we had to work with domain experts. Example -> In a law ai agent, lawyers are needed because law is complex and lawyers have a deeper context compared to non-lawyers. Other evaluation tools in the market focus on the experience of the developer and we are focusing on making as easy as…

    2025 · github.com · its alternatives →

  22. 22
    Spec27▲34

    Hi HN! We’re a team of ML validation specialists and we’ve been building /Spec27, a tool for testing whether AI agents still do their job safely and reliably as models, prompts, tools, and surrounding systems change. We started working on this because a lot of current LLM evaluation work seems aimed at scoring general model behavior, while many teams are deploying systems that have a specific mission to fulfill. Many of the tools also assume you have full access to the agent stack and traces so you can place SDKs and Gateways, but a lot of agents are being created on vendor platforms…

    Apr 2026 · spec27.ai · its alternatives →

  23. 23

    Stop trusting vendor demos. Interrogate them with AI first.

    Apr 2026 · github.com · its alternatives →

  24. 24

    Contribute to alpbahadur/interns-review-plugin development by creating an account on GitHub.

    Sep 2026 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →