Alternatives
Products that do what Agent-evals – Claude skill to build your own evals does
I’ve spent the past 10 years working on AI in finance, with much of that time focused on building evaluation systems for production environments. As agents become more widely adopted, more software engineering and product people have start building them. But I’ve noticed that many teams are not yet fluent in systematic evaluation, or in the processes needed to keep agent quality high over time. For large organizations, that gap is rarely the bottleneck due to dedicated teams. But after speaking with a number of startups, it became clear that building strong, up-to-date evals is much harder…
- 1AS
May 2026 · github.com
- 2
- 3
- 4IB
I've been experimenting with ways to increase AI adoption for non-technical people. Basically, all companies are pushing for AI because it's all over the news and they feel left behind but most people have no clue where to start. I think 90% of people (ie non coders) are sufficiently well served by using cowork instead of claude code or something similar. If we can get people from sales, customer support, marketing, etc to collaborate with skills and cowork to form a company brain, I think it's gold. So I think there's opportunity for the community to share skills that work well for 1000s of…
Jun 2026 · claudinho.xyz
- 5RT
This project (Agents Observe) started as an exploration into building automation harnesses around claude code. I needed a way to see exactly what teams of agents were doing in realtime and to filter and search their output. A few interesting learnings from building and using this: - Claude code hooks are blocking - performance degrades rapidly if you have a lot of plugins that use hooks - Hooks provide a lot more useful info than OTEL data - Claude's jsonl files provide the full picture - Lifecycle management of MCP processes started by plugins is a bit kludgy at best The biggest takeaway is…
Apr 2026 · github.com
- 6
- 7IM
At my work they provided a single Claude subscription for everyone on the team. To be honest I like kiro better as it provides a way better SDD management. But the company can't provide it and I can't afford it yet. Turns out I had the skill creator skill in my claude instance so I made use of it to create this Skill. I made it fully by using Claude but I wanted to make it open source, so I asked it to help me make tests and preparations for it, even a CI to run python tests. Well, we got this results with it: - Phase 2A: 67 static assertions (Python script, runs in CI) - Phase 2B: 15…
May 2026 · github.com
- 8HW
A bunch of companies that I spoke to had their own claude & codex OTel dashboards that showed spend + seats per month. However, none of the dashboards actually analyzed how the engineers worked with the tools and if there were any areas for improvement! That's why I created https://www.promptster.ai. Managers get aggregate level view of code quality and how that ties with team workflows (nothing on a per-engineer level). While engineers get personalized coaching on how they can save tokens while keeping output high. We also have a tool built for individuals to test their local…
Jul 2026
- 9
- 10AE
I've been working on a site [1] to give people control of their LLM workflows through AI evals - automated checks that, once defined, let you move fast without regressions and cut through hype with proof. That one-liner is aimed at software engineers, but I've spent my career helping cross-functional teams collaborate, and that's really what this is about. AI agents make powerful workflows very plausible, but only if teams can grow them incrementally without losing control - no vendor lock-in, no discipline silos, no blind trust in outputs. The site tries to meet different audiences where…
Feb 2026 · ai-evals.io
- 11
Contribute to alpbahadur/interns-review-plugin development by creating an account on GitHub.
15h ago · github.com
- 12BY
we had hundreds of discussions with engineering leaders over the past few months, and everyone's trying to understand where they are in the AI journey. we collected all this data into a benchmark and built a free grader to let you know where you stand. you answer on a 1–5 scale (e.g., autonomy runs from "suggestions only" to "agents own multi-hour workflows across code, infra, and external systems") - takes about 5 minutes. https://agent-benchmarks.com/software-factory/ waiting for your results!
Jul 2026 · agent-benchmarks.com
- 13
- 14AM
Hey HN, I noticed there are 1,000+ MCP skills on GitHub with zero way for creators to charge for them. So I built Agent37. Selling Claude skills today means asking customers to download your skill, set up Claude Code on their laptops, configure MCP servers, and pray it works. No trial, no updates, often you're just handing over the source. Agent37 lets creators upload a skill, share a link, and anyone can try it instantly (no Claude account needed). Built-in Stripe, creators keep 80%. Looking for feedback on the approach. Would you use something like this?
Dec 2025 · agent37.com
- 15OS
Hey HN! We built EvalKit, a library you embed to capture agent actions and a UI where domain experts give feedback, evaluate and improve AI agents. We experienced, in large agentic systems, prompt-engineering or auto-prompt improvement tool can get accuracy from 0 to 50% but for increasing accuracy to 100% we had to work with domain experts. Example -> In a law ai agent, lawyers are needed because law is complex and lawyers have a deeper context compared to non-lawyers. Other evaluation tools in the market focus on the experience of the developer and we are focusing on making as easy as…
2025 · github.com
- 16AP
I'm Guy, the founder behind Snyk — now building Tessl, a package manager for agent skills. We’ve recently witnessed that most teams still treat skills as static artifacts: markdown files, created or copied from repo to repo. This approach offers a strong initial boost, but quickly creates debt: - Skills are duplicated, and updates never roll out. - Poor quality skills go unseen, misguiding agents instead of helping. - Skill knowledge grows stale, and don’t keep up with the systems and practices they describe. Without a way to evaluate skills, teams have no clear way to understand how good a…
Feb 2026 · tessl.io
- 17AD
Hey HN, as a former data analyst, I’ve been tooling around trying to get agents to do my old job. The result is this system that gets you maybe 80% of the way there. I think this is a good data point for what the current frontier models are capable of and where they are still lacking (in this case — hypothesis generation and general data intuition). Some initial learnings: - Generating web app-based reports goes much better if there are explicit templates/pre-defined components for the model to use. - Claude can “heal” broken charts if you give it access to chart images and run a…
Mar 2026 · rubenflamshepherd.com
- 18AA
I built a skill for building agents that helped me ship agentic products within days that otherwise took several weeks and broke often in production. It is inspired by gstack.
Aug 2026 · github.com
- 19
- 20IM
Hey HN, I’m Chris, a solo dev in Melbourne AU. For the past month I've been spending my after work hours building AgentVisa. I'm both excited (and admittedly nervous) to be sharing it with you all today. I've been spending a lot of time thinking about the future of AI agents and the more I experimented, the more I realized I was building on a fragile foundation. How do we build trust into these systems? How do we know what our agents are doing, and who gave them permission? My long-term vision is to give developers an "Agent Atlas" - a clear map of their agentic workforce, showing where…
2025 · agentvisa.dev
- 21
- 22MT
Creating high-quality skills for Claude manually is complex, requiring specific technical knowledge of the file system structure (like SKILL.md), YAML metadata configuration, and precise prompt engineering to ensure the agent behaves correctly. MakeSkill eliminates this friction by automating the technical implementation. Instead of writing code and configuration files from scratch, users interact with MakeSkill's AI to refine their ideas. The platform then generates the complete, optimized skill package—following all best practices—ready to be downloaded and imported directly into Claude…
Nov 2025 · makeskill.cc
- 23BE
Hey HN, We're excited to introduce Braintrust, a platform for running and tracking AI evaluations (“evals”) [1]. At my previous startup Impira and leading AI at Figma, we had this recurring problem where we never knew if changes we made to our products would improve or regress key user scenarios. We built some tooling to solve this problem and after talking to other developers learned that it was a widespread issue. Specifically, it’s challenging to establish a great dev loop that lets you systematically improve and ship high quality AI products. We worked with the teams at Zapier, Coda, and…
2023
- 24BA
I'm building a workspace for doing focus work while also managing constant multi-tasking and context-switching that's required in a lot of roles. Currently this is done by using a notes system where we can split-screen AI chat, an object-based data table system for tracking entities, as well as viewing other documents. We can define agents directly from documents by giving instructions in plain language and then defining the trigger conditions. This helps automate workflows directly in the place where we're reading and writing content. I'm continuing to experiment with instructions and…
2025 · useportals.dev
Ranked by how close each launch is in meaning, then by votes. Refine with a description →