AI · alternatives · 2026
24 alternatives to Werkbank – 40 tool-using tasks to evaluate self-hosted LLMs
Autonomy benchmark for self-hosted LLM agents. Verifiable task completion, stateful workflows, coding, and efficiency. - aisyndicate-ch/victors-werkbank
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Prices are shown for the 2 we have checked on their own sites, 2 of them free or with a free tier.
- 1
Codex Subagents▲300Parallel custom agents for complex tasks
Mar 2026 · learn.chatgpt.com · its alternatives →
- 2

Hey HN, We’ve been building browser agents for a while. In production, we kept converging on the same pattern: deterministic scripts for the happy path, agents only for edge cases. So we built Demonstrate Mode. The idea is simple: You perform your workflow once in a remote browser. Notte records the interactions and generates deterministic automation code. How it works: - Record clicks, inputs, navigations in a cloud browser - Compile them into deterministic code (no LLM at runtime) - Run and deploy on managed browser infrastructure Closest analog is Playwright codegen but: - Infrastructure…
2025 · notte.cc · its alternatives →
- 3

Microsoft’s decision model for agents and workflows
Oct 2026 · commandline.microsoft.com · its alternatives →
- 4

Single-agent LLMs suck at long-running complex tasks. We’ve open-sourced a multi-agent orchestrator that we’ve been using to handle long-running LLM tasks. We found that single LLM agents tend to stall, loop, or generate non-compiling code, so we built a harness for agents to coordinate over shared context while work is in progress. How it works: 1. Orchestrator agent that manages task decomposition 2. Sub-agents for parallel work 3. Subscriptions to task state and progress 4. Real-time sharing of intermediate discoveries between agents We tested this on a Putnam-level math problem, but the…
Feb 2026 · github.com · its alternatives →
- 5
Backenlyfree tier, from $25/mo▲169The autonomous backend for AI coding agents
20d ago · backenly.com · its alternatives →
- 6
APIEval-20▲121An open benchmark for AI agents that test APIs
May 2026 · resources.kusho.ai · its alternatives →
- 7

- 8

- 9

Intelligent model routing for code, agents and workflows
Oct 2026 · asterwise.dev · its alternatives →
- 10
M9Rfree tier▲56Multiplayer space for your AI coding agents and teams
Sep 2026 · app.m9r.workers.dev · its alternatives →
- 11
Semwright▲67Give AI agents structured access to real software
Oct 2026 · semwright.com · its alternatives →
- 12

- 13

we had hundreds of discussions with engineering leaders over the past few months, and everyone's trying to understand where they are in the AI journey. we collected all this data into a benchmark and built a free grader to let you know where you stand. you answer on a 1–5 scale (e.g., autonomy runs from "suggestions only" to "agents own multi-hour workflows across code, infra, and external systems") - takes about 5 minutes. https://agent-benchmarks.com/software-factory/ waiting for your results!
Jul 2026 · agent-benchmarks.com · its alternatives →
- 14

If you're interested in exploring what LLM-based agent systems these days actually do to solve certain benchmarks such as SWEBench or WebArena, we created a small leaderboard with our team, that allows to view a lot of public and OSS agent results including all the runtime traces (the step-by-step reasoning behind the scenes). Looking at traces is actually quite interesting, as they reveal a lot about the inner working and shortcomings of current agent system, e.g. see https://explorer.invariantlabs.ai/u/invariant/webarena--SteP... for an example trace.
2024 · explorer.invariantlabs.ai · its alternatives →
- 15

An agent that remembers across sessions can keep its memory as curated markdown files, as an auto-mined structured store, or as trained experience.
Aug 2026 · pinglin.tw · its alternatives →
- 16

We’re excited to share ML-Dev-Bench, a new open-source benchmark that tests AI agents on real-world ML development tasks. Unlike typical coding challenges or Kaggle-style competitions, our benchmark simulates end-to-end ML workflows including: - Dataset handling and preprocessing - Debugging model and code failures - Implementing new model architectures - Fine-tuning and improving existing models With 30 diverse tasks, ML-Dev-Bench evaluates agents across critical stages of ML development. To complement this, we built Calipers, a framework that provides systematic performance evaluation and…
2025 · github.com · its alternatives →
- 17

Enables small-to-large self-hosted ai models to use local source code when running tool-calling agentic workloads. We actively data mine 20,900+ (2+ TB) popular github repos using large and small ai models to create reuseable: json, markdown and parquet files for local-first tool-calling models. - d
May 2026 · github.com · its alternatives →
- 18

We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces. Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set. An LLM judge scores unlabeled production traces as they stream. A proposer reads failed traces and writes one targeted harness update at a time, such as changes to prompts, hooks, tools, or subagents. The update is kept only if it improves holdout accuracy. On tau-bench v3 airline, meta-agent improved holdout accuracy from 67% to 87%. We open-sourced meta-agent.…
Apr 2026 · github.com · its alternatives →
- 19

Hey HN, I've been building AutoAgents, an AI agent framework in Rust. Today I'm sharing a feature I haven't seen done well elsewhere: composable middleware layers for LLM inference pipelines. The problem Every agent framework lets you swap LLM providers. Almost none of them give you a structured way to enforce safety, caching, or data sanitization in the inference path itself. You end up with guardrails as application-level if-statements, caching bolted on as a separate service, and PII handling as a "we'll add it later" TODO that never ships. This gets worse with local models. Cloud APIs…
Mar 2026 · github.com · its alternatives →
- 20

GEAR: An Open General Evolutionary Architecture for Recursive Self-Improvement of LLM Agent Harness. An open framework for harness evolution, reproducible evaluation, and learning across tasks.
21d ago · rsi-gear.github.io · its alternatives →
- 21

Dynamiq is an orchestration framework for agentic AI and LLM applications
2024 · github.com · its alternatives →
- 22

Enable LLMs to Program Themselves. Contribute to Osly-AI/Pocket-Flow-Framework development by creating an account on GitHub.
2025 · github.com · its alternatives →
- 23

We combined Stanford's ACE (agents learning from execution feedback) with the Reflective Language Model pattern. Instead of reading traces in a single pass, an LLM writes and runs Python in a sandbox to programmatically explore them - finding cross-trace patterns that single-pass analysis misses. The framework achieved 2x consistency improvement on τ2-bench.
Mar 2026 · github.com · its alternatives →
- 24

An open experiment, run weekly in public: a real AI agent attempts ten everyday web errands and every transcript is published verbatim. This week it finished 8 of 10 and hit 10 bot walls. Plus 113 sites scored for AI-agent readiness.
Oct 2026 · agentability.org · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →