Alternatives
Products that do what Open-source eval framework for AI agents does
aligned to the OWASP Agentic Security Initiative Top 10
- 1
- 2NO
Hello HN! The day has finally come to stop adding features and start sharing what I've been building the last 5-6 months. It's a bit of CrewAI, OpenDevon, LangFuse/Cloud all in one, providing devs who prefer TypeScript an integrated framework thats provides a lot out of the box to start experimenting and building agents with. It started after peeking at the LangChain docs a few times and never liking the example code. I began experimenting with automating a simple Jira request from the engineering team to add an index to one of our Google Spanner databases (for context I'm the…
2024 · github.com
- 3
- 4
- 5
- 6
- 7AO
2024 · github.com
- 8
- 9EA
Hey HN, I've been working on an open-source framework for creating AI agents that evolve, communicate, and collaborate to solve complex tasks. The Evolving Agents Framework allows agents to: Reuse, evolve, or create new agents dynamically based on semantic similarity Communicate and delegate tasks to other specialized agents Continuously improve by learning from past executions Define workflows in YAML, making it easy to orchestrate agent interactions Search for relevant tools and agents using OpenAI embeddings Support multiple AI frameworks (BeeAI, etc.) Current Status & Roadmap This is…
2025 · github.com
- 10OS
Hey HN, We are Winston, Edward, and James, and we built Meka Agent, an open-source framework that lets vision-based LLMs execute tasks directly on a computer, just like a person would. Backstory: In the last few months, we've been building computer-use agents that have been used by various teams for QA testing, but realized that the underlying browsing frameworks aren't quite good enough yet. As such, we've been working on a browsing agent. We achieved 72.7% on WebArena compared to the previous state of the art set by OpenAI's new ChatGPT agent at 65.4%. You can read more about it here:…
2025 · github.com
- 11FA
Hello! We just released freeact (https://github.com/gradion-ai/freeact), a lightweight agent library that empowers language models to act as autonomous agents through executable code actions. By enabling agents to express their actions directly in code rather than through constrained formats like JSON, freeact provides a flexible and powerful approach to solving complex, open-ended problems that require dynamic solution paths. * Supports dynamic installation and utilization of Python packages at runtime * Agents learn from feedback and store successful code actions as…
2025 · github.com
- 12OS
We build runtime security for AI agents. The playground started as an internal tool that we used to test our own guardrails. But we kept finding the same types of vulnerabilities because we think about attacks a certain way. At some point you need people who don't think like you. So we open-sourced it. Each challenge is a live agent with real tools and a published system prompt. Whenever a challenge is over, the full winning conversation transcript and guardrail logs get documented publicly. Building the general-purpose agent itself was probably the most fun part. Getting it to reliably use…
Mar 2026 · github.com
- 13AU
Hello hackernews! I'm excited to share a new open source python library I just released for creating AI agent-integrated systems. The name is `agency`. It differs from other agent libraries, most importantly in that it's intended to address a distinct part of the overall problem, that of agent integration. It is not an agent toolchain like LangChain and others. `agency` is a framework intended for safely integrating agents with computing systems and humans in a way that all parties can easily understand and communicate with each other. I've spent a lot of time on the readme which contains a…
2023 · github.com
- 14GA
Hey HN! Wanted to show our open source agent harness called Gambit. If you’re not familiar, agent harnesses are sort of like an operating system for an agent... they handle tool calling, planning, context window management, and don’t require as much developer orchestration. Normally you might see an agent orchestration framework pipeline like: compute -> compute -> compute -> LLM -> compute -> compute -> LLM we invert this so with an agent harness, it’s more like: LLM -> LLM -> LLM -> compute -> LLM -> LLM -> compute -> LLM Essentially you describe each agent in either a self contained…
Jan 2026 · github.com
- 15TO
2025 · github.com
- 16AA
Nov 2025 · github.com
- 17
- 182C
Single-agent LLMs suck at long-running complex tasks. We’ve open-sourced a multi-agent orchestrator that we’ve been using to handle long-running LLM tasks. We found that single LLM agents tend to stall, loop, or generate non-compiling code, so we built a harness for agents to coordinate over shared context while work is in progress. How it works: 1. Orchestrator agent that manages task decomposition 2. Sub-agents for parallel work 3. Subscriptions to task state and progress 4. Real-time sharing of intermediate discoveries between agents We tested this on a Putnam-level math problem, but the…
Feb 2026 · github.com
- 19IB
Excited to share a project I’ve been building for months! Would love to receive honest feedback :) My motivation: AI is clearly going to be the interface for data. But earlier attempts (text-to-SQL, etc.) fell short — they treated it like magic. The space has matured: teams now realize that AI + data needs structure, context, and rules. So I built a product to help teams deliver “chat with data” solutions fast with full control and observability (agent tracing, quality scores, etc) — am I wrong? The product allows you to connect any LLM to any data source with centralized context…
Oct 2025 · github.com
- 20AM
Hey HN, Michael and Scott here. We’re open-sourcing an interactive murder mystery featuring LLM-driven character agents. Solve the mystery by finding clues, taking notes, and interrogating agents. They all have distinct motives, personality, and can impact the game in different ways (attacking you, running away, etc). Try it out, it’s pretty fun! We’re also open-sourcing the framework that we used to make and refine the agents. The goal is to create an intuitive interface for storytellers to create, debug, and test game agents. We then take those game agents and expose an API beyond just…
2023 · gron.games
- 21AA
Hey HN! I am super excited (and slightly nervous) to introduce AgentServe! AgentServe is a framework to make hosting scalable AI agents as easy as possible. With 4 lines of code AS wraps your agent (any framework) in a FastAPI and connects it to a Task Queue (celery or redis). Why Should You Care? Standardized Communication Pattern: AgentServe proposes that all agents should communicate with each other and the outside world with “Tasks” that can be submitted in a sync or async way. This simple API wil enable Framework Agnostic: No favorites. OpenAI, LangChain, LlamaIndex, CrewAI are all…
2024 · github.com
- 22GA
Hello! Introducing geniusrise, an agent framework and component ecosystem for building AI agent networks that are as flexible as your team. landing page: https://geniusrise.ai (fancy but useless) docs: https://docs.geniusrise.ai (please check this out) github: https://github.com/geniusrise (for dear devs) ## Thought process Since the ChatGPT disruption, I've been pondering on what the tooling layer is going to look like for building LLM-interfacing agents. Saw a plethora of tools coming out as we witness here every week. I'd broadly categorize them into the…
2023 · github.com
- 23OS
2024 · github.com
- 24
Ranked by how close each launch is in meaning, then by votes. Refine with a description →