AgentDiff

What it does

Traditional evals test outputs, missing when agents loop on tools or burn 50% more tokens. AgentDiff fixes this by recording agent runs as DAGs and diffing execution trajectories against golden baselines directly in CI. It catches tool loops, cost spikes, and latency regressions before merge evaluating how the model arrived at the answer, not just what it returned. Framework-agnostic with adapters for OpenAI Agents, Langfuse, LangSmith, and OpenInference.

AgentDiff compares agent execution traces as DAGs in CI/CD - automatically detecting trajectory drift, redundant tool loops, and cost regressions.

Your agent returned the right answer, but took 5 extra steps and burned 3× the tokens. AgentDiff catches silent tool loops, cost surges, and execution drift in CI before your PR lands in production. Traditional assertions only check if the final output string matched. They are blind to execution drift — missing recursive tool loops, unverified prompt detours, and 3× cost surges before code merges. The agent still delivered the expected summary, so standard assertion tests pass easily in CI. Behind the scenes, a prompt tweak caused the agent to loop 3 times over the customer database. AgentDiff detects the step surge in milliseconds and fails the PR before it ever costs you real money. No…from agentdiff.lostmartian.in

• 
  Progress AI ObservabilityAug 2026 · telerik.com · ▲168

  Hi HN! We’re the team behind Fiddler, and we recently built an Agent Cache feature. It works by capturing an LLM request/response pair and, once caching is enabled, serving subsequent matching calls locally so duplicate requests never hit the provider. It’s meant to reduce three pains that show up together in agent development: token cost, feedback-loop latency, and output non-determinism. We’d love to hear your thoughts.

• 
  TrailsJan 2026 · trails-red.vercel.app · ▲81

  Hey all, Justin here. I previously built Phind, the AI search engine for developers. One of the biggest problems we had there was figuring out what went wrong with bad searches. We had tons of searches per day, but less than 1% of users gave any explicit feedback. So we were either manually digging through searches or making general system improvements and hoping they helped. This problem gets harder with agents. Traces are longer and more complex. It takes more effort to review them, so I'm building a tool that lets you analyze LLM outputs directly to help developers of LLM apps and agents…

• 
  AgenticLensApr 2026 · agenticlens.in · ▲64

  Visual debugging, tracing, and replay for agent workflows

• 
  Agent-skills-eval – Test whether Agent Skills improve outputsMay 2026 · github.com · ▲79

  A test runner for agentskills.io-style AI agent skills - darkrishabh/agent-skills-eval

• 
  TrajectlyMar 2026 · trajectly.dev · ▲2

  Deterministic regression testing for AI agents

• 
  Fix My Agent (FMA)Jan 2026 · docs.futureagi.com · ▲50

  See what breaks your AI agent and fix it automatically

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 30d ago · hemory.com

• TL
  The load-bearing vocabulary of Claude▲710

  Life & fun · Aug 2026 · louisabraham.github.io

• 
  Hey Noah▲656

  A proactive AI executive assistant for founders

  AI · Aug 2026 · heynoah.io

• 
  Clipto MCP▲655

  Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…

  Work · Aug 2026 · clipto.com

• 
  Simple algorithm and color space to generate diverse skin tones▲627

  Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…

  Life & fun · Aug 2026 · toneyalexander.github.io

• 
  AdAnt AI▲620

  Claude for viral, high-converting social ads

  AI · Aug 2026 · adant.ai

• 
  Astute▲606

  Automate your B2B brand going viral, with new media creators

  AI · Aug 2026 · company-app.joinastute.com