I spent 3 months making desktop automation stop lying to AI agents

What it does

Agent Desktop gives any agent reliable computer use on the desktop. Built with Rust, it sees any app's real UI structure through OS accessibility trees and operates it — refs stay stable and actions stay safe to retry, instead of guessing from pixels. - lahfir/agent-desktop

In the maker’s words, at launch

That's a bold claim. But I genuinely feel like I might have actually solved computer use (demo: https://x.com/mdlahfir/status/2088109763783700827?s=20) For context, I've been building agent-desktop (Inspired by agent-browser by Vercel Labs), an automation CLI for desktop apps. It's like…

• 
  Agent-desktop – Native desktop automation CLI for AI agentsMay 2026 · github.com · ▲99

  I've been building computer-use tools for a while, and I quietly launched this about a month ago (122 Stars on GH). I figured it was worth sharing here. Over the last few months, a lot of computer-use agents have come out: Codex, Claude Code, CUA, and others. Most of them seem to work roughly like this: 1. Take a screenshot 2. Have the model predict pixel coordinates 3. Click x,y 4. Take another screenshot 5. Repeat That works, but it's slow, expensive in tokens, and fragile. If the UI shifts a few pixels, things break. And the model still doesn't know what any element actually is. But the…

• 
  ComputerX2025 · computerx.ai · ▲560

  Introducing the first-ever desktop AI agent that gets your computer tasks done for you. Like having your own AI operator that seamlessly integrates with every app on your computer!

• 
  Atomic2023 · github.com · ▲140

  Hey HN, I’ve been building Atom (https://github.com/rush86999/atom), an open-source, self-hosted AI automation platform. I built this because while tools like OpenClaw are excellent for one-off scripts and personal tasks, I found them difficult to use for complex business workflows (e.g., managing invoices or SaaS ops). The main issue was State Blindness: the agent would fire a command and assume it worked, without "seeing" if the UI or state actually updated. I just shipped a new architecture to solve this called Canvas AI Accessibility. The Technical Concept: Instead of…

• 
  Open-source browser for AI agentsMar 2026 · github.com · ▲155

  Hi HN, I forked chromium and built agent-browser-protocol (ABP) after noticing that most browser-agent failures aren’t really about the model misunderstanding the page. Instead, the problem is that the model is reasoning from a stale state. ABP is designed to keep the acting agent synchronized with the browser at every step. After each action (click, type, etc), it freezes JavaScript execution and rendering, then captures the resulting state. It also compiles the notable events that occurred during that action loop, such as navigation, file pickers, permission prompts, alerts, and downloads,…

• 
  AgentOne DesktopAug 2026 · agent-one.dev · ▲78

  Automate boring work. Extensible and free desktop AI agent.

• 
  Owl BrowserJan 2026 · owlbrowser.net · ▲145

  I've been working on browser automation infrastructure for a while and kept hitting the same ceiling: Playwright and Puppeteer are great for scripting but fall apart when you need stealth at scale. Cloud-based solutions like Browserbase work but you're sending all your data to a third party and can't control the environment. So we built Owl Browser, a self-hosted Chromium-based engine that runs in a single Docker container. The core technical problem we tried to solve was fingerprint consistency. Most browser automation tools either ignore fingerprinting entirely or apply surface-level…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 19d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 19d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 21d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 22d ago · stillwet.art

• 
  Beam.win▲379

  Run AI agents on one Mac and use its windows on another

  AI · 5d ago · beam.win

• 
  FastRouter.ai▲364

  Route requests to the right LLM for cost, latency & quality

  AI · 23d ago · fastrouter.ai

• TL
  The load-bearing vocabulary of Claude▲710

  Life & fun · Aug 2026 · louisabraham.github.io

• 
  Hey Noah▲656

  A proactive AI executive assistant for founders

  AI · Aug 2026 · heynoah.io

• 
  Clipto MCP▲655

  Hey HN, We recently built Clipto. It’s a tool that lets you search over terabytes of video, audio, and images on your computer, without relying on the cloud. Motivation: we probably all had this similar experience, we know a moment exists in a video or audio, but finding it takes hours scrubbing the timeline. You can send all the media to process in the cloud, but it’s slow, expensive and raises privacy concerns. So we decided to build our own on-device media search engine. How it works (high level): 1. We ingest video, audio, image; normalize formats via ffmpeg; run content analysis to…

  Work · Aug 2026 · clipto.com

• 
  Simple algorithm and color space to generate diverse skin tones▲627

  Hello HN! I found that picking out plausible but diverse skin tones for my digital art and game development projects was kind of difficult, and I got curious about if there was a way to define a color space that made it easy. I've built a color picker and procedural generation algorithm based on the space as well as a bunch of other fun js features and demos throughout the page that use the equations. If you find it interesting, I have lots of explanations of how I built it and what properties the space has. The methodology might be a bit shaky, but hopefully the result is as helpful for…

  Life & fun · Aug 2026 · toneyalexander.github.io

• 
  AdAnt AI▲620

  Claude for viral, high-converting social ads

  AI · Aug 2026 · adant.ai

• 
  Astute▲606

  Automate your B2B brand going viral, with new media creators

  AI · Aug 2026 · company-app.joinastute.com