Understudy – Teach a desktop agent by demonstrating a task once
I built Understudy because a lot of real work still spans native desktop apps, browser tabs, terminals, and chat tools. Most current agents live in only one of those surfaces. Understudy is a local-first desktop agent runtime that can operate GUI apps, browsers, shell tools, files, and messaging in one session. The part I'm most interested in feedback on is teach-by-demonstration: you do a task once, the agent records screen video + semantic events, extracts the intent rather than coordinates, and turns it into a reusable skill. Demo video:…
Understudy – Teach a desktop agent by demonstrating a task once launched on March 12, 2026 with 120 votes, #341 of 23,380 launches that month and more than 95% of that year's launches.
In plain words
Understudy is a local-first desktop agent that operates across native apps, browsers, terminals, and messaging tools in a single session. Users can teach it tasks by demonstrating them once—the agent records the action, extracts intent rather than specific coordinates, and converts it into a reusable skill. It's designed for people whose work spans multiple applications and need automation that understands intent across these different surfaces, not brittle coordinate-based macros.
written from the facts on this page · September 2026
From the sources
An understudy watches. Then performs. Contribute to understudy-ai/understudy development by creating an account on GitHub.
In the maker’s words, at launch
I built Understudy because a lot of real work still spans native desktop apps, browser tabs, terminals, and chat tools. Most current agents live in only one of those surfaces. Understudy is a local-first desktop agent runtime that can operate GUI apps, browsers, shell tools, files, and messaging in one session. The…
Does a similar job
all alternatives →
UnderstudyMar 2026 · understudy-ai.github.io · ▲4I've been building Understudy, an open-source GUI agent for macOS. Wanted to push the GUI stuff beyond the usual short demos, so I tried turning it into an iPhone app reviewer. You give it one prompt. It browses the real App Store in Chrome, installs the app on a real iPhone through macOS iPhone Mirroring (not a simulator), opens the app and explores it — never seen Snapseed before — records clips and screenshots, composites a narrated review video with FFmpeg locally, uploads it to YouTube, then deletes the app. About an hour, didn't touch the keyboard. The exploration part is what I'm…
- LSLearning SICP with Understudy2014 · blog.understudyapp.com · ▲109
ADEJul 2026 · ade-app.dev · ▲99Use any coding subscription you already pay for, in one synced app that runs on web, desktop, terminal, and mobile. All your chats stay synced between all ade surfaces. Run agents from your laptop, continue the conversation from your phone at dinner, then later finish it off from another computer by simply using the web client. All subs, all in one place. Fully free and open source!
Agent-desktop – Native desktop automation CLI for AI agentsMay 2026 · github.com · ▲99I've been building computer-use tools for a while, and I quietly launched this about a month ago (122 Stars on GH). I figured it was worth sharing here. Over the last few months, a lot of computer-use agents have come out: Codex, Claude Code, CUA, and others. Most of them seem to work roughly like this: 1. Take a screenshot 2. Have the model predict pixel coordinates 3. Click x,y 4. Take another screenshot 5. Repeat That works, but it's slow, expensive in tokens, and fragile. If the UI shifts a few pixels, things break. And the model still doesn't know what any element actually is. But the…
SkillForgeFeb 2026 · skillforge.expert · ▲102Stop repeating the same clicks and typing every day. Record a task once and SkillForge turns it into a skill your AI assistant (Claude, ChatGPT) replays for you. No coding. Free to start.
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, March 2026
the whole month →
Switch from ChatGPT to Claude with import memory feature
AI · Mar 2026 · claude.com
Littlebird▲709Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.
AI · Mar 2026 · littlebird.ai
