Open-source SDK to generate UI-based CUA tools or RPA scripts on macOS
My friend and I were building UI-based automation tools for small businesses and kept running into a few recurring problems: - Computer-use agents (CUAs) are powerful, but often unreliable and slow when controlling UIs directly. - Workflows vary — some can be handled deterministically by RPAs, while others need a bit more intelligence from CUAs (while they may share a lot of the same 'actions'). We wanted an easier way to record UI-based automation scripts that could: - Be run by humans, like a lightweight RPA, or - Be invoked by CUAs as tool calls — improving their reliability and speed. So…
What it does
In the maker’s words, at launch
My friend and I were building UI-based automation tools for small businesses and kept running into a few recurring problems: - Computer-use agents (CUAs) are powerful, but often unreliable and slow when controlling UIs directly. - Workflows vary — some can be handled deterministically by RPAs, while others need a bit more intelligence from CUAs (while they may share a lot of the same 'actions'). We wanted an easier way to record UI-based automation scripts that could: - Be run by humans, like a lightweight RPA, or - Be invoked by CUAs as tool calls — improving their reliability and speed. So we open-sourced the SDK we’ve been using internally. It currently works on macOS, and lets you: - Record desktop interactions with any app that exposes accessibility info - Record browser interactions via the Chrome extension (link on the github). - Replay recordings deterministically like an RPA, or integrate the generated UI script as a callable tool for your CUA. We’d love feedback from anyone working on UI automation, RPAs, or CUAs — especially around reliability and edge-case handling.
Does the same job
all alternatives →
OpenCode SuperappJul 2026 · opencodesuper.app · ▲128The power of Codex with local, self-hosted models and voice
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, October 2025
the whole month →
- SA
I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…
AI · Oct 2025 · blog.shashanktomar.com
- ASAutism Simulator▲779
Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…
Life & fun · Oct 2025 · autism-simulator.vercel.app
