OculOS – Any desktop app as a JSON API via OS accessibility tree
Hi HN, I built OculOS because giving AI agents (like Claude Code or Cursor) control over desktop apps is still surprisingly difficult. Most current solutions rely on slow OCR/Vision or fragile pixel coordinates. OculOS is a lightweight daemon written in Rust that reads the OS accessibility tree and exposes every button, text field, and menu item as a structured JSON API and MCP server. Why this is different: Semantic Control: No screenshots or coordinates. The agent interacts with actual UI elements (e.g., "Click the 'Play' button"). Rust-powered: Single binary, zero dependencies, and…
OculOS – Any desktop app as a JSON API via OS accessibility tree launched on March 7, 2026 with 18 votes, #910 of 23,380 launches that month and more than 90% of that year's launches.
In plain words
OculOS is a lightweight Rust tool that exposes desktop application interfaces as JSON APIs by reading the OS accessibility tree. It enables users to interact with any desktop app—clicking buttons, typing text, and toggling checkboxes—through REST endpoints or as an MCP server that integrates with Claude, Cursor, and Windsurf. The single binary runs on Windows, Linux, and macOS, making it useful for developers building automation tools or AI-assisted desktop application control. It is MIT licensed.
written from the facts on this page · September 2026
From the sources
If it's on the screen, it's an API. Control any desktop app via REST + MCP. Rust. - huseyinstif/oculos
In the maker’s words, at launch
Single Rust binary (~3 MB) that reads the OS accessibility tree and gives every UI element a REST endpoint. Click buttons, type text, toggle checkboxes — all via JSON. Works as an MCP server too, so Claude/Cursor/Windsurf can control any desktop app out of the box. Windows + Linux + macOS. MIT licensed.
Does a similar job
all alternatives →
Slint – A declarative UI toolkit for embedded and desktop2023 · slint.dev · ▲291Slint is a declarative GUI toolkit written primarily in Rust, with API support for multiple programming languages such as C++ and JavaScript. It is designed for desktop and embedded usage. The Slint website has just been redesigned. And we added a new Royalty-Free License option besides GPL and commercial
Cursor for your API2025 · app.getelva.ai · ▲473Generate, edit, lint & test your API workflow in one place
1CodeJan 2026 · github.com · ▲569Just to clarify the background a bit. This project wasn’t planned as a big standalone release at first. On January 16, Ollama added support for an Anthropic-compatible API, and I was curious how far this could be pushed in practice. I decided to try plugging local Ollama models directly into a Claude Code-style workflow and see if it would actually work end to end. Here is the release note from Ollama that made this possible: https://ollama.com/blog/claude Technically, what I do is pretty straightforward: - Detect which local models are available in Ollama. - When…
MCP-stama – An ultra-fast Rust MCP server with no dependenciesAug 2026 · github.com · ▲73An ultra-fast, single-binary MCP server written in Rust as a lightweight alternative to Node.js/Python. - StamManif/mcp-stama
Rust built open-sourced CLI tool for API specification validation2022 · github.com · ▲23Stop half-done APIs! Cherrybomb is a CLI tool that helps you avoid undefined user behaviour by auditing your API specifications, validating them and running API security tests. - blst-security/cherrybomb
- WMWe made an MCP Server so Cursor can build things from REST API docs2025 · npmjs.com · ▲102
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 21d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 30d ago · world.pixverse.video
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, March 2026
the whole month →
Switch from ChatGPT to Claude with import memory feature
AI · Mar 2026 · claude.com
Littlebird▲709Littlebird remembers everything across your meetings, messages, docs, and apps, then takes action so you can recall any detail and never lose context.
AI · Mar 2026 · littlebird.ai
