I built an AI Agent that uses the iPhone
It’s powered by OpenAI’s GPT 4.1 model. Uses Xcode UI tests + accessibility tree to look into apps, and performs swipes, taps, etc to get things done.
I built an AI Agent that uses the iPhone launched on June 2, 2025 with 53 votes, #538 of 7,999 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 1 year on.
In plain words
This AI agent automates tasks on iPhones by using OpenAI's GPT-4.1 model to understand and interact with apps. It leverages Xcode UI tests and accessibility trees to identify interface elements, then executes actions like swipes and taps to complete requested tasks. The tool is designed for developers and users seeking iPhone automation capabilities through natural language commands.
written from the facts on this page · September 2026
From the sources
This is an iPhone using Agent that uses OpenAI models to get things done on a phone, spanning across multiple apps, very similar to a human user. It was built during an OpenAI hackathon last year.
An AI agent that can get things done across iPhone apps. - rounak/PhoneAgent
# iOS bundle identifier example ./.agents/skills/phoneagent/scripts/rpc.py open-app com.apple.Preferences # Android package example ./.agents/skills/phoneagent/scripts/rpc.py open-app com.android.settings # Fetch tree ./.agents/skills/phoneagent/scripts/rpc.py get-tree # Capture screenshot (writes PNG under /tmp/phoneagent-artifacts) ./.agents/skills/phoneagent/scripts/rpc.py get-screen-image --print-metadata The CLI supports --host and --port if you need non-default endpoint settings. ./.agents/skills/phoneagent/scripts/start_android_rpc_bridge_local.sh --serial < PHONE_IP:ADB_PORT > Security Model RPC bridge is localhost-oriented ( 127.0.0.1 ) iOS physical-device workflow uses localhost…from github.com
Does a similar job
all alternatives →
AI Assistant2023 · aichat.fm · ▲455A simple Go package for unified AI chat management across OpenRouter, OpenAI, Google GenAI, and more, with support for tool calling and S3-compatible user sessions
More ai this month
the category →
Paintings by AI models: programs run through a simulation of oil paint.
AI · 20d ago · stillwet.art
PixVerse R2▲381A real-time world model you can explore and change
AI · 28d ago · world.pixverse.video
Source: Show HN post ↗
Launched alongside, June 2025
the whole month →- IM
Hey HN! Pilots everywhere are required to keep a logbook of all their flying hours, aircraft, airports, and so on. Since I track everything digitally (some people still just use paper logbooks!), I put together some data visualizations and a few 3D globes to show my flying history. This globe is probably my favourite so far: https://jameshard.ing/pilot/globes/all If you’ve got ideas for other graphs or ways to show this kind of data, I’d love to hear them!
Life & fun · 2025 · jameshard.ing
Stunning presentations with AI. No design skills required.
AI · 2025 · chroniclehq.com
Build native mobile apps for iOS and Android without code.
Dev tools · 2025 · bble.io
All your connections, across all your socials.
AI · 2025 · pally.com
I was the main contributor to workout.lol, an open-source fitness app to easily build a workout routine. The project had traction (1.4k GitHub stars, 95 forks, ~20K visits/month), but was eventually sold due to video licensing hurdles. The new owner stopped maintaining it, and the repo went abandoned. Over the next 9 months, I sent 15 emails to try to save it : no replies. Feature requests & issues were ignored. The community was left with a "broken" tool let's say. I couldn't just let it die So I built the new version from scratch with the same open-source spirit, but a better…
Dev tools · 2025 · github.com