onehumanbeing /esp32-iphone-agent
Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.
★ 5,012⑂ 686👁 17⑃ 110● 46▤ 14
+36
Daily
+287
Weekly
5,012
stars
686
forks
17
watchers
110
prs
46
issues
14
releases
README
ESP32 iPhone Agent An AI agent uses a real iPhone like a person. It even made a phone call on its own. No jailbreak, no developer account, open source. If this is useful, a ⭐ helps a lot Try on TestFlight · Flash the board · Not a developer? · Watch the demo · Docs · Changelog English · 简体中文 A real iPhone doing a Duolingo lesson by itself, sped up 8×. Nobody touches the screen. Featured on Hackaday · Digital Trends · Ruanyf Weekly 415 · Seeed Studio Follow along: X @iamhenryyuan · Xiaohongshu · YouTube demo · DeepSeek Harness demo · handsy.tech Building on this project? Keep the LICENSE and credit ESP32 iPhone Agent by Henry Yuan in your README and posts. See NOTICE. What's new - It hears the phone. The board forwards AirPlay audio and the iPhone turns it into words, so listening exercises and voice prompts work. How it works. - Free Jev line. Jev takes the plain steps in a fraction of a second and leaves the rest to the large model; the agent loop is rebuilt around one model call per step. - Long tasks. No 40-step limit; any stopped run can continue. Every run can be replayed step by step on the phone. Get it on TestFlight (App Store listing in review). Needs board firmware v0.2.4. Full changelog. Why a board Most iPhone agents run on a computer. Before the first task you install Xcode, turn on Developer Mode, pair the phone over USB and type commands into a terminal, and the computer has to stay on for every task after that. Fine for a developer, a wall for everyone else. Here the board does the computer's job, so the phone is all you need. | | ESP32 iPhone Agent | Computer-tethered agentsWebDriverAgent, CoreDevice, idevice | |---|---|---| | What you need | An iPhone and a $7 board | A Mac (often a recent macOS), full Xcode, developer tools | | Setup | Flash in the browser, install from TestFlight, four guided steps in the app | Terminal: clone, build, install dependencies, sign the helper app | | Changes on the iPhone | AssistiveTouch on (the app walks you through it) | Developer Mode, USB trust and pairing | | While it runs | Just the phone. Take it anywhere | The computer stays on and connected | | Apps it can use | Any app a person can use: it sees the screen and moves a pointer | What the debug and accessibility interfaces expose | | Hears the phone | Yes (App 1.0.2) | Usually not | The honest costs: you buy a $7 board, each step takes a few seconds (most of it the model), and the phone uses cellular data while it runs because the board's hotspot takes the Wi-Fi. Not a developer? Start here 1. Get the board. A Seeed XIAO ESP32S3, about $7: what to buy. 2. Flash it in Chrome or Edge. No tools to install: handsy.tech/install. 3. Install the app and follow its four setup steps. TestFlight · setup guide with pictures. Stuck? See troubleshooting or mail [email protected]. [!NOTE] Free line busy or failing? The free model line is shared and can be busy or
Top issues
#115iOS app: pointer / sensitivity calibration inaccurate — taps and draw strokes miss (fw 0.2.4, Export trace attached)3 comments · 2026-11-07#104相对 HID 点击前校验指针落点,纠偏失败时停止点击3 comments · 2026-11-07#134加入计划进度,避免 Jev 重复操作并减少主模型调用2 comments · 2026-11-09#106iOS:模型任务结束后统一执行 reset,恢复自动化遗留的临时状态2 comments · 2026-11-07#95Listening and speaking exercises (Duolingo): AirPlay audio in, board as a USB microphone out1 comments · 2026-11-06#150Phone calls (Beta): slow start, captions setup, and rough conversations0 comments · 2026-11-12#149Chinese typing: detect the nine-key (九宫格) pinyin and third-party keyboards0 comments · 2026-11-12#146Idea: drive a Mac/PC from the phone (board plugged into a computer)0 comments · 2026-11-10
Latest release
esp32agent 0.1.4 cli-v0.1.4 2026-11-08esp32agent CLI 0.1.4. Install: see cli/README.md.
相关报道 (2)
News & coverage (5)
Hacker NewsESP32-iPhone-agent: Let an AI model use an iPhone via ESP32, AirPlay, USB HID▲ 3 · 0 comments · 2026-10-15Hacker NewsESP32 iPhone Agent▲ 2 · 0 comments · 2026-10-17opensourceforuESP32 iPhone Agent Opens AI Phone Automation2026-10-15noteAI operates a real iPhone with a $7 board. Reading the 'ESP32 iPhone Agent' documentation2026-10-14HacksterESP32 iPhone Agent: Control Your iPhone with AI2026-10-14