Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.

★ 5,012⑂ 686👁 17⑃ 110● 46▤ 14
SwiftMITCreated 2026-10-11handsy.tech?ref=github
Download: esp32agent 0.1.4cli-v0.1.4 ↓0.1.42026-11-08
+36
Daily
+287
Weekly
5,012
stars
686
forks
17
watchers
110
prs
46
issues
14
releases

README

ESP32 iPhone Agent


  An AI agent uses a real iPhone like a person.
  It even made a phone call on its own. No jailbreak, no developer account, open source.



  If this is useful, a ⭐ helps a lot
   



  Try on TestFlight ·
  Flash the board ·
  Not a developer? ·
  Watch the demo ·
  Docs ·
  Changelog


English · 简体中文


  
  A real iPhone doing a Duolingo lesson by itself, sped up 8×. Nobody touches the screen.





  
  
  
  


Featured on Hackaday · Digital Trends · Ruanyf Weekly 415 · Seeed Studio

Follow along: X @iamhenryyuan · Xiaohongshu · YouTube demo · DeepSeek Harness demo · handsy.tech

Building on this project? Keep the LICENSE and credit ESP32 iPhone Agent by Henry Yuan in your README and posts. See NOTICE.

 What's new



- It hears the phone. The board forwards AirPlay audio and the iPhone turns it into words, so listening
  exercises and voice prompts work. How it works.
- Free Jev line. Jev takes the plain steps in a fraction of a second and leaves the rest to the large model;
  the agent loop is rebuilt around one model call per step.
- Long tasks. No 40-step limit; any stopped run can continue. Every run can be replayed step by step on the phone.

Get it on TestFlight (App Store listing in review). Needs board firmware
v0.2.4. Full changelog.

 Why a board

Most iPhone agents run on a computer. Before the first task you install Xcode, turn on Developer Mode, pair the
phone over USB and type commands into a terminal, and the computer has to stay on for every task after that.
Fine for a developer, a wall for everyone else. Here the board does the computer's job, so the phone is all you need.

| | ESP32 iPhone Agent | Computer-tethered agentsWebDriverAgent, CoreDevice, idevice |
|---|---|---|
| What you need | An iPhone and a $7 board | A Mac (often a recent macOS), full Xcode, developer tools |
| Setup | Flash in the browser, install from TestFlight, four guided steps in the app | Terminal: clone, build, install dependencies, sign the helper app |
| Changes on the iPhone | AssistiveTouch on (the app walks you through it) | Developer Mode, USB trust and pairing |
| While it runs | Just the phone. Take it anywhere | The computer stays on and connected |
| Apps it can use | Any app a person can use: it sees the screen and moves a pointer | What the debug and accessibility interfaces expose |
| Hears the phone | Yes (App 1.0.2) | Usually not |

The honest costs: you buy a $7 board, each step takes a few seconds (most of it the model), and the phone uses
cellular data while it runs because the board's hotspot takes the Wi-Fi.

 Not a developer? Start here

1. Get the board. A Seeed XIAO ESP32S3, about $7: what to buy.
2. Flash it in Chrome or Edge. No tools to install: handsy.tech/install.
3. Install the app and follow its four setup steps. TestFlight ·
   setup guide with pictures.

Stuck? See troubleshooting or mail [email protected].

 [!NOTE]
 Free line busy or failing? The free model line is shared and can be busy or

Top issues

Latest release

esp32agent 0.1.4 cli-v0.1.4 2026-11-08
esp32agent CLI 0.1.4. Install: see cli/README.md.

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON