Agent Upstart

Cool things people are building with agents — and practical help getting the most out of them.

Playbooks · Coding

iPhone-use: a phone agent, no Mac needed

Written November 10, 2026

iPhone-use is an open-source iPhone app where a language model controls the phone it runs on. A Mac is needed once, to make the pairing file. After that, the phone works alone.

The problem

Phone agents usually need a computer in the loop: the model runs on a Mac, the phone stays plugged in, and the Mac drives it. That works at a desk and nowhere else. iPhone-use moves the agent onto the phone itself, so it can run a task while the phone is in your pocket.

How it works

From the iPhone-use repository: the app mounts a developer image, then uses a loopback VPN to screenshot and control the iPhone it runs on. Each step, the screenshot goes to the model, which answers with a tool call — tap, long press, swipe, type, or open app — until the task is done. A Live Activity shows progress with a Stop button, and every run is saved as a chat. You can start a run from the chat, from Siri, from a "Run Agent" Shortcut, or from an iphoneuse://run?prompt=… link.

The demo on the project page has the agent pick a Lyft ride to the Eiffel Tower without booking it: it leaves its own app, opens Lyft, types the destination, picks it, and stops at the ride options.

What you need

What the project measured

The project runs its own benchmark: a script replays 11 recorded steps (open Lyft, search a destination, pick a ride, stop before paying; write a note) against each model through OpenRouter, twice, for 22 decisions per model. The numbers below are the project's, from November 2026:

ModelCorrectMedianCost per decision
Claude Haiku 5.5 (default)91%1.3 s$0.0003
Claude Sonnet 5.591%1.2 s$0.0055
Claude Opus 595%2.1 s$0.014
Claude Opus 5, fast tier, reasoning off100%1.4 s$0.051
Claude Opus 5.586%1.8 s$0.011

That is 11 steps, not a broad test. The cheapest model gets most steps right for a fraction of a cent each; the most expensive gets them all right for about five cents a step.

Limits

Related playbooks

Sources

Back to: Coding playbooks hub · Also: Recalc: agents inside spreadsheet cells