What changed
The iphone-cli (or iph) project provides a command-line interface written in Rust that enables AI agents to read and operate applications on a physical iPhone. It achieves this by leveraging the device's accessibility tree, a structured representation of UI elements, rather than relying on screenshots or visual recognition. This approach eliminates the need for Xcode, WebDriverAgent, or any application to be installed on the iPhone itself. The tool connects to iPhones via USB or Wi-Fi, utilizing Apple's direct developer services for accessibility and HID (Human Interface Device) functionalities. It supports a built-in QuickJS engine for executing multi-step scripts directly on the device. The project emphasizes a safety-first approach with defined outcomes like 'done', 'not_sent', and 'unknown'. It is distributed as a single native binary for macOS and Windows, requiring no Python, Node.js, or Appium runtime. The latest release, v0.1.6, targets iOS 27 or later, with specific verification on an iPhone 15 Pro Max running iOS 27.0.1. The tool's functionality includes reading screen elements, finding elements by selector, tapping, and swiping, with options for long presses and drag gestures. It also supports text input via pasting and restoring clipboard content. For unattended operations, it offers a 'Do Not Disturb' mode. The project is built on the principle of 'Poki' and relies on the 'idevice' library for device communication.
Why it matters for builders
For AI builders, iphone-cli introduces a direct and low-overhead method for integrating real iPhone automation into their agent workflows. The ability to interact with an iPhone's accessibility tree means agents can understand and manipulate UI elements programmatically, which is more robust than image-based automation. This opens up avenues for creating sophisticated AI agents capable of performing complex tasks on iOS devices, such as automated testing, user flow simulation, or even assistive technology development, all without the typical development environment setup.
Practical impact
Developers can install iphone-cli with a single command on macOS or by downloading a binary for Windows. The setup process involves pairing the iPhone via USB, enabling developer mode on the device, and ensuring the developer disk image is installed. The iph doctor command guides users through these checks and provides actionable steps for any failed requirements, including Wi-Fi setup for wireless connections. The CLI offers commands like iph read, iph tap, and iph script for interacting with the device. For example, iph read --human displays the accessibility tree in a human-readable format, while iph tap "General" simulates a tap on the 'General' button. The tool's comparison with alternatives highlights its advantages in native accessibility tree access, lack of Xcode/signing requirements, and cross-platform host support (macOS and Windows), making it a compelling choice for AI agents targeting iOS 27+ devices.
Caveats and source limits
The iphone-cli tool is specifically designed for iOS 27 and later versions, with verification limited to iOS 27.0.1 on a single device model. Its functionality on earlier iOS versions or different iPhone models is not guaranteed. The project does not support simulators, Android devices, or Linux hosts. While it supports Wi-Fi connections, initial pairing requires USB, and wireless discovery might require manual IP configuration in some cases. The source does not provide details on performance benchmarks or specific pricing information, as it is an open-source project. The effectiveness of touch input relies on the phone's screen-sharing service, which is new in iOS 27, implying potential issues on iOS 26 or earlier.
Sources
Claim check: 10/10 supported claims - 10 evidence links - 100% avg confidence
- AI agents can read and operate any app on a real iPhone through the accessibility tree.supported - github.com
- iphone-cli does not require XCUITest, WebDriverAgent, or Xcode signing.supported - github.com
- The tool connects using direct Apple developer services over USB or Wi-Fi.supported - github.com
- It uses a built-in QuickJS engine for running multi-step flows.supported - github.com
- iphone-cli is a single native binary for macOS and Windows.supported - github.com
- The tool targets real iPhones on iOS 27 or later.supported - github.com
- Verification was performed on an iPhone 15 Pro Max with iOS 27.0.1.supported - github.com
- The tool supports Windows hosts.supported - github.com
- Touch and text input rely on a new screen-sharing service in iOS 27.supported - github.com
- iphone-cli is built on the principle of Poki and uses idevice (MIT) for device communication.supported - github.com
Caveats
- Single-source caution: verify critical details at the linked source.
Radar score 88/100 - how it was calculated
- Reliability 82: GitHub metadata supports source trust
- Freshness 100: Fresh GitHub release date
- Novelty 81: Fresh GitHub release
- Technical 85: Repository technical metadata
- Developer 96: Developer tooling signals
- Ecosystem 72: Fresh GitHub release
- Confidence 96: Claims have reliable evidence
Discussion
Loading comments...