Why it matters
This project offers AI builders a novel way to automate iPhone interactions without complex setup or platform limitations. Developers can integrate real iPhone control into AI agents, enabling new possibilities for testing, automation, and user experience research on physical devices.

What changed

The iphone-cli (or iph) project provides a command-line interface written in Rust that enables AI agents to read and operate applications on a physical iPhone. It achieves this by leveraging the device's accessibility tree, a structured representation of UI elements, rather than relying on screenshots or visual recognition. This approach eliminates the need for Xcode, WebDriverAgent, or any application to be installed on the iPhone itself. The tool connects to iPhones via USB or Wi-Fi, utilizing Apple's direct developer services for accessibility and HID (Human Interface Device) functionalities. It supports a built-in QuickJS engine for executing multi-step scripts directly on the device. The project emphasizes a safety-first approach with defined outcomes like 'done', 'not_sent', and 'unknown'. It is distributed as a single native binary for macOS and Windows, requiring no Python, Node.js, or Appium runtime. The latest release, v0.1.6, targets iOS 27 or later, with specific verification on an iPhone 15 Pro Max running iOS 27.0.1. The tool's functionality includes reading screen elements, finding elements by selector, tapping, and swiping, with options for long presses and drag gestures. It also supports text input via pasting and restoring clipboard content. For unattended operations, it offers a 'Do Not Disturb' mode. The project is built on the principle of 'Poki' and relies on the 'idevice' library for device communication.

Why it matters for builders

For AI builders, iphone-cli introduces a direct and low-overhead method for integrating real iPhone automation into their agent workflows. The ability to interact with an iPhone's accessibility tree means agents can understand and manipulate UI elements programmatically, which is more robust than image-based automation. This opens up avenues for creating sophisticated AI agents capable of performing complex tasks on iOS devices, such as automated testing, user flow simulation, or even assistive technology development, all without the typical development environment setup.

Practical impact

Developers can install iphone-cli with a single command on macOS or by downloading a binary for Windows. The setup process involves pairing the iPhone via USB, enabling developer mode on the device, and ensuring the developer disk image is installed. The iph doctor command guides users through these checks and provides actionable steps for any failed requirements, including Wi-Fi setup for wireless connections. The CLI offers commands like iph read, iph tap, and iph script for interacting with the device. For example, iph read --human displays the accessibility tree in a human-readable format, while iph tap "General" simulates a tap on the 'General' button. The tool's comparison with alternatives highlights its advantages in native accessibility tree access, lack of Xcode/signing requirements, and cross-platform host support (macOS and Windows), making it a compelling choice for AI agents targeting iOS 27+ devices.

Caveats and source limits

The iphone-cli tool is specifically designed for iOS 27 and later versions, with verification limited to iOS 27.0.1 on a single device model. Its functionality on earlier iOS versions or different iPhone models is not guaranteed. The project does not support simulators, Android devices, or Linux hosts. While it supports Wi-Fi connections, initial pairing requires USB, and wireless discovery might require manual IP configuration in some cases. The source does not provide details on performance benchmarks or specific pricing information, as it is an open-source project. The effectiveness of touch input relies on the phone's screen-sharing service, which is new in iOS 27, implying potential issues on iOS 26 or earlier.

Sources

Written with AI assistance from the linked sources; every claim below was checked against them automatically. How we produce articles.

Claim check: 10/10 supported claims - 10 evidence links - 100% avg confidence
  • AI agents can read and operate any app on a real iPhone through the accessibility tree.supported - github.com
  • iphone-cli does not require XCUITest, WebDriverAgent, or Xcode signing.supported - github.com
  • The tool connects using direct Apple developer services over USB or Wi-Fi.supported - github.com
  • It uses a built-in QuickJS engine for running multi-step flows.supported - github.com
  • iphone-cli is a single native binary for macOS and Windows.supported - github.com
  • The tool targets real iPhones on iOS 27 or later.supported - github.com
  • Verification was performed on an iPhone 15 Pro Max with iOS 27.0.1.supported - github.com
  • The tool supports Windows hosts.supported - github.com
  • Touch and text input rely on a new screen-sharing service in iOS 27.supported - github.com
  • iphone-cli is built on the principle of Poki and uses idevice (MIT) for device communication.supported - github.com

Caveats

  • Single-source caution: verify critical details at the linked source.
Radar score 88/100 - how it was calculated
Reliability82
Freshness100
Novelty81
Technical85
Developer96
Ecosystem72
Confidence96
  • Reliability 82: GitHub metadata supports source trust
  • Freshness 100: Fresh GitHub release date
  • Novelty 81: Fresh GitHub release
  • Technical 85: Repository technical metadata
  • Developer 96: Developer tooling signals
  • Ecosystem 72: Fresh GitHub release
  • Confidence 96: Claims have reliable evidence
Share
XLinkedInHacker News

Discussion

Loading comments...

Related articles

AI Coding - Nov 19, 2026Termaxa: AI Agent Shell Command Safety GateTermaxa is a new Rust binary that acts as a gatekeeper for AI coding agents interacting with the shell. It previews command consequences, takes backups, and enforces policies before execution, aiming to prevent accidental damage from agents like Claude Code, Codex, Cursor, and Copilot.AI Tools - Nov 19, 2026Moli: Rust-based Headless Browser for AI AgentsMoli is a production-ready, Rust-built headless browser designed for AI agents, offering a lightweight footprint with on-demand rendering. It supports CLI, CDP, and WebDriver protocols, running on Linux, macOS, and Windows.AI Coding - Nov 20, 2026ConeCode: Desktop AI Coding Workspace with RSIConeCode is a new desktop workspace for AI coding agents, built with Electron, React, and TypeScript. It integrates chat, file editing, terminal, Git, and browser preview, with a key feature being bounded, evidence-driven Recursive Self-Improvement (RSI). The tool supports multiple agent modes and model providers, aiming to enhance software development through disciplined self-improvement loops.AI Coding - Nov 16, 2026cdpilot: Browser Automation CLI with Zero Dependenciescdpilot is a new command-line interface tool for browser automation that operates directly on the Chrome DevTools Protocol (CDP) without relying on external libraries like Puppeteer, Playwright, or Selenium. It offers over 70 commands for navigation, interaction, and testing, designed to be AI-agent friendly and provide isolated browser sessions.AI Coding - Nov 20, 2026Apple RAG: AI Agent Tool for Apple Developer DocsThe Apple RAG project provides an AI agent tool that integrates Apple's developer documentation and WWDC transcripts. It utilizes a hybrid retrieval system combining keyword and semantic search, with Jev relevance ranking to deliver contextually accurate information to AI agents.AI Coding - Nov 16, 2026Open Walnut: Self-Hosted AI Agent Workspace with Claude Code IntegrationOpen Walnut is a new self-hosted, local-first application that integrates AI agents, including Claude Code, into a single web interface. It offers durable coding sessions, task management, and note-taking capabilities, aiming to replace multiple developer tools.