What problem does it solve?
It enables reliable UI automation on real and simulated mobile devices, eliminating slow manual tapping to complete device-driven workflows.
Core Features & Use Cases
- Mobile device driving: Automates discovery and selection of iOS/Android devices and simulators/emulators, then performs app install/launch/terminate and UI interactions (tap, swipe, typing, and device button presses).
- Accessibility-tree targeting: Finds UI elements using accessibility-id first, then label/name/role, with coordinate fallback after fresh snapshots.
- Safety boundaries for mobile risks: Enforces stop-and-ask handling for OS/app-store/biometric/security-critical overlays and disallows jailbreak/root/DRM/biometric bypass and protected payment flows.
- Use case: You want to run the same end-to-end UI flow on an iPhone simulator and an Android emulator to regression-test onboarding steps and capture consistent run artifacts.
Quick Start
Ask to automate your phone or tablet’s UI flow, for example: "Run the device-mobile-automation skill to launch the app, navigate to the target screen, and complete the steps while stopping for any permission or biometric prompts."