device-mobile-automation

What problem does it solve?

It enables reliable UI automation on real and simulated mobile devices, eliminating slow manual tapping to complete device-driven workflows.

Core Features & Use Cases

• Mobile device driving: Automates discovery and selection of iOS/Android devices and simulators/emulators, then performs app install/launch/terminate and UI interactions (tap, swipe, typing, and device button presses).
• Accessibility-tree targeting: Finds UI elements using accessibility-id first, then label/name/role, with coordinate fallback after fresh snapshots.
• Safety boundaries for mobile risks: Enforces stop-and-ask handling for OS/app-store/biometric/security-critical overlays and disallows jailbreak/root/DRM/biometric bypass and protected payment flows.
• Use case: You want to run the same end-to-end UI flow on an iPhone simulator and an Android emulator to regression-test onboarding steps and capture consistent run artifacts.

Quick Start

Ask to automate your phone or tablet’s UI flow, for example: "Run the device-mobile-automation skill to launch the app, navigate to the target screen, and complete the steps while stopping for any permission or biometric prompts."