Skills
.Work. You
Rest

android-cli-ui-automation-skill

Community

Drive Android UI flows with AI actions.

Software Engineering#ui automation#android#agent skill#adb input#layout tree#screenshot targeting#device orchestration
Authortakahirom
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill removes the guesswork and manual steps of interacting with an Android app by letting an AI repeatedly locate UI elements and perform the corresponding taps, text input, and navigation until your goal is achieved.

Core Features & Use Cases

  • Launch and navigate apps or URLs: Start installed apps, open a URL via Android intents, or run an APK on a connected device.
  • Observe UI reliably: Use structured UI trees via android layout and fall back to screenshot labeling with android screen capture/resolve when layout is ambiguous.
  • Act on the device: Perform taps, text entry, swipes, and key events via adb shell input, re-observing after each action to stay in sync with the screen state.
  • Multi-device support: Target a specific device/emulator using adb serial (-s) and Android CLI --device.

Quick Start

Ask your agent to launch your APK and tap the “Sign in” button, and the agent will iterate through launch, observe, act, and re-observe steps until the flow completes.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: android-cli-ui-automation-skill
Download link: https://github.com/takahirom/android-cli-ui-automation-skill/archive/main.zip#android-cli-ui-automation-skill

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.