skills.rest
conorluddy
conorluddyCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

ui-automation-workflows

Automate iOS simulator UI interactions via IDB accessibility queries.

179|17|Updated Nov 6, 2025
Search Tags:#automation#testing#accessibility#UI#iOS#describe#IDB
One-click install
npx skills add https://github.com/conorluddy/xclaude-plugin --skill ui-automation-workflows
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ui-automation-workflows
Source: https://github.com/conorluddy/xclaude-plugin/tree/main/skills/ui-automation-workflows
Command: npx skills add https://github.com/conorluddy/xclaude-plugin --skill ui-automation-workflows

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides an accessibility-first framework for automating iOS simulator interactions via IDB, reducing manual testing effort and token usage by prioritizing the accessibility tree over screenshots.

Core Features & Use Cases

  • Accessibility-first UI automation: prioritize querying the accessibility tree before screenshots to identify elements quickly and reliably.
  • Unified IDB automation: use a single MCP tool (execute_idb_command) to describe, find, tap, and input across flows.
  • Use cases: automate login flows, form filling, navigation verification, and UI state validation on the iOS simulator.

Quick Start

Enable the ui-automation-workflows and run a quick test: describe booted; find-element with query 'Login'; tap; describe to verify navigation.

Frequently Asked Questions about ui-automation-workflows

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate iOS simulator UI testing using accessibility labels?▼

Automate iOS simulator UI testing by querying the accessibility tree with IDB to locate elements by label, perform taps, type input, and validate navigation. This accessibility-first approach reduces manual testing effort and token usage by prioritizing the tree over screenshots.

Do I need the IDB MCP tool to run UI automation workflows on an iOS simulator?▼

Yes, IDB MCP tool is required. The UI automation workflows use the execute_idb_command MCP tool to describe, find, tap, and input across flows, returning structured results to simplify debugging for iOS simulator interactions.

What is an accessibility-first approach for iOS UI automation?▼

An accessibility-first approach for iOS UI automation prioritizes querying the accessibility tree before taking screenshots. This identifies elements quickly and reliably, reducing token usage while automating flows like login, form filling, and navigation verification.

Can I verify navigation and UI state on an iOS simulator without manual testing?▼

Yes, you can verify navigation and UI state on an iOS simulator without manual testing by using IDB to describe booted simulators, find elements, tap, and describe again. This automates validation across common flows and returns structured results for debugging.

How do I start automating a login flow on an iOS simulator with IDB?▼

Start automating a login flow on an iOS simulator by running IDB commands: describe booted, find-element with query 'Login', tap, and describe to verify navigation. This workflow locates elements by accessibility label and returns structured results.

Related Skills

Explore More Software Engineering Skills→
wyattjohwyattjoh
1

driving-ios-simulator

Control booted iOS Simulator UI via idb_companion and xcrun simctl.

Community
Advanced
aresbitaresbit
46

agent-browser

Automate browser navigation, form filling, and data extraction via CLI.

Community
Intermediate
krzemienskikrzemienski
3

idb-claude-mobile-testing

Automate iOS simulator UI tests via IDB CLI using testID elements.

Community
Intermediate
tuliopc23tuliopc23

axiom-axe-ref

Reference AXe CLI commands for iOS Simulator UI automation.

Community
Intermediate