driving-ios-simulator

Control booted iOS Simulator UI via idb_companion and xcrun simctl.

1|Updated Jul 22, 2026

Search Tags:#automation #testing #ui #ios #simulator #idb

Ready to run

npx skills add https://github.com/wyattjoh/skills --skill driving-ios-simulator

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: driving-ios-simulator
Source: https://github.com/wyattjoh/skills/tree/main/skills/driving-ios-simulator
Command: npx skills add https://github.com/wyattjoh/skills --skill driving-ios-simulator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires idb-companion, fb-idb, and includes scripts (resource) components.

What problem does it solve?

This skill solves the challenge of automating UI interactions on a booted iOS Simulator, specifically addressing the common failure where HID actions like tapping or swiping silently fail due to missing framework dependencies.

Core Features & Use Cases

Programmatic UI Control: Perform taps, swipes, text entry, and hardware button presses (Home, Lock, etc.) via the command line.
Accessibility Tree Inspection: Query the UI hierarchy to retrieve precise coordinates for elements, avoiding brittle coordinate guessing.
Environment Management: Automatically bootstraps the idb_companion with the correct Xcode environment to ensure HID interactions function reliably.

Quick Start

Use the driving-ios-simulator skill to identify the center coordinates of the login button and perform a tap action on the booted simulator.

Frequently Asked Questions about driving-ios-simulator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

Why do my programmatic taps and swipes silently fail on the iOS Simulator?▼

iOS Simulator UI automation taps and swipes often silently fail when HID interactions are attempted without the correct Xcode environment and idb_companion framework dependencies properly bootstrapped. This skill resolves the issue by automatically configuring the environment to ensure reliable HID interaction execution.

How do I find exact coordinates for UI elements during iOS Simulator testing?▼

To find exact coordinates for iOS Simulator UI testing, you can inspect the accessibility tree to query the UI hierarchy. This skill bridges idb_companion and xcrun simctl to retrieve precise element coordinates, avoiding brittle coordinate guessing during test automation.

Do I need idb-companion and Xcode command-line tools installed for iOS Simulator UI automation?▼

Yes, you need both idb-companion and Xcode command-line tools installed to perform iOS Simulator UI automation. This skill requires a properly configured environment to bridge idb_companion with xcrun simctl for programmatic control and hardware simulation.

Can I simulate hardware button presses like Home and Lock on a booted iOS Simulator?▼

You can simulate hardware button presses like Home and Lock on a booted iOS Simulator using command line UI automation. This skill facilitates programmatic control over hardware simulation, text entry, taps, and swipes via idb_companion and xcrun simctl integration.

What is the best way to automate UI interactions on a booted iOS Simulator?▼

The best way to automate UI interactions on a booted iOS Simulator is by bridging idb_companion and xcrun simctl. This approach enables programmatic control over accessibility tree inspection, coordinate-based interaction, and hardware simulation for complex testing workflows.

How does idb work with xcrun simctl for complex iOS testing workflows?▼

idb works with xcrun simctl by bridging the two frameworks to provide programmatic control over a booted iOS Simulator. This integration enables complex testing workflows including element discovery, coordinate-based interaction, and hardware simulation without silent HID failures.