skills.rest
CamilleScholtz
CamilleScholtzCOMMUNITY
Explore all skills by this author →
GitHub

device-interaction

Verify iOS app UI stability via screenshots, hierarchy, and touch interactions.

232|14|Updated Nov 8, 2024
Search Tags:#automation#screenshots#ios#ui-testing#touch-interactions#device-testing#ui-hierarchy
One-click install
npx skills add https://github.com/CamilleScholtz/swmpc --skill device-interaction
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: device-interaction
Source: https://github.com/CamilleScholtz/swmpc/tree/main/.claude/skills/device-interaction
Command: npx skills add https://github.com/CamilleScholtz/swmpc --skill device-interaction

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Verify iOS app behavior on physical devices or simulators by capturing screenshots, inspecting UI hierarchy, and validating touch interactions to ensure correct functionality across environments.

Core Features & Use Cases

  • Capture and compare screenshots to detect visual regressions on device form factors.
  • Read and validate UI hierarchy to ensure elements are present and accessible.
  • Validate common touch interactions (tap, swipe, long-press) to verify correct app responses.
  • Use Case: After implementing a UI change, run device verification to confirm the flow remains intact on both device and simulator.

Quick Start

Start a device verification session by selecting a target device, launching the app, and capturing the initial UI state for validation.

Frequently Asked Questions about device-interaction

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify iOS UI behavior on a simulator after making interface changes?▼

Validate touch interactions by orchestrating device-based verification tests that simulate taps, swipes, and long-press gestures, ensuring the app responds correctly to user inputs across iOS devices and simulators.

Can I detect visual regressions by capturing and comparing screenshots on iOS devices?▼

Yes, you can capture and compare screenshots on device form factors to detect visual regressions, inspecting the UI hierarchy to ensure elements are present and accessible after UI-affecting changes.

Does this approach support validating touch interactions like taps and swipes on physical devices?▼

Yes, validating touch interactions is supported by orchestrating device-based verification tests that simulate taps, swipes, and long-press gestures, ensuring the app responds correctly to user inputs across iOS devices and simulators.

What is the best way to extract UI hierarchy and check element accessibility during device testing?▼

The best way to extract UI hierarchy is through structured device verification sessions that read and validate the hierarchy layout, ensuring elements are present and accessible while classifying functional and visual findings as bugs.

Do I need a specific testing framework to run UI stability checks on iOS simulators?▼

You need an environment that supports a defined session lifecycle and subagent invocation pattern to run UI stability checks, enabling you to select a target device, launch the app, and capture the initial UI state for validation.

Related Skills

Explore More Software Engineering Skills→
jperezdelrealjperezdelreal

ios-debugger-agent

Automate building, launching, and debugging iOS apps on a booted simulator with XcodeBuildMCP.

Community
Advanced
FortemiFortemi
4

aiwg-doctor

Diagnose AIWG installation health and provide remediation commands.

Official
Intermediate
MadAppGangMadAppGang
7

debug-ui

Capture screenshots and inspect DOM state to diagnose UI layout issues.

Official
Intermediate
TrainLCDTrainLCD
71

argent-test-ui-flow

Automate end-to-end UI testing and visual regression analysis for iOS and Android mobile apps.

Official
Advanced