argent-device-interact

Automate taps, gestures, typing, and app launches on iOS simulators and Android emulators.

1.9k|65|Updated Feb 23, 2026

Search Tags:#ios #automated testing #simulator #android #ui interaction #gestures #emulator

Ready to run

npx skills add https://github.com/software-mansion/argent --skill argent-device-interact-software-mansion

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: argent-device-interact
Source: https://github.com/software-mansion/argent/tree/main/packages/skills/skills/argent-device-interact
Command: npx skills add https://github.com/software-mansion/argent --skill argent-device-interact-software-mansion

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

It solves the problem of performing repeatable, accurate UI and device interactions across iOS Simulator and Android Emulators without manually clicking, swiping, typing, or managing device controls.

Core Features & Use Cases

Tap and gesture control: Perform single taps plus normalized-coordinate gestures (swipe, pinch, rotate, and custom touch sequences) to reproduce user flows reliably.
Typing and hardware input: Type via iOS paste (clipboard-based) or keyboard input (iOS+Android), and press hardware buttons like home, back, power, volume, app switch, and action button.
App and URL navigation: Launch apps by bundle ID and open URLs/schemes (including deep links) instead of tapping home-screen icons.
Best-practice UI targeting: Use discovery tools like describe (and RN/native-specific variants) to find correct tap targets before interacting.

Quick Start

To reproduce a UI flow on a ready device, ask the assistant to use argent-device-interact to tap, swipe, type, and launch apps by normalized coordinates and tool-driven discovery.

Frequently Asked Questions about argent-device-interact

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate UI interactions on iOS simulators and Android emulators?▼

Automate UI interactions on iOS simulators and Android emulators by dispatching commands with a unified udid, using normalized 0.0–1.0 coordinates to tap elements, perform gestures, type text, and press hardware buttons. Use describe tools to locate correct tap targets before interacting.

What is the best way to reproduce user flows for manual testing on mobile emulators?▼

Reproduce user flows for manual testing by applying single taps, normalized-coordinate gestures, and text input across both platforms. Launch apps directly by bundle ID or open URLs and deep links instead of tapping home-screen icons to ensure reliable navigation during testing.

Can I press hardware buttons and type text on both Android and iOS simulators?▼

Yes, you can press hardware buttons like home, back, power, volume, and app switch on both platforms. Type text via iOS paste (clipboard-based) or keyboard input for iOS and Android, enabling comprehensive hardware input and typing automation across simulators and emulators.

How do I find correct tap targets for automated UI testing without relying on screenshots?▼

Find correct tap targets by using discovery tools like describe, debugger, and native describe variants before interacting. Avoid screenshot-driven navigation; instead, use these tools to inspect the UI hierarchy and ensure accurate touch targeting across iOS and Android environments.

Why does my automated swipe or gesture fail to trigger the expected UI response?▼

Automated gestures fail when tap targets are incorrect or coordinates are not properly normalized. Use describe tools to verify the correct UI element before interacting, and ensure all swipe, pinch, and rotate gestures use normalized 0.0–1.0 coordinates for reliable cross-platform reproduction.

Do I need a specific device identifier to run automated tests on iOS and Android emulators?▼

Yes, you need a unified udid-based dispatch to target the correct device. This identifier routes all tap, gesture, typing, and hardware button commands to the specific iOS simulator or Android emulator instance you intend to automate.