skills.rest
hatayama
hatayamaCOMMUNITY
Explore all skills by this author →
GitHub

simulate-mouse-demo

Simulate mouse clicks, drags, and joystick motions in Unity PlayMode.

500|44|Updated Jun 15, 2025
Search Tags:#automation#unity#ui-testing#drag-and-drop#playmode#uloop#simulate-mouse
One-click install
npx skills add https://github.com/hatayama/unity-cli-loop --skill simulate-mouse-demo
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: simulate-mouse-demo
Source: https://github.com/hatayama/unity-cli-loop/tree/main/.claude/skills/simulate-mouse-demo
Command: npx skills add https://github.com/hatayama/unity-cli-loop --skill simulate-mouse-demo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates manual, error-prone testing of mouse-driven UI interactions in a Unity demo scene so developers can quickly verify clicks, long-presses, one-shot drags, split-drags, and virtual pad behavior without performing repetitive manual input.

Core Features & Use Cases

  • Coordinate discovery: Uses an annotated screenshot to extract SimX/SimY coordinates for every interactive element so actions target exact UI positions.
  • End-to-end scenario: Chains Click, LongPress, Drag, DragStart, DragMove, and DragEnd calls to exercise buttons, one-shot drags, multi-waypoint split-drags, and a virtual joystick pad in sequence.
  • Latency-safe execution: Recommends running all commands chained in a single Bash call to avoid AI round-trip delays and preserve single-pointer simulation semantics.
  • Use Case: Run after code changes or during QA to confirm simulated input handling and visual feedback in PlayMode.

Quick Start

Discover element coordinates with uloop screenshot and run the provided chained uloop simulate-mouse-ui commands to execute the full demo scenario.

Frequently Asked Questions about simulate-mouse-demo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate mouse interactions for Unity PlayMode UI testing?▼

Use uloop simulate-mouse-ui commands in a single Bash call to automate clicks, long-presses, drags, and virtual joystick motions in Unity PlayMode, verifying UI input handling without manual interaction.

How do I find the exact coordinates to target UI elements for simulated mouse input?▼

Capture an annotated screenshot using the uloop screenshot command, then extract SimX and SimY coordinates to target exact interactive UI element positions for simulated mouse actions.

Can I run simulate-mouse-ui commands separately across multiple AI round-trips?▼

No, you should chain all uloop simulate-mouse-ui commands in a single Bash call. Running them separately risks AI round-trip delays and breaks single-pointer simulation semantics for split-drag sequences.

What Unity scene and environment do I need for automated mouse simulation?▼

You need Unity running in PlayMode with the SimulateMouseDemoScene loaded, along with the uloop CLI providing simulate-mouse-ui and screenshot commands to execute the automated mouse interactions.

What types of drag interactions can I validate in a Unity demo scene?▼

You can validate one-shot drags and multi-waypoint split-drag sequences using chained DragStart, DragMove, and DragEnd commands, alongside clicks and virtual pad joystick motions in the Unity demo scene.

Related Skills

Explore More Software Engineering Skills→
hatayamahatayama
500

uloop-simulate-mouse-ui

Simulate mouse pointer events on Unity PlayMode UI elements for testing.

Community
Intermediate
mintuzmintuz
21

eyes

Capture UI screenshots and compare states using Playwright MCP tools.

Community
Basic
hatayamahatayama
500

uloop-simulate-keyboard

Simulate keyboard input in Unity PlayMode using the Input System.

Community
Intermediate
breakingcircuits1337breakingcircuits1337

peekaboo

Automate macOS UI interactions via the Peekaboo CLI with YAML scripts.

Community
Advanced