What problem does it solve?
When you need to operate apps and web pages manually, repeating mouse/keyboard steps becomes slow, error-prone, and hard to audit; this Skill turns those actions into deterministic, controllable automation with safety guardrails.
Core Features & Use Cases
- Pixel-level desktop control: move/click/drag/scroll, relative or absolute positioning, and current mouse tracking.
- Keyboard automation: fast typing with configurable speed, hotkeys, special keys, and key-hold controls for multi-step inputs.
- Screen interaction: full/region screenshots, pixel color sampling, and template-based image detection (for locating UI elements).
- Window management: list windows, activate by title, query the active window, and support multi-monitor coordinate setups.
- Safety & reliability: failsafe abort (corner trigger), optional approval mode, bounds/operation tolerance via safety checks, and action logging.
Use case example: You can quickly automate a repeatable workflow like launching an editor, copying text from a source window, pasting into the target, and capturing a screenshot of the result for verification.
Quick Start
Tell the agent to take a screenshot of your current screen after launching the target application and placing the cursor where you want it, using failsafe and (optionally) approval mode for safety.
