What problem does it solve?
This Skill eliminates the tedious, error-prone manual work of interacting with macOS user interfaces, capturing screenshots, and automating repetitive UI tasks that require precise mouse and keyboard input.
Core Features & Use Cases
- Full macOS UI Automation: Automate clicks, typing, gestures, app/window management, menu interactions, and keyboard shortcuts across all macOS applications.
- UI Inspection & Capture: Take annotated screenshots of screens, windows, or regions, identify on-screen UI elements by ID or coordinates, and analyze on-screen content with custom prompts.
- Use Case: Use this Skill to automate logging into web apps, test macOS application UI flows, or extract information from on-screen dashboards without manual input.
Quick Start
Use the peekaboo skill to capture an annotated screenshot of your active Safari window, click the login button identified as B1, and enter your credentials to log in automatically.