What problem does it solve?
This Skill automates the tedious and error-prone process of interacting with macOS graphical user interfaces, enabling programmatic control over applications, windows, and user input.
Core Features & Use Cases
- UI Element Interaction: Target and interact with UI elements using various methods (ID, coordinates, visual cues).
- Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
- Application & Window Management: Launch, quit, focus, and manipulate application windows.
- Input Simulation: Simulate keyboard presses, hotkeys, mouse clicks, drags, and scrolls.
- Use Case: Automate the process of logging into a desktop application by having Peekaboo capture the login screen, click the username field, type credentials, click the password field, type the password, and then click the login button.
Quick Start
Run the peekaboo skill to check permissions for screen recording and accessibility.