peekaboo

Automates macOS UI interactions and screen capture via command-line.

Updated Mar 2, 2026
One-click install
npx skills add https://github.com/chebizarro/swarmstr --skill peekaboo-chebizarro
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/chebizarro/swarmstr/tree/main/skills/peekaboo
Command: npx skills add https://github.com/chebizarro/swarmstr --skill peekaboo-chebizarro

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the tedious and error-prone process of interacting with macOS graphical user interfaces, enabling programmatic control over applications, windows, and user input.

Core Features & Use Cases

  • UI Element Interaction: Target and interact with UI elements using various methods (ID, coordinates, visual cues).
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
  • Application & Window Management: Launch, quit, focus, and manipulate application windows.
  • Input Simulation: Simulate keyboard presses, hotkeys, mouse clicks, drags, and scrolls.
  • Use Case: Automate the process of logging into a desktop application by having Peekaboo capture the login screen, click the username field, type credentials, click the password field, type the password, and then click the login button.

Quick Start

Run the peekaboo skill to check permissions for screen recording and accessibility.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?

The Skill automates macOS UI interactions through a command-line interface, enabling programmatic control over applications, windows, menus, and user input events like clicks, typing, and gestures.

How can I capture screenshots and record screen activity on macOS for automation?

You can capture screenshots and record screen activity on macOS using CLI commands that support screen recording with motion analysis and visual content analysis for automated testing workflows.

What is the best way to simulate keyboard and mouse input for GUI testing on macOS?

The best way to simulate keyboard and mouse input for GUI testing is using a CLI tool that programmatically generates hotkeys, mouse clicks, drags, scrolls, and typing events to interact with target applications.

Can I target specific UI elements using visual cues during macOS UI automation?

Yes, you can target specific UI elements using visual cues, element IDs, or screen coordinates, allowing the automation script to interact with precise components within the macOS graphical user interface.

Do I need special permissions to run macOS UI automation and screen capture scripts?

Yes, you need to grant accessibility and screen recording permissions to allow the CLI tool to programmatically control applications, simulate input events, and capture visual content on the macOS system.

How do I automate logging into a desktop application on macOS?

To automate logging into a desktop application, the CLI captures the login screen, clicks the username field, types credentials, clicks the password field, enters the password, and clicks the login button programmatically.