peekaboo

Automate macOS UI interactions and screen captures with the Peekaboo CLI tool.

Updated Feb 11, 2026
One-click install
npx skills add https://github.com/storyclaw-official/storyclaw-assistant --skill peekaboo-storyclaw-official
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/storyclaw-official/storyclaw-assistant/tree/main/skills/peekaboo
Command: npx skills add https://github.com/storyclaw-official/storyclaw-assistant --skill peekaboo-storyclaw-official

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the control and interaction with the macOS graphical user interface, enabling complex UI-driven tasks to be performed programmatically.

Core Features & Use Cases

  • UI Automation: Capture screenshots, inspect UI elements, and drive user input (clicks, typing, drags).
  • App & Window Management: Launch, quit, and manage applications and their windows.
  • Use Case: Automate the process of filling out a complex multi-step form within a desktop application, or script repetitive UI interactions for testing purposes.

Quick Start

Run peekaboo permissions to check for necessary macOS permissions.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions for desktop testing?

You can automate macOS UI interactions by using scripting to capture screenshots, inspect UI elements, and simulate inputs like clicks and typing for deterministic testing. This enables programmatic control over complex multi-step desktop application workflows.

Do I need special permissions to script GUI automation on macOS?

Yes, macOS GUI automation requires Screen Recording and Accessibility permissions. You can verify your system's authorization status by running the peekaboo permissions command to ensure the scripting environment has the necessary access.

Can I manage application windows programmatically using CLI scripting?

Yes, CLI scripting supports app and window management allowing you to launch, quit, and manage applications programmatically. This facilitates deterministic UI control and enables complex UI-driven tasks to be performed automatically.

What is the best way to inspect UI elements for macOS automation?

The best way to inspect UI elements for macOS automation is using a CLI tool that supports element targeting and visual analysis. This allows you to identify interface components accurately before simulating user input like clicks and drags.

How does visual analysis work for deterministic UI control?

Visual analysis for deterministic UI control works by capturing screenshots and inspecting UI elements to identify targets on the screen. This mechanism ensures that input simulation accurately interacts with the correct application components.