peekaboo

Automates macOS UI interactions and captures screen content via the Peekaboo CLI.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/planetazuzu/planetazuzu-memory --skill peekaboo-planetazuzu
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/planetazuzu/planetazuzu-memory/tree/main/skills/openclaws-kb/skills/peekaboo
Command: npx skills add https://github.com/planetazuzu/planetazuzu-memory --skill peekaboo-planetazuzu

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates interactions with the macOS graphical user interface, allowing for programmatic control of applications, windows, and user input.

Core Features & Use Cases

  • UI Element Interaction: Click, type, drag, and scroll through UI elements using various targeting methods.
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
  • App & Window Management: Launch, quit, and manage application windows and their states.
  • Use Case: Automate the process of filling out a complex online form within a desktop application by scripting clicks, text inputs, and window focus changes.

Quick Start

Run peekaboo permissions to check and grant necessary macOS permissions.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?

To automate macOS UI interactions from the command line, you can use a CLI tool to script clicks, typing, and app management. This allows programmatic control of desktop applications and windows without manual input.

What macOS permissions do I need to capture screen content and simulate input?

Capturing screen content and simulating input requires granting macOS Screen Recording and Accessibility permissions. You can check and grant these necessary permissions by running a dedicated permissions setup command.

Can I script complex GUI workflows like filling out desktop application forms?

Yes, you can script complex GUI workflows like filling out desktop application forms. The automation supports targeting specific UI elements to programmatically perform clicks, text inputs, and window focus changes.

How do I capture screenshots and analyze visual content during automation?

You can capture screenshots and analyze visual content during automation by using built-in screen capture commands. The CLI allows you to record screen activity and process visual output for scripting tasks.

What is the best way to manage application windows programmatically on macOS?

The best way to manage application windows programmatically on macOS is using a UI automation CLI. It enables you to launch, quit, and manage application windows along with their states directly from scripts.

Does UI automation work with applications that use non-standard interface elements?

UI automation targets elements using various targeting methods and supports visual analysis for non-standard interfaces. If standard element targeting fails, you can often fall back on coordinate-based input simulation and screen capture.