peekaboo

Automate macOS UI interactions via command-line for capturing and driving interface elements.

Updated Mar 10, 2026

Search Tags:#testing #cli #macos #scripting #ui automation #peekaboo

Ready to run

npx skills add https://github.com/JiayueMeng128/OpenClaw2Androidtrying --skill peekaboo-jiayuemeng128

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/JiayueMeng128/OpenClaw2Androidtrying/tree/main/openclaw/skills/peekaboo
Command: npx skills add https://github.com/JiayueMeng128/OpenClaw2Androidtrying --skill peekaboo-jiayuemeng128

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the tedious and error-prone process of interacting with macOS graphical user interfaces, enabling efficient UI automation for testing and scripting.

Core Features & Use Cases

UI Element Interaction: Capture screens, target UI elements by ID or coordinates, and perform actions like clicks, typing, and drags.
Application Management: Launch, quit, and manage application windows and states.
Use Case: Automate the process of filling out a complex software installation wizard by using Peekaboo to navigate through dialogs, input text, and click buttons.

Quick Start

Run peekaboo permissions to check and grant necessary macOS permissions for UI automation.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate macOS UI interactions from the command line?▼

Automate macOS UI interactions by using a command-line interface to capture screens, target elements by ID or coordinates, and simulate inputs like clicks, typing, and drags. This enables efficient scripting for application and window management.

Do I need special permissions to automate macOS UI testing?▼

Yes, macOS UI automation requires granting Screen Recording and Accessibility permissions. You can run the permissions command to check and grant the necessary access before executing your interface interaction scripts.

Can I script application window management and input simulation on macOS?▼

Yes, you can script application window management and input simulation to launch, quit, and manage application states. It supports driving user interface elements to automate complex workflows like installation wizards.

What is the best way to navigate a complex software installation wizard on macOS?▼

The best way to navigate a software installation wizard is through UI automation scripting that targets dialogs, inputs text, and clicks buttons. This automates the tedious process of interacting with graphical user interfaces.

How does visual analysis of screen content work in CLI UI automation?▼

Visual analysis of screen content works by capturing the screen and inspecting user interface elements through a command-line interface. This allows scripts to target specific UI components by ID or coordinates for automated interaction.