skills.rest
Clawdi-AI
Clawdi-AIOFFICIAL
Explore all skills by this author →
WebsiteGitHub

peekaboo

Automate macOS UI interactions via command-line scripting and deterministic execution.

4|2|Updated Feb 26, 2026
Search Tags:#automation#accessibility#cli#macos#gui#ui scripting
One-click install
npx skills add https://github.com/Clawdi-AI/openclaw --skill peekaboo-clawdi-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/Clawdi-AI/openclaw/tree/main/skills/peekaboo
Command: npx skills add https://github.com/Clawdi-AI/openclaw --skill peekaboo-clawdi-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates complex interactions with macOS graphical user interfaces, enabling scripting and automation of tasks that typically require manual mouse and keyboard input.

Core Features & Use Cases

  • UI Element Interaction: Click, type, drag, and scroll on specific UI elements identified by their properties or on-screen location.
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content for automation cues.
  • App & Window Management: Launch, quit, focus, and manipulate application windows programmatically.
  • Use Case: Automate the process of filling out a complex software installation wizard by using Peekaboo to identify and interact with dialog boxes, input fields, and buttons.

Quick Start

Run the peekaboo permissions command to check your macOS security settings.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS GUI interactions from the command line?▼

Automating macOS GUI interactions from the command line is done by targeting UI elements, simulating input, and managing applications programmatically. This enables deterministic task execution without manual mouse or keyboard input.

What macOS permissions do I need to script UI elements?▼

Scripting UI elements on macOS requires granting Screen Recording and Accessibility permissions to the automation tool. You can verify your system security settings by running the permissions check command before execution.

Can I capture screenshots and analyze screen content during macOS automation?▼

Yes, you can capture screenshots and analyze screen content during macOS automation. The tool supports screen capture and activity recording to provide visual cues and feedback for your automated scripts.

How do I interact with specific UI elements like dialog boxes and input fields?▼

Interacting with specific UI elements like dialog boxes and input fields is achieved by identifying components through their properties or on-screen location. You can then simulate clicks, typing, dragging, and scrolling actions.

What is the best way to automate a complex software installation wizard on macOS?▼

Automating a complex software installation wizard on macOS is best handled by programmatically identifying and interacting with dialog boxes, input fields, and buttons. This replaces manual clicking with deterministic script execution.

Does macOS UI scripting work for managing application windows?▼

Yes, macOS UI scripting supports application window management. You can programmatically launch, quit, focus, and manipulate application windows to fully control the workflow environment.

Related Skills

Explore More Software Engineering Skills→
coltonbattscoltonbatts

peekaboo

Automate macOS UI interactions via command-line interface.

Community
Advanced
whilpwhilp
9

cleanshot

Automate screenshots, recordings, scrolling captures, and OCR via CleanShot X CLI.

Community
Advanced
steipetesteipete
385.7k

peekaboo

Capture and control macOS UI elements via CLI commands.

Community
Advanced
GitnappGitnapp

macos-computer-use

Automate macOS desktop interactions without disrupting the active cursor or workspace.

Community
Advanced