skills.rest
Polealpha
PolealphaCOMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Automate macOS UI interactions via JSON-targeted clicks, typing, and hotkeys.

Updated Mar 21, 2026
Search Tags:#accessibility#json output#screen recording#element interaction#macos ui automation#ui targeting#cli scripting
One-click install
npx skills add https://github.com/Polealpha/XINNIAN_PI --skill peekaboo-polealpha
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/Polealpha/XINNIAN_PI/tree/main/app%20windows/vendor/openclaw-runtime/skills/peekaboo
Command: npx skills add https://github.com/Polealpha/XINNIAN_PI --skill peekaboo-polealpha

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Peekaboo eliminates the frustration of manually clicking through complex macOS interfaces by capturing the screen, identifying UI elements, and executing deterministic interactions for you.

Core Features & Use Cases

  • UI capture, inspection, and targeting: take live snapshots or screenshots, annotate targets, and reuse snapshot IDs for consistent element selection.
  • Action automation across apps and windows: click, type, hotkey, scroll, swipe, drag-and-drop, manage windows/menus, and launch or control apps reliably.
  • Scripting-friendly execution: run .peekaboo.json scripts and use JSON output to integrate with repeatable workflows.

Use it when you need to automate repetitive macOS tasks like logging into an app, navigating through menus, filling forms, and collecting screenshots for auditing.

Quick Start

Ask to run peekaboo permissions, then list apps as JSON, then see and annotate a target before you click and type to complete your workflow.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions without manual clicking?▼

Automate macOS UI interactions by capturing the screen, identifying UI elements, and executing deterministic inputs like clicks and typing. This eliminates manual clicking through complex interfaces by using snapshot-based targeting and JSON output for reliable, repeatable workflows.

Do I need specific macOS permissions to run UI automation scripts?▼

Yes, macOS UI automation requires granting Screen Recording and Accessibility permissions to the executing binary. You must configure these system permissions before capturing snapshots, selecting targets, or executing input commands across applications and windows.

What's the best way to target a specific UI element for automated clicking on Mac?▼

The best way to target a UI element is by taking a live snapshot or screenshot, annotating the target, and reusing the snapshot ID. This ensures consistent element selection for precise clicks, typing, and hotkey execution during macOS automation.

Can I integrate macOS UI automation into a JSON-based scripting workflow?▼

Yes, you can run `.peekaboo.json` scripts to drive script-friendly execution and use JSON output to integrate UI automation into repeatable workflows. This supports app management, form filling, and screenshot collection for auditing.

Why does my macOS screen recording automation fail to capture interface elements?▼

Screen recording automation fails to capture interface elements when Screen Recording and Accessibility permissions are not granted to the CLI binary. Ensure the macOS system permissions are enabled so the tool can take live snapshots and execute input commands.

Related Skills

Explore More Software Engineering Skills→
Clawdi-AIClawdi-AI
4

peekaboo

Automate macOS UI interactions via command-line scripting and deterministic execution.

Official
Advanced
SeifBenayedSeifBenayed
114

chatgpt-search

Extract ChatGPT conversation text, hydration JSON, and SSE streams via Chrome CDP.

Community
Intermediate
0xHoneyJar0xHoneyJar
5

peekaboo

Automate macOS UI interactions and screen captures via the Peekaboo CLI.

Official
Intermediate
tiancaiamaotiancaiamao
5

peekaboo

Operates a CLI to capture, inspect, and control macOS UI elements.

Community
Advanced