peekaboo

Capture and inspect macOS UI elements to drive deterministic input automation.

Updated May 8, 2026
One-click install
npx skills add https://github.com/freire19/Mythos --skill peekaboo-freire19
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/freire19/Mythos/tree/main/skills/peekaboo
Command: npx skills add https://github.com/freire19/Mythos --skill peekaboo-freire19

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Peekaboo automates repetitive macOS UI work by letting you capture, inspect, and control real app interfaces quickly and consistently, without manual clicking and searching.

Core Features & Use Cases

  • UI capture and targeting: capture screenshots or live regions, then identify stable UI targets via snapshot IDs.
  • Deterministic interaction: click, type, press keys, drag, scroll, swipe, and hotkey actions against UI elements with smart waits and focus options.
  • Automation-ready scripting: run command scripts via .peekaboo.json and use --json for automation-friendly outputs, including clipboard and dialog automation.

Quick Start

Run peekaboo permissions to verify Screen Recording and Accessibility access, then use peekaboo see to annotate the UI and get snapshot/element targets before issuing click and type commands to complete the flow.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions without manually clicking through repetitive app workflows?

Automate macOS UI interactions by capturing screenshots, identifying stable UI targets via snapshot IDs, and programmatically driving clicks, typing, and key presses. This deterministic approach eliminates manual clicking and searching when completing repetitive form workflows or app testing.

What macOS permissions are required for screen capture and UI automation scripting?

macOS UI automation requires Screen Recording and Accessibility permissions to capture on-screen elements and drive user input programmatically. You can verify access by running a permissions check command before starting your snapshot-based targeting and interaction sequences.

How do I target specific UI elements consistently during macOS app testing?

Target specific UI elements consistently by running a UI annotation command to capture and inspect on-screen elements, which generates stable snapshot IDs. These snapshot IDs serve as deterministic targets for subsequent click, type, and swipe actions during app testing.

Can I run macOS UI automation commands via scripts and get automation-friendly output?

Run macOS UI automation commands via JSON script files and use JSON output flags for automation-friendly responses. This enables scripted capture-to-action sequences, including clipboard and dialog automation, while returning structured data for programmatic workflow integration.

What macOS UI interactions can I perform beyond basic clicking and typing?

Beyond basic clicking and typing, macOS UI automation supports dragging, scrolling, swiping, and hotkey actions against identified UI elements. You can apply these interactions with smart waits and focus options to handle specific windows and UI targets during repetitive workflows.

Does macOS UI automation work for validating accessibility permissions in testing environments?

macOS UI automation supports accessibility-permission validation by checking Screen Recording and Accessibility access before executing deterministic commands. This ensures your scripted capture-to-action sequences run reliably in testing environments where required macOS permissions might be missing or revoked.