skills.rest
estebanrfp
estebanrfpCOMMUNITY
Explore all skills by this author →
Website𝕏@estebanrfpGitHub

peekaboo

Automate macOS UI capture and interaction workflows via the Peekaboo CLI.

1|Updated May 12, 2026
Search Tags:#accessibility#macos#scripting#ui automation#window management#screen capture#peekaboo
One-click install
npx skills add https://github.com/estebanrfp/gos --skill peekaboo-estebanrfp
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/estebanrfp/gos/tree/main/skills/peekaboo
Command: npx skills add https://github.com/estebanrfp/gos --skill peekaboo-estebanrfp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the friction of manually inspecting and controlling macOS apps by letting you capture screens, identify UI elements, and drive interactions from a single CLI workflow.

Core Features & Use Cases

  • Screen Inspection: Capture screenshots, annotate interfaces, and map visible UI elements before taking action.
  • Deterministic Interaction: Click, type, scroll, swipe, press hotkeys, and drag items using stable targets like element IDs, window IDs, or coordinates.
  • App and Window Control: Launch, quit, focus, resize, and switch between applications, windows, Dock items, Spaces, and menus.
  • Automation Scenarios: Useful for login flows, repetitive desktop tasks, app testing, support troubleshooting, and guided UI scripting on macOS.
  • Permission-Aware Workflows: Helps verify Screen Recording and Accessibility access before running automation, reducing failed runs.

Quick Start

Use the peekaboo skill to inspect the current macOS screen, target the desired UI element, and perform the requested click, typing, or window action.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

You can automate macOS UI interactions by capturing screenshots, identifying UI elements, and driving clicks or typing from a CLI. This approach wraps screen inspection and deterministic interaction into a single scriptable workflow.

Do I need special permissions to script UI automation on macOS?▼

Yes, scripting macOS UI automation requires Screen Recording and Accessibility permissions. The workflow is permission-aware and helps verify these accesses before running automation to reduce failed runs on Apple Silicon Macs.

Can I target specific UI elements when automating desktop tasks on macOS?▼

Yes, you can target specific UI elements using stable identifiers like element IDs, window IDs, or coordinates. This deterministic targeting allows precise clicks, typing, scrolling, and dragging across local Mac applications.

What's the best way to manage windows and applications during macOS automation?▼

The best way to manage windows and applications during macOS automation is using a CLI that supports launching, quitting, focusing, and resizing. It also handles switching between Dock items, Spaces, and menu navigation.

How does macOS UI automation handle output for scripting?▼

macOS UI automation handles output for scripting by supporting JSON output for deterministic results. This structured format allows you to programmatically parse screen inspection data and automate subsequent desktop tasks.

Why is my macOS UI automation script failing to capture the screen?▼

macOS UI automation scripts fail to capture the screen when Screen Recording and Accessibility permissions are missing. You must verify these permissions on your Apple Silicon Mac before executing the automation workflow.

Related Skills

Explore More Software Engineering Skills→
Zentin-LZentin-L
1

peekaboo

Automate macOS UI tasks by capturing screens, targeting elements, and driving input via CLI.

Community
Advanced
JnusoJnuso

peekaboo

Automate macOS UI tasks with JSON output and element targeting.

Community
Intermediate
edteedte
11

playwright-cli

Automate browser interactions for testing, form filling, screenshots, and data extraction via Playwright CLI.

Community
Intermediate
steipetesteipete
385.7k

peekaboo

Capture and control macOS UI elements via CLI commands.

Community
Advanced