skills.rest
shalevamin
shalevaminCOMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Capture and automate macOS UI elements using the Peekaboo CLI.

Updated Mar 7, 2026
Search Tags:#accessibility#cli#macos#ui automation#screenshot#peekaboo#desktop control
One-click install
npx skills add https://github.com/shalevamin/Tau_agent --skill peekaboo-shalevamin
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/shalevamin/Tau_agent/tree/main/tau-agent-main/skills/peekaboo
Command: npx skills add https://github.com/shalevamin/Tau_agent --skill peekaboo-shalevamin

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Automating macOS desktop interactions normally requires fragile AppleScript or manual clicking. This Skill provides a structured CLI to capture screens, identify UI elements, and drive mouse, keyboard, apps, windows, and menus programmatically. ## Core Features & Use Cases - Screen Capture & Vision: Take screenshots of screens, windows, or menu bar regions, generate annotated UI maps with element IDs via peekaboo see, and optionally analyze captures with AI prompts. - UI Interaction: Click, type, drag, scroll, swipe, and press hotkeys targeting elements by ID, query, or coordinates, with smart waits and focus control. - System Management: Launch, quit, hide, and switch apps; move, resize, and focus windows; click menus, menu bar items, and Dock icons; handle system dialogs and clipboard content. - Use Case: Automate a login flow by running peekaboo see --annotate to map the window, then peekaboo click --on B3 and peekaboo type to fill credentials without manual input. ## Quick Start Ask the agent to run peekaboo see with annotation on the frontmost app, then click a specific element and type text into it.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I click a UI element on macOS from the command line?▼

Run peekaboo see with the --annotate flag to generate an annotated UI map with element IDs, then use peekaboo click --on <ID> to click the target. You can also target by coordinates with --coords x,y or scope to an app with --app.

How to capture a screenshot of a specific window on macOS?▼

Use peekaboo image with --app and --window-title to target a specific window, and set --path for the output file. Flags like --retina, --format png|jpg, and --analyze let you control quality and optionally run AI analysis on the capture.

Does Peekaboo work on Linux or Windows?▼

No, Peekaboo is macOS-only. It relies on macOS Accessibility and Screen Recording APIs, and its metadata specifies darwin as the supported operating system. It is installed via the Homebrew tap steipete/tap/peekaboo.

Why does peekaboo click or see fail with permission errors?▼

Peekaboo requires Screen Recording and Accessibility permissions granted to the host terminal or app. Run peekaboo permissions to check status, then grant access in macOS System Settings under Privacy & Security.

Can Peekaboo automate menus, Dock, and system dialogs?▼

Yes. Use peekaboo menu click for application menus, peekaboo menubar for status bar items, peekaboo dock for Dock interactions, and peekaboo dialog to click, input, or dismiss system dialogs.

Related Skills

Explore More Software Engineering Skills→
trpc-grouptrpc-group
1.8k

peekaboo

Capture and automate macOS UI interactions using the Peekaboo CLI.

Official
Intermediate
dingdyandingdyan

peekaboo

Capture and inspect macOS screens to target UI elements for automated interaction.

Community
Intermediate
tiancaiamaotiancaiamao
5

burner-phone

Control Android device screens via ADB with vision-based coordinate detection.

Community
Intermediate
autonomy-cloudautonomy-cloud
2

macos-automation

Automate native macOS app interactions using AppleScript via osascript.

Official
Intermediate