skills.rest
travis-burmaster
travis-burmasterCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

peekaboo

Capture and automate macOS UI interactions using the Peekaboo CLI.

Updated Feb 16, 2026
Search Tags:#accessibility#cli#macos#ui automation#screenshot#peekaboo#gui testing
One-click install
npx skills add https://github.com/travis-burmaster/agentbox --skill peekaboo-travis-burmaster
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/travis-burmaster/agentbox/tree/main/agentfork/skills/peekaboo
Command: npx skills add https://github.com/travis-burmaster/agentbox --skill peekaboo-travis-burmaster

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires peekaboo.

What problem does it solve? Automating macOS graphical interfaces normally requires manual clicking, typing, and screen inspection. This Skill lets an AI agent capture screens, identify UI elements, and drive mouse, keyboard, apps, windows, and menus through the Peekaboo CLI. ## Core Features & Use Cases - Screen Capture & Vision: Take screenshots of screens, windows, or menu bar regions, generate annotated UI maps with see, and optionally analyze captures with AI prompts. - UI Interaction: Click, type, drag, scroll, swipe, and press hotkeys targeting elements by ID, query, or coordinates, with smart waits and focus control. - System Control: Launch, quit, and switch apps; manage windows, Spaces, Dock items, menus, dialogs, and the clipboard. - Use Case: Automate a login flow by running peekaboo see to annotate the Safari window, clicking the username field by element ID, typing credentials, and pressing return. ## Quick Start Ask the agent to check Peekaboo permissions, list running apps, capture an annotated screenshot of a target app, then click and type into the identified UI elements.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate clicking and typing in macOS apps from the command line?▼

Use the Peekaboo CLI: run `peekaboo see --annotate` to capture an annotated UI map, then `peekaboo click --on <element-id>` and `peekaboo type "text"` to interact with elements. Target specific apps with `--app` or windows with `--window-id`.

How do I capture a screenshot of a specific window on macOS?▼

Run `peekaboo image --app Safari --window-title "Dashboard" --path /tmp/shot.png` to capture a specific window. Use `--mode screen` for full displays, `--retina` for high resolution, and `--analyze "prompt"` for AI-based analysis.

Does Peekaboo work on Linux or Windows?▼

No, Peekaboo is macOS-only (darwin) because it relies on macOS accessibility and screen capture APIs. It also requires Screen Recording and Accessibility permissions granted to the terminal or host app.

Why does peekaboo click fail to find UI elements?▼

Clicks fail when the snapshot is stale, the target app lacks focus, or permissions are missing. Re-run `peekaboo see --annotate` to refresh element IDs, verify permissions with `peekaboo permissions`, and use `--focus-timeout-seconds` or `--space-switch` for focus issues.

How do I install the Peekaboo CLI?▼

Install via Homebrew with `brew install steipete/tap/peekaboo`. Verify the installation with `peekaboo --version` and check required permissions using `peekaboo permissions`.

Related Skills

Explore More Software Engineering Skills→
trpc-grouptrpc-group
1.8k

peekaboo

Capture and automate macOS UI interactions using the Peekaboo CLI.

Official
Intermediate
everrunseverruns
42

ui-screenshots

Capture web page screenshots with agent-browser for visual verification.

Official
Intermediate
go-vikunjago-vikunja
5.2k

run-e2e-tests

Runs Vikunja's Playwright end-to-end tests through the mage test:e2e command.

Official
Basic
mlamla123mlamla123

desktop-vision

Automate macOS desktop observation and interaction using native tools and vision models.

Community
Advanced