Capture and automate macOS UI interactions through the Peekaboo CLI.
npx skills add https://github.com/srgaba/open-claw --skill peekaboo-srgaba
Please help me install this Agent Skill. Skill: peekaboo Source: https://github.com/srgaba/open-claw/tree/main/project/skills/peekaboo Command: npx skills add https://github.com/srgaba/open-claw --skill peekaboo-srgaba
see, and optionally analyze captures with AI prompts. - UI Interaction: Click, type, drag, swipe, scroll, and press hotkeys by targeting elements via snapshot IDs, coordinates, or app/window identifiers. - System Management: Launch, quit, hide, and switch apps; manage windows, Spaces, Dock items, menus, menu bar extras, dialogs, and the clipboard. - Use Case: Automate a login flow by running peekaboo see --annotate to map the UI, then peekaboo click --on B3 and peekaboo type "[email protected]" to fill in credentials without manual input. ## Quick Start Ask the agent to run peekaboo permissions, then use peekaboo see with the annotate flag to capture the current screen and identify clickable elements before automating any clicks or typing.High-intent search queries and answers about installing and using this skill.
Use the Peekaboo CLI to automate macOS UI input. Run peekaboo see --annotate to generate an annotated UI map with element IDs, then use peekaboo click --on <id> and peekaboo type "text" targeting the app or window.
Use peekaboo image with --app and --window-title to capture a specific window, or --mode screen with --screen-index for full displays. Add --retina for high resolution and --path to set the output file.
Peekaboo requires Screen Recording and Accessibility permissions to capture screens and control the UI. Run peekaboo permissions to check the current status of both before executing automation commands.
Install Peekaboo via Homebrew with the steipete/tap/peekaboo formula. After installation, verify the build with peekaboo --version and explore commands with peekaboo --help.
Clicks fail when the snapshot is stale or the element ID is wrong. Re-run peekaboo see --annotate to refresh the snapshot, then reference the new element ID, or target by coordinates with --coords x,y instead.
Yes, most Peekaboo commands support --json or -j flags for machine-readable output. This enables scripting workflows such as listing windows with peekaboo list windows --json and piping results into other tools.
trpc-groupCapture and automate macOS UI interactions using the Peekaboo CLI.
nguyenvanlinh1902Drive Puppeteer browser automation with persistent sessions and JSON outputs.
pplmxGenerates Playwright end-to-end tests for Desktop Ethereal workflows and system events.
autonomy-cloudAutomate native macOS app interactions using AppleScript via osascript.