Capture and automate macOS UI interactions through the Peekaboo CLI.
npx skills add https://github.com/AmirulAndalib/Vilvona-AI --skill peekaboo-amirulandalib
Please help me install this Agent Skill. Skill: peekaboo Source: https://github.com/AmirulAndalib/Vilvona-AI/tree/main/skills/peekaboo Command: npx skills add https://github.com/AmirulAndalib/Vilvona-AI --skill peekaboo-amirulandalib
peekaboo see. - UI Interaction: Click, type, drag, scroll, swipe, and press hotkeys targeting elements by ID, query, or coordinates, with app and window targeting options. - System Management: Launch, quit, and focus apps; move and resize windows; click menus, Dock items, and menu bar extras; read and write the clipboard. - Use Case: Automate a Safari login flow by running peekaboo see --app Safari --annotate to identify fields, then peekaboo click --on B3 and peekaboo type "[email protected]" to fill the form without manual input. ## Quick Start Ask the assistant to take an annotated screenshot of the frontmost app and click a specific button using Peekaboo.High-intent search queries and answers about installing and using this skill.
Use the Peekaboo CLI to target UI elements and send input. Run `peekaboo see --annotate` to get element IDs, then `peekaboo click --on <id>` and `peekaboo type "text"` to interact with the app.
Run `peekaboo image --app Safari --window-title "Dashboard" --path /tmp/shot.png` to capture a specific window. You can also use `--mode screen` for full displays or `--retina` for high-resolution output.
Peekaboo requires Screen Recording and Accessibility permissions. Check their status with `peekaboo permissions` or `peekaboo permissions status --json` before running capture or interaction commands.
Install Peekaboo with Homebrew using the formula steipete/tap/peekaboo. After installation, verify it works by running `peekaboo --version` and `peekaboo permissions`.
Subprocess captures fail when the calling process lacks its own Screen Recording grant. Diagnose with `peekaboo bridge status --json`, then `peekaboo permissions status --json`, and use the default Bridge path instead of `--no-remote`.
Yes, capture commands support an `--analyze` flag with a prompt, such as `peekaboo image --mode screen --analyze "Summarize the dashboard"`. The `see` command also produces annotated UI maps with element IDs.
trpc-groupCapture and automate macOS UI interactions using the Peekaboo CLI.
GNHuaExecute Layer 2 adb visual verification flows and capture screenshots for Android devices.
BruceTyndallSchedule and sequence development tasks into automated workflow pipelines.
autonomy-cloudAutomate native macOS app interactions using AppleScript via osascript.