skills.rest
me2Doc
me2DocCOMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Automate macOS UI interactions by capturing screenshots and executing input commands.

6|Updated Mar 13, 2026
Search Tags:#automation#accessibility#cli#macos#ui-testing#screen-capture
One-click install
npx skills add https://github.com/me2Doc/friendlyclaw --skill peekaboo-me2doc
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/me2Doc/friendlyclaw/tree/main/body/skills/peekaboo
Command: npx skills add https://github.com/me2Doc/friendlyclaw --skill peekaboo-me2doc

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires peekaboo.

What problem does it solve?

This skill solves the challenge of interacting with non-API-driven macOS applications by providing a programmatic interface to capture, inspect, and manipulate UI elements.

Core Features & Use Cases

  • Visual UI Inspection: Capture screenshots and identify UI elements for precise interaction.
  • Automated Input: Execute clicks, drags, typing, and hotkey sequences across any application window.
  • System Management: Launch, quit, and manage application windows, menus, and system dialogs programmatically.

Quick Start

Use the peekaboo skill to list all currently open applications and then click on the Safari window to type a search query.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions for desktop applications without an API?▼

macOS UI automation can be achieved by programmatically capturing screen snapshots, inspecting UI elements, and executing input commands like clicks, drags, and typing on non-API-driven desktop applications.

Do I need special permissions to run macOS screen capture and UI testing automation?▼

macOS screen capture and UI testing automation requires explicit accessibility and screen recording permissions to function as a system-level automation agent capable of managing windows and executing gestures.

Can I use command line interface tools to manage application windows and system dialogs?▼

Command line interface tools can manage application windows and system dialogs programmatically, enabling you to launch, quit, and navigate menus across any open application window on macOS.

What is the best way to execute gesture-based input and hotkey sequences on macOS?▼

Executing gesture-based input and hotkey sequences on macOS relies on visual UI inspection to capture screenshots and identify elements, allowing precise automated input execution across desktop applications.

Does peekaboo support complex workflows for non-API-driven macOS applications?▼

peekaboo supports complex workflows for non-API-driven macOS applications by providing a programmatic interface to capture, inspect, and manipulate UI elements through automated input and system management.

Related Skills

Explore More Software Engineering Skills→
vignesh2027vignesh2027
18

peekaboo

Automate macOS UI interactions via command-line interface.

Community
Advanced
tedtv1007-ctrltedtv1007-ctrl

peekaboo

Automate macOS UI by capturing screenshots and executing input events.

Community
Advanced
FatByFatBy
2

peekaboo

Automate macOS UI interactions and screen captures via a command-line interface.

Community
Advanced
steipetesteipete
385.7k

peekaboo

Capture and control macOS UI elements via CLI commands.

Community
Advanced