peekaboo

Automate macOS UI interactions by capturing screenshots and executing input commands.

6|Updated Mar 13, 2026

Search Tags:#automation #accessibility #cli #macos #ui-testing #screen-capture

Ready to run

npx skills add https://github.com/me2Doc/friendlyclaw --skill peekaboo-me2doc

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/me2Doc/friendlyclaw/tree/main/body/skills/peekaboo
Command: npx skills add https://github.com/me2Doc/friendlyclaw --skill peekaboo-me2doc

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires peekaboo.

What problem does it solve?

This skill solves the challenge of interacting with non-API-driven macOS applications by providing a programmatic interface to capture, inspect, and manipulate UI elements.

Core Features & Use Cases

Visual UI Inspection: Capture screenshots and identify UI elements for precise interaction.
Automated Input: Execute clicks, drags, typing, and hotkey sequences across any application window.
System Management: Launch, quit, and manage application windows, menus, and system dialogs programmatically.

Quick Start

Use the peekaboo skill to list all currently open applications and then click on the Safari window to type a search query.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate macOS UI interactions for desktop applications without an API?▼

macOS UI automation can be achieved by programmatically capturing screen snapshots, inspecting UI elements, and executing input commands like clicks, drags, and typing on non-API-driven desktop applications.

Do I need special permissions to run macOS screen capture and UI testing automation?▼

macOS screen capture and UI testing automation requires explicit accessibility and screen recording permissions to function as a system-level automation agent capable of managing windows and executing gestures.

Can I use command line interface tools to manage application windows and system dialogs?▼

Command line interface tools can manage application windows and system dialogs programmatically, enabling you to launch, quit, and navigate menus across any open application window on macOS.

What is the best way to execute gesture-based input and hotkey sequences on macOS?▼

Executing gesture-based input and hotkey sequences on macOS relies on visual UI inspection to capture screenshots and identify elements, allowing precise automated input execution across desktop applications.

Does peekaboo support complex workflows for non-API-driven macOS applications?▼

peekaboo supports complex workflows for non-API-driven macOS applications by providing a programmatic interface to capture, inspect, and manipulate UI elements through automated input and system management.