skills.rest
letta-ai
letta-aiOFFICIAL
Explore all skills by this author →
Website𝕏@letta_aiGitHub

peekaboo

Automate macOS UI interactions and testing via the Peekaboo CLI.

327|85|Updated Jan 29, 2026
Search Tags:#automation#testing#CLI#macOS#scripting#UI automation#peekaboo
One-click install
npx skills add https://github.com/letta-ai/lettabot --skill peekaboo-letta-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/letta-ai/lettabot/tree/main/.skills/peekaboo
Command: npx skills add https://github.com/letta-ai/lettabot --skill peekaboo-letta-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Peekaboo provides a CLI to automate macOS UI tasks such as capturing screens, inspecting UI elements, driving inputs, and managing apps, enabling reproducible automation and testing.

Core Features & Use Cases

  • Automate UI tasks: see UI elements, click, type, hotkeys, and window management across macOS apps.
  • Screen capture and analysis: capture screenshots/videos, annotate results, and inspect UI state.
  • App/Window/Dock/Menu control: launch, quit, switch apps, interact with menus and the Dock.
  • Scriptable automation: run and compose commands for repeatable workflows and testing.
  • Use Case: create a reproducible flow to log into a macOS app and extract UI state for verification.

Quick Start

Start with a quick validation of Peekaboo capabilities:

  • permissions
  • list apps --json
  • see --app Safari --window-title "Login" --annotate --path /tmp/see.png
  • click --on B3 --app Safari
  • type "[email protected]" --app Safari --return

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

You can automate macOS UI interactions by using a CLI tool to capture screens, inspect UI elements, and drive inputs like clicks and keystrokes. This enables scriptable and reproducible workflows for testing.

What do I need to set up before scripting macOS UI automation tasks?▼

Before scripting macOS UI automation, you need macOS, the relevant CLI binary installed via a package manager like Homebrew, and system permissions granted for screen recording and accessibility access.

Can I capture screenshots and inspect UI elements in macOS apps?▼

Yes, you can capture screenshots and inspect UI elements in macOS apps by running specific commands. The tool allows you to annotate captured images and extract the current UI state for verification.

How do I script a reproducible login flow for a macOS application?▼

To script a reproducible login flow, you compose CLI commands to launch the app, inspect the login window, click on specific UI elements by their index, type the credentials, and submit the form.

Does this approach support managing windows and application menus on macOS?▼

Yes, this approach supports managing windows and application menus on macOS. You can programmatically launch, quit, and switch apps, as well as interact with menu bars and the Dock.

Are there limitations when automating GUI tasks with a CLI on macOS?▼

The primary limitation is the strict dependency on macOS system permissions. Without explicitly granting accessibility and screen recording access to the executing terminal, automation commands will fail.

Related Skills

Explore More Software Engineering Skills→
Yogi-076Yogi-076

peekaboo

Capture and control macOS user interfaces via CLI for automated tasks.

Community
Advanced
pradyumnasagarpradyumnasagar
6

agent-handoff

Automate inter-skill data transfer and provenance capture via JSON Material Passports.

Community
Advanced
HellblazerHellblazer
4

cli-controller

Orchestrate interactive CLI sessions using tmux panes and bash scripting.

Community
Advanced
projectedanxprojectedanx
1

macos-computer-use

Automate macOS GUI interactions via accessibility APIs and visual overlays.

Community
Advanced