peekaboo

Automate macOS UI interactions via command-line interface with screen capture and input simulation.

1|Updated Feb 14, 2026
One-click install
npx skills add https://github.com/AmitabhainArunachala/clawd --skill peekaboo-amitabhainarunachala
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/AmitabhainArunachala/clawd/tree/main/skills/peekaboo
Command: npx skills add https://github.com/AmitabhainArunachala/clawd --skill peekaboo-amitabhainarunachala

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the tedious and error-prone process of interacting with macOS user interfaces, enabling scripting and automation of complex UI tasks.

Core Features & Use Cases

  • UI Element Interaction: Click, type, drag, and scroll through UI elements with precision.
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
  • App & Window Management: Launch, quit, and manipulate applications and their windows.
  • Use Case: Automate the process of filling out a complex login form across multiple applications, ensuring accuracy and speed.

Quick Start

Check if Peekaboo has the necessary permissions to automate the UI.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?

You can automate macOS UI interactions from the command line by using a CLI tool to target elements, simulate inputs like clicking and typing, and capture screens for deterministic task execution.

Do I need special permissions to automate macOS UI and capture screens?

Yes, automating macOS UI and capturing screens requires granting Screen Recording and Accessibility permissions to the CLI tool to ensure full functionality for element interaction and visual analysis.

Can I script complex workflows like filling out login forms across multiple macOS applications?

Yes, you can script complex workflows like filling out login forms across multiple macOS applications by launching apps, targeting specific UI elements, and simulating precise typing and clicking inputs.

What is UI element introspection and how does it help with macOS scripting?

UI element introspection provides detailed analysis of application states and interface elements, enabling precise targeting for macOS scripting so automation tasks execute deterministically without relying on blind coordinate clicks.

Does this approach work for managing application windows and recording screen activity on macOS?

Yes, this approach works for managing application windows and recording screen activity on macOS, allowing you to launch, quit, manipulate windows, and capture visual content via command-line scripts.

Are there limitations when using CLI scripting for macOS UI automation?

Limitations of CLI scripting for macOS UI automation include dependency on system-level Accessibility and Screen Recording permissions, and potential execution failures if target application UI elements dynamically change states.