skills.rest
s1366560
s1366560COMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Automate macOS UI interactions via command-line with screenshots, input, and window management.

5|2|Updated Jan 24, 2026
Search Tags:#automation#testing#ui#cli#macos#scripting
One-click install
npx skills add https://github.com/s1366560/agi-demos --skill peekaboo-s1366560
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/s1366560/agi-demos/tree/main/.memstack/skills/peekaboo
Command: npx skills add https://github.com/s1366560/agi-demos --skill peekaboo-s1366560

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates tedious macOS user interface interactions, allowing for programmatic control of applications, windows, and system elements.

Core Features & Use Cases

  • UI Automation: Capture screenshots, click elements, type text, and manage applications.
  • Scripting: Execute .peekaboo.json scripts for complex automation sequences.
  • Use Case: Automate the process of logging into a web application by opening the browser, navigating to the login page, typing credentials, and submitting the form.

Quick Start

Use the peekaboo skill to check permissions for screen recording and accessibility.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

macOS UI automation can be executed via a command-line interface to capture screenshots, target UI elements by coordinates, and drive keyboard and mouse input. This Skill automates tedious programmatic interactions with applications and windows.

What macOS permissions do I need to run UI automation scripts?▼

UI automation scripts require explicit macOS permissions for Screen Recording and Accessibility to function correctly. You can use the peekaboo skill to check if your system has the necessary permissions configured before executing tasks.

Can I execute complex macOS automation sequences using JSON?▼

Complex macOS automation sequences can be executed by running `.peekaboo.json` scripts. This allows you to string together multiple UI interactions like opening applications, typing text, and submitting forms into a single automated workflow.

Does UI automation work for logging into web applications on macOS?▼

UI automation can log into web applications on macOS by opening the browser, navigating to the login page, targeting input elements, typing credentials, and submitting the form. This solves the problem of repetitive manual web logins.

What are the limitations of using CLI for macOS UI automation?▼

macOS UI automation via CLI requires installing the peekaboo binary and granting system-level Screen Recording and Accessibility permissions. Automation may fail if these prerequisites are missing or if target applications change their UI element structure.

What is the best way to manage applications and windows programmatically on macOS?▼

Managing applications and windows programmatically on macOS is best handled by targeting UI elements by ID or coordinates to drive input. This Skill automates these precise interactions through a dedicated command-line interface.

Related Skills

Explore More Software Engineering Skills→
wangqianCAIwangqianCAI

peekaboo

Automate macOS UI interactions via accessibility and screen recording APIs.

Community
Advanced
vignesh2027vignesh2027
18

peekaboo

Automate macOS UI interactions via command-line interface.

Community
Advanced
joeleung0122joeleung0122

peekaboo

Automate macOS UI tasks with the Peekaboo CLI for screens, elements, and input.

Community
Intermediate
Team-HirealTeam-Hireal

peekaboo

Automate macOS UI interactions with screen capture, element targeting, and input simulation.

Community
Advanced