skills.rest
ybsa
ybsaCOMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Automate macOS GUI interactions via command-line interface.

3|Updated Feb 26, 2026
Search Tags:#cli#macos#ui automation#screen capture#gui scripting#application control
One-click install
npx skills add https://github.com/ybsa/sovereign-kernel --skill peekaboo-ybsa
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/ybsa/sovereign-kernel/tree/main/crates/sk-tools/skills/peekaboo
Command: npx skills add https://github.com/ybsa/sovereign-kernel --skill peekaboo-ybsa

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill addresses the challenge of automating graphical user interface (GUI) interactions on macOS, enabling programmatic control over applications and system elements.

Core Features & Use Cases

  • UI Element Interaction: Click, type, drag, and scroll through UI elements using robust targeting mechanisms.
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
  • Application & Window Management: Launch, quit, and manage application windows and system dialogs.
  • Use Case: Automate the process of logging into a web application by controlling the browser's UI elements, filling in credentials, and clicking the login button.

Quick Start

Run peekaboo permissions to check necessary macOS permissions for UI automation.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

Automating macOS UI interactions from the command line requires a tool that handles GUI scripting, input simulation, and application control. This approach enables programmatic element targeting and screen capture directly from terminal workflows.

Do I need special macOS permissions for GUI scripting and screen capture?▼

GUI scripting and screen capture on macOS require granting specific system permissions. You must enable Screen Recording and Accessibility access to allow a CLI tool to control UI elements and capture visual content programmatically.

Can I script application control and window management on macOS without AppleScript?▼

You can script application control and window management on macOS without AppleScript by using a CLI that executes GUI scripting. This enables launching, quitting, and managing application windows and system dialogs through input simulation.

What is the best way to automate logging into a web application on macOS?▼

Automating web application logins on macOS is best achieved using a CLI to control browser UI elements. This method fills in credentials and clicks the login button through targeted input simulation and GUI scripting.

Why is my macOS screen capture or UI automation not working?▼

macOS screen capture or UI automation fails when the CLI lacks required system permissions. Running a permissions check verifies that Screen Recording and Accessibility access are properly granted for executing GUI scripting tasks.

Related Skills

Explore More Software Engineering Skills→
xg-gh-25xg-gh-25
36

peekaboo

Capture screens, identify UI elements, and automate clicks and typing in macOS apps.

Community
Advanced
phanijappsphanijapps
1

eagle-eye

Extract structured insights from images, diagrams, charts, and PDFs.

Community
Intermediate
wyattjohwyattjoh
1

driving-ios-simulator

Control booted iOS Simulator UI via idb_companion and xcrun simctl.

Community
Advanced
victor-brechbillvictor-brechbill
1

peekaboo

Automate macOS UI interactions and system tasks via the Peekaboo CLI.

Official
Advanced