skills.rest
brikkoAI
brikkoAIOFFICIAL
Explore all skills by this author →
WebsiteGitHub

peekaboo

Automates macOS UI tasks including targeting, input, capture, and window/app management via Peekaboo CLI.

1|Updated May 3, 2026
Search Tags:#macos#ui testing#ui automation#app control#screen capture#peekaboo#desktop automation
One-click install
npx skills add https://github.com/brikkoAI/brikko-studio --skill peekaboo-brikkoai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/brikkoAI/brikko-studio/tree/main/packages/core/skills/peekaboo
Command: npx skills add https://github.com/brikkoAI/brikko-studio --skill peekaboo-brikkoai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually interacting with macOS UI elements for repetitive tasks like form filling, app navigation, or data entry is slow, error-prone, and impossible to scale for bulk operations. This Skill eliminates that friction by enabling full programmatic control of the macOS desktop interface.

Core Features & Use Cases

  • Precise UI Interaction: Target and click, type, drag, scroll, or send hotkeys to specific UI elements via annotated screenshots, coordinates, or element IDs, with support for app/window targeting and human-like input timing to avoid detection.
  • Screen Capture & Analysis: Capture full screens, specific windows, or custom regions, with optional AI-powered analysis of on-screen content and annotated visual maps to simplify element identification.
  • Use Case: For example, use this Skill to automate logging into a macOS app by capturing the login window, identifying the username and password fields, entering pre-defined credentials, and submitting the form without any manual input.

Quick Start

Use the peekaboo skill to capture the frontmost macOS window, identify the login button, click it, enter the test user credentials, and submit the form to complete the automated login flow.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI tasks like form filling and data entry?▼

Automate macOS UI interactions programmatically by targeting elements via annotated screenshots or coordinates, simulating input, and managing windows. This approach eliminates manual clicking and typing for repetitive desktop workflows like form filling and data entry.

Does macOS UI automation require special system permissions to control desktop apps?▼

macOS UI automation requires Screen Recording and Accessibility permissions enabled on the host system. These permissions allow programmatic tools to capture on-screen content and send simulated inputs to control desktop applications.

What is the best way to identify and click specific UI elements during desktop automation?▼

The best way to identify UI elements during desktop automation is using annotated visual maps and screen capture. AI-powered analysis of on-screen content simplifies targeting specific elements by generating annotated screenshots for precise interaction.

Can I capture screenshots and analyze on-screen content during UI testing on macOS?▼

Capture screenshots and analyze on-screen content during macOS UI testing by grabbing full screens, specific windows, or custom regions. AI-powered analysis interprets the captured visual data to assist with UI testing and element identification.

Do I need Homebrew to set up macOS desktop automation workflows?▼

Setting up macOS desktop automation workflows requires installing the underlying CLI binary via Homebrew. This package manager provides the necessary executable to programmatically orchestrate cross-application workflows and manage system permissions.

Related Skills

Explore More Software Engineering Skills→
Zentin-LZentin-L
1

peekaboo

Automate macOS UI tasks by capturing screens, targeting elements, and driving input via CLI.

Community
Advanced
ZardLi1115ZardLi1115
4

findmy

Extract Apple device and AirTag locations from macOS Find My screenshots.

Community
Intermediate
steelan9199steelan9199
9

pyautogui-automation

Control mouse, keyboard, and screen interactions for desktop automation.

Community
Advanced
openakitaopenakita
2.0k

desktop-find-element

Locate desktop UI elements via UIAutomation or vision recognition.

Community
Intermediate