skills.rest
xg-gh-25
xg-gh-25COMMUNITY
Explore all skills by this author →
WebsiteGitHub

peekaboo

Capture screens, identify UI elements, and automate clicks and typing in macOS apps.

36|4|Updated Feb 11, 2026
Search Tags:#automation#accessibility#macos#ui-testing#screenshot#ui-automation#multi-app
One-click install
npx skills add https://github.com/xg-gh-25/SwarmAI --skill peekaboo-xg-gh-25
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/xg-gh-25/SwarmAI/tree/main/backend/skills/s_peekaboo
Command: npx skills add https://github.com/xg-gh-25/SwarmAI --skill peekaboo-xg-gh-25

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

macOS UI automation that lets you see and act across apps by capturing screens and driving interactions, reducing manual repetitive testing and debugging.

Core Features & Use Cases

  • See: capture annotated screenshots and identify UI elements
  • Decide: interpret visual state and plan actions
  • Act: automate clicks, typing, and navigation across macOS apps

Quick Start

Take a screenshot of the current screen and drive a simple see, decide, and act workflow in a target macOS app.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI tasks across multiple apps?▼

Capturing screenshots and identifying UI elements enables macOS UI automation by following a See, Decide, and Act workflow. It interprets visual states to automate clicks, typing, and navigation across multiple apps.

Do I need accessibility and screen recording permissions for macOS UI testing?▼

Yes, macOS UI automation requires Screen Recording and Accessibility permissions to capture screens and drive interactions. The workflow includes safety checks and handles permission prompts to ensure proper execution.

How does visual state interpretation work for UI automation?▼

Visual state interpretation captures annotated screenshots to identify UI elements and plan actions. The automation system decides what interactions to perform by analyzing the current visual state of the macOS interface.

Can I use screenshot-based automation for debugging macOS apps?▼

Yes, screenshot-based automation supports debugging macOS apps by capturing screens and identifying UI elements. It reduces manual repetitive testing and debugging by automating interactions across applications.

What are the limitations of screenshot-based UI automation on macOS?▼

Limitations of macOS UI automation include dependency on Screen Recording and Accessibility permissions. The workflow requires handling permission prompts and safety checks, which may interrupt automated execution.

Related Skills

Explore More Software Engineering Skills→
coltonbattscoltonbatts

peekaboo

Automate macOS UI interactions via command-line interface.

Community
Advanced
alter123-zzalter123-zz
18

webapp-testing

Test and debug local web applications using Playwright.

Community
Intermediate
JeffallanJeffallan
10.9k

Playwright Expert

Orchestrate Playwright end-to-end browser automation and testing infrastructure.

Community
Intermediate
diegopetruccidiegopetrucci

peekaboo

Automate macOS UI interactions and screenshot capture via CLI.

Community
Intermediate