peekaboo

Capture screens, identify UI elements, and automate clicks and typing in macOS apps.

36|4|Updated Feb 11, 2026

Search Tags:#automation #accessibility #macos #ui-testing #screenshot #ui-automation #multi-app

Ready to run

npx skills add https://github.com/xg-gh-25/SwarmAI --skill peekaboo-xg-gh-25

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/xg-gh-25/SwarmAI/tree/main/backend/skills/s_peekaboo
Command: npx skills add https://github.com/xg-gh-25/SwarmAI --skill peekaboo-xg-gh-25

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

macOS UI automation that lets you see and act across apps by capturing screens and driving interactions, reducing manual repetitive testing and debugging.

Core Features & Use Cases

See: capture annotated screenshots and identify UI elements
Decide: interpret visual state and plan actions
Act: automate clicks, typing, and navigation across macOS apps

Quick Start

Take a screenshot of the current screen and drive a simple see, decide, and act workflow in a target macOS app.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate macOS UI tasks across multiple apps?▼

Capturing screenshots and identifying UI elements enables macOS UI automation by following a See, Decide, and Act workflow. It interprets visual states to automate clicks, typing, and navigation across multiple apps.

Do I need accessibility and screen recording permissions for macOS UI testing?▼

Yes, macOS UI automation requires Screen Recording and Accessibility permissions to capture screens and drive interactions. The workflow includes safety checks and handles permission prompts to ensure proper execution.

How does visual state interpretation work for UI automation?▼

Visual state interpretation captures annotated screenshots to identify UI elements and plan actions. The automation system decides what interactions to perform by analyzing the current visual state of the macOS interface.

Can I use screenshot-based automation for debugging macOS apps?▼

Yes, screenshot-based automation supports debugging macOS apps by capturing screens and identifying UI elements. It reduces manual repetitive testing and debugging by automating interactions across applications.

What are the limitations of screenshot-based UI automation on macOS?▼

Limitations of macOS UI automation include dependency on Screen Recording and Accessibility permissions. The workflow requires handling permission prompts and safety checks, which may interrupt automated execution.