skills.rest
caiazzop
caiazzopCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

peekaboo

Automate macOS UI interactions and screen capture via command-line interface.

Updated Jan 26, 2026
Search Tags:#accessibility#cli#macos#ui automation#gui#screen capture
One-click install
npx skills add https://github.com/caiazzop/clawdbot-personal-assistant --skill peekaboo-caiazzop
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/caiazzop/clawdbot-personal-assistant/tree/main/skills/peekaboo
Command: npx skills add https://github.com/caiazzop/clawdbot-personal-assistant --skill peekaboo-caiazzop

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the control and inspection of the macOS graphical user interface, allowing AI to interact with applications and system elements as a user would.

Core Features & Use Cases

  • UI Automation: Drive clicks, typing, drags, and other interactions with UI elements.
  • Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
  • App & Window Management: Launch, quit, and manage application windows.
  • Use Case: An AI could use Peekaboo to log into a web application by navigating through the browser's UI, filling in form fields, and clicking buttons, all without direct code execution within the browser.

Quick Start

Use the peekaboo skill to check for necessary permissions on macOS.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions with an AI agent?▼

Automating macOS UI interactions involves driving clicks, typing, and app management through a command-line interface. This AI automation enables executing tasks like logging into web applications by navigating browser elements, filling forms, and clicking buttons without direct code execution.

Can AI capture screenshots and analyze screen content on macOS?▼

Yes, AI can capture screenshots, record screen activity, and analyze visual content on macOS. This functionality allows AI agents to inspect the graphical user interface, gather visual information from applications, and verify UI states during automated task execution.

Do I need special permissions to automate macOS GUI tasks?▼

Yes, automating macOS GUI tasks requires granting Screen Recording and Accessibility permissions on the target system. These macOS permissions are necessary to allow the AI agent to capture visual information and control UI elements like buttons and text fields.

What is the best way to control macOS application windows using AI?▼

The best way to control macOS application windows using AI is through a command-line interface that drives UI automation. It enables AI agents to launch, quit, and manage application windows seamlessly, replicating user interactions within the graphical user interface.

How does AI handle typing text and clicking buttons in macOS applications?▼

AI handles clicking buttons and typing text in macOS applications by automating interactions with UI elements directly. It drives these actions through a command-line interface, allowing the AI to perform complex sequences like navigating forms and managing application windows.

Related Skills

Explore More Software Engineering Skills→
RlierRlier
1

peekaboo

Automate macOS UI interactions with screen capture, element targeting, and input simulation.

Community
Advanced
AIDotNetAIDotNet
84

screenshot-capture

Capture full screens, windows, or regions and save as PNG files.

Official
Basic
arbazkhan971arbazkhan971
26

agent

Design and validate autonomous AI agents with tool orchestration and guardrails.

Community
Advanced
dislerdisler
267

steer

Automate macOS GUI interactions via screenshots, OCR, and input simulation.

Community
Advanced