skills.rest
SeanHogg
SeanHoggCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

peekaboo

Automate macOS UI interactions via command-line clicks, typing, drags, and scrolls.

3|1|Updated Feb 23, 2026
Search Tags:#developer tools#cli#macos#scripting#ui automation#gui
One-click install
npx skills add https://github.com/SeanHogg/coderClaw --skill peekaboo-seanhogg
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/SeanHogg/coderClaw/tree/main/product/skills/peekaboo
Command: npx skills add https://github.com/SeanHogg/coderClaw --skill peekaboo-seanhogg

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates tedious macOS UI interactions, allowing for programmatic control of applications, windows, and system elements, streamlining repetitive tasks.

Core Features & Use Cases

  • UI Element Interaction: Click, type, drag, and scroll through UI elements with precise targeting.
  • Screen Capture & Analysis: Capture screenshots, record screen regions, and analyze visual content.
  • App & Window Management: Launch, quit, focus, and manipulate application windows.
  • Use Case: Automate the process of filling out a complex web form within a desktop application, including navigating through multiple fields, handling dropdowns, and submitting the form.

Quick Start

Check the screen recording and accessibility permissions for the peekaboo tool.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

You can automate macOS UI interactions by using a command-line interface to script clicks, typing, drags, and scrolls. This enables programmatic control of applications and windows to streamline repetitive desktop tasks.

What do I need to set up before scripting macOS GUI automation?▼

Before scripting macOS GUI automation, you must grant screen recording and accessibility permissions to the tool. These system permissions are required for the command-line interface to capture screens and control UI elements.

Can I capture screenshots and analyze screen regions during UI automation?▼

Yes, the UI automation tool supports screen capture and analysis during execution. You can capture screenshots, record specific screen regions, and analyze visual content to verify deterministic UI interactions.

How do I script precise element targeting for deterministic UI automation?▼

Deterministic UI automation is achieved through precise element targeting that scripts clicks, typing, and drags. This allows you to programmatically interact with specific UI elements like form fields and dropdowns without visual ambiguity.

Does macOS UI automation support application and window management?▼

Yes, macOS UI automation supports comprehensive application and window management. You can programmatically launch, quit, focus, and manipulate application windows to orchestrate complex workflows across multiple desktop apps.

What is the best way to automate filling out a complex web form in a desktop application?▼

To automate complex web forms within desktop applications, use a scripting tool that supports precise UI element interaction. This enables you to navigate multiple fields, handle dropdowns, and submit the form programmatically.

Related Skills

Explore More Software Engineering Skills→
elizaOSelizaOS
19.0k

peekaboo

Automate macOS UI interactions via command-line interface.

Official
Advanced
tranceetrancee

capturing-screenshots-and-screenrecord

Capture PNG screenshots and MP4 screen recordings from Android devices via ADB.

Community
Advanced
gajjalaashok75-UIgajjalaashok75-UI
2

bash-linux

Provide Bash and Linux command patterns for chaining, file inspection, and scripting.

Community
Basic
ybsaybsa
3

peekaboo

Automate macOS GUI interactions via command-line interface.

Community
Advanced