skills.rest
frankhli843
frankhli843COMMUNITY
Explore all skills by this author →
GitHub

peekaboo

Automate macOS UI interactions by capturing, inspecting, and controlling on-screen elements.

Updated Apr 24, 2026
Search Tags:#automation#cli#macos#scripting#peekaboo#gui-testing#ui-automation
One-click install
npx skills add https://github.com/frankhli843/gemmahermes --skill peekaboo-frankhli843
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/frankhli843/gemmahermes/tree/main/skills/peekaboo
Command: npx skills add https://github.com/frankhli843/gemmahermes --skill peekaboo-frankhli843

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Peekaboo automates macOS UI interactions by capturing, inspecting, and controlling on-screen elements, reducing manual effort and increasing reliability.

Core Features & Use Cases

  • Full macOS UI automation CLI: capture, inspect, target UI elements, drive input, and manage apps/windows/menus with a single tool.
  • Enables scripting and automation workflows for repetitive GUI tasks across apps on macOS.
  • Use case: automate routine UI checks during development or testing, like clicking a button and entering text in a form, then validating results.

Quick Start

See a target UI element, then click it and type into it using Peekaboo.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI interactions from the command line?▼

You can automate macOS UI interactions from the command line by using a CLI tool to capture, inspect, and control on-screen elements. This enables programmatic clicking, typing, and menu navigation across macOS apps.

Can I script repetitive GUI tasks across macOS applications?▼

Yes, you can script repetitive GUI tasks across macOS applications by capturing and targeting UI elements programmatically. This allows you to automate routine UI checks, drive input, and manage app windows during development or testing.

What is the best way to click buttons and enter text in a macOS form automatically?▼

The best way to click buttons and enter text in a macOS form automatically is to use a UI automation CLI that supports targeting specific on-screen elements. You capture the UI element, then issue commands to click and type into it.

Does macOS UI automation require any special frameworks or dependencies?▼

This macOS UI automation approach requires no external dependencies or special frameworks. It operates directly through CLI commands for app management, element inspection, and input control to drive the graphical interface.

How do I inspect and target on-screen elements for macOS UI testing?▼

You inspect and target on-screen elements for macOS UI testing by using a CLI capture command to identify the UI components. Once captured, you can programmatically interact with those elements to validate application behavior.

Are there limitations to automating macOS UI tasks from the CLI?▼

When automating macOS UI tasks from the CLI, limitations may arise if the target application has non-standard or inaccessible UI elements. The automation relies on capturing and inspecting visible on-screen elements to function correctly.

Related Skills

Explore More Software Engineering Skills→
Probably-GroupProbably-Group
3

macos-accessibility

Inspect and control macOS UI elements via AXUIElement with permission checks.

Official
Advanced
Patasse97Patasse97

report

Generate Markdown and HTML test reports from Playwright results.

Community
Intermediate
dannotedannote
48

applescript

Automate macOS app control and workflows using AppleScript and JXA.

Community
Advanced
edteedte
11

playwright-cli

Automate browser interactions for testing, form filling, screenshots, and data extraction via Playwright CLI.

Community
Intermediate