peekaboo

Automate macOS UI interactions with screen capture and input simulation.

Updated Jan 29, 2026

Search Tags:#accessibility #macos #scripting #ui automation #screen capture #gui testing

Ready to run

npx skills add https://github.com/balaraj74/F.R.I.D.A.Y --skill peekaboo-balaraj74

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/balaraj74/F.R.I.D.A.Y/tree/main/skills/peekaboo
Command: npx skills add https://github.com/balaraj74/F.R.I.D.A.Y --skill peekaboo-balaraj74

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill streamlines repetitive tasks on macOS by enabling programmatic control and automation of the graphical user interface, reducing manual effort and errors.

Core Features & Use Cases

UI Element Interaction: Click, type, drag, and scroll through UI elements with precision.
Screen Capture & Analysis: Capture screenshots, record screen activity, and analyze visual content.
App & Window Management: Launch, quit, focus, and manipulate application windows.
Use Case: Automate the process of filling out a complex software installation wizard by using Peekaboo to navigate dialogs, enter text, and click buttons.

Quick Start

Run the peekaboo command to check your permissions for screen recording and accessibility.

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate macOS UI interactions like clicking and typing programmatically?▼

macOS UI automation simulates clicks, typing, dragging, and scrolling through scriptable element targeting. This Skill controls application windows and inputs with precision, reducing manual effort for repetitive desktop tasks.

Can I capture screenshots and analyze visual UI states during macOS automation?▼

Yes, you can capture screenshots and record screen activity to analyze visual UI states. This Skill supports screen capture and visual analysis, allowing scripts to verify interface conditions during automated workflows.

Do I need specific macOS permissions to run scripts that control the user interface?▼

You need specific macOS permissions for Screen Recording and Accessibility to control the user interface. Running the peekaboo command checks these permissions, ensuring scripts can interact with UI elements and capture screens.

What is the best way to automate navigating a complex software installation wizard on macOS?▼

Automating installation wizards requires programmatic control to navigate dialogs, enter text, and click buttons. This Skill targets UI elements precisely, handling window management and input simulation for complex application setups.

How does GUI testing handle application focus and window management on macOS?▼

GUI testing handles application focus and window management by launching, quitting, and manipulating application windows programmatically. This Skill targets specific UI elements, ensuring inputs route to the correct active application.

Why does my macOS screen capture automation fail to record interface elements?▼

Screen capture automation fails when macOS Screen Recording permissions are not granted. You must enable accessibility and screen recording permissions for your automation tool to interact with and capture the user interface effectively.