peekaboo

Automates macOS UI tasks by capturing screen, locating elements, and scripting clicks, typing, and window control.

32|9|Updated Feb 12, 2026
One-click install
npx skills add https://github.com/DotNetAge/mindx --skill peekaboo-dotnetage
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: peekaboo
Source: https://github.com/DotNetAge/mindx/tree/main/skills/peekaboo
Command: npx skills add https://github.com/DotNetAge/mindx --skill peekaboo-dotnetage

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

在 macOS 上,日常的 UI 操作需要重复、耗时且易出错的步骤。本技能提供屏幕捕获、UI 元素定位、自动点击和窗口管理等能力,帮助用户实现可重复、无人工干预的 UI 自动化。

Core Features & Use Cases

  • 交互操作:点击、拖动、热键、输入文本等,支持在目标应用内的定位、等待与执行。
  • 系统操作:启动/退出应用,聚焦/切换窗口,管理菜单与 Dock 项等。
  • 视觉操作:屏幕捕捉、图像定位、带注释的看到/分析 UI 地图,快速定位目标。
  • Use Case: 通过 peekaboo 在 macOS 上实现自动化的日常任务,如打开 Safari、导航到页面、输入信息、提交表单。

Quick Start

例如,让 peekaboo see 捕获目标界面并使用 peekaboo click 完成点击。

Frequently Asked Questions about peekaboo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS UI tasks using a CLI?

Automate macOS UI tasks via a CLI by capturing the screen, locating target UI elements, and driving scripted interactions like clicks, typing, and navigation. This enables native app automation and window management without manual intervention.

How does screen capture help with UI automation on macOS?

Screen capture enables UI automation by capturing the target interface and generating an annotated UI map. This visually locates UI elements, allowing automation scripts to precisely target and interact with native application windows and controls.

Can I manage windows and launch native apps through macOS UI automation?

Yes, macOS UI automation supports system operations including launching and quitting applications, focusing and switching windows, and managing menu and Dock items. This allows scripts to control native apps and handle window management.

What is the best way to script repetitive interface interactions on macOS?

The best way to script repetitive interface interactions on macOS is using a CLI-based automation tool to capture the screen and target UI elements. This allows you to script clicks, text input, and navigation for reliable, repeated UI operations.

Does macOS UI automation require specific dependencies to run?

macOS UI automation runs as a standalone CLI tool with no external dependencies. It directly captures the screen, locates visual UI elements, and executes interaction workflows on the macOS operating system.

Why does my macOS UI automation fail to locate UI elements?

macOS UI automation may fail to locate UI elements if the target interface is not fully loaded or visually obscured. Ensure the automation script captures the screen after the target window is focused and the UI elements are completely rendered.