ui-inspector

Inspects macOS UI elements via Accessibility API using atomacos, returning metadata and coordinates.

3|1|Updated Feb 12, 2026

Search Tags:#developer tools #macos #ui automation #accessibility api #element inspection #click coordinates

Ready to run

npx skills add https://github.com/smykla-skalski/sai --skill ui-inspector

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: ui-inspector
Source: https://github.com/smykla-skalski/sai/tree/main/ui-inspector/skills/ui-inspector
Command: npx skills add https://github.com/smykla-skalski/sai --skill ui-inspector

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill allows you to programmatically inspect and interact with live UI elements within macOS applications, enabling automation and detailed analysis of application interfaces.

Core Features & Use Cases

Element Discovery: Find buttons, text fields, and other UI elements by role, title, or identifier.
Coordinate Retrieval: Obtain precise click coordinates for UI elements to facilitate automation.
UI State Inspection: Check the enabled status and other properties of UI elements.
Use Case: Automate the process of filling out a form in a desktop application by finding the correct text fields and buttons and then programmatically clicking them.

Quick Start

List all UI elements in the Finder application.

Frequently Asked Questions about ui-inspector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I get click coordinates for macOS UI elements during automation?▼

To find UI elements in macOS applications, this Skill inspects the accessibility tree via the Accessibility API. It discovers elements by role, title, or identifier, returning properties like enabled status for interface verification and automation.

Can I use the Accessibility API to inspect a desktop application's UI state?▼

Yes, you can inspect a desktop application's UI state using this Skill. It queries the macOS Accessibility API to check element properties such as enabled status, helping verify interface readiness before performing automated actions.

What's the best way to find buttons and text fields in a running macOS app?▼

The best way to find buttons and text fields in a running macOS app is using this Skill's element discovery feature. It inspects the live accessibility tree to locate specific UI elements by role, title, or identifier for automation tasks.

Does UI automation on macOS require accessibility permissions to inspect elements?▼

UI automation on macOS requires accessibility permissions to inspect elements. This Skill uses the atomacos library to interact with the Accessibility API, which requires granting accessibility access to the controlling application or terminal environment.

How to automate filling out a form in a macOS desktop application?▼

To automate filling out a form in a macOS desktop application, use this Skill to inspect the UI and locate target text fields and buttons. It returns the precise click coordinates needed to programmatically interact with the form elements.