skills.rest
smykla-skalski
smykla-skalskiOFFICIAL
Explore all skills by this author →
WebsiteGitHub

ui-inspector

Inspects macOS UI elements via Accessibility API using atomacos, returning metadata and coordinates.

3|1|Updated Feb 12, 2026
Search Tags:#developer tools#macos#ui automation#accessibility api#element inspection#click coordinates
One-click install
npx skills add https://github.com/smykla-skalski/sai --skill ui-inspector
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ui-inspector
Source: https://github.com/smykla-skalski/sai/tree/main/ui-inspector/skills/ui-inspector
Command: npx skills add https://github.com/smykla-skalski/sai --skill ui-inspector

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill allows you to programmatically inspect and interact with live UI elements within macOS applications, enabling automation and detailed analysis of application interfaces.

Core Features & Use Cases

  • Element Discovery: Find buttons, text fields, and other UI elements by role, title, or identifier.
  • Coordinate Retrieval: Obtain precise click coordinates for UI elements to facilitate automation.
  • UI State Inspection: Check the enabled status and other properties of UI elements.
  • Use Case: Automate the process of filling out a form in a desktop application by finding the correct text fields and buttons and then programmatically clicking them.

Quick Start

List all UI elements in the Finder application.

Frequently Asked Questions about ui-inspector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I get click coordinates for macOS UI elements during automation?▼

To find UI elements in macOS applications, this Skill inspects the accessibility tree via the Accessibility API. It discovers elements by role, title, or identifier, returning properties like enabled status for interface verification and automation.

Can I use the Accessibility API to inspect a desktop application's UI state?▼

Yes, you can inspect a desktop application's UI state using this Skill. It queries the macOS Accessibility API to check element properties such as enabled status, helping verify interface readiness before performing automated actions.

What's the best way to find buttons and text fields in a running macOS app?▼

The best way to find buttons and text fields in a running macOS app is using this Skill's element discovery feature. It inspects the live accessibility tree to locate specific UI elements by role, title, or identifier for automation tasks.

Does UI automation on macOS require accessibility permissions to inspect elements?▼

UI automation on macOS requires accessibility permissions to inspect elements. This Skill uses the atomacos library to interact with the Accessibility API, which requires granting accessibility access to the controlling application or terminal environment.

How to automate filling out a form in a macOS desktop application?▼

To automate filling out a form in a macOS desktop application, use this Skill to inspect the UI and locate target text fields and buttons. It returns the precise click coordinates needed to programmatically interact with the form elements.

Related Skills

Explore More Software Engineering Skills→
syxscottsyxscott
1

peekaboo

Automate macOS UI interactions via command-line screen capture and input simulation.

Community
Advanced
testdriveraitestdriverai
238

testdriver:click

Perform element-based and coordinate-based click actions in automated tests.

Official
Intermediate
wanhaoniuwanhaoniu
41

macos-use-desktop-control

Automate macOS desktop UI interactions by locating elements via visible text.

Community
Intermediate
autonomy-cloudautonomy-cloud
2

computer-use

Automate macOS desktop workflows by controlling GUI elements via accessibility-tree targeting.

Official
Advanced