Automate macOS GUI tasks using AX-tree discovery with vision fallback.
npx skills add https://github.com/buildoak/fieldwork-skills --skill peekaboo-buildoak
Please help me install this Agent Skill. Skill: peekaboo Source: https://github.com/buildoak/fieldwork-skills/tree/main/skills/peekaboo Command: npx skills add https://github.com/buildoak/fieldwork-skills --skill peekaboo-buildoak
Automates macOS GUI tasks with an AX-first automation core and vision fallback to handle brittle UIs and complex workflows.
Run a health check, then perform a baseline see/interact/verify sequence to validate end-to-end automation.
High-intent search queries and answers about installing and using this skill.
macOS GUI automation can be stabilized using an AX-first core with vision fallback. This approach discovers accessibility trees for native apps and dialogs, applying a finite-state machine to ensure deterministic, sequential execution and explicit failure recovery.
Yes, you can automate system dialogs and file pickers using AX-tree discovery. This method targets native macOS UI elements directly, enabling programmatic navigation and health checks for cross-app data flows without relying on brittle screen coordinates.
The best way to handle brittle macOS UI is combining an accessibility-tree-first core with vision fallback. A finite-state machine workflow manages explicit recovery paths and bug-specific transitions, ensuring safe sequential execution when UI elements shift.
macOS GUI automation supports complex cross-app data flows by applying a finite-state machine workflow. It uses AX-tree discovery for native apps and vision fallback for tough UIs, delivering safe sequential execution with programmatic navigation.
macOS UI automation often fails on non-standard interfaces lacking accessibility labels. A vision fallback mechanism addresses this by visually analyzing the UI, while a finite-state machine workflow provides explicit recovery paths to resume deterministic execution.
Yes, you need jq installed to process JSON data structures within the macOS GUI automation workflows. It supports the finite-state machine logic and AX-tree discovery outputs required for deterministic, sequential execution and failure recovery.
rnbenRead and send iMessages and SMS from the macOS command line via imsg.
serkan-ozalAudits web accessibility via ARIA snapshots, AX tree analysis, WCAG validation, and keyboard navigation testing using browser-devtools-cli.
zeronx798Automates native desktop GUIs via background cursor and keyboard synthesis across macOS, Windows, Linux.
malue-aiAutomates macOS UI via command-line with targeting, input simulation, and screen management.
