computer-use-bridge

You can automate macOS GUI applications from the command line by using this Skill to simulate inputs, launch apps, and execute cross-app workflows programmatically without manual clicking. It eliminates repetitive desktop interactions by supporting both vision-based and accessibility-tree automation.

Yes, you can control Mac desktop apps in the background without moving your cursor by using the cua-driver backend. This approach uses accessibility-tree automation to execute tasks without interrupting your current foreground work or taking over your screen.

The best way to automate native Mac app workflows like organizing Finder files is to use this Skill's utility commands to programmatically open directories, create folders, and move files based on specific criteria. It provides machine-readable JSON output to integrate these actions into larger agent workflows.

Yes, GUI automation on macOS requires valid TCC permissions for both screen recording and accessibility access. You can run a built-in health check command to verify that your system has the correct permissions and backend setups configured properly.

Vision-based foreground automation uses OpenAI Codex Computer Use to interact with the screen visually, even supporting locked screens. Accessibility-tree automation uses cua-driver to interact with application elements in the background without requiring visual focus or cursor movement.