What problem does it solve? Automating or reading desktop applications normally requires brittle screen scraping or manual clicking. This Skill lets an agent inspect any local desktop app window through its accessibility tree, take screenshots, and perform safe UI actions like clicking, typing, scrolling, and dragging through Orca's computer-use CLI. ## Core Features & Use Cases - Window and app inspection: List running apps and windows, get app state, and read visible UI elements via accessibility trees. - Safe UI automation: Click controls, type text, press keys, scroll, drag, and set values in desktop apps, browser windows, webviews, and Orca's own UI. - Version-matched guidance: Loads the full command reference from the installed Orca binary via ORCA skills get computer-use, so instructions never drift from the binary actually executing commands. - Use Case: Ask the agent to read your unread Slack messages or check what is currently playing in Spotify, and it resolves the correct Orca executable, confirms the app is running, and reads the window state with JSON output. ## Quick Start Ask the agent to read the current state of a desktop app such as Slack or Spotify using Orca computer use.
