desktop-vision
CommunitySee and act on your macOS desktop with vision.
Authormlamla123
Version1.0.0
Installs0
System Documentation
What problem does it solve?
See and interact with the macOS desktop using a vision-enabled workflow to observe content, detect UI elements, and perform scripted actions without relying on browser automation.
Core Features & Use Cases
- Screen capture and analysis using native macOS tools + vision models to understand on-screen state.
- Native interactions: clicking, typing, and window management via CLI utilities and AppleScript.
- Use Case: automate routine UI checks, dismiss dialogs, and perform long-running monitoring of apps.
Quick Start
Open your OpenClaw workspace and start a desktop-vision session to watch and interact with your macOS desktop.
Dependency Matrix
Required Modules
opencv-pythonPillownumpyrequestswebsocket-client
Components
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: desktop-vision Download link: https://github.com/mlamla123/openclaw-starter-kit/archive/main.zip#desktop-vision Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.