What problem does it solve?
Many agents and automation scripts cannot directly interact with a Windows desktop; this Skill exposes a simple REST interface so tools can capture screens, send mouse and keyboard input, and manage windows without complex UI automation stacks.
Core Features & Use Cases
- Screenshots: full-desktop and per-window captures served as files for vision models or verification.
- Mouse control: absolute moves and single/double/right clicks for GUI interactions.
- Keyboard input: clipboard-first paste, typed input, and press/key-combination endpoints for hotkeys.
- Window management: enumerate windows, focus, minimize, maximize, and restore by HWND.
- Use Case: run on a LAN Windows machine to let an agent open Notepad, paste text, click buttons, and confirm results via screenshots.
Quick Start
Point the agent at the WinUse server URL, take a screenshot, analyze it, and then send mouse or keyboard commands to act on the UI.