What problem does it solve?
It lets the agent operate Agent Zero's built-in Docker/Xpra Linux desktop—launching XFCE apps, driving LibreOffice GUI windows, managing files in Thunar, and running terminal commands—without touching the user's real host machine.
Core Features & Use Cases
- Structured Desktop Control: Query window state, focus apps, send keystrokes, paste text, and batch multi-step GUI actions through the
desktopctl.sh helper script.
- Live LibreOffice Coworking: Edit Calc spreadsheet cells through the visible LibreOffice session via UNO, with on-disk verification, so users see updates in real time.
- Screenshot-Based Verification: Capture fresh screenshots for visual confirmation, OCR, and coordinate-based actions as a last resort.
- Use Case: Ask the agent to open a workbook in the Desktop's Calc app, set cell B2 on Sheet1 to a new value, save the file, and verify the change on disk.
Quick Start
Ask the agent to open LibreOffice Calc in the built-in Desktop and update a specific cell in your spreadsheet file.