CUA-Gym
Generate verifiable training tasks for computer-use agents
All Skills in This Repository (17)
Pure Emerald Level Indicatorspenpot
Automate Penpot project setup and design state via HTTP APIs.
libreoffice-writer
Create, modify, and verify LibreOffice Writer .docx files with Python.
openshot
Automate OpenShot video project setup and verification with Python.
libreoffice-calc
Create, modify, and verify .xlsx files with Python's openpyxl library.
overleaf_reward
Generate reward.py scripts that verify Overleaf LaTeX project states via HTTP APIs.
Generate, modify, and verify PDF files using Python libraries.
grafana
Automates Grafana dashboard setup, manipulation, alerting via HTTP APIs for CUA-Gym tasks.
excalidraw
Automate Excalidraw scene setup and verification for RLVR environments.
vlc
Automate VLC media player configuration, playback control, and verification via Python.
mock_websites
Set up and manipulate mock web application state via HTTP APIs.
drawio
Manage draw.io diagrams programmatically via Playwright CDP and Python XML.
chrome
Automate Chrome browser state setup and verification with Playwright.
Frequently Asked Questions
FAQPage SchemaHow to install CUA-Gym?โผ
Run `npx skills add xlang-ai/CUA-Gym --all -g -y` in your terminal to install all skills in this suite globally.
What does CUA-Gym do?โผ
It automatically creates verified training tasks for computer-use agents, bundling each task instruction with an executable environment state and a programmatic reward function.
Which applications does CUA-Gym cover?โผ
It covers 110 environments including LibreOffice, Chrome, VS Code, GIMP, Blender, VLC, Grafana, Penpot, and 94 mock web apps like Gmail, Slack, and Notion.
How are the generated tasks verified?โผ
A discriminator agent writes reward scripts without seeing the generator's code, and an orchestrator iterates until the reward scores 1.0 on the golden state and 0.0 on the initial state, followed by a majority-vote filter.
Can I download the pre-built CUA-Gym dataset?โผ
Yes. The full dataset of 32,112 verified task bundles is available on Hugging Face at xlangai/CUA-Gym and can be loaded with the standard datasets library.
Related Repositories in Education & Research
View All in Education & Researchโlearn-claude-code
Learn to build AI agent harnesses from scratch
ai-agents-for-beginners
Learn to build, deploy, and secure AI agents step by step
33-js-concepts
Master 33 essential JavaScript concepts with tested, verified guides