computer-use

Control desktop clicks and typing across macOS, Windows, and Linux.

1|Updated Jun 23, 2026
One-click install
npx skills add https://github.com/whichguy/hermes-skills-marketplace --skill computer-use-whichguy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: computer-use
Source: https://github.com/whichguy/hermes-skills-marketplace/tree/main/computer-use
Command: npx skills add https://github.com/whichguy/hermes-skills-marketplace --skill computer-use-whichguy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires cua-driver, and includes scripts (resource) components.

What problem does it solve?

This Skill allows you to control your desktop background operations, such as clicking, typing, scrolling, and dragging, without disrupting the user's workflow or focus.

Core Features & Use Cases

  • Background Control: Interact with your desktop in the background, including clicking, typing, scrolling, and dragging.
  • Cross-Platform: Supports macOS, Windows, and Linux.
  • Use Case: Automate tasks like navigating a web page or managing multiple windows while you continue working in another application.

Quick Start

Enable the computer-use skill and use the command 'computer_use(action="click", element=7)' to click on the 7th element of the current application.

Frequently Asked Questions about computer-use

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate desktop background operations without disrupting my current workflow?

You can automate desktop background operations using this Skill to control clicking, typing, scrolling, and dragging without disrupting your active workflow. It operates across macOS, Windows, and Linux environments seamlessly.

Does cross-platform desktop automation work on both macOS and Linux?

Cross-platform desktop automation supports macOS, Windows, and Linux. It relies on the cua-driver dependency to execute platform-specific operations, ensuring background interaction commands function consistently across these operating systems.

What is the best way to click a specific UI element in the background?

To click a specific UI element in the background, use the computer_use command. Execute computer_use(action="click", element=7) to target and interact with the 7th element of the current application without bringing it to the foreground.

Do I need cua-driver to perform background typing and scrolling tasks?

Yes, cua-driver is required to perform background typing and scrolling tasks. The Skill depends on cua-driver to manage platform-specific operations and translate automation commands into background desktop interactions across operating systems.

Can I automate window management tasks while continuing to work in another application?

You can automate window management tasks while working in another application. The Skill performs background control for actions like navigating web pages or managing multiple windows without stealing focus or disrupting active work.