skills.rest
AllBeingsFuture
AllBeingsFutureCOMMUNITY
Explore all skills by this author →
GitHub

desktop-click

Click desktop UI elements or screen coordinates with configurable mouse options.

9|2|Updated Mar 18, 2026
Search Tags:#automation#ui-testing#coordinates#gui-automation#desktop-click#mouse-click#element-description
One-click install
npx skills add https://github.com/AllBeingsFuture/AllBeingsFuture --skill desktop-click-allbeingsfuture
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: desktop-click
Source: https://github.com/AllBeingsFuture/AllBeingsFuture/tree/main/electron/embedded-assets/skills/system/desktop-click
Command: npx skills add https://github.com/AllBeingsFuture/AllBeingsFuture --skill desktop-click-allbeingsfuture

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates clicking desktop UI elements or exact screen coordinates to streamline repetitive GUI tasks across applications.

Core Features & Use Cases

  • Click by element description or coordinates on the desktop
  • Supports mouse button options (left, right, middle) and double-click
  • Flexible find methods: auto, uia, or vision for robust interactions

Quick Start

Click the desktop element described as '确定按钮' or at coordinates 100,200 to perform a click.

Frequently Asked Questions about desktop-click

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate desktop GUI interactions by clicking UI elements?▼

Automate desktop GUI interactions by targeting UI elements through element descriptions or exact screen coordinates to click across applications. You can specify mouse button options and double-click settings to streamline repetitive tasks.

How do I click specific screen coordinates to automate a desktop application?▼

Click specific screen coordinates to automate a desktop application by providing target coordinates as input. You can optionally configure the mouse button, enable double-click, and select a find method to ensure reliable GUI automation.

Can I use different mouse buttons for desktop UI automation?▼

Yes, desktop UI automation supports left, right, and middle mouse button options for clicking elements or coordinates. It defaults to the left button but allows configuration to perform right-clicks or middle-clicks as needed.

What find methods work best for clicking desktop UI elements?▼

Available find methods for clicking desktop UI elements include auto, uia, and vision. The default auto method handles robust interactions, while uia and vision offer flexible targeting approaches for reliable GUI automation across different environments.

Does desktop click automation support double-clicking elements or coordinates?▼

Yes, desktop click automation supports double-clicking elements or coordinates by enabling the double-click option. It defaults to false for single clicks but can be toggled to perform double-click actions on targeted desktop UI elements.

Why does my desktop click automation fail to find the correct UI element?▼

Desktop click automation may fail if the find method does not match the application's UI structure. Switching from the default auto method to uia for native elements or vision for graphical interfaces can improve targeting reliability.

Related Skills

Explore More Software Engineering Skills→
Smyan1909Smyan1909
18

somatic

Automate desktop UI clicks and keyboard input using YOLO-detected element IDs.

Community
Advanced
viralcodeviralcode
61

computer-use

Control headless Linux desktop GUIs via Xvfb, XFCE, and VNC.

Community
Advanced
kcns008kcns008
5

peekaboo

Automate macOS UI inspection and interaction via the Peekaboo CLI.

Community
Advanced
thilak0105thilak0105

google-sheets

Automate Google Sheets interactions via browser automation for data entry and formatting.

Community
Intermediate