skills.rest
kortix-ai
kortix-aiOFFICIAL
Explore all skills by this author →
Website𝕏@kortixGitHub

computer-use

Automate macOS desktop tasks by controlling apps and UI elements via agent-click.

20.1k|3.4k|Updated Oct 5, 2024
Search Tags:#macos#scripting#tunnel#desktop-automation#ui-automation#agent-click
One-click install
npx skills add https://github.com/kortix-ai/suna --skill computer-use-kortix-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: computer-use
Source: https://github.com/kortix-ai/suna/tree/main/packages/kortix-opencode/skills/KORTIX-system/computer-use
Command: npx skills add https://github.com/kortix-ai/suna --skill computer-use-kortix-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates macOS desktop tasks by controlling apps and UI elements through agent-click. It provides a programmable approach to automate repetitive UI interactions on macOS, reducing manual effort and increasing reliability.

Core Features & Use Cases

  • Open apps, interact with UI, and perform scripted desktop workflows on macOS.
  • Take snapshots, click, type, scroll, and manage windows to automate common tasks like app onboarding and data entry.
  • Use with the Agent Tunnel to run automation remotely or across machines in a controlled environment.

Quick Start

Install agent-click on the target macOS machine and run it through the tunnel to start desktop automation.

Frequently Asked Questions about computer-use

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS desktop tasks like opening apps and typing?▼

You can automate macOS desktop tasks by using agent-click to control apps and UI elements, enabling you to open apps, click, type, scroll, and manage windows programmatically. This approach reduces manual effort and increases reliability for repetitive UI interactions.

Can I run macOS UI automation remotely across different machines?▼

Yes, you can run macOS UI automation remotely by integrating agent-click with the Agent Tunnel. This setup allows you to execute scripted desktop workflows and automations across machines in a controlled environment.

What's the best way to script repetitive UI interactions on macOS?▼

The best way to script repetitive UI interactions on macOS is using agent-click, which provides a programmable approach to take snapshots, click, type, and manage windows for real-world use cases like app onboarding and data entry.

Do I need to install anything specific to start automating macOS desktop workflows?▼

Yes, to start automating macOS desktop workflows, you need to install agent-click on the target macOS machine. Once installed, you can run it through the Agent Tunnel to execute desktop automations.

Does agent-click support taking UI snapshots for desktop automation?▼

Yes, agent-click supports taking UI snapshots as part of its macOS desktop automation capabilities. It covers opening apps, taking snapshots, clicking, typing, scrolling, and window management for scripted desktop workflows.

Related Skills

Explore More Software Engineering Skills→
yethikrishnayethikrishna

agent-tunnel

Expose local machine automation commands via a self-contained CLI tunnel.

Community
Advanced
phodalphodal
1.8k

electron

Automate Electron desktop apps via Chrome DevTools Protocol connections.

Community
Intermediate
rdimasciordimascio

manage-transactions

Implement atomic Supabase transactions with PL/pgSQL functions and RPC calls.

Community
Advanced
NJX-njxNJX-njx
55

peekaboo

Capture screenshots, identify UI elements, and drive input events on macOS.

Community
Intermediate