skills.rest
autonomous-ai
autonomous-aiOFFICIAL
Explore all skills by this author →
Website𝕏@autonomous_labsGitHub

computer-use

Controls a paired Mac via Lamp Buddy to open apps, navigate URLs, and type text.

10|2|Updated Mar 24, 2026
Search Tags:#automation#accessibility#macos#keyboard-shortcuts#open_url#lamp-buddy#type_text
One-click install
npx skills add https://github.com/autonomous-ai/autonomous-lamp --skill computer-use-autonomous-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: computer-use
Source: https://github.com/autonomous-ai/autonomous-lamp/tree/main/lamp/resources/openclaw-skills/computer-use
Command: npx skills add https://github.com/autonomous-ai/autonomous-lamp --skill computer-use-autonomous-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Control the user's Mac via the paired Lamp Buddy companion app — open/close apps, navigate URLs in Chrome, type text into focused fields, fire keyboard shortcuts, show desktop notifications, write to clipboard, click named UI buttons via macOS Accessibility. Also covers vision-driven tasks (screenshot, find/click unlabelled UI, read text off the screen, drag) — those load reference/vision.md for the synchronous see-think-act loop. Use when the user explicitly asks Lamp to do something on their COMPUTER (e.g. "open Chrome", "go to Gmail", "join Meet", "close Slack", "type … into my Mac", "copy … to clipboard", "click the blue button on my screen", "what's on my Mac right now?"). Do NOT use for hardware control of the lamp itself (LED, scene, emotion, music, servo) — those are separate skills. Do NOT use if no Mac is paired (the lamp web UI shows pairing status under the Buddy card).

Core Features & Use Cases

  • Launch macOS apps, open URLs, type text, fire keyboard shortcuts, and click named UI elements on the Mac via Lamp Buddy.
  • Vision-driven tasks (screenshot, read text on screen) supported via reference/vision.md when needed.
  • Do not use for lamp hardware; must have a paired Mac.

Quick Start

Pair Lamp Buddy with your Mac and start giving commands like "Open Chrome on my Mac" to perform actions.

Frequently Asked Questions about computer-use

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I control my Mac and open apps using a voice assistant?▼

You can control your Mac by pairing the Lamp Buddy companion app, which lets you launch macOS apps, open URLs in Chrome, type text, and fire keyboard shortcuts through voice commands.

Can I click UI elements on macOS without using the mouse?▼

Yes, you can click named UI buttons on macOS via Lamp Buddy using the Accessibility framework, and for unlabeled UI elements, vision-driven screenshot tasks can locate and interact with them.

How do I automate typing text and firing keyboard shortcuts on a Mac?▼

Automate typing text and firing keyboard shortcuts by pairing a Mac with the Lamp Buddy app, then issuing commands that inject text input and keystrokes into your currently focused fields.

Do I need to install a companion app to automate macOS tasks?▼

Yes, you must pair the Lamp Buddy companion app with your Mac; without a paired Mac, the lamp web UI will show no active pairing status and computer use commands will fail.

Can I use this to control the lamp's LED, music, or servo hardware?▼

No, do not use this for hardware control of the lamp itself such as LED, scene, emotion, music, or servo adjustments; those functions require separate dedicated skills.

How do I read text from a screenshot on my Mac screen?▼

You can read text from a Mac screen by triggering vision-driven screenshot tasks that load a see-think-act loop to capture, analyze, and extract text or interact with on-screen UI elements.

Related Skills

Explore More Software Engineering Skills→
autonomous-aiautonomous-ai
10

claude-desktop-buddy

Manage approval prompts and sync desktop state with Lamp via REST endpoints.

Official
Intermediate
Kira-PgrKira-Pgr
8

axiclick

Verify macOS UI focus and confirm actions with screenshots.

Community
Intermediate
autonomous-aiautonomous-ai
10

emotion

Coordinate servo, LED, and display eyes to express predefined emotions in chat responses.

Official
Advanced
Prathmesh234Prathmesh234

microsoft-teams

Navigate Microsoft Teams on macOS using keyboard shortcuts.

Community
Basic