skills.rest
igot-ai
igot-aiOFFICIAL
Explore all skills by this author →
WebsiteGitHub

input-capture

Automate macOS mouse and keyboard input through System Events using osascript-based commands.

Updated Aug 27, 2026
Search Tags:#automation#macos#keyboard#system-events#input#mouse
One-click install
npx skills add https://github.com/igot-ai/os-twin --skill input-capture
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: input-capture
Source: https://github.com/igot-ai/os-twin/tree/main/.agents/skills/roles/macos-automation-engineer/input-capture
Command: npx skills add https://github.com/igot-ai/os-twin --skill input-capture

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates macOS user input by simulating mouse actions and keyboard entries through System Events, enabling UI automation without manual clicks or keystrokes.

Core Features & Use Cases

  • Move the cursor, click, and type text using osascript-based System Events.
  • Generate key codes, modifier combinations, and key holds to automate complex input sequences.
  • Useful for UI testing, accessibility macros, and batch data entry on macOS.

Quick Start

Instruct ostwin to move the mouse to coordinates 640 400, click, and type a string using System Events.

Frequently Asked Questions about input-capture

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate macOS input to simulate mouse clicks and keyboard typing?▼

You can automate macOS input by simulating mouse actions and keyboard entries through System Events, enabling UI automation without manual clicks or keystrokes.

What is the best way to generate key codes and modifier combos for automated testing on macOS?▼

Generating key codes, modifier combinations, and key holds through osascript-based System Events dispatches deterministic input sequences for complex automated testing on macOS.

Do I need macOS Accessibility permissions to automate keyboard and mouse input via System Events?▼

Yes, automating keyboard and mouse input via System Events requires and satisfies macOS Accessibility permission requirements to successfully dispatch input events.

Can I use osascript to move the cursor to specific coordinates and type a string?▼

Yes, using osascript-based System Events, you can move the cursor to specific coordinates, click, and type text strings to automate batch data entry.

What are the limitations of using System Events for UI automation on macOS?▼

System Events for UI automation relies on osascript-based patterns to dispatch deterministic input events, which may be limited by macOS Accessibility permissions and system-level UI changes.

When should I use System Events to automate mouse actions instead of other UI automation approaches?▼

Use System Events to automate mouse actions and keyboard entries when you need accessibility macros, UI testing, or batch data entry on macOS without manual interaction.

Related Skills

Explore More Software Engineering Skills→
RockaRhymeLLCRockaRhymeLLC

macos-automation

Automate macOS system tasks using osascript, pbcopy, and open.

Official
Intermediate
Project-N-E-K-OProject-N-E-K-O
2.4k

3d-camera-interaction

Align mouse input with 3D model drag and zoom in Three.js.

Official
Advanced
openakitaopenakita
2.0k

desktop-click

Click desktop UI elements or screen coordinates with configurable mouse buttons.

Community
Basic
rafaelcallejarafaelcalleja
2

gemini-cli

Interact with Gemini AI models through a command-line interface.

Community
Intermediate