skills.rest
Aradotso
AradotsoOFFICIAL
Explore all skills by this author →
Website𝕏@aradotsoGitHub

native-devtools-mcp-automation

Automate desktop apps, Chrome/Electron browsers, and Android devices via MCP server.

4|Updated May 16, 2026
Search Tags:#ocr#browser automation#mcp#adb#desktop automation#chrome devtools protocol#accessibility tree
One-click install
npx skills add https://github.com/Aradotso/devtools-skills --skill native-devtools-mcp-automation
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: native-devtools-mcp-automation
Source: https://github.com/Aradotso/devtools-skills/tree/main/skills/native-devtools-mcp-automation
Command: npx skills add https://github.com/Aradotso/devtools-skills --skill native-devtools-mcp-automation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the gap between “AI understanding” and “real UI execution” by letting agents directly operate native desktop apps, Chrome/Electron, and Android devices through a local MCP server.

Core Features & Use Cases

  • Multi-modal UI control: Screenshots + OCR/text search and click/type/drag/scroll actions to automate apps even without accessibility hooks.
  • Accessibility-first native automation (macOS): AX dispatch to click and set values using an accessibility tree for precise, cursor-free control.
  • Web automation for Chrome/Electron (CDP): DOM-level control for finding elements, filling forms, waiting on conditions, and inspecting UI.
  • Android automation (ADB): Screenshot, text lookup, tapping, typing, and app launch/stop via connected devices.
  • Use Case: Automate a macOS settings flow by taking an AX snapshot, clicking the right controls, and verifying the resulting state via a new snapshot or screenshot.

Quick Start

Run the MCP server, then connect your MCP-compatible client and ask it to automate your target desktop app, browser, or Android workflow.

Frequently Asked Questions about native-devtools-mcp-automation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate native desktop applications with an MCP server?▼

You can automate native desktop applications with an MCP server by using screenshot capture, OCR-based text finding, and click/type/window management actions, allowing AI agents to navigate UIs even without native accessibility hooks.

Can I use Chrome DevTools Protocol to automate web browsers through MCP?▼

Yes, Chrome DevTools Protocol enables MCP-driven web automation for Chrome and Electron browsers, providing DOM-level control to find elements, fill forms, wait on conditions, and inspect UI.

Does MCP browser automation support Android devices via ADB?▼

Yes, MCP browser automation supports Android devices via ADB, enabling screenshot capture, text lookup, tapping, typing, and app launch or stop actions on connected mobile devices.

What is macOS accessibility tree automation for AI agents?▼

macOS accessibility tree automation for AI agents uses AX dispatch to click and set values directly, providing precise, cursor-free control over native desktop applications without relying on visual screenshots.

How do I automate a macOS settings flow using screenshots and OCR?▼

You can automate a macOS settings flow by taking an accessibility tree snapshot, clicking the targeted controls, and verifying the resulting state via a new snapshot or screenshot using OCR-based visual navigation.

Do I need accessibility hooks to perform desktop automation with MCP?▼

No, you do not need accessibility hooks to perform desktop automation with MCP, because the server supports multi-modal UI control using screenshots and OCR text search to locate and interact with elements visually.

Related Skills

Explore More Software Engineering Skills→
xztxyxztxy

mcp

Expose an MCP server and UI bundle to render json-render UIs in MCP clients.

Community
Advanced
tyronerosstyroneross
1

validate

Audit UI components and interactions against accessibility standards via CDP.

Community
Advanced
autonomy-cloudautonomy-cloud
2

computer-use

Automate macOS desktop workflows by controlling GUI elements via accessibility-tree targeting.

Official
Advanced
liauw-medialiauw-media
3

dispatching-parallel-agents

Dispatch parallel agents to execute independent tasks concurrently.

Community
Advanced