skills.rest
microsoft
microsoftOFFICIAL
Explore all skills by this author →
Website𝕏@OpenAtMicrosoftGitHub

winapp-ui-automation

Inspect and interact with Windows app UIs via the winapp CLI.

1.2k|68|Updated Jul 30, 2025
Search Tags:#automation#cli#screenshot#windows#ui-automation#ui-tree#UIA
One-click install
npx skills add https://github.com/microsoft/winappCli --skill winapp-ui-automation
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: winapp-ui-automation
Source: https://github.com/microsoft/winappCli/tree/main/.github/plugin/skills/winapp-cli/ui-automation
Command: npx skills add https://github.com/microsoft/winappCli --skill winapp-ui-automation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Inspect and interact with running Windows app UIs from the command line, enabling automation and rapid UI investigation.

Core Features & Use Cases

  • Inspect the UI element tree and retrieve semantic slugs for automation across WinUI 3, WPF, WinForms, Win32, and Electron apps.
  • Interact with UI elements by invoking actions, reading values, taking screenshots, and verifying UI state.
  • Automate UI workflows across multiple windows or dialogs, enabling reliable UI automation in testing and automation pipelines.

Quick Start

Connect to a running Windows app and start inspecting its UI tree using the winapp ui inspect command.

Frequently Asked Questions about winapp-ui-automation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I inspect a Windows UI element tree from the command line?▼

To inspect a Windows UI element tree from the command line, connect to a running app and use the winapp ui inspect command to retrieve semantic slugs for UIA automation. This enables rapid UI investigation across WinUI 3, WPF, WinForms, Win32, and Electron apps.

Can I automate clicks and take screenshots of Windows apps via CLI?▼

Yes, you can automate clicks and take screenshots of Windows apps via CLI by using UIA-based commands like click, invoke, and screenshot within the winapp tool. These commands interact directly with running application windows and dialogs.

Does CLI UI automation support both Win32 and Electron applications?▼

CLI UI automation supports both Win32 and Electron applications, alongside WinUI 3, WPF, and WinForms. It uses UIA-based commands to connect to running apps, allowing you to read or set values and trigger UI actions across these frameworks.

What is the best way to wait for a specific UI state in Windows automation?▼

The best way to wait for a specific UI state in Windows automation is using the wait-for command provided by the winapp CLI. This ensures reliable UI automation by verifying element states before proceeding with further interactions.

How do I target a specific window during UI automation when multiple windows are open?▼

To target a specific window during UI automation when multiple windows are open, you can optionally specify the window by name or HWND. This ensures the UIA commands like get-value and focus act on the correct application window.

Related Skills

Explore More Software Engineering Skills→
glideappsglideapps
10

glide

Automate end-to-end Glide app building with agents, browser automation, and APIs.

Official
Advanced
ThejanaJayalathThejanaJayalath

e2e-testing

Standardizes Playwright end-to-end testing with Page Object Model and CI/CD integration.

Community
Advanced
xianmingyaoxianmingyao
1

cli-anything-windows-control

Automate Windows UI interactions and control applications from the command line.

Community
Intermediate
martinholovskymartinholovsky
45

windows-ui-automation

Automate Windows desktop applications using UIA and Win32 APIs.

Community
Advanced