compose-ui-control

Control running Compose Desktop applications via HTTP REST API.

6|Updated Jan 23, 2026
One-click install
npx skills add https://github.com/forketyfork/compose-ui-test-server --skill compose-ui-control
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: compose-ui-control
Source: https://github.com/forketyfork/compose-ui-test-server/tree/main
Command: npx skills add https://github.com/forketyfork/compose-ui-test-server --skill compose-ui-control

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables AI coding agents and automation tools to programmatically control running Compose Desktop applications via HTTP, eliminating the need for manual UI interaction during testing, automation, or AI-driven workflows.

Core Features & Use Cases

  • HTTP-based UI Control: Perform actions like clicking buttons, entering text, and waiting for specific UI elements to appear.
  • Screenshot Capture: Verify the application's visual state at any point for robust testing and debugging.
  • Zero-Configuration Launcher: Easily integrate agent control into new or existing Compose Desktop projects with minimal setup.
  • Use Case: An AI agent can use this skill to automate end-to-end tests for a desktop application, simulating user interactions to navigate through complex workflows, fill forms, and validate outcomes by capturing screenshots.

Quick Start

Instruct the application to click the 'login_button' using its test tag.

Frequently Asked Questions about compose-ui-control

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Compose Desktop UI testing without manual interaction?

You can automate Compose Desktop UI testing by sending HTTP commands to control the running application. This approach enables programmatic clicking, text entry, and element waiting, eliminating manual UI interaction during automated workflows.

Can I capture screenshots of a Compose Desktop application via HTTP for debugging?

Yes, you can capture screenshots of a Compose Desktop application via HTTP to verify its visual state. This feature allows you to retrieve the current UI appearance at any point for robust automated testing and interactive debugging.

What is the best way to let an AI agent control a Kotlin Compose Desktop application?

The best way to let an AI agent control a Kotlin Compose Desktop application is through a REST API. This skill provides HTTP-based UI control, allowing agents to perform actions like clicking buttons using test tags and simulating user interactions.

Do I need complex configuration to integrate HTTP agent control into an existing Compose Desktop project?

No, you do not need complex configuration to integrate HTTP agent control. This skill offers a zero-configuration launcher, allowing you to easily add agent control capabilities to new or existing Compose Desktop projects with minimal setup.

How does HTTP-based UI control work for simulating user interactions in Kotlin desktop apps?

HTTP-based UI control works by sending REST API commands to interact with elements using test tags. It programmatically applies actions like clicking buttons, entering text, and waiting for specific UI elements to appear in the Kotlin desktop app.

When should I use HTTP commands for Compose Desktop automation instead of other testing methods?

You should use HTTP commands for Compose Desktop automation when you need remote UI interaction, agent-driven task execution, or visual state verification. It is ideal for AI coding agents and automation tools that must programmatically control running desktop applications.