Skills
.Work. You
Rest

detect-ui

Official

Extract structured UI detections from screenshots

Software Engineering#automation#unity#ui-detection#screen-analysis#detection-json#canvas-units
Authorigot-ai
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Automates the extraction of structured UI data from screenshots, returning a machine-readable JSON that feeds Unity UI builders and animation analyzers. This reduces manual UI breakdown work and improves consistency across teams.

Core Features & Use Cases

  • Background classification: detects dim overlays, fullscreen backdrops, and gameplay-only backgrounds.
  • Hierarchy and components: infers parent-child relationships and identifies common UI components (Image, Button, ScrollRect, Toggle, Slider, InputField, Mask, LayoutGroups, etc.).
  • Output format: emits a schema 5.0.0 JSON containing meta, canvas mapping, and a flat objects[] array suitable for downstream tooling.
  • Use cases: QA/UI review, asset planning, UI prototyping, and automated UI documentation.

Quick Start

Analyse a provided UI screenshot to generate a schema 5.0.0 detection JSON.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: detect-ui
Download link: https://github.com/igot-ai/os-twin/archive/main.zip#detect-ui

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.