vision

Analyze screen content to describe UI, detect elements, and extract text.

1|Updated Dec 7, 2025
One-click install
npx skills add https://github.com/CoachSteff/superskills --skill vision-coachsteff
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vision
Source: https://github.com/CoachSteff/superskills/tree/main/superskills/vision
Command: npx skills add https://github.com/CoachSteff/superskills --skill vision-coachsteff

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Analyzing and interpreting screen content manually is time-consuming and error-prone; this skill automates the process by describing UI, detecting elements, and extracting text.

Core Features & Use Cases

  • Describe current screen content to generate a clear, human-readable summary.
  • Detect UI elements and their approximate positions for automation and testing.
  • Extract visible text (OCR) for indexing, accessibility, and documentation.
  • Identify UI issues and accessibility problems to drive fixes and improvements.
  • Monitor changes over time and generate structured testing insights.
  • Produce actionable QA notes and documentation from visual analysis.

Quick Start

Describe your current screen by asking the Vision Skill to analyze it using the describe mode.

Frequently Asked Questions about vision

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract text from a screen capture for accessibility audits?

To extract text from a screen capture for accessibility audits, you can use a vision skill to perform OCR on full-screen, region, or window captures. This automatically extracts visible text from the UI to generate actionable documentation and structured testing insights.

Can I automatically detect UI elements and their positions for test generation?

Yes, you can automatically detect UI elements and their approximate positions for test generation. By analyzing the main screen content, the tool identifies interface components and generates structured testing insights to drive QA automation.

Do I need a GEMINI_API_KEY to analyze screens and describe UI?

Yes, you need a GEMINI_API_KEY and standard dependencies to analyze screens and describe UI. The tool uses Gemini Vision to process full-screen or region captures, requiring this key to automatically generate human-readable summaries of the content.

What is the best way to monitor screen changes over time for UI monitoring?

The best way to monitor screen changes over time for UI monitoring is by applying a continuous visual analysis mode. This identifies UI issues, tracks accessibility problems, and produces actionable QA notes from full-screen or window captures.

How do I analyze a specific application window instead of the full screen?

To analyze a specific application window instead of the full screen, you can provide optional window_id, app_name, or region inputs. This targets the screen analysis to a specific area, extracting text and detecting UI elements accurately.