gemini-vision-analysis

Extract UI state, labels, controls, and layout details from screenshots.

5|Updated Jun 3, 2026
One-click install
npx skills add https://github.com/rafael-fae/agent-ops-worflow --skill gemini-vision-analysis
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gemini-vision-analysis
Source: https://github.com/rafael-fae/agent-ops-worflow/tree/main/archive/skills/operacao/gemini-vision-analysis
Command: npx skills add https://github.com/rafael-fae/agent-ops-worflow --skill gemini-vision-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai.

What problem does it solve?

This Skill helps teams understand screenshots and UI captures quickly when text alone is not enough, reducing manual inspection and re-interpretation of visual evidence.

Core Features & Use Cases

  • Screenshot analysis: Extract interface text, layout, controls, and visible state from system prints.
  • Vision fallback strategy: Prefer auxiliary vision with Kimi K2.5 when available, then fall back to Gemini 2.5 Flash for reliable processing.
  • Batch workflow support: Handle large image sets with parallel and sequential processing patterns, including progress tracking and result consolidation.
  • Operational documentation: Save analysis findings as markdown references for later reuse and auditability.

Quick Start

Ask the skill to analyze the attached screenshot and return the page name, visible controls, and key findings in a structured summary.

Frequently Asked Questions about gemini-vision-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract visible UI state and controls from a screenshot?

Screenshot analysis extracts interface text, layout, controls, and visible state from system prints. It applies vision-capable model routing to process visual evidence and return structured summaries of key findings for web application inspection.

Can I process a large batch of screenshots for visual documentation?

Batch workflow support handles large image sets using parallel and sequential processing patterns. It includes progress tracking and result consolidation to manage large-scale screenshot processing effectively during multi-agent operations.

What happens if the primary vision API is unavailable during image analysis?

Vision fallback strategy handles unavailable APIs by preferring auxiliary vision with Kimi K2.5, then falling back to Gemini 2.5 Flash. This ensures reliable screenshot analysis and continuous image processing when primary endpoints fail.

Does this require google-genai for multi-agent screenshot inspection?

Yes, google-genai is required as a dependency for routing requests to vision-capable models. It enables the fallback handling mechanism that processes system prints and extracts visible UI state during multi-agent operations.

How do I save extracted UI layout details for later reuse and audits?

Operational documentation saves analysis findings as markdown references for later reuse and auditability. This converts extracted interface text, layout details, and visible controls into structured markdown files during batch image review.

What is the best way to analyze web application screenshots for visible labels?

The best way is applying vision-capable model routing to web application inspection, which extracts visible UI state, labels, and controls. It uses fallback handling to ensure reliable processing of visual evidence from system prints.