vision

Query local images with a Gemma 4 vision model via Ollama.

2.6k|145|Updated Feb 13, 2021
One-click install
npx skills add https://github.com/gridaco/grida --skill vision-gridaco
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vision
Source: https://github.com/gridaco/grida/tree/main/.agents/skills/vision
Command: npx skills add https://github.com/gridaco/grida --skill vision-gridaco

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ollama, and includes scripts (resource) components.

What problem does it solve?

Query images with a local Ollama vision model without loading the image into the main agent context. Use when you need to describe a screenshot, check whether rendered content is present, detect overlapping elements, or ask any visual question about a PNG/JPEG/WebP file.

Core Features & Use Cases

  • Local image analysis via Gemma 4 through Ollama, enabling on-device descriptions without exposing data.
  • Supports concise scene description, layout awareness, color and text detection, and checks for overlapping UI elements.
  • Use cases include PR description generation, asset validation, and visual QA for rendered canvases.

Quick Start

Describe a target image by running the local vision script against a file to obtain a concise summary of its content.

Frequently Asked Questions about vision

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze a screenshot locally without sending image data to the cloud?

Local image analysis via Gemma 4 through Ollama processes PNG, JPEG, and WebP files directly on your machine. This on-device approach describes screenshots and detects UI overlaps without exposing data to external servers.

How do I detect overlapping UI elements in a PNG screenshot?

Detecting overlapping UI elements in a PNG screenshot involves running a local vision script against the file. The Gemma 4 model evaluates the rendered canvas and produces textual results identifying layout and overlap issues.

Do I need Ollama to run local image description workflows?

Yes, Ollama is a required dependency to run local image description workflows. The process relies on a local Ollama server and the Gemma 4 vision model to process PNG, JPEG, and WebP assets and generate textual summaries.

Can I check if rendered content is present in a JPEG file using a local model?

Yes, you can verify if rendered content is present in a JPEG file by querying it with a local vision model. The Gemma 4 model via Ollama supports visual question answering and concise scene description for assets.

What are the limitations of using Gemma 4 for visual QA on screenshots?

The primary limitation of using Gemma 4 for visual QA is that it requires a local Ollama server to be running. Additionally, it generates concise textual descriptions rather than modifying the underlying PNG, JPEG, or WebP files.