llava

Run image-based conversations and visual question answering via CLI.

Updated Apr 9, 2026
One-click install
npx skills add https://github.com/MarbleSodas/Mavis --skill llava-marblesodas
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llava
Source: https://github.com/MarbleSodas/Mavis/tree/main/optional-skills/mlops/llava
Command: npx skills add https://github.com/MarbleSodas/Mavis --skill llava-marblesodas

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires transformers, torch, pillow, and includes references (resource) components.

What problem does it solve?

LLaVA helps turn visual inputs like photos or screenshots into actionable answers, so you can understand what’s in an image without manually inspecting it.

Core Features & Use Cases

  • Image-based conversation: Hold multi-turn dialogue about what appears in images, maintaining context across turns.
  • Visual question answering (VQA): Ask targeted questions like counting objects, describing scenes, or identifying elements.
  • Instruction following with images: Perform visual tasks such as captioning, document understanding with image inputs, and multimodal reasoning prompts.
  • Use cases: Use it for customer-support image triage, assistive image analysis, screenshot Q&A, and vision-language prototyping for apps and workflows.

Quick Start

Run a single-image question-and-answer query against a selected model using the CLI with your image file and prompt text.

Frequently Asked Questions about llava

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I perform visual question answering on an image using PyTorch?

Visual question answering with PyTorch uses a vision-language model to process image inputs and text prompts. You provide an image file and a question, and the model performs multimodal reasoning to return actionable text answers.

Can I hold a multi-turn image chat to ask follow-up questions about a screenshot?

Multi-turn image chat maintains conversational context across follow-up questions about a screenshot. The vision-language model tokenizes multimodal prompts, allowing you to ask targeted questions like counting objects or describing scenes sequentially.

Do I need transformers and Pillow to run image instruction following locally?

Image instruction following requires transformers, PyTorch, and Pillow to run locally. These dependencies handle image preprocessing and transformer-based multimodal prompting to execute visual tasks like captioning and document understanding.

What's the best way to deploy multimodal QA for customer support image triage?

Deploying multimodal QA for image triage utilizes a Gradio interface or interactive CLI for local deployment. This stack processes customer photos to identify elements and generate actionable answers without manual inspection.

Does multimodal reasoning work for both scene-level analysis and document understanding?

Multimodal reasoning supports both scene-level analysis and document understanding with image inputs. By using transformer-based PyTorch inference, the model follows visual instructions to caption scenes or extract text from documents.

Why does my image-to-text conversational model require image preprocessing?

Image-to-text conversational models require image preprocessing to format visual inputs for tokenized multimodal prompting. This aligns the image data with the vision-language model stack, enabling accurate visual question answering.