llava

Enable conversational image understanding and visual question answering for multimodal inputs.

Updated Apr 12, 2026
One-click install
npx skills add https://github.com/thisismynewfmail-ui/Monika-agent --skill llava-thisismynewfmail-ui
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llava
Source: https://github.com/thisismynewfmail-ui/Monika-agent/tree/main/optional-skills/mlops/llava
Command: npx skills add https://github.com/thisismynewfmail-ui/Monika-agent --skill llava-thisismynewfmail-ui

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

LLaVA provides conversational visual understanding so users can ask natural-language questions about images and receive coherent, multi-turn answers instead of piecing together separate vision and language tools.

Core Features & Use Cases

  • Multi-turn Image Chat: Maintain context across questions about the same image for follow-up queries and clarifications.
  • Visual Question Answering (VQA): Answer direct questions about image content such as object counts, actions, and scene descriptions.
  • Instruction Following & Captioning: Produce detailed captions, scene summaries, and document-image understanding for downstream tasks.
  • Deployment Options: Run on GPU with FP16 or quantized 4-bit modes, serve interactively with Gradio, or integrate as an LLM backend (Vicuna/LLaMA) with a CLIP vision encoder.

Quick Start

Provide an image and ask the model "What is in this image?" to receive a detailed conversational description and follow-up Q&A.

Frequently Asked Questions about llava

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enable visual question answering for multi-turn image conversations?

Visual question answering for multi-turn image conversations is enabled by combining a CLIP vision encoder with a Vicuna or LLaMA language backbone, allowing users to ask natural-language questions and receive coherent, context-aware answers about image content.

Can I run vision-language chat inference on GPU with 4-bit quantization?

Yes, vision-language chat inference supports GPU execution with FP16 or 4-bit quantization modes to reduce memory requirements, alongside optional Gradio serving for interactive deployment and multi-turn context handling.

What is the best way to generate detailed image captions from document images?

Generating detailed image captions from document images is best handled through instruction following capabilities that produce scene summaries and document-image understanding, maintaining context across multi-turn conversations for follow-up queries.

Does multi-turn image chat maintain context for follow-up visual queries and clarifications?

Multi-turn image chat maintains context across questions about the same image, enabling follow-up queries and clarifications without piecing together separate vision and language tools for each interaction.

How do I serve an interactive vision-language chatbot using Gradio?

Serving an interactive vision-language chatbot with Gradio provides a web interface for conversational image understanding, supporting real-time visual question answering and multi-turn image conversations using the CLIP vision encoder and LLM backend.