llava

Run LLaVA vision-language chat and visual question answering on CUDA hardware.

Updated Mar 24, 2026
One-click install
npx skills add https://github.com/1thirteeng3/greenmoire --skill llava-1thirteeng3
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llava
Source: https://github.com/1thirteeng3/greenmoire/tree/main/integrations/hermes-agent/skills/mlops/models/llava
Command: npx skills add https://github.com/1thirteeng3/greenmoire --skill llava-1thirteeng3

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

LLaVA enables seamless vision-language interaction by unifying image understanding with conversational AI, letting users reason about images in natural language.

Core Features & Use Cases

  • Visual question answering and image-based chat
  • Multi-turn conversations with image context
  • Image captioning and document-image understanding

Quick Start

Load a LLaVA model, prepare an image, and start a multi-turn visual conversation.

Frequently Asked Questions about llava

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I perform visual question answering with an image in a chat session?

Visual question answering is achieved by loading a LLaVA model and providing an image to initiate a multi-turn conversation. This enables natural language reasoning about visual content.

What hardware do I need to run multimodal vision-language chat locally?

Multimodal vision-language chat requires CUDA-enabled hardware to run LLaVA model variants ranging from 7B to 34B parameters. You also need transformers, torch, and pillow libraries installed.

Can I use image-informed conversation for document-image understanding?

Image-informed conversation supports document-image understanding by unifying image context with multi-turn chat. This allows you to extract and reason about information contained within document images.

How does multimodal image captioning work with open-source models?

Multimodal image captioning works by loading an open-source vision-language model like LLaVA that processes an input image. The model then generates descriptive natural language text based on the visual content.

What are the limitations of using LLaVA for visual instruction processing?

Visual instruction processing requires CUDA-enabled hardware and specific model variants from 7B to 34B parameters, limiting deployment to capable GPU environments. It relies on transformers and torch dependencies.

Is LLaVA the best way to do multi-turn visual reasoning with open-source models?

LLaVA provides multi-turn visual reasoning by unifying image understanding with conversational AI for open-source workflows. It handles visual question answering and image captioning across multi-turn sessions effectively.