llava

Enable conversational image understanding and visual question answering for multimodal inputs.

Updated Apr 12, 2026
One-click install
npx skills add https://github.com/thisismynewfmail-ui/Monika-agent --skill llava-thisismynewfmail-ui
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: llava
Source: https://github.com/thisismynewfmail-ui/Monika-agent/tree/main/optional-skills/mlops/llava
Command: npx skills add https://github.com/thisismynewfmail-ui/Monika-agent --skill llava-thisismynewfmail-ui

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

LLaVA provides conversational visual understanding so users can ask natural-language questions about images and receive coherent, multi-turn answers instead of piecing together separate vision and language tools.

Core Features & Use Cases

  • Multi-turn Image Chat: Maintain context across questions about the same image for follow-up queries and clarifications.
  • Visual Question Answering (VQA): Answer direct questions about image content such as object counts, actions, and scene descriptions.
  • Instruction Following & Captioning: Produce detailed captions, scene summaries, and document-image understanding for downstream tasks.
  • Deployment Options: Run on GPU with FP16 or quantized 4-bit modes, serve interactively with Gradio, or integrate as an LLM backend (Vicuna/LLaMA) with a CLIP vision encoder.

Quick Start

Provide an image and ask the model "What is in this image?" to receive a detailed conversational description and follow-up Q&A.

Frequently Asked Questions about llava

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enable visual question answering for multi-turn image conversations?▼

Visual question answering for multi-turn image conversations is enabled by combining a CLIP vision encoder with a Vicuna or LLaMA language backbone, allowing users to ask natural-language questions and receive coherent, context-aware answers about image content.

Can I run vision-language chat inference on GPU with 4-bit quantization?▼

Yes, vision-language chat inference supports GPU execution with FP16 or 4-bit quantization modes to reduce memory requirements, alongside optional Gradio serving for interactive deployment and multi-turn context handling.

What is the best way to generate detailed image captions from document images?▼

Generating detailed image captions from document images is best handled through instruction following capabilities that produce scene summaries and document-image understanding, maintaining context across multi-turn conversations for follow-up queries.

Does multi-turn image chat maintain context for follow-up visual queries and clarifications?▼

Multi-turn image chat maintains context across questions about the same image, enabling follow-up queries and clarifications without piecing together separate vision and language tools for each interaction.

How do I serve an interactive vision-language chatbot using Gradio?▼

Serving an interactive vision-language chatbot with Gradio provides a web interface for conversational image understanding, supporting real-time visual question answering and multi-turn image conversations using the CLIP vision encoder and LLM backend.