text-to-image-search

Searches image collections using natural language via CLIP or VLM on Milvus.

3|2|Updated Jan 29, 2026
One-click install
npx skills add https://github.com/zilliztech/milvus-marketplace --skill text-to-image-search
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: text-to-image-search
Source: https://github.com/zilliztech/milvus-marketplace/tree/main/plugins/multimodal-retrieval/skills/text-to-image-search
Command: npx skills add https://github.com/zilliztech/milvus-marketplace --skill text-to-image-search

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill enables users to search image collections by describing the visuals they want, turning natural language queries into relevant visual results.

Core Features & Use Cases

  • Natural language image search: Describe images in plain language and retrieve matching visuals.
  • Dual-mode indexing: CLIP Direct for fast queries and VLM Captions for complex, domain-specific queries.
  • Milvus-backed retrieval: Semantic search over a vector store with scalable indexing.
  • Use Case: A marketing team wants to find product images matching a description like 'red sports car in motion at dusk' to assemble a campaign.

Quick Start

Invoke the skill with a natural language request such as: Find images of a red car turning right at night.

Frequently Asked Questions about text-to-image-search

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search for images using natural language descriptions?

Natural language image search lets you find images by describing what you want in plain text. This skill converts your description into semantic vectors and matches them against indexed images using CLIP or VLM Captions, returning visually relevant results without manual tagging.

What's the difference between CLIP Direct and VLM Captions for image queries?

CLIP Direct provides fast semantic matching for straightforward visual descriptions. VLM Captions handles complex, domain-specific queries by generating detailed image captions first, then matching against your request for higher accuracy on nuanced searches.

Can I use this skill to index and search large image collections?

Yes. This skill uses Milvus as a scalable vector database to index images and perform semantic search across large collections. Milvus handles the indexing and retrieval infrastructure, enabling efficient search even as your image library grows.

What do I need to set up before using text-to-image search?

You need an image collection to index, access to OpenAI GPT-4o for caption generation, a Milvus instance for vector storage, and Python libraries for embeddings and semantic matching. The skill handles the indexing and search once these dependencies are configured.

Does this approach work for domain-specific image searches?

Yes. The dual-mode design supports both fast general searches via CLIP and complex domain-specific queries via VLM Captions, which generates contextual descriptions tailored to specialized vocabularies like medical imaging or product photography.