clip

Classify images and match them with text using CLIP vision-language similarities.

Updated Apr 2, 2026
One-click install
npx skills add https://github.com/JKhyro/HERMES-AGENT --skill clip-jkhyro
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: clip
Source: https://github.com/JKhyro/HERMES-AGENT/tree/main/skills/mlops/models/clip
Command: npx skills add https://github.com/JKhyro/HERMES-AGENT --skill clip-jkhyro

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps you connect images and text so you can classify visual content, search by meaning, and compare captions without building a labeled dataset.

Core Features & Use Cases

  • Zero-shot classification: Assign the best label to an image using natural-language prompts.
  • Semantic retrieval: Find matching images from a text query or matching text from an image.
  • Moderation and similarity checks: Rank content for safety review, deduplication, and cross-modal matching.
  • Use case: A product team can quickly organize a photo library by concepts like sunset, product shot, or indoor scene without training a custom model.

Quick Start

Use the clip skill to classify the attached image against a short list of labels and return the most likely match with confidence.

Frequently Asked Questions about clip

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I perform zero-shot image classification without training a custom model?

Zero-shot image classification matches images to natural-language prompts by computing CLIP vision-language similarities. You provide an image and a list of text labels, and it ranks the best match using normalized embeddings and cosine-similarity scoring.

Can I do semantic image search using text queries across a batch of images?

Semantic image search matches text queries to images using cross-modal retrieval. It processes batches by loading a transformer-based CLIP model, preprocessing images, generating normalized embeddings, and ranking cosine-similarity scores.

What is cross-modal retrieval and how does it connect images and text?

Cross-modal retrieval connects images and text by computing CLIP vision-language similarities. It generates normalized embeddings for both formats and ranks their cosine-similarity scores to find matching content across modalities without labeled datasets.

Do I need a labeled dataset to use CLIP for content moderation and similarity checks?

You do not need a labeled dataset for content moderation or similarity checks using CLIP. It performs zero-shot inference by comparing normalized embeddings and ranking cosine-similarity scores across single images or batches.

What's the best way to deduplicate a photo library by visual meaning?

Deduplicating a photo library by visual meaning uses CLIP to compute vision-language similarities. It preprocesses batch images into normalized embeddings and ranks cosine-similarity scores to identify matching content without training a custom model.