media-tag

Automate image and video tagging, captioning, and semantic classification with open-source vision-language models.

15|4|Updated Apr 18, 2026
One-click install
npx skills add https://github.com/damionrashford/media-os --skill media-tag
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: media-tag
Source: https://github.com/damionrashford/media-os/tree/main/skills/media-tag
Command: npx skills add https://github.com/damionrashford/media-os --skill media-tag

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires open_clip_torch, transformers, torch, sentence_transformers, opencv-python, numpy, Pillow, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill automates image and video tagging, captioning, and semantic classification by orchestrating multiple open-source vision-language models (CLIP, SigLIP, BLIP-2, and LLaVA) to enrich media metadata for catalogs, accessibility, and search.

Core Features & Use Cases

  • Tag images with labels from custom vocabularies or model predictions
  • Generate captions for images (WCAG-style alt text) and per-frame video narration
  • Build and query semantic search indexes over media folders to enable fast retrieval
  • Bulk-tag a directory of media files into CSV with scores for downstream cataloging

Quick Start

Tag a batch of images in a folder with open-source vision-language models and output a CSV with image, label, and score.

Frequently Asked Questions about media-tag

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automatically generate alt text and tags for a folder of images?

You can automate image tagging and captioning by batch processing an entire directory using open-source vision-language models like CLIP and BLIP-2 to generate labels and WCAG-style alt text for each file.

Can I use custom vocabularies for semantic image classification?

Yes, semantic classification supports custom vocabularies for image tagging, allowing you to apply specific labels to media files rather than relying solely on default model predictions.

What is the best way to extract metadata and captions from videos frame by frame?

Per-frame video narration extracts metadata and generates captions for videos by processing individual frames with vision-language models, creating detailed descriptions for media archives.

How do I build a semantic search index over my media library?

You can build and query semantic search indexes over media folders by using vision-language models to generate vector embeddings, enabling fast content retrieval across large photo libraries.

Do I need PyTorch and OpenCV to batch tag media files into a CSV?

Yes, batch tagging media files into a CSV requires PyTorch and OpenCV, along with dependencies like transformers and open_clip_torch, to run the vision-language models for metadata enrichment.

Does this media tagging approach support multi-model orchestration for better accuracy?

Multi-model orchestration coordinates open-source models like CLIP, SigLIP, BLIP-2, and LLaVA to enrich media metadata, combining different vision-language architectures for comprehensive tagging and captioning.