media-processing

Ingest media assets, deduplicate by content hash, and run a 3-phase pipeline.

1.0k|158|Updated Feb 7, 2026
One-click install
npx skills add https://github.com/vellum-ai/vellum-assistant --skill media-processing-vellum-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: media-processing
Source: https://github.com/vellum-ai/vellum-assistant/tree/main/assistant/src/config/bundled-skills/media-processing
Command: npx skills add https://github.com/vellum-ai/vellum-assistant --skill media-processing-vellum-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ingests media files and orchestrates automated processing (ingest, preprocess, map, reduce) to extract structured outputs for downstream analysis and interaction.

Core Features & Use Cases

  • Ingest, deduplicate by content hash, and track assets through a deterministic three-phase pipeline.
  • Preprocess: extract keyframes and optional transcripts; Map: Gemini-driven vision analysis with structured JSON outputs; Reduce: Claude-driven QA over structured results.
  • Clip generation and on-demand access to frames, transcripts, and metadata for reviews and reporting.

Quick Start

Upload a video to begin automated ingestion and pipeline processing.

Frequently Asked Questions about media-processing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate video transcription and frame extraction in a single pipeline?

Automated video transcription and frame extraction is handled by a deterministic three-phase pipeline that preprocesses media assets, extracts keyframes, and generates optional transcripts during the initial ingest phase.

Can I use Claude for Q&A and Gemini for vision analysis on the same media assets?

Claude and Gemini can be used together on the same media assets through a map-reduce pipeline where Gemini drives vision analysis to produce structured JSON, and Claude performs subsequent Q&A over those structured results.

What is the best way to prevent duplicate media processing and track costs per segment?

Prevent duplicate processing by deduplicating assets through content hashing and enforcing idempotent reprocessing, while tracking costs and maintaining resumable progress through modular services with per-segment caching.

How do I extract structured JSON outputs from audio and image files for downstream analysis?

Extract structured JSON outputs from audio and image files by ingesting them into the pipeline, where Gemini-driven vision analysis processes visual content and audio transcription converts speech into tracked text metadata.

Does the media processing pipeline support resumable progress if a job fails midway?

The media processing pipeline supports resumable progress through per-segment caching and idempotent reprocessing, allowing interrupted jobs to resume without duplicating work or losing previously generated structured outputs.