media-processing

Ingest media files, extract video segments and keyframes, and map frames through Gemini into structured JSON.

2|2|Updated May 13, 2026
One-click install
npx skills add https://github.com/autonomy-cloud/kairos-interface --skill media-processing-autonomy-cloud
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: media-processing
Source: https://github.com/autonomy-cloud/kairos-interface/tree/main/assistant/src/config/bundled-skills/media-processing
Command: npx skills add https://github.com/autonomy-cloud/kairos-interface --skill media-processing-autonomy-cloud

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the manual effort of organizing media files and interpreting what’s inside videos by turning them into structured, queryable outputs you can reuse.

Core Features & Use Cases

  • Media ingestion with deduplication: Registers video/audio/images from an absolute file path, detects MIME type, extracts duration (for video/audio), and deduplicates using a content hash.
  • Configurable 3-phase processing pipeline: Ingests files, preprocesses videos by extracting keyframes/segments (including optional dead-time detection and optional audio transcription), maps segments through Gemini for structured vision output, and reduces results through Claude for analysis and Q&A.
  • Reusable analysis + querying: Produces pipeline artifacts (manifest, map outputs) that enable fast follow-up questions without reprocessing the entire media.
  • Clip extraction: Generates shareable clips around time ranges with ffmpeg, saving them as attachments for in-chat delivery.

Quick Start

Use the media-processing skill to ingest "/path/to/video.mp4", then run a broad analyze_keyframes prompt with a JSON output schema and ask follow-up questions via query_media.

Frequently Asked Questions about media-processing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract keyframes from a video and output structured JSON?

To extract keyframes and output structured JSON, the skill ingests video files via absolute paths, uses ffmpeg-based preprocessing to extract segments and keyframes, and maps them through Gemini structured generation to produce schema-guaranteed JSON outputs.

What is the best way to analyze video content and answer LLM Q&A without reprocessing?

Analyzing video content for LLM Q&A without reprocessing involves mapping video segments into structured JSON via Gemini, then using Claude to reduce results and answer reusable follow-up queries over the prior map outputs.

Can I use ffmpeg to generate video clips around specific time ranges for in-chat delivery?

Yes, you can use ffmpeg to generate video clips. The skill extracts shareable clips around specified time ranges and saves them as attachments, enabling direct in-chat delivery of the generated video segments.

Does multimodal processing support audio transcription alongside video keyframe extraction?

Yes, multimodal processing supports optional audio transcription alongside video keyframe extraction. During the configurable preprocessing pipeline phase, the skill can ingest audio and transcribe it while simultaneously extracting video segments.

How do I ingest media files while deduplicating video and audio content?

To ingest media files while deduplicating content, the skill registers files from an absolute path, detects MIME type, extracts duration, and automatically deduplicates video and audio assets using a computed content hash.

When should I not use Claude for querying over generated map outputs?

You should not use Claude for querying over map outputs if your task requires bypassing the Gemini structured generation phase, as the Claude-based querying mechanism depends on prior map-output data to perform natural-language analysis.