video-understand

Extract frames and transcribe speech from video files into structured JSON.

Updated Apr 2, 2026
One-click install
npx skills add https://github.com/gyalamanch001a/pur-new --skill video-understand-gyalamanch001a
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: video-understand
Source: https://github.com/gyalamanch001a/pur-new/tree/main/.agents/skills/video-understand
Command: npx skills add https://github.com/gyalamanch001a/pur-new --skill video-understand-gyalamanch001a

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ffmpeg, ffprobe, openai-whisper, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill removes the manual work of watching long videos just to figure out what happened, by turning video content into structured frames, timestamps, and text you can inspect quickly.

Core Features & Use Cases

  • Local Frame Extraction: Detects scene changes, keyframes, or regular intervals to pull the most informative images from a video.
  • Offline Transcription: Extracts audio and transcribes speech locally with Whisper when available, without needing API keys.
  • Structured Video Review: Produces JSON with duration, resolution, frame paths, frame timing, and transcript segments for downstream analysis.
  • Use Case: A researcher can analyze an interview recording by reviewing key frames alongside the transcript to summarize topics, identify scenes, or locate important moments.

Quick Start

Ask the skill to analyze the attached video and return the most relevant frames, timestamps, and transcript as structured JSON.

Frequently Asked Questions about video-understand

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract key frames and transcribe speech from a video offline?

To extract key frames and transcribe speech offline, you need a tool that detects scene changes and transcribes audio with Whisper. The video-understand skill outputs structured JSON with frame paths, timestamps, and transcript segments.

What is the best way to analyze recorded interviews and tutorials locally?

Analyzing recorded interviews locally requires extracting representative frames and transcribing speech. The video-understand skill handles this offline, providing timestamped JSON output for quick review of important moments and topics.

Do I need ffmpeg and ffprobe installed to extract frames and transcribe audio?

Yes, you need ffmpeg and ffprobe installed for media probing and frame extraction. Optional openai-whisper is used for speech transcription, with graceful fallback when audio or speech models are unavailable.

Can I get timestamped JSON output from local video analysis?

Yes, local video analysis can produce timestamped JSON output containing duration, resolution, frame paths, frame timing, and transcript segments. This structured output enables downstream analysis without manual video watching.

What happens if Whisper transcription is unavailable during video analysis?

If Whisper transcription is unavailable, the video analysis skill provides a graceful fallback. It continues to extract representative frames and media metadata while omitting the transcript segments from the final JSON output.

Does offline video processing work without API keys?

Yes, offline video processing works without API keys. The skill uses local ffmpeg tools and openai-whisper for transcription, ensuring privacy and enabling analysis of screen captures and clips without external API calls.