video-understand

Extract frames and transcribe audio from videos locally using FFmpeg and Whisper.

46.2k|5.7k|Updated Mar 29, 2026
One-click install
npx skills add https://github.com/calesthio/OpenMontage --skill video-understand-calesthio
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: video-understand
Source: https://github.com/calesthio/OpenMontage/tree/main/.agents/skills/video-understand
Command: npx skills add https://github.com/calesthio/OpenMontage --skill video-understand-calesthio

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ffmpeg, ffprobe, openai-whisper, and includes scripts (resource) and references (resource) components.

## What problem does it solve? Understand video content locally using ffmpeg frame extraction and Whisper transcription. No API keys needed.

## Core Features & Use Cases

  • Extract frames at scene changes or keyframes for visual analysis.
  • Transcribe audio locally with an optional Whisper model.
  • Operate fully offline, without cloud-based APIs.

### Quick Start Run understand_video on a sample video to extract frames and transcribe audio locally.

Frequently Asked Questions about video-understand

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe video audio offline without an API key?

You can transcribe video audio offline without an API key by using a local Whisper model to process the audio track directly on your machine. This Skill extracts audio and transcribes it entirely locally without relying on cloud-based APIs.

How do I extract keyframes from a video using ffmpeg?

Extract keyframes from a video using ffmpeg by applying frame extraction at scene changes. This Skill automates ffmpeg frame extraction, supporting multiple extraction modes to isolate keyframes for visual analysis and scene inspection.

Do I need openai-whisper installed to analyze video content locally?

You need openai-whisper installed only if you want to transcribe audio locally. The Whisper model is optional; frame extraction and scene inspection features work independently through ffmpeg without requiring openai-whisper.

What is the best way to perform offline transcription for educational videos?

The best way to perform offline transcription for educational videos is using a local Whisper model to process the audio without cloud services. This Skill handles offline transcription specifically for education, research, or content production contexts.

Can I extract frames at scene changes without cloud-based APIs?

You can extract frames at scene changes without cloud-based APIs by running ffmpeg locally to process the video file. This Skill operates fully offline, applying ffmpeg frame extraction to detect scene changes and isolate keyframes.

What are the limitations of offline video transcription with Whisper?

Offline video transcription with Whisper requires ffmpeg, ffprobe, and an optional Whisper model installed locally. Processing happens entirely on your machine, so performance depends on your local hardware capabilities rather than cloud resources.