multimodal-extraction
CommunityCreate synced screenshot-transcript video notes.
Education & Research#whisper#video transcription#slide extraction#multimodal notes#markdown timeline#video recap#timestamped transcript
Authorswyxio
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Manually creating notes from videos that sync screenshots with transcript text is extremely time-consuming, especially for long talks or presentations with dense slide content. This Skill automates the entire end-to-end workflow to produce a ready-to-use markdown document in minutes.
Core Features & Use Cases
- End-to-end video processing: Automatically downloads videos from URLs or uses local files, extracts slide frames and key visual moments, transcribes audio, and merges everything into a single timestamped markdown file.
- Three quality modes: Choose between fast swift mode for quick first-pass notes, context mode for OCR-enriched slide text integration, or polish mode for LLM-refined, high-quality deliverables.
- Use cases: Perfect for generating study notes from recorded lectures, creating shareable recaps of conference talks, or building searchable archives of video content with synced visuals and text.
Quick Start
Use the multimodal-extraction skill to turn the attached video file or URL into a markdown timeline with synced screenshots and full transcript text.
Dependency Matrix
Required Modules
ffmpegyt-dlpopenai-whispertesseract
Components
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: multimodal-extraction Download link: https://github.com/swyxio/skills/archive/main.zip#multimodal-extraction Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 537,000+ vetted skills library on demand.