embedded-captions

Composite WhisperX-derived captions behind speakers in videos using ffmpeg matte occlusion.

255|42|Updated Nov 16, 2023
One-click install
npx skills add https://github.com/chmonitor/chmonitor --skill embedded-captions
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: embedded-captions
Source: https://github.com/chmonitor/chmonitor/tree/main/.agents/skills/embedded-captions
Command: npx skills add https://github.com/chmonitor/chmonitor --skill embedded-captions

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ffmpeg, sharp, puppeteer, gsap, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Talking-head videos require professional, readable captions that integrate with the scene rather than obscure it, but manual motion graphics editing is time-consuming and demands specialized design skills.

Core Features & Use Cases

  • 32 Visual Identities: Choose from cinematic column-flow styles (cream, ink, neon, glitch) or themed constitutions (anchor, ordnance, terminal, arcade) to match any tone from poetic to cyberpunk.
  • Matte Occlusion Pipeline: Uses hyperframes remove-background to composite captions behind the subject, so the speaker's body naturally occludes text for a diegetic, embedded look.
  • Deterministic Rendering: Transcribes audio via WhisperX, validates timing and occlusion gates, and composites via ffmpeg for reproducible outputs.
  • Use Case: A YouTube educator records a 10-minute explainer and uses the 'anchor' identity to add clean verbatim lower-thirds with a single emphasized climax, or a music video director uses the 'neon' identity to make captions glow like signage behind the artist.

Quick Start

Use the embedded-captions skill to add cinematic captions to the video file 'monologue.mp4', choosing the 'cream' identity for a warm poetic look.

Frequently Asked Questions about embedded-captions

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add captions to a talking-head video that appear behind the subject?

Matte occlusion composites captions behind the subject by using the hyperframes remove-background pipeline, so the speaker's body naturally occludes text for a diegetic, embedded look in talking-head videos.

Can I automate motion graphics typography for YouTube monologues using ffmpeg?

Yes, deterministic rendering transcribes audio via WhisperX, validates timing and occlusion gates, and composites cinematic captions via ffmpeg for reproducible outputs on YouTube monologues.

Do I need a single-subject video file to apply embedded captions?

Yes, applying embedded captions requires a single-subject video file to correctly execute the hyperframes matting pipeline and achieve accurate matte occlusion of the text.

What visual styles are available for cinematic scene-embedded captions?

You can choose from 32 visual identities, including cinematic column-flow styles like cream, ink, neon, and glitch, or themed constitutions like anchor, ordnance, terminal, and arcade.

When should I not use matte occlusion for video captioning?

Matte occlusion for video captioning is not suitable for multi-subject videos or complex scenes where the hyperframes matting pipeline cannot isolate a single subject to composite text behind.

How does Whisper transcription integrate with motion graphics compositing?

Whisper transcription provides the timing and text data for deterministic rendering, validating occlusion gates before ffmpeg composites the motion graphics captions into the final video.