embedded-captions

Generate scene-embedded captions for talking-head videos using matting, transcription, and ffmpeg compositing.

Updated Jun 20, 2026
One-click install
npx skills add https://github.com/Noetfield-Systems/SourceA --skill embedded-captions-noetfield-systems
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: embedded-captions
Source: https://github.com/Noetfield-Systems/SourceA/tree/main/commercial-video-factory/trustfield-storyboard-hf-v1/.agents/skills/embedded-captions
Command: npx skills add https://github.com/Noetfield-Systems/SourceA --skill embedded-captions-noetfield-systems

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires hyperframes, ffmpeg, sharp, puppeteer, whisperx, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Adding captions to talking-head videos usually means flat subtitle overlays that ignore the scene. This Skill composites captions into the footage itself — behind the subject via human matting, matched to scene lighting and palette — while keeping the source video untouched. ## Core Features & Use Cases - Identity catalog routing: Pick one of 32 visual identities (cream, ink, anchor, terminal, neon, glitch, etc.) from CATALOG.md; the engine, compiler, and authoring file are derived automatically. - Automated pipeline: One prepare script runs background-removal matting, WhisperX transcription, and safe-zone scene analysis in parallel, then compiles a small authored JSON into the final render. - Rail + embed caption model: A verbatim lower-third rail carries most text while scarce hero words are composited behind the subject with matte occlusion. - Use Case: Given a 30-second founder update clip, probe the scene, pick the keynote identity, author a small JSON, preview composite frames, and render a final.mp4 with word-timed captions embedded in the scene. ## Quick Start Add embedded captions to my talking-head video clip.mp4 using the most fitting identity from the catalog.

Frequently Asked Questions about embedded-captions

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add captions to a talking-head video with this pipeline?

Run hyperframes init on the clip, then scripts/prepare.sh to matte, transcribe, and compute safe zones in one command. Author a small JSON for the chosen identity, preview composite frames, and run render-and-composite.sh to produce final.mp4.

How do I choose between the caption identities like cream, ink, or anchor?

Pick from CATALOG.md by content register and scene luminance, never by engine name. Bright scenes above luma 150 use ink, verbatim explainers default to the anchor rail, and dark poetic scenes fit cream; the agent recommends one and the user confirms.

What video types are not supported for embedded captions?

The skill refuses clips with multiple speakers, hard cuts, no human subject, under 3 seconds, no speech, existing burned-in captions, or garbage transcripts. Fast handheld footage also fails because the matte flickers.

Does the caption pipeline modify or color-grade the original footage?

No, the source video ships untouched; captions are the only addition and the matte only lets the subject occlude embedded text. The single exception is Theme mode's plate budget, which applies register-gated reaction effects after compositing.

Why do light captions wash out on bright backgrounds?

Screen-blend cream templates fail above 180 luminance and those DNAs are locked against recoloring. The fix is to switch identity to ink, which uses near-black multiply blending designed for bright surfaces, or the opaque anchor rail.

What dependencies does the embedded captions pipeline require?

It requires a built hyperframes checkout for the remove-background CLI, plus ffmpeg, sharp, and puppeteer resolved from that checkout. Transcription runs WhisperX through uvx, and matting weights auto-download once to the hyperframes cache.