hyperframes-media

Generates TTS voiceover, background music, sound effects, and captions for HyperFrames video compositions.

Updated Jun 20, 2026
One-click install
npx skills add https://github.com/Noetfield-Systems/SourceA --skill hyperframes-media-noetfield-systems
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hyperframes-media
Source: https://github.com/Noetfield-Systems/SourceA/tree/main/commercial-video-factory/trustfield-storyboard-hf-v1/.agents/skills/hyperframes-media
Command: npx skills add https://github.com/Noetfield-Systems/SourceA --skill hyperframes-media-noetfield-systems

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai, transformers, torch, soundfile, numpy, kokoro-onnx, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Producing the audio layer of a video — voiceover, background music, sound effects, transcription, and captions — normally requires juggling multiple TTS providers, music generators, and transcription tools with inconsistent outputs. This Skill provides one shared audio engine that produces all of these assets from a single request file, with automatic provider fallback when credentials are missing. ## Core Features & Use Cases - Multi-provider TTS: Synthesizes voiceover via HeyGen (with native word timestamps), ElevenLabs, or local Kokoro-82M, selected automatically by available credentials. - BGM and SFX: Retrieves music and sound effects from the HeyGen audio library when credentialed, or falls back to local Lyria/MusicGen generation and a bundled 21-file SFX library. - Transcription and captions: Runs Whisper transcription with language-safe model rules and authors styled, word-timed captions including karaoke and per-word emphasis. - Use Case: Given a storyboard with narration lines and a music mood, write an audio_request.json and run scripts/audio.mjs to produce voice WAVs with word timestamps, a BGM track, and timed SFX cues in one audio_meta.json. ## Quick Start Ask the AI to generate voiceover, background music, and sound effects for your HyperFrames composition by writing an audio_request.json and running the audio engine script.

Frequently Asked Questions about hyperframes-media

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate TTS voiceover with word timestamps for video captions?

Use the HeyGen TTS path, which returns native word timestamps in the same response as the audio. Run scripts/heygen-tts.mjs with --words to capture them, or let scripts/audio.mjs handle it automatically; ElevenLabs and Kokoro require a chained Whisper transcribe pass.

Which TTS provider should I use: HeyGen, ElevenLabs, or Kokoro?

HeyGen gives the best quality plus word timestamps in one call but needs a credential. ElevenLabs offers a large cloud voice catalog with an API key. Kokoro-82M runs fully offline with no key and supports multilingual voices, making it the default fallback.

What happens to BGM and SFX when no HeyGen API key is set?

Without a HeyGen credential, BGM falls back to local generation via Google Lyria or MusicGen, spawned detached and awaited with wait-bgm.mjs. SFX falls back to a bundled 21-file library matched by name, so the pipeline still works fully offline.

Why does Whisper transcription translate my non-English audio into English?

The CLI default model small.en silently translates non-English audio into English. Always pass --model explicitly: use small.en only for known English, small --language <code> for known non-English, or small for auto-detection.

Can remove-background produce a clean plate of a scene without the person?

No. The --background-output option produces a hole-cut plate where the subject region is transparent, not an inpainted clean plate. For a standalone scene without the person, an inpainting tool such as LaMa, ProPainter, or E2FGVI is required.