hyperframes-media

Generate audio, captions, and background-removed visuals for HyperFrames video compositions.

255|42|Updated Nov 16, 2023
One-click install
npx skills add https://github.com/chmonitor/chmonitor --skill hyperframes-media-chmonitor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hyperframes-media
Source: https://github.com/chmonitor/chmonitor/tree/main/.agents/skills/hyperframes-media
Command: npx skills add https://github.com/chmonitor/chmonitor --skill hyperframes-media-chmonitor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ffmpeg, python3, pip, google-genai, python-dotenv, transformers, torch, soundfile, numpy, elevenlabs, kokoro-onnx, hyperframes-cli, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill eliminates the manual work of producing all audio and visual media assets required for HyperFrames video compositions, including voiceover, background music, sound effects, transcription, timed captions, and subject background removal, which would otherwise require integrating multiple separate tools and services.

Core Features & Use Cases

  • Multi-provider Text-to-Speech: Supports HeyGen (with native word timestamps), ElevenLabs, and offline local Kokoro TTS, with automatic fallback based on available credentials and language needs.
  • Background Music & Sound Effects: Retrieves royalty-free BGM and SFX from HeyGen's library when credentialed, or falls back to local Lyria/MusicGen BGM generation and a bundled offline SFX library when no credentials are available.
  • Transcription & Caption Authoring: Generates word-level timestamps for TTS audio, cleans raw transcripts, and creates customizable captions with karaoke effects, motion animations, and audio-reactive modulation.
  • Background Removal: Creates transparent cutouts of subjects from video or image files for compositing into custom scenes.
  • Use Case: For a product launch video, use this Skill to generate a polished voiceover from a script, add matching background music, insert UI interaction sound effects, auto-generate perfectly timed captions, and cut out the presenter to overlay on a branded background.

Quick Start

Use the hyperframes-media skill to produce all required audio, caption, and background removal assets for your HyperFrames video composition from a provided script and scene cues.

Frequently Asked Questions about hyperframes-media

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate timed captions and voiceover for video production?

To generate timed captions and voiceover, this Skill produces multi-provider text-to-speech audio with word-level timestamp normalization and deterministic caption authoring. It supports automatic credential-based fallback across HeyGen, ElevenLabs, and local Kokoro TTS providers.

Can I use local text-to-speech and offline sound effects without API credentials?

You can generate local text-to-speech and offline sound effects without credentials by utilizing the bundled offline SFX library and local Kokoro TTS. The system automatically falls back to local Lyria or MusicGen BGM generation when no external service credentials are available.

How does background removal work for compositing video subjects?

Background removal for compositing works by processing video or image files to create transparent cutouts of subjects. These transparent assets are then ready to overlay onto custom scenes within your HyperFrames video compositions.

Does this Skill support karaoke effects and audio-reactive animations for captions?

Yes, this Skill supports karaoke effects and audio-reactive animations for captions. It generates customizable captions with motion animations and audio-reactive modulation based on the cleaned word-level timestamps derived from your TTS audio.

What is the best way to automate product launch video asset generation?

The best way to automate product launch video asset generation is to provide a script and scene cues to produce synchronized voiceover, background music, UI sound effects, timed captions, and subject background removal in a single workflow.

Do I need ffmpeg and python3 installed to run transcription and audio generation?

Yes, you need ffmpeg and python3 installed to run transcription and audio generation. These are core dependencies required to execute the scripts, process audio files, and generate the required media assets for your video compositions.