What problem does it solve?
Asset preprocessing for HyperFrames compositions — text-to-speech narration (Kokoro), audio/video transcription (Whisper), and background removal for transparent overlays (u2net). Use when generating voiceover from text, transcribing speech for captions, removing the background from a video or image to use as a transparent overlay, choosing a TTS voice or whisper model, or chaining these (TTS → transcribe → captions). Each command downloads its own model on first run.
Core Features & Use Cases
- Generate speech audio locally with Kokoro-82M. No API key.
- Produce transcripts with word-level timestamps for captions.
- Remove backgrounds from video or image to create transparent overlays for compositions.
- Output is cached under ~/.cache/hyperframes/ for reuse across projects.
Quick Start
Generate a voiceover from text, transcribe it for captions, and remove backgrounds to create transparent overlays for your HyperFrames projects.