music-to-video

Generates beat-synced HyperFrames videos from music tracks using audio analysis and per-frame compositions.

Updated Jun 20, 2026
One-click install
npx skills add https://github.com/Noetfield-Systems/SourceA --skill music-to-video-noetfield-systems
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: music-to-video
Source: https://github.com/Noetfield-Systems/SourceA/tree/main/commercial-video-factory/trustfield-storyboard-hf-v1/.agents/skills/music-to-video
Command: npx skills add https://github.com/Noetfield-Systems/SourceA --skill music-to-video-noetfield-systems

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires librosa, numpy, soundfile, and includes scripts (resource) and references (resource) components.

What problem does it solve? Turning a music track into a beat-synced video normally requires manual timeline editing, beat detection, and frame-by-frame motion design. This Skill automates that pipeline: it analyzes the audio once, cuts the track into frames at real musical changes, plans a per-frame treatment, and builds each frame as an HTML composition rendered to MP4. ## Core Features & Use Cases - Deterministic audio analysis: A single analyzer script produces an audiomap.json with beat grid, onsets, drum classification, energy phases, rolls, silences, and key moments that drives all timing decisions. - Orchestrated multi-step workflow: Setup, analysis, frame skeleton, user-approved plan, parallel per-frame sub-agent builds, deterministic assembly, and lint/validate/inspect verification before rendering. - Template and motion-primitive catalogs: Typography-first templates and free-compose motion primitives mean a complete video needs zero user assets; supplied images or videos are cut in on the same beat grid via beat-cut, ken-burns, or background treatments. - Use Case: Give the Skill a 30-second synthwave track and a short tagline; it produces a beat-synced kinetic typography video rendered to renders/video.mp4 at 1920x1080. ## Quick Start Use the music-to-video skill to turn my track bgm.mp3 into a beat-synced kinetic typography video with the tagline "Ship It".

Frequently Asked Questions about music-to-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I make a beat-synced video from a music track?

Provide an audio file or a video to extract audio from; the skill analyzes it with analyze-beatgrid.py into an audiomap.json, cuts the track into frames at musical changes, plans per-frame treatments, and renders an MP4 via the HyperFrames CLI.

How does the audio beat analysis work?

The analyze-beatgrid.py script uses librosa for tempo and beat tracking, band-split onset flux for drum classification, and RMS energy for phases, rolls, and key moments. Output is a deterministic audiomap.json that all timing decisions trust.

Can I use my own images or video clips in the generated video?

Yes. User-supplied media is staged into the project assets folder and woven into frames on the same beat grid using beat-cut, ken-burns, or background-under-text treatments. Assets are optional since typography templates alone can carry the video.

Does beat syncing work with calm or ambient music?

Yes, but pacing changes. On calm tracks the beat grid is treated as unreliable, so frames use phrase_flow pacing driven by phrases and energy envelopes instead of hard beat cuts. The pacing decision is made per frame from robust audiomap fields.

What dependencies are required to run the audio analysis?

The analyzer requires Python 3 with librosa, numpy, and soundfile installed, plus ffmpeg on PATH for decoding. Frame building and rendering use Node.js scripts and the HyperFrames CLI with headless Chrome validation.