music-to-video

Generates beat-synced HyperFrames videos from music tracks using audio analysis and per-frame compositions.

Updated Aug 28, 2026
One-click install
npx skills add https://github.com/AnderHonorato/Mem-rias-IA---Infinity --skill music-to-video-anderhonorato
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: music-to-video
Source: https://github.com/AnderHonorato/Mem-rias-IA---Infinity/tree/main/Manus/Skills/html-video-production/references/music-to-video
Command: npx skills add https://github.com/AnderHonorato/Mem-rias-IA---Infinity --skill music-to-video-anderhonorato

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires librosa, numpy, soundfile, and includes scripts (resource) and references (resource) components.

What problem does it solve? Turning a music track into a video whose visuals actually follow the beat requires manual audio analysis, timeline planning, and frame-by-frame animation work. This Skill automates that pipeline: it analyzes the track once, cuts it into frames at real musical changes, plans a per-frame treatment, and builds a rendered MP4. ## Core Features & Use Cases - Deterministic beat analysis: analyze-beatgrid.py produces a canonical audiomap.json with tempo, beat grid, drum classification, energy phases, rolls, silences, and key moments. - Gated multi-step workflow: setup → analysis → frame skeleton → user-approved storyboard plan → parallel per-frame composition builds → assembly → verified MP4 render. - Template and motion-primitive catalogs: each frame group uses a matched template, a free-compose of motion primitives, or an asset treatment (beat-cut, ken-burns, background-under-text) for user-supplied images/videos. - Use Case: Give it a 30-second music track and a mood brief; it produces a lyric video, slideshow, or kinetic promo where every cut and reveal lands on the analyzed beat grid, with zero assets required. ## Quick Start Turn my song bgm.mp3 into a beat-synced lyric video in 1920x1080 and render the final MP4.

Frequently Asked Questions about music-to-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I make a beat-synced video from a music track?

Run the music-to-video workflow: analyze the track with analyze-beatgrid.py to get an audiomap.json, cut it into frames at musical changes, fill a storyboard plan with templates or motion primitives, build one composition file per frame, then assemble and render the MP4 with the HyperFrames CLI.

How to sync video cuts to music beats automatically?

The analyze-beatgrid.py script detects tempo, beat grid, onsets, drum hits, rolls, and energy phases using librosa, writing them to audiomap.json. Frame boundaries and per-onset reveals snap to these real anchor seconds rather than being measured by ear.

What Python libraries are needed for music beat analysis?

The analyzer requires librosa, numpy, and soundfile, plus ffmpeg on PATH for decoding. Install them with pip before running analyze-beatgrid.py; no machine-learning models are used, only band-split heuristics.

Can I use my own images and videos in a music video?

Yes, stage them with stage-assets.mjs and the planner assigns asset treatments: beat_cut on rhythmic frames, ken_burns on calm frames, or bg_under_text behind typography. Assets are optional since typography templates alone can carry a complete video.

Why does beat syncing fail on calm or ambient music?

On calm music the detected beat grid is a metronome the tracker imposed, not real rhythm, so hard cuts to it look wrong. The workflow handles this by marking such frames phrase_flow and pacing them by phrases and energy instead of beats.

What video formats and resolutions does the workflow support?

Output is an MP4 rendered by the HyperFrames CLI. The canvas is set once in the storyboard frontmatter: 1920x1080 landscape by default, with 1080x1920 portrait and 1080x1080 square also supported.