qwen-mm-plugins-omni-chatcut-music-to-mv

Generates music videos from local audio through captioning, storyboard authoring, and provider-based video assembly.

2.9k|185|Updated Jul 29, 2026
One-click install
npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-chatcut-music-to-mv-qwenlm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qwen-mm-plugins-omni-chatcut-music-to-mv
Source: https://github.com/QwenLM/Qwen-MM-Plugins/tree/main/src/capabilities/omni-chatcut/skill/music-to-mv
Command: npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-chatcut-music-to-mv-qwenlm

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Turning a song into a finished music video requires coordinating music analysis, creative storyboarding, image and video generation, and final assembly across multiple AI providers. This Skill orchestrates that entire pipeline while tracking project state so work can be resumed, validated, or diagnosed at any stage. ## Core Features & Use Cases - State-aware routing: Inspects a project directory with inspect_music2mv_state.py and routes to the correct workflow—music captioning, storyboard authoring, video generation, resume, or final-MV validation. - Three internal workflows: Music caption analysis, timed storyboard authoring with validation and continuity reports, and video generation with identity assets, optional Omni shot QC, assembly, and technical QC. - Multi-provider generation: Defaults to Qwen Image 3.0 and Wan 3.0 on DashScope, with Seedream and Seedance on Volcengine Ark, including a local 300-character catalog for Seedance cast selection. - Use Case: Provide a local MP3 and a creative brief; the Skill analyzes the music structure and lyrics, authors a validated shot-by-shot storyboard, generates per-shot video segments, and assembles a final MV with burned-in lyric subtitles. ## Quick Start Ask the agent to create a music video from your local song file, for example: turn my song track.mp3 into an MV using this project folder.

Frequently Asked Questions about qwen-mm-plugins-omni-chatcut-music-to-mv

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn a local music file into a music video with AI?

Provide the source audio and a project directory; the Skill runs music captioning to extract structure and lyrics, authors a validated timed storyboard, generates one video segment per editorial shot via Qwen Image/Wan or Seedream/Seedance, then assembles the final MV with technical QC.

How do I resume an interrupted music video generation project?

Run the state inspection script on the project directory. If resumable execution state or an incomplete caption run with readable source audio exists, the Skill continues from the last durable phase instead of restarting.

Which video generation providers does the music-to-MV pipeline support?

It defaults to Qwen Image 3.0 and Wan 3.0 on DashScope using a Beijing-region DASHSCOPE_API_KEY. Seedream and Seedance connect directly to Volcengine Ark, with Seedance using existing Ark image asset IDs for fixed characters.

Does the Skill enable Omni semantic shot quality control by default?

No. Omni semantic shot QC is off unless the user explicitly requests it or sets quality_control.enabled=true in the run config. When skipped, the Skill reports it as skipped without treating it as a required stage.

Why does storyboard validation block video generation?

Execution requires a validator-approved storyboard with creative direction, one provider request per editorial shot, and a passing continuity report. Failed validation returns work to storyboard authoring because structural problems cannot be fixed during generation.

When does the Skill ask before making paid API calls?

Music analysis, validation, and planning are free, but an explicit request to create the final MV or resume generation authorizes provider calls. If intent is ambiguous, the Skill stops before the first paid call and asks once.