yue2-music

Generate, cover, transcribe, and edit songs with YuE2 and SheetSage2 via ABC scores.

38|4|Updated Jan 22, 2026
One-click install
npx skills add https://github.com/Qo-qiao/ComfyUI-omni-llm --skill yue2-music-qo-qiao
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: yue2-music
Source: https://github.com/Qo-qiao/ComfyUI-omni-llm/tree/main/skills/yue2-music
Command: npx skills add https://github.com/Qo-qiao/ComfyUI-omni-llm --skill yue2-music-qo-qiao

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, transformers, soundfile, numpy, huggingface-hub, and includes references (resource) and assets (resource) components.

What problem does it solve? It turns musical requests into reproducible songs by orchestrating YuE2 generation, SheetSage2 audio transcription, and ABC score editing, while preserving plans, invariants, and audible comparisons. ## Core Features & Use Cases - Song Generation: Generate songs with YuE2 in full, melody, or off chain-of-thought modes, retaining symbolic plans, tokens, and latents. - Audio-to-Score Covers: Transcribe recordings with SheetSage2 into ABC notation, strip chords, and re-render them as covers in new styles. - Score Editing & Reharmonization: Edit ABC scores with invariant checks, delegate bounded edits to agents, and regenerate audio from revised scores. - Use Case: Transcribe a reference recording to ABC, adapt the lyrics for singing, reharmonize the score as modern jazz, and deliver a local HTML listening comparison of before and after versions. ## Quick Start Use the yue2-music skill to generate a song from the example prompt in assets/prompt.json and save all plan artifacts.

Frequently Asked Questions about yue2-music

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a song with YuE2?

Create a request JSON with style, lyrics, cot mode, and seed, then run the generation helper or the YuE2 Python pipeline. Use cot="full" for editable melody and harmony, cot="melody" for a chord-free plan, or cot="off" for direct text-to-audio generation.

How do I cover an existing audio recording with YuE2?

Transcribe the recording with SheetSage2 to obtain ABC notation, inspect and correct the score, strip chord symbols, then render with YuE2 using cot="melody" plus your target style and lyrics. This preserves the melody symbolically but not the original singer's identity.

What hardware does YuE2 music generation require?

The supported baseline is an NVIDIA GPU with 24GB VRAM and BF16 support, running one request at a time with default settings. SheetSage2 requires a separate Python environment because its dependency pins differ from YuE2.

Can I feed MERT feature embeddings to YuE2 as tokens?

No. MERT-v2 encoders return continuous features, not the discrete semantic tokens YuE2 uses internally. YuE2 also exposes no audio-reference, phoneme-alignment, or local-inpainting arguments in its public interface.

How do I edit a generated song's harmony or lyrics?

Render a baseline from the full plan, edit a copy of its score.abc under a defined invariant contract, validate the changes with the ABC comparison helper, then regenerate audio with the revised score, style, and lyrics. Old latents cannot implement musical edits.

What are the license restrictions on YuE2 model weights?

The YuE2 and related model weights are released under CC BY-NC 4.0, meaning non-commercial use only. The skill's own code is Apache 2.0, but that license does not relicense the model weights or remove their non-commercial terms.