What problem does it solve?
HeartMuLa turns written lyrics and stylistic tags into full-length, music-like audio so you can create song drafts without composing melodies, harmonies, or instrumentation manually.
Core Features & Use Cases
- Lyrics + Tags Music Generation: Produces complete songs conditioned on lyrics formatted with structural sections (e.g., Intro/Verse/Chorus).
- Open-Source Foundation Models: Uses HeartMuLa (generation), HeartCodec (audio reconstruction), HeartTranscriptor (lyrics transcription), and HeartCLAP (audio-text alignment).
- Multilingual, Local Execution: Runs locally with configurable model precision and optional lazy loading to fit within available VRAM.
Quick Start
Ask the skill to generate an MP3 song using your provided lyrics file and comma-separated tags, loading the 3B model from your local checkpoint directory and saving the output to an MP3 path.