heartmula

Generate open-source music from lyrics and tags using HeartMuLa models.

97|8|Updated Mar 20, 2026
One-click install
npx skills add https://github.com/peteromallet/megaplan --skill heartmula-peteromallet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/peteromallet/megaplan/tree/main/megaplan/agent/skills/media/heartmula
Command: npx skills add https://github.com/peteromallet/megaplan --skill heartmula-peteromallet

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

HeartMuLa provides an open-source, local solution to generate full songs from lyrics and tags, enabling offline music creation without relying on proprietary services.

Core Features & Use Cases

  • HeartMuLa: music language model for generation from lyrics and tags
  • HeartCodec: high-fidelity audio reconstruction codec
  • HeartTranscriptor: Whisper-based lyrics transcription
  • HeartCLAP: audio-text alignment model
  • Use cases include offline music production, multilingual lyric-based generation, and multi-GPU deployment for higher throughput.

Quick Start

Install dependencies, download the required checkpoints, and run the provided script to generate music from lyrics and tags.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics locally?

Generate music from lyrics locally by installing dependencies, downloading checkpoints, and running the provided script to produce full songs offline without proprietary services.

Does open-source music generation support multilingual lyrics?

Yes, open-source music generation supports multilingual lyrics, using Whisper-based transcription and audio-text alignment models to process diverse languages.

Can I use multi-GPU setups for offline AI music production?

Yes, you can use multi-GPU setups for offline AI music production to achieve higher throughput and process multiple songs efficiently.

Do I need a CUDA-enabled GPU for AI music generation?

Yes, you need a CUDA-enabled GPU running PyTorch, as the audio reconstruction codec and language models require configurable hardware acceleration.

What is the best way to generate audio from text tags?

The best way to generate audio from text tags is using an end-to-end pipeline that transcribes lyrics, applies timing, and reconstructs high-fidelity audio.

Why does local music generation require separate checkpoints?

Local music generation requires separate checkpoints because the language models, audio codec, transcriptor, and alignment model each need distinct pre-trained weights to function.