heartmula

Generates full songs from lyrics and style tags using the HeartMuLa open-source music models.

14|5|Updated Apr 9, 2026
One-click install
npx skills add https://github.com/MLT-OSS/hermes-agent-go --skill heartmula-mlt-oss
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/MLT-OSS/hermes-agent-go/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/MLT-OSS/hermes-agent-go --skill heartmula-mlt-oss

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Setting up and running the HeartMuLa open-source music generation model family involves dependency conflicts, source code patches, and multi-gigabyte model downloads that are easy to get wrong without guidance. ## Core Features & Use Cases - Guided Installation: Walks through cloning heartlib, creating a Python 3.10 environment, fixing dependency conflicts, and applying required source patches for transformers 5.x compatibility. - Song Generation: Generates complete songs (MP3, 48kHz stereo) from bracketed lyrics files and comma-separated style tags using the 3B/7B HeartMuLa models with HeartCodec audio reconstruction. - Hardware Planning: Covers VRAM requirements, lazy loading for 8GB GPUs, multi-GPU splitting, and CPU fallback expectations. - Use Case: A user wants an open-source Suno alternative to generate a 4-minute rock song locally from their own lyrics on a single NVIDIA GPU. ## Quick Start Set up HeartMuLa and generate a song from my lyrics.txt and tags.txt files using the 3B model with lazy loading enabled.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics with HeartMuLa?

Clone the heartlib repository, install it in a Python 3.10 virtual environment, download the HeartMuLa and HeartCodec checkpoints, then run examples/run_music_generation.py with your lyrics file, tags file, and model path. Output is a 48kHz stereo MP3.

What GPU do I need for HeartMuLa music generation?

HeartMuLa requires a minimum of 8GB VRAM using the --lazy_load true flag, with 16GB or more recommended. The 3B model with lazy loading peaks at about 6.2GB VRAM, and multi-GPU setups can split models across devices.

Can HeartMuLa run on CPU or macOS?

CPU mode works via --mula_device cpu but is extremely slow, potentially 30-60+ minutes per song, and needs 12GB+ free RAM. Triton is unavailable on macOS, so GPU acceleration is Linux/CUDA only.

Why does HeartMuLa fail after installing with pip?

The pinned dependencies conflict with newer packages, requiring upgrades of datasets and transformers. Transformers 5.x also needs two source patches: a RoPE cache reinitialization fix and ignore_mismatched_sizes=True on HeartCodec loading.

What audio quality and length does HeartMuLa produce?

HeartMuLa outputs MP3 at 48kHz stereo, 128kbps, with a default maximum length of 240 seconds. Generation runs at roughly real-time, so a 4-minute song takes about 4 minutes on GPU.