heartmula

Generate music from lyrics and tags using HeartMuLa models on local hardware.

3|Updated Mar 20, 2026
One-click install
npx skills add https://github.com/ever-oli/io --skill heartmula-ever-oli
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/ever-oli/io/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/ever-oli/io --skill heartmula-ever-oli

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

HeartMuLa enables offline, open-source music generation anchored on lyrics and tags, removing reliance on proprietary services to produce songs locally.

Core Features & Use Cases

  • Open HeartMuLaGen, HeartCodec, HeartTranscriptor, and HeartCLAP to generate music from lyrics and tags.
  • Local/offline generation with GPU support for fast turnaround.
  • Multilingual lyrics support and fine-grained control via tags; suitable for open-source music experiments and research.

Quick Start

Install the required environment, download the HeartMuLa checkpoints, and run the provided example script to generate music from lyrics and tags.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics locally without using proprietary services?

You can generate music from lyrics locally by running the HeartMuLa models on GPU-enabled hardware. This open-source approach removes reliance on proprietary services by using downloaded checkpoints and a Python environment for offline song creation.

What are the requirements for offline AI music generation with HeartMuLa?

Offline AI music generation requires CUDA-enabled PyTorch, downloaded model checkpoints, and a Python environment configured with the run script. A GPU-enabled machine is necessary to support the local processing and fast turnaround.

Can I use multilingual lyrics to create songs with open-source AI?

Yes, you can create songs using multilingual lyrics with open-source AI. The generation process supports multiple languages and provides fine-grained control over the musical output through descriptive tags.

How does lyric-driven music generation work with tags?

Lyric-driven music generation works by processing text lyrics alongside descriptive tags using models like HeartMuLaGen and HeartCLAP. These tags provide fine-grained control, guiding the local AI to shape the song's style and structure.

What is the best way to set up a local environment for lyric-driven song creation?

The best way to set up a local environment for lyric-driven song creation is to install CUDA-enabled PyTorch, download the HeartMuLa checkpoints, and configure the provided Python run script with optional lazy_load and device settings.

Are there limitations when generating music from lyrics on local hardware?

A key limitation of generating music from lyrics on local hardware is the strict requirement for CUDA-enabled PyTorch and a compatible GPU. Without these, the open-source models cannot process the generation workload offline.