heartmula

Generate music from lyrics and tags using a neural network model.

Updated May 25, 2026
One-click install
npx skills add https://github.com/webdevtodayjason/subctl-rust --skill heartmula-webdevtodayjason
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/webdevtodayjason/subctl-rust/tree/main/skills/heartmula
Command: npx skills add https://github.com/webdevtodayjason/subctl-rust --skill heartmula-webdevtodayjason

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires python, pytorch, datasets, transformers, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

HeartMuLa addresses the need for music generation from text descriptions, providing an open-source alternative to Suno-like tools.

Core Features & Use Cases

  • Music Generation: Create full songs from lyrics and tags.
  • Multilingual Support: Generate music in various languages.
  • Use Case: Ideal for users who want to produce music based on specific themes or moods without writing music from scratch.

Quick Start

Generate music from a set of lyrics and tags by using HeartMuLa with the following command:

python ./examples/run_music_generation.py \
  --model_path=./ckpt \
  --version="3B" \
  --lyrics="./assets/lyrics.txt" \
  --tags="./assets/tags.txt" \
  --save_path="./assets/output.mp3" \
  --lazy_load true

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics and tags using an open-source AI model?

To generate music from lyrics and tags, use a neural network model that processes text descriptions to create full songs. You need Python, PyTorch, and specific model checkpoints to run the generation script and output an MP3 file.

Can I create multilingual AI music without using Suno-like closed tools?

Yes, you can create multilingual AI music as an open-source alternative to Suno-like tools. This neural network model supports generating full songs from lyrics and tags in various languages, requiring Python, PyTorch, and specific checkpoints.

What dependencies do I need to run an AI music generation script locally?

To run AI music generation locally, you need Python, PyTorch, datasets, and transformers installed. You also need to download the specific model checkpoints and provide your lyrics and tags as text files.

How do I start a text-to-music generation task with PyTorch and transformers?

Start text-to-music generation by executing the provided Python script with parameters for model path, version, lyrics file, tags file, and save path. This neural network processes the inputs and outputs a generated audio track.

Does this open-source music generation model support lazy loading for large checkpoints?

Yes, the open-source music generation model supports lazy loading. You can pass the lazy load flag in the execution command to manage memory usage when loading large model checkpoints for generating audio from lyrics and tags.