heartmula

Generate songs from lyrics and tags using Python music processing libraries.

Updated Jun 26, 2026
One-click install
npx skills add https://github.com/NITISH-gitbit/hermes-custom --skill heartmula-nitish-gitbit
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/NITISH-gitbit/hermes-custom/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/NITISH-gitbit/hermes-custom --skill heartmula-nitish-gitbit

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires transformers, datasets, torchtune, pytorch, numpy, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

HeartMuLa helps users create songs by providing lyrics and tags, making music generation more accessible and customizable.

Core Features & Use Cases

  • Lyrics-Driven Generation: Users can create songs based on provided lyrics and tags.
  • Music Language Model: Features HeartMuLa, HeartCodec, HeartTranscriptor, and HeartCLAP models for various stages of music creation.
  • Open-Source: Open-source Apache-2.0 licensed models provide transparency and customization.
  • Use Case: Ideal for artists or enthusiasts who want to generate custom songs based on their lyrics and desired style.

Quick Start

To generate a song using HeartMuLa, use the following command: python ./examples/run_music_generation.py --model_path ./ckpt --version "3B" --lyrics ./assets/lyrics.txt --tags ./assets/tags.txt --save_path ./assets/output.mp3

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics using an open-source AI model?▼

Generate music from lyrics by passing your text files and tags to the model via a Python script. The HeartMuLa model processes the lyrics and tags to produce a custom audio track saved as an mp3 file.

Can I create background music for films or games using lyrics-based music generation?▼

Lyrics-based music generation supports creating background music for films or games. You provide the lyrics and style tags, and the model generates audio tailored to your specific project requirements.

Do I need PyTorch and transformers installed to run lyrics to song generation?▼

Yes, you need Python with PyTorch, transformers, datasets, and numpy installed. These dependencies handle the model loading, music processing, and encoding required for audio generation.

What is the best way to generate a custom song for an artist using lyrics and tags?▼

The best way to generate a custom song is using the provided Python generation script. Specify the model path, lyrics file, tags file, and output save path to create your customized track.

Does lyrics to music generation work with Apache-2.0 licensed models for commercial use?▼

Lyrics to music generation works with Apache-2.0 licensed models. This open-source license provides transparency and allows customization, making it suitable for personal and commercial music creation projects.

What limitations exist when generating songs from lyrics with open-source AI?▼

Limitations of generating songs from lyrics include requiring specific Python music processing libraries and adequate hardware to run the 3B model. You must format your lyrics and tags as text files before execution.