heartmula

Generate music from lyrics and tags using open-source foundation models.

Updated Jul 13, 2026
One-click install
npx skills add https://github.com/zangjeicy/Hermes --skill heartmula-zangjeicy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/zangjeicy/Hermes/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/zangjeicy/Hermes --skill heartmula-zangjeicy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, torchtune, transformers, datasets, huggingface-hub, and includes assets (resource) components.

What problem does it solve?

This Skill solves the challenge of generating high-quality, original music from text-based lyrics and descriptive tags without requiring professional audio production skills or expensive proprietary software.

Core Features & Use Cases

  • Lyrics-to-Song Generation: Converts structured lyrics and mood tags into full-length, multi-track audio files.
  • High-Fidelity Codec: Utilizes the HeartCodec model to ensure professional-grade audio reconstruction.
  • Use Case: A content creator needs a unique, royalty-free background track for a video; they provide the lyrics and style tags to the agent, which then generates a custom song locally.

Quick Start

Use the heartmula skill to generate a song from the lyrics in assets/lyrics.txt and the tags in assets/tags.txt and save the output to output.mp3.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics and descriptive tags locally?

To generate music from lyrics and tags, provide structured text files and descriptive mood tags to the agent. The Skill uses open-source foundation models to convert them into high-fidelity, full-length audio files.

Do I need a CUDA-enabled GPU to run PyTorch audio generation models?

Yes, you need a CUDA-enabled GPU environment with PyTorch and specific model checkpoints to perform inference. The audio generation process relies on GPU acceleration to handle the foundation models.

Can I create multilingual songs using open-source text-to-audio models?

Yes, multilingual song creation is supported by this text-to-audio alignment approach. You provide the lyrics in your target language and descriptive tags to generate original music.

What is the best way to get royalty-free background music for video production?

Generating royalty-free background tracks using lyrics and style tags provides custom audio for media production. This approach uses a high-fidelity codec to ensure professional-grade audio reconstruction.

Does lyrics-to-song generation work with Hugging Face transformer models?

Yes, lyrics-to-song generation leverages transformer models and datasets from the Hugging Face ecosystem. It uses these open-source foundation models to condition audio synthesis on text inputs.

Why does high-fidelity audio reconstruction require specific model checkpoints?

High-fidelity audio reconstruction requires specific model checkpoints because the HeartCodec model depends on pre-trained weights to accurately rebuild professional-grade audio from generated codec representations.