heartmula

Generate music from lyrics and descriptive tags using a foundation model.

1|Updated Jul 31, 2026
One-click install
npx skills add https://github.com/icyzh/hermes-web --skill heartmula-icyzh
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/icyzh/hermes-web/tree/main/optional-skills/creative/heartmula
Command: npx skills add https://github.com/icyzh/hermes-web --skill heartmula-icyzh

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, torchtune, transformers, datasets, huggingface-hub, and includes assets (resource) components.

What problem does it solve?

This Skill solves the challenge of generating high-quality, original music from text-based inputs, providing an open-source alternative to proprietary AI music generators.

Core Features & Use Cases

  • Lyrics-to-Song Generation: Converts structured lyrics and descriptive tags into full-length audio tracks.
  • High-Fidelity Reconstruction: Utilizes a specialized 12.5Hz music codec for professional-grade audio output.
  • Use Case: A content creator can generate custom background music for a video project by providing specific mood tags and structural lyrics, ensuring a unique, royalty-free soundtrack.

Quick Start

Use the heartmula skill to generate a song from the lyrics file located at assets/lyrics.txt and the tags file at assets/tags.txt.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics and descriptive tags?

To generate music from lyrics, provide structured text files for lyrics and descriptive mood tags to process them into a full-length audio track. The system uses a foundation model architecture conditioned on these inputs to synthesize high-fidelity audio.

Do I need a CUDA-enabled GPU environment for local audio synthesis?

Yes, local audio synthesis requires a CUDA-enabled GPU environment with PyTorch and specific model checkpoints for optimal performance. The generation process relies on these hardware and software dependencies to run the foundation model architecture efficiently.

Can I use this for generating royalty-free background music for video projects?

Yes, you can generate custom royalty-free background music for video projects by providing specific mood tags and structural lyrics. This creates a unique soundtrack as an open-source alternative to proprietary AI music generators.

How does the 12.5Hz music codec work for audio generation?

The 12.5Hz music codec works by reconstructing professional-grade audio output from the foundation model's conditioning inputs. It enables high-fidelity audio synthesis from text, converting structured lyrics and tags into full-length audio tracks.

What's the best open-source alternative for AI music generation from text?

An open-source approach to AI music generation uses PyTorch and Transformers to condition foundation models on lyrics and tags. This provides an alternative to proprietary tools by supporting local audio synthesis for custom creative projects.