heartmula

Generate music tracks from lyrics and descriptive tags using a local foundation model.

Updated Jun 25, 2026
One-click install
npx skills add https://github.com/Rheasilvia/hermes-desktop --skill heartmula-rheasilvia
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/Rheasilvia/hermes-desktop/tree/main/optional-skills/creative/heartmula
Command: npx skills add https://github.com/Rheasilvia/hermes-desktop --skill heartmula-rheasilvia

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, torchtune, transformers, datasets, huggingface-hub, and includes assets (resource) components.

What problem does it solve?

This Skill solves the challenge of creating high-quality, original music locally without relying on closed-source cloud services, enabling users to generate songs directly from text-based lyrics and descriptive tags.

Core Features & Use Cases

  • Lyrics-to-Song Generation: Converts structured lyrics and mood tags into full-length audio tracks.
  • High-Fidelity Reconstruction: Utilizes the HeartCodec model to ensure professional-grade audio output.
  • Use Case: A content creator needs a unique, royalty-free background track for a video; they provide the lyrics and style tags to the model to generate a custom song locally on their workstation.

Quick Start

Use the heartmula skill to generate a new song from the lyrics file located at assets/lyrics.txt and the tags file at assets/tags.txt.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate high-fidelity music from lyrics locally?

Yes, you can generate multilingual songs locally by providing lyrics and style tags to the foundation model. It supports multilingual song creation and high-fidelity audio reconstruction for creative workflows.

Do I need a CUDA-enabled GPU to run local music generation?

Yes, you need a CUDA-enabled GPU environment to run local audio generation. The inference process requires specific Python dependencies including torch, transformers, and model checkpoints to function properly.

Can I generate royalty-free background music for videos using text tags?

Yes, you can generate royalty-free background music for videos using text tags. Provide your descriptive mood tags and lyrics to the model to create unique, custom audio tracks locally for media production.

What is the best way to convert text lyrics into a full audio track?

The best way to convert text lyrics into a full audio track is using a local foundation model architecture with HeartCodec. This approach ensures professional-grade, high-fidelity audio output directly from your workstation.

How do I start text-to-song generation with model checkpoints?

To start text-to-song generation, load your model checkpoints and pass your lyrics file and tags file to the local inference pipeline. The model processes these inputs to generate the final audio track.

Are there limitations when using local foundation models for audio reconstruction?

A key limitation of using local foundation models for audio reconstruction is the hardware requirement. You must maintain a CUDA-enabled GPU environment and correctly manage specific Python dependencies to ensure successful inference.