heartmula

Orchestrate HeartMuLa music generation from lyrics and tags locally.

1|Updated Mar 22, 2026
One-click install
npx skills add https://github.com/nelohenriq/hermes-agent-plus --skill heartmula-nelohenriq
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/nelohenriq/hermes-agent-plus/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/nelohenriq/hermes-agent-plus --skill heartmula-nelohenriq

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

HeartMuLa enables building and running an open-source music generation pipeline that creates full songs conditioned on lyrics and descriptive tags, with multilingual support.

Core Features & Use Cases

  • Open-source music models HeartMuLaGen, HeartCodec, HeartTranscriptor, and HeartCLAP generate music from text and tags.
  • Local/offline generation capability for on-device workflows.
  • Use Case: Create a simple song from provided lyrics and mood tags for a customizable music assistant.

Quick Start

Install the HeartMuLa environment and run a basic generation workflow using the provided checkpoints and scripts.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics using an open-source model locally?

Generate music from lyrics locally by orchestrating the HeartMuLa pipeline, which coordinates HeartMuLaGen, HeartCodec, HeartTranscriptor, and HeartCLAP to create full songs conditioned on text and tags completely offline.

What hardware do I need to run open-source music generation models?

Open-source music generation requires a CUDA-enabled GPU to execute the local HeartMuLa pipeline, alongside specific model checkpoints and a Python environment configured with necessary dependencies and repository patches.

Can I use multilingual lyrics for local AI music generation?

AI music generation supports multilingual lyrics through the HeartMuLa pipeline, allowing you to condition full song creation on text inputs across multiple languages alongside descriptive mood tags.

How does the HeartMuLa pipeline coordinate audio generation from text tags?

The HeartMuLa pipeline coordinates audio generation by routing text and tags through HeartMuLaGen, HeartCodec, HeartTranscriptor, and HeartCLAP, processing lyrical conditioning and descriptive tags to synthesize full songs.

What's the best way to set up an offline text-to-music generation environment?

Set up offline text-to-music generation by installing the HeartMuLa Python environment, applying repository patches, downloading model checkpoints, and executing the provided scripts for local song creation.

Why does local AI music generation require specific Python environment patches?

Local AI music generation requires Python environment patches to ensure compatibility across the HeartMuLaGen, HeartCodec, HeartTranscriptor, and HeartCLAP components, enabling stable offline execution of the generation pipeline.