heartmula

Generate music from lyrics and tags using HeartMuLa models.

Updated Apr 27, 2026
One-click install
npx skills add https://github.com/x-TheFox/Corvus --skill heartmula-x-thefox
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heartmula
Source: https://github.com/x-TheFox/Corvus/tree/main/skills/media/heartmula
Command: npx skills add https://github.com/x-TheFox/Corvus --skill heartmula-x-thefox

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes assets (resource) components.

What problem does it solve?

HeartMuLa provides open-source tools to generate music conditioned on lyrics and tags, enabling offline, customizable music creation without relying on proprietary models. It encompasses a family of components (HeartMuLa, HeartCodec, HeartTranscriptor, HeartCLAP) to deliver end-to-end music generation, audio encoding, transcription, and alignment.

Core Features & Use Cases

  • HeartMuLa: music language model (3B/7B) for generation from lyrics + tags
  • HeartCodec: 12.5Hz music codec for high-fidelity audio reconstruction
  • HeartTranscriptor: Whisper-based lyrics transcription
  • HeartCLAP: Audio-text alignment model

Use cases include generating songs from lyrics and tags locally, building custom music generation apps, and offline workflows for creative production.

Quick Start

Run a local generation workflow using the provided assets and models to synthesize music from a lyrics file and a tags file.

Frequently Asked Questions about heartmula

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate music from lyrics offline using local hardware?

Open-source music generation from lyrics and tags allows offline creation using local hardware. This Skill provides models and assets to synthesize audio directly from text inputs without relying on cloud APIs or proprietary services.

Can I use multilingual lyrics for local music generation?

Yes, local music generation workflows support multilingual lyric inputs. The integrated transcription component processes various languages, enabling you to condition the music generation models on diverse linguistic text.

What is a music codec and how does it reconstruct high-fidelity audio?

A music codec encodes audio into a compressed representation and decodes it back. The included 12.5Hz codec reconstructs high-fidelity audio from the generated outputs, ensuring the final synthesized music retains rich acoustic quality.

Does open-source music generation work with multi-hardware environments?

Open-source music generation supports multi-hardware environments for offline workflows. The provided installation steps and models allow you to configure and run the generation process on various local hardware setups.

How do I align generated audio with text tags during music synthesis?

Audio-text alignment is achieved using a dedicated alignment model during the music synthesis workflow. This ensures the generated audio accurately matches the conditioning tags and lyrics you provided as input.