wan-multitalk

Builds WAN MultiTalk audio-driven lip-sync talking-avatar video workflows in ComfyUI.

715|111|Updated Feb 15, 2026
One-click install
npx skills add https://github.com/artokun/comfyui-mcp --skill wan-multitalk
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: wan-multitalk
Source: https://github.com/artokun/comfyui-mcp/tree/main/plugin/skills/wan-multitalk
Command: npx skills add https://github.com/artokun/comfyui-mcp --skill wan-multitalk

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Creating a talking-avatar or lip-synced video from a still portrait and an audio track requires wiring a complex ComfyUI graph across WAN 2.1 I2V, Wav2Vec speech embeddings, and the MultiTalk head, plus sourcing the correct model files. This Skill provides the complete node graph, model manifest, and parameter guidance to do it correctly.

Core Features & Use Cases

  • Audio-driven lip-sync pipeline: Full node graph using kijai's WanVideoWrapper with MultiTalkWav2VecEmbeds conditioning the WAN 2.1 14B I2V sampler so mouth and expression follow speech.
  • Model manifest and loaders: Exact checkpoint list (WAN 2.1 14B GGUF, MultiTalk fp8, UMT5 fp16, VAE, CLIP vision, lightx2v distill LoRA) with the correct loader and folder for each.
  • VRAM tier guidance: Configurations from ~6 GB low-VRAM (BlockSwap, GGUF quant) up to 720p, plus launch-flag recommendations like --use-sage-attention and --reserve-vram.
  • Use Case: Dub a portrait photo with a voiceover track to produce a ~10 second 480p lip-synced talking-head clip, with audio separation isolating the voice from background music first.

Quick Start

Use the wan-multitalk skill to build a ComfyUI workflow that animates this portrait image to lip-sync with my audio track.

Frequently Asked Questions about wan-multitalk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a lip-sync talking avatar video in ComfyUI?

Use the WAN MultiTalk pipeline: load a portrait and audio, isolate the voice with AudioSeparation, generate Wav2Vec embeddings via MultiTalkWav2VecEmbeds, and condition the WAN 2.1 14B I2V sampler through WanVideoImageToVideoMultiTalk. The output is decoded and muxed to mp4 with VHS_VideoCombine.

What is the difference between WAN MultiTalk and wan-animate?

MultiTalk is audio-driven: it lip-syncs a portrait to a speech track using Wav2Vec embeddings. wan-animate is pose and motion driven, transferring movement from a reference video to a character. Use MultiTalk for talking heads and dubbing, not motion transfer.

How much VRAM does WAN MultiTalk need?

The base 480p 10-second configuration needs roughly 8-12 GB VRAM. A low-VRAM variant reaches 6-8.4 GB using more BlockSwap, GGUF quantization, and lower quality settings, while 720p requires about 11-16 GB.

Why is the lip-sync in my MultiTalk render inaccurate?

Poor lip-sync usually comes from skipping AudioSeparation on music-heavy audio, so the mouth chases the wrong signal. Also verify the MultiTalk embeds are actually wired into WanVideoImageToVideoMultiTalk and that the audio is not silent after AudioCrop.

Can WAN MultiTalk handle multiple speakers in one video?

No, this graph is single-speaker only. Multi-speaker MultiTalk requires a multi-embed variant that is not included in this pack.