What problem does it solve?
Creating a talking-avatar or lip-synced video from a still portrait and an audio track requires wiring a complex ComfyUI graph across WAN 2.1 I2V, Wav2Vec speech embeddings, and the MultiTalk head, plus sourcing the correct model files. This Skill provides the complete node graph, model manifest, and parameter guidance to do it correctly.
Core Features & Use Cases
- Audio-driven lip-sync pipeline: Full node graph using kijai's WanVideoWrapper with MultiTalkWav2VecEmbeds conditioning the WAN 2.1 14B I2V sampler so mouth and expression follow speech.
- Model manifest and loaders: Exact checkpoint list (WAN 2.1 14B GGUF, MultiTalk fp8, UMT5 fp16, VAE, CLIP vision, lightx2v distill LoRA) with the correct loader and folder for each.
- VRAM tier guidance: Configurations from ~6 GB low-VRAM (BlockSwap, GGUF quant) up to 720p, plus launch-flag recommendations like --use-sage-attention and --reserve-vram.
- Use Case: Dub a portrait photo with a voiceover track to produce a ~10 second 480p lip-synced talking-head clip, with audio separation isolating the voice from background music first.
Quick Start
Use the wan-multitalk skill to build a ComfyUI workflow that animates this portrait image to lip-sync with my audio track.