wan-multitalk

Featured

Build WAN MultiTalk audio-driven talking-avatar / lip-sync video workflows — MeiGen-AI MultiTalk on WAN 2.1 14B I2V via kijai WanVideoWrapper (portrait + audio → lip-synced video)

AI & Automation 450 stars 76 forks Updated today MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
88
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# WAN MultiTalk — Audio-Driven Talking Avatar ## Overview MultiTalk (MeiGen-AI) drives a **still portrait's lip-sync and head motion from an audio track**. It runs on WAN 2.1 14B Image-to-Video via kijai's **ComfyUI-WanVideoWrapper**: Wav2Vec speech embeddings condition the WAN sampler so the mouth/expression follow the speech, while the lightx2v step-distill LoRA keeps it to a few sampling steps. Use it for talking heads, dubbing, and single-speaker avatar clips (~10s at 480p). It is **distinct from `wan-animate`** (pose/motion-driven character animation) — this is *audio → lip-sync*, not reference-video motion transfer. Pack: `wan-multitalk` (480p, ~10s). Higher-res/longer variants exist in the source bundle (720p, long-context) as VRAM/duration knobs on the same graph. ## Pipeline (node graph) ``` LoadImage (portrait) ─┐ LoadAudio ─ AudioSeparation ─ AudioCrop ─ DownloadAndLoadWav2VecModel ─ MultiTalkWav2VecEmbeds ─┐ ▼ WanVideoModelLoader (WAN 2.1 14B I2V GGUF) ─ MultiTalkModelLoader ─ WanVideoLoraSelect (lightx2v) + LoadWanVideoT5TextEncoder (umt5) + WanVideoTextEncode + WanVideoClipVisionEncode (clip_vision_h) + WanVideoVAELoader ──────────────────────────────────────────────────────────────────────────┘ ▼ WanVideoImageToVideoMultiTalk ─ WanVideoSampler ─ WanVideoDecode ─ VHS_VideoCombine ...

Details

Author
artokun
Repository
artokun/comfyui-mcp
Created
5 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

wan-t2v-video

Build WAN 2.2 Text-to-Video workflows — dual hi-lo models, lightning LoRAs, VACE modules, and KSamplerAdvanced two-pass

450 Updated today
artokun
AI & Automation Featured

wan-flf-video

Build WAN 2.2 First-Last-Frame video workflows — native dual hi-lo (required), and WanVideoWrapper VACE approaches

450 Updated today
artokun
Code & Development Listed

talking-head-video

Turn a raw 口播 / talking-head selfie video plus its script into a finished explainer, vertical 9:16 or landscape 横屏 16:9 — synced burned-in subtitles, animated knowledge graphics in three selectable styles (darkcard 深色科技卡 default, watercolor 纸上水彩, inkline 白纸简笔; both style and orientation are confirmed with the user first), and a circular picture-in-picture avatar that shrinks the speaker to the top-left while a graphic or B-roll fills the screen during explanations. THE pipeline whenever someone has a clip of a person talking to camera and wants it "剪成成片", subtitles auto-added from a 逐字稿/脚本, the 画面 to "切成图/弹图表/做大数字特效" on key points while the "人脸/人头缩小、放到角落、变成圆形头像/画中画/小圈圈", or Remotion/ffmpeg 动态讲解图 cut into a 口播/讲解/知识科普短视频 for 视频号/抖音/B站/Shorts. Also covers standalone 知识卡/概念卡/章节卡 in any of the three styles (水彩/简笔画/ 深色卡) without a source video. Partial asks count: "帮我剪口播", "自动加字幕配动态图", "源视频和脚本都有帮我合成成片". NOT for: writing a 口播脚本, 数字人/AI 主播 reading a script, multi-cam cutting, PPT→video, video compression, audio→text

3 Updated 1 weeks ago
Vibetool