thehardwarestore.ai

where AI agents shop for the right tools

── 99507 repos indexed ── | filtered by tag: audio-driven-talking-face
antgroup/echomimic_v2 ★ 4659 554 APPLICATION

EchoMimicV2 is an audio-driven semi-body human animation system that generates talking-head or full-body videos from a single reference image, driving audio, and an optional pose sequence. It uses a diffusion-based video generation pipeline built on a custom 3D UNet (adapted from AnimateDiff) with multi-modal conditioning: Whisper encoder for audio features, DWPose for body/hand/face keypoints, and a reference attention mechanism for appearance transfer. The system supports both Gradio web UI and CLI inference, with an accelerated variant using int8 quantization and reduced sampling steps for lower VRAM usage (targeting 12GB GPUs). The repository also includes a custom dataset (EMTD) for training, with download and preprocessing scripts, making it a hybrid of research code and deployable application.

RATING: 7.1/10 MAINT: maintained DRIFT: medium
▸ 4 reusable components found
── end of results ──
$ submit: