Research map / 3D vision / Gaussian splatting
EmoDiffTalk: Emotion-aware Diffusion for Editable 3D Gaussian Talking Head
Chang Liu, Tianjiao Jing, Chengcheng Ma, Xuanqi Zhou, Zhengxuan Lian, Qin Jin, Hongliang Yuan, Shi-Sheng Huang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add AU codes to the diffusion transformer (Codes4P) (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | PSNR: 20.12 -> 25.78 | Improved |
| add AU codes to the diffusion transformer (Codes4P) (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | LMD: 6.25 -> 3.56 | Improved |
| add AU codes to OPCNet (Codes4O) (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | PSNR: 22.43 -> 25.78 | Improved |
| add AU codes to OPCNet (Codes4O) (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | LMD: 4.75 -> 3.56 | Improved |
| use diffusion transformer instead of GRU for point offsets (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | PSNR: 24.96 -> 25.78 | Improved |
| use diffusion transformer instead of GRU for point offsets (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | LPIPS: 0.21 -> 0.12 | Improved |
| use diffusion instead of GRU (ablation) | EmoDiffTalk · EmoTalk3D (ablation) | CPBD: 0.36 -> 0.36 | No clear effect |
| AU-code prompted Gaussian diffusion vs EmoTalk3D | EmoDiffTalk · EmoTalk3D | PSNR: 21.22 -> 25.78 | Improved |
| AU-code prompted diffusion vs Hallo3 | EmoDiffTalk · RenderMe-360 | LMD: 9.33 -> 6.59 | Improved |
| AU-code diffusion vs Hallo3 on sharpness | EmoDiffTalk · RenderMe-360 | CPBD: 0.30 -> 0.26 | Mixed |
| AU-code diffusion vs Hallo3 on perceptual similarity | EmoDiffTalk · RenderMe-360 | LPIPS: 0.14 -> 0.15 | No clear effect |
Closest papers by meaning
- EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusion (CVPR 2025 · similarity 0.90)
- DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animation (AAAI 2025 · similarity 0.88)
- Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style (AAAI 2024 · similarity 0.88)
- Hierarchically Controlled Deformable 3D Gaussians for Talking Head Synthesis (AAAI 2025 · similarity 0.86)
- Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control (ICLR 2025 · similarity 0.86)
- Playmate: Flexible Control of Portrait Animation via 3D-Implicit Space Guided Diffusion (ICML 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
