Research map / 3D vision / Face and shape
Neural Emotion Director: Speech-Preserving Semantic Control of Facial Expressions in "In-the-Wild" Videos
Check your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use NED instead of GANmut | MEAD self-translation · MEAD self-translation, avg. (7) | FID: 4.3 -> 2.9 | Helped |
| Use NED instead of GANmut | MEAD user study · MEAD user study, avg. | Emotion recognition accuracy: 77% -> 35% | Hurt |
| Use NED instead of GANmut | MEAD user study · MEAD user study, avg. | Realism ratings (4 or 5): 11% -> 28% | Helped |
| Add detailed shape images as renderer conditioning (ablation) | NED face renderer · YouTube Actors renderer self-reenactment | MAPD: 13.27 -> 12.20 | Helped |
| Add face alignment (ablation) | NED face renderer · YouTube Actors renderer self-reenactment | MAPD: 14.59 -> 12.20 | Helped |
| Add meta-renderer pretraining (ablation) | NED face renderer · YouTube Actors renderer self-reenactment | MAPD: 12.20 -> 11.66 | Helped |
| Add the speech-preserving jaw-opening correlation loss (ablation) | NED emotion manipulator · Speech-preserving emotion translation | Preservation of mouth movement | Helped |
Closest papers by meaning
- DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animation (AAAI 2025 · similarity 0.88)
- RealPortrait: Realistic Portrait Animation with Diffusion Transformers (AAAI 2025 · similarity 0.86)
- EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars (CVPR 2024 · similarity 0.86)
- Learning Adaptive Spatial Coherent Correlations for Speech-Preserving Facial Expression Manipulation (CVPR 2024 · similarity 0.86)
- Emotional Face-to-Speech (ICML 2025 · similarity 0.86)
- KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolation (CVPR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.