AI Paper Atlas

Research map / Video / Video generation

Co-speech Gesture Video Generation with 3D Human Meshes

Aniruddha Mahapatra, Richa Mishra, Ziyi Chen, Boyang Ding, Renda Li, Shoulei Wang, Jun-Yan Zhu, Peng Chang, Mei Han, Jing Xiao

ECCV 2024 · Video › Video generation · approach: Talking face generation · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use textured SMPL-X meshes as conditioning instead of 2D keypointsGAN video generator · TalkSHOW OliverLPIPS: 0.482 -> 0.408Improved
add textured meshes as conditioning (ablation)Mesh-grounded video generator · TalkSHOW SethLPIPS: 0.328 -> 0.312Improved
add textured meshes as conditioning (ablation)Mesh-grounded video generator · User study, Chemistry% users preferring Ours: 88%Improved
add depth and normal maps as conditioning (ablation)Mesh-grounded video generator · TalkSHOW OliverLPIPS: 0.407 -> 0.408No clear effect
add depth and normal maps as conditioning (ablation)Mesh-grounded video generator · User study, Chemistry% users preferring Ours: 42% prefer Ours on Chemistry; 66% on SethMixed
use a larger UV texture map (512 instead of 256) (ablation)Mesh texturing · TalkSHOWvisual qualityNo clear effect
use per-vertex textures instead of UV texture map (ablation)Mesh texturing · TalkSHOWvisual qualityNo clear effect
use dynamic NeRF (INST) instead of textured mesh representation (ablation)Appearance representation · TalkSHOWhand artifactsHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy