AI Paper Atlas

Research map / 3D vision / Face and shape

Expressive Telepresence via Modular Codec Avatars

Hang Chu, Shugao Ma, Fernando De la Torre, Sanja Fidler, Yaser Sheikh

ECCV 2020 · 3D vision › Face and shape · approach: Speech-driven 3D facial animation · 33 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add learned blending weights instead of equal weights (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 7.33 -> 6.67Improved
add end-to-end training (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 6.67 -> 6.10Improved
add soft exemplar latent codes with gaussian noise instead of hard classes (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 6.10 -> 5.71Improved
expand latent code dimension (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 5.71 -> 5.64Improved
add cross-module skip connections (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 5.64 -> 5.52Improved
add temporal convolution in the synthesizer (ablation)MCA · VR headset face dataset (test sessions), all test dataRMSE: 5.52 -> 5.48Improved
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), overallRMSE: 5.81 -> 5.48Improved
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), overallMAE: 6.54 -> 6.17Improved
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), overallSSIM: 0.953 -> 0.956Improved
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), all personsGeo. RMSE: 1.37 -> 1.17Mixed
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), person4SSIM: 0.984 -> 0.984No clear effect
replace holistic Codec Avatar with modular MCACodec Avatar · VR headset face dataset (test sessions), person3%-better: 0.3 -> 99.7Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy