AI Paper Atlas

Research map / 3D vision / Face and shape

AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction

Aggelina Chatziagapi, Dimitris Samaras

CVPR 2023 · 3D vision › Face and shape · approach: Face reflectance and relightable rendering · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add temporal modeling to video-only expression and jaw prediction (ablation)AVFace expression-jaw branch · FaceSetNME (%): 2.60 -> 1.98Improved
Add temporal modeling to audio-only expression and jaw prediction (ablation)AVFace expression-jaw branch · FaceSetNME (%): 2.80 -> 2.10Improved
Add modality dropout to the AV expression-jaw branch (ablation)AVFace · FaceSetNME (%): 2.91 -> 2.14Improved
Add temporal modeling to AV expression-jaw prediction with modality dropout (ablation)AVFace · FaceSetNME (%): 2.14 -> 1.73Improved
Add lip refinement to the AV expression-jaw model with dropout and temporal modeling (ablation)AVFace · FaceSetNME (lips) (%): 0.99 -> 0.91Improved
Use DeepSpeech instead of wav2vec 2.0 audio features (ablation)AVFace · FaceSetNME (lips) (%): 1.11 -> 0.91Improved
Use DeepSpeech instead of mel-spectrogram audio features (ablation)AVFace · FaceSetNME (%): 2.20 -> 1.63Improved
Fine-tune the coarse stage on synthetic face occlusions (ablation)AVFace · Synthetic test set with occlusionsNME (occ) (%): 2.62 -> 2.39Improved
Use AVFace instead of 3DDFA-V2Face reconstruction methods · FaceSetNME (lips) (%): 1.15 -> 0.91Improved
Use AVFace instead of DECAFace reconstruction methods · Synthetic test set with occlusionsNME (occ) (%): 3.89 -> 2.39Improved
Use AVFace instead of DECA3D face reconstruction methods · MultifaceMean 3D reconstruction error (mm): 2.01 -> 1.98Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy