AI Paper Atlas

Research map / Video / Video generation

Responsive Listening Head Generation: A Benchmark Dataset and Baseline

Mohan Zhou, Yalong Bai, Wei Zhang, Ting Yao, Tiejun Zhao, Tao Mei

ECCV 2022 · Video › Video generation · approach: Talking face generation · 70 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add speaker visual input to audio-only listener model (ablation)listener generator · ViCo D_testFD angle: 8.69 -> 7.79Improved
add speaker audio input to visual-only listener model (ablation)listener generator · ViCo D_testFD expression: 18.85 -> 15.04Improved
add speaker audio input to visual-only listener model (ablation)listener generator · ViCo D_testFD translation: 7.54 -> 6.52Improved
add speaker audio and visual input versus mirroring the speaker (ablation)listener generator · ViCo D_testFD expression: 26.48 -> 15.04Improved
use correct audio instead of wrong audio (ablation)listener generator · ViCo D_testFD expression: 18.02 -> 15.04Improved
use auto-regressive LSTM decoder instead of parallel non-sequential layers (ablation)listener generator · ViCo D_testFD expression: 18.50 -> 15.04Improved
use auto-regressive LSTM decoder instead of parallel non-sequential layers (ablation)listener generator · ViCo D_testFD translation: 7.06 -> 6.52Improved
use learned responsive model instead of random perturbationlistener generator · ViCo D_testFD expression: 44.67 -> 15.04Improved
use learned model instead of repeating sampled motion patterns (Simulation)listener generator · ViCo D_oodFD expression: 28.66 -> 22.83Improved
condition simulated motion patterns on the matching attitude (Simulation*)Simulation baseline · ViCo D_testFD angle: 10.81 -> 11.24No clear effect
audio input gives expression, visual input gives head motion (ablation)listener generator · ViCo D_testFD expression vs angle: 17.19 -> 18.85Mixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy