AI Paper Atlas

Research map / Video / Video generation

Neural Video Portrait Relighting in Real-Time via Consistency Modeling

Longwen Zhang, Qixuan Zhang, Minye Wu, Jingyi Yu, Lan Xu

ICCV 2021 · Video › Video generation · approach: Diffusion-based human image animation · 49 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add structure self-supervision (content) (ablation)Neural video portrait relighting · Synthesized sequencesRMSE: 0.0549 -> 0.0349Improved
add structure self-supervision (content) (ablation)Neural video portrait relighting · Synthesized sequencesPSNR: 25.5496 -> 30.6110Improved
add temporal consistency modeling (ablation)Neural video portrait relighting · Synthesized sequencesRMSE: 0.0404 -> 0.0349Improved
add temporal consistency modeling (ablation)Neural video portrait relighting · Synthesized sequencesPSNR: 28.6403 -> 30.6110Improved
add semantic parsing multi-task (ablation)Neural video portrait relighting · Synthesized sequencesRMSE: 0.0680 -> 0.0349Improved
add semantic parsing multi-task (ablation)Neural video portrait relighting · Synthesized sequencesPSNR: 23.6189 -> 30.6110Improved
add Beta-based lighting sampling (ablation)Neural video portrait relighting · Synthesized sequencesRMSE: 0.0616 -> 0.0349Improved
add Beta-based lighting sampling (ablation)Neural video portrait relighting · Synthesized sequencesSSIM: 0.9223 -> 0.9584Improved
add temporal consistency modeling (ablation)Neural video portrait relighting · Synthesized sequencesSSIM: 0.9510 -> 0.9584Improved
use proposed method instead of EMRCM (best baseline)Neural video portrait relighting · Dynamic OLAT test setPSNR: 22.7197 -> 30.6110Improved
use proposed method instead of SIPRNeural video portrait relighting · Dynamic OLAT test setSSIM: 0.8901 -> 0.9584Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy