AI Paper Atlas

Research map / Video / Video generation

Personalized Video Relighting With an At-Home Light Stage

Jun Myeong Choi, Max Christman, Roni Sengupta

ECCV 2024 · Video › Video generation · approach: Diffusion-based human image animation · 9 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add LCFN de-lighting of skip-connected features (ablation)relighting U-Net · LSYDLPIPS: 0.0964 -> 0.0904Improved
add source monitor lighting prediction from intermediate encoder features (ablation)relighting U-Net · LSYDLPIPS: 0.0964 -> 0.0915Improved
add both LCFN and source lighting prediction (ablation)relighting U-Net · LSYDLPIPS: 0.0964 -> 0.0853Improved
add skip-connected feature smoothing (exponential smoothing of de-lit LCFN features) (ablation)relighting U-Net · LSYD temporal consistencyadjacent-frame RMSE: 6.01 -> 5.68Improved
add source monitor lighting averaging over previous frames (ablation)relighting U-Net · LSYD temporal consistencyadjacent-frame RMSE: 6.01 -> 5.73Improved
add source-light averaging to Sengupta et al. (ablation)Sengupta et al. · LSYD temporal consistencyadjacent-frame RMSE: 6.37 -> 5.76Improved
use the proposed loss handling pose misalignment when training Sun et al. (ablation)Sun et al. · LSYDLPIPS: 0.1712 -> 0.1029Improved
use predicted source lighting instead of known source lighting (ablation)proposed relighting network · LSYDLPIPS: 0.0832 -> 0.0839No clear effect
use segmentation versus facial keypoints for pairing source and target images (ablation)training data construction · LSYDpair qualityImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy