AI Paper Atlas

Research map / Video / Video generation

Stable Video Portraits

Mirela Ostrek, Justus Thies

ECCV 2024 · Video › Video generation · approach: Trajectory-guided motion control · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
reduce training data from 100% to 6.25% of frames (ablation)Stable Video Portraits · Obama sequencePSNR: 33.78 -> 20.99Hurt
reduce training data from 100% to 50% of frames (ablation)Stable Video Portraits · Obama sequenceLPIPS: 0.016 -> 0.016No clear effect
use SVP instead of PECHead on perceptual metricsStable Video Portraits · Monocular head avatarsLPIPS: 0.034 -> 0.026Improved
use SVP instead of PECHead on FIDStable Video Portraits · Monocular head avatarsFID: 23 -> 11Improved
SVP versus best baselines on pixel metrics (PSNR, SSIM, MSE)Stable Video Portraits · Monocular head avatarsPSNR/SSIM/MSE: PSNR 31.4 vs 31.4; SSIM 0.9445 vs 0.9487; MSE 0.0010 vs 0.0009No clear effect
drop the previous-frame information in the denoising (original scheme) (ablation)Stable Video Portraits · Video generationtemporal stability (qualitative)Hurt
increase influence of previous frame (w_p) (ablation)Stable Video Portraits denoising · Video generationsmoothness vs sharpnessMixed
use 5 consecutive 3DMM meshes as conditioning instead of 1 (ablation)Stable Video Portraits ControlNet · Video generationtemporal smoothness (qualitative)Improved
use person-specific fine-tuning instead of a person-generic model trained on FFHQ and CelebA-HQ (ablation)Stable Video Portraits · Video generationidentity consistency (qualitative)Improved
lower ControlNet strength below 0.5 for face morphing (ablation)Celeb face morphing · Face morphingtemporal stability and 3DMM controlHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy