AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Real-time 3D-aware Portrait Editing from a Single Image

Qingyan Bai, Zifan Shi, Yinghao Xu, Hao Ouyang, Qiuyu Wang, Ceyuan Yang, Xuan Wang, Gordon Wetzstein, Yujun Shen, Qifeng Chen

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Multi-subject personalization · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
distill into a feedforward module instead of 2D editing followed by Live3D inversionIP2P+Live3D · FFHQ 100 pairsInference time: 10s -> 0.04sImproved
distill into a feedforward module instead of IP2P+Live3DIP2P+Live3D · FFHQ 100 pairsCLIP_r: 0.62 -> 0.73Improved
3DPE versus Live3D+StyleCLIP on identity3DPE · FFHQ 100 pairsID_t: 0.63 vs 0.47Hurt
add 3D distillation loss L_3D from Live3D (ablation)3DPE · FFHQ qualitativegeometry qualityImproved
add 2D distillation loss L_2D from diffusion prior (ablation)3DPE · FFHQ qualitativetexture detailImproved
increase pretraining styles from 3 to 20 (ablation)customized prompt adaptation · golden statue adaptationLPIPS after 5min: 0.5220 -> 0.4849Improved
increase pretraining styles from 3 to 20 (ablation)customized prompt adaptation · golden statue adaptationLPIPS after 0.1min: 0.7758 -> 0.5703Improved
increase tuning pairs from 2 to 50 (ablation)customized prompt adaptation · golden statue adaptationLPIPS after 5min: 0.5212 -> 0.4797Improved
increase tuning pairs from 10 to 50 (ablation)customized prompt adaptation · golden statue adaptationLPIPS after 1min: 0.5242 -> 0.5718Hurt
train only prompt encoder and decoder while freezing the rest of Live3D3DPE · trainingconvergence speedImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy