AI Paper Atlas

Research map / Image generation / Editing and style transfer

Editable Image Elements for Controllable Synthesis

Jiteng Mu, Michaël Gharbi, Richard Zhang, Eli Shechtman, Nuno Vasconcelos, Xiaolong Wang, Taesung Park

ECCV 2024 · Image generation › Editing and style transfer · approach: Inversion-based diffusion editing · 11 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use staged training (content encoder first, then diffusion decoder) instead of joint training (ablation)editable image elements · LAION held-out reconstructionPSNR: 19.74 -> 22.98Improved
add staged training (joint training preferred only 34.2% of the time in editing) (ablation)editable image elements · MTurk editing preferencepreference vs ours (%): 34.2%Improved
freeze the content encoder when training the diffusion decoder (ablation)editable image elements · LAION held-out reconstructionPSNR: 21.35 -> 22.98Improved
freeze the content encoder (ablation)editable image elements · LAION held-out reconstructionFID: 10.48 -> 10.82Mixed
add random partition when dropping image elements during training (ablation)editable image elements · MTurk editing preferencepreference vs ours (%): 27.3%Improved
add random partition (ablation)editable image elements · LAION held-out reconstructionFID: 9.75 -> 10.82Mixed
replace SD conditioning with image-element diffusion decoder vs plain L2-trained AE bottleneckreconstruction · Reconstruction 5,000 samplesFID: 55.65 -> 10.82Improved
ours vs adversarially trained VAE on reconstructioneditable image elements · Reconstruction 5,000 samplesFID: 5.96 -> 10.82Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy