AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Customized Generation Reimagined: Fidelity and Editability Harmonized

Jian Jin, Yang Shen, Zhenyong Fu, Jian Yang

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Multi-concept composition · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace manual prompt templates with learnable image-specific contexts (ICO) for fine-tuning (ablation)Stable Diffusion customization · 16 customization subjects (CLIP fidelity-editability curve)fidelity-editability trade-offImproved
increase concept-specific context length S (ablation)ICO prompt scheme · customization subsetconcept fidelity vs editabilityMixed
increase total image-specific context length M+L (ablation)ICO prompt scheme · customization subsetoverall trade-offImproved
add DCI dual-branch integration at inference on ICO fine-tuned modelICO · 16 customization subjectsconcept fidelity and text alignmentImproved
add DCI to ICOICO · User study vs DreamBoothtext alignment preference: 58.33 % -> 66.67 %Improved
add DCI to ICOICO · User study vs Custom Diffusionvisual alignment preference: 57.29 % -> 68.75 %Improved
increase injection strength lambda (ablation)DCI · qualitative examplestext alignment vs fidelityMixed
remove aggregation masks (directly add two branches) (ablation)DCI · qualitative samplesgeneration qualityHurt
use entire prompt for each branch instead of separated content prompts (ablation)DCI · qualitative samplesgeneration qualityImproved
aggregate branches at every cross-attention layer (deep aggregation) (ablation)DCI · qualitative samplesauxiliary branch injection capacityImproved
use DCI for counterfactual contexts such as swimming on the moonDCI · rare contextsprompt faithfulnessNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy