AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

SmartControl: Enhancing ControlNet for Handling Rough Visual Conditions

Xiaoyu Liu, Yuxiang Wei, Ming Liu, Xianhui Lin, Peiran Ren, xuansong xie, Wangmeng Zuo

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Layout-to-image control · 29 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
predict a spatially local control scale map instead of a fixed scale (ablation)SmartControl · Depth rough conditionCLIP Score: 0.268 -> 0.274Improved
predict local scale map instead of one global scale (ablation)SmartControl · Depth rough conditionCLIP Score: 0.272 -> 0.274Improved
train control scale predictor instead of fine-tuning ControlNet (ablation)SmartControl · Depth rough conditionCLIP Score: 0.248 -> 0.274Improved
train control scale predictor instead of an adapter (ablation)SmartControl · Depth rough conditionSelf-similarity distance: 0.192 -> 0.128Improved
use convolution predictor instead of cross-attention (ablation)SmartControl · Depth rough conditionCLIP Score / time: CLIP 0.272 -> 0.274; time 7.69 -> 7.36Improved
increase training set size from 500 to 2000 images (ablation)SmartControl · Depth rough conditionClass Confidence: 0.740 -> 0.742Improved
add conflict/background regularization loss L_c (ablation)SmartControl · Qualitativelayout control and artifactsImproved
SmartControl versus ControlNet alpha=1.0 on structure preservationSmartControl · Depth rough conditionSelf-similarity distance: 0.100 -> 0.128Hurt
SmartControl versus fixed-scale ControlNet on canny Class ConfidenceSmartControl · Canny rough conditionClass Confidence: 0.736 -> 0.721Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy