AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

ReGround: Improving Textual and Spatial Grounding at No Cost

Phillip Y. Lee, Minhyuk Sung

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Compositional text-to-image guidance · 4 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
rewire gated self-attention and cross-attention from sequential to parallel at inference timepretrained GLIGEN · MS-COCO-2014CLIP score: 30.44 -> 31.29Improved
rewire to parallel attention (spatial grounding preserved)pretrained GLIGEN · MS-COCO-2014YOLO score: 58.13 -> 56.96No clear effect
rewire to parallel attention on counting promptspretrained GLIGEN · NSR-1K-GPT CountingCLIP score: 32.46 -> 33.20Improved
reduce gated self-attention activation to the first 0.1 of steps (scheduled sampling) (ablation)GLIGEN · MS-COCO-2014YOLO score: 58.13 -> 22.75 (CLIP 30.44 -> 31.65)Hurt
reduce gated self-attention activation to the first 0.1 of steps (ablation)GLIGEN · NSR-1K-GPT CountingYOLO score: 65.36 -> 26.38Hurt
remove cross-attention after gated self-attention in GLIGEN (ablation)GLIGEN · qualitative cat/people examplesspatial groundingNo clear effect
rewire to parallel attention when 50% of category boxes are dropped (COCO-Drop)pretrained GLIGEN · COCO-DropCLIP score gap: gap 1.57 times that of original MS-COCO-2017Improved
rewire GLIGEN to parallel attentionGLIGEN · MS-COCO-2017FIDImproved
rewire GLIGEN to parallel attentionGLIGEN · user study (92 valid participants)preference rate (%): 29.95 -> 70.05Improved
use ReGround rewired GLIGEN as backbone for BoxDiffBoxDiff · NSR-1K-GPTCLIP score at same spatial accuracyImproved
apply rewiring to GLIGEN trained on SD v2.1GLIGEN (SD v2.1) · MS-COCOCLIP score vs YOLO scoreImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy