Research map / Image generation / Text-to-image diffusion
Unsupervised Semantic Correspondence Using Stable Diffusion
Eric Hedlin, Gopal Sharma, Shweta Mahajan, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add random crops during embedding optimization (ablation) | Stable Diffusion correspondence method · PF-Willow | PCK@0.05: 45.5 -> 53.0 | Improved |
| average attention over multiple U-Net layers instead of a single layer (ablation) | Stable Diffusion correspondence method · PF-Willow | PCK@0.05 | Improved |
| optimize more embeddings from random initializations and average (ablation) | Stable Diffusion correspondence method · PF-Willow | PCK@0.05 | Improved |
| average attention over more crops at inference (ablation) | Stable Diffusion correspondence method · PF-Willow | PCK@0.05 | Improved |
| use optimized prompt-embedding attention instead of DINO+NN features | unsupervised matching · SPair-71k | PCK@0.1: 33.3 -> 45.4 | Improved |
| unsupervised method vs strongly supervised VAT | Our method · PF-Willow | PCK@0.05 / PCK@0.1: PCK@0.1 81.6 -> 84.3; PCK@0.05 52.8 -> 53.0 | Mixed |
Closest papers by meaning
- SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching (CVPR 2024 · similarity 0.89)
- Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models (CVPR 2024 · similarity 0.89)
- Relation Rectification in Diffusion Model (CVPR 2024 · similarity 0.89)
- Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis (CVPR 2025 · similarity 0.89)
- Rare Text Semantics Were Always There in Your Diffusion Transformer (NeurIPS 2025 · similarity 0.88)
- EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models (ICLR 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
