AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion

Shitao Tang, Fuyang Zhang, Jiacheng Chen, Peng Wang, Yasutaka Furukawa

NeurIPS 2023 · Image generation › Text-to-image diffusion · approach: Layout-to-image control · 26 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add correspondence-aware attention across views to stable diffusion (ablation)MVDiffusion panorama · Matterport3D panorama consistencyPSNR ratio: 0.28 -> 0.67Improved
add correspondence-aware attention across views to stable diffusion (ablation)MVDiffusion depth-to-image · ScanNet consistencyPSNR ratio: 0.44 -> 0.76Improved
generate all views in parallel with CAA instead of iterative warping and inpaintingpanorama generation · Matterport3DFID: 42.13 -> 21.44Improved
generate all views in parallel with CAA instead of iterative warping and inpainting (RePaint)depth-to-image generation · ScanNetFID: 70.05 -> 23.10Improved
use frozen SD with CAA instead of fine-tuning SD on panoramaspanorama generation · Matterport3DFID: 23.02 -> 21.44Improved
adapt SD for multi-view generation versus original perspective SDMVDiffusion · Matterport3D panoramaFID: 25.59 -> 21.44No clear effect

Later papers that compared with this method

7 later accepted papers report MVDiffusion as a baseline in their results tables; 4 of them report a better number on most of the results they share with it.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy