AI Paper Atlas

Research map / 3D vision / 3D generation

DreamSparse: Escaping from Plato’s Cave with 2D Diffusion Model Given Sparse Views

Paul Yoo, Jiaxian Guo, Yutaka Matsuo, Shixiang Shane Gu

NeurIPS 2023 · 3D vision › 3D generation · approach: Diffusion-based novel view synthesis

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add frozen Stable Diffusion prior with spatial guidance on top of geometry module (training categories) (ablation)DreamSparse · CO3D training categories avgFID: 191.21 -> 81.8Improved
add diffusion prior (training categories) (ablation)DreamSparse · CO3D training categories avgLPIPS: 0.33 -> 0.21Improved
add diffusion prior (training categories) (ablation)DreamSparse · CO3D training categories avgPSNR: 21.95 -> 22.03Mixed
add diffusion prior (open-set categories) (ablation)DreamSparse · CO3D open-set avgFID: 219.64 -> 122.2Improved
add diffusion prior (open-set categories) (ablation)DreamSparse · CO3D open-set avgPSNR: 20.66 -> 20.19Hurt
add diffusion prior (scene-level, 5 views) (ablation)DreamSparse · CO3D hydrant scene-levelFID: 216.34 -> 70.62Improved
add diffusion prior (scene-level, 5 views) (ablation)DreamSparse · CO3D hydrant scene-levelPSNR: 17.16 -> 14.15Hurt
DreamSparse vs SparseFusion on training categoriesDreamSparse · CO3D training categories avgFID: 172.6 -> 81.8Improved
DreamSparse vs SparseFusion on open-set categoriesDreamSparse · CO3D open-set avgFID: 212.9 -> 122.2Improved
increase context views from 1 to 5DreamSparse · CO3D hydrantFID: 75.63 -> 70.62Improved
increase context views from 1 to 5SparseFusion · CO3D hydrantFID: 272.72 -> 231.73Improved
spatial guidance weight lambda=0 (no guidance) (ablation)DreamSparse · qualitativeconsistencyHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy