AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image

Yoonwoo Jeong, Jinwoo Lee, Chiheon Kim, Minsu Cho, Doyup Lee

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Layout-to-image control · 7 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
generate 4 target views jointly instead of 1 (ablation)NVS-Adapter · Google Scanned Objects (16 views)PSNR: 14.38 -> 19.01Improved
increase target views from 4 to 6 (ablation)NVS-Adapter · Google Scanned ObjectsPSNR: 19.01 -> 18.38Hurt
increase learnable tokens from c=1 to c=2 (ablation)target views alignment · Google Scanned ObjectsPSNR: 18.56 -> 18.51No clear effect
add global semantic conditioning with CLIP image embedding (ablation)NVS-Adapter · Google Scanned ObjectsPSNR: 18.27 -> 18.45Improved
use Plucker ray embeddings instead of camera extrinsics (ablation)view-consistency cross-attention · Google Scanned ObjectsPSNR: 18.02 -> 18.45Improved
use Plucker instead of ray origin/direction embeddings (ablation)view-consistency cross-attention · Google Scanned ObjectsPSNR: 18.41 -> 18.45No clear effect
add HED ControlNet to NVS-Adapter without extra trainingNVS-Adapter (SD1.5) · Google Scanned ObjectsPSNR: 17.87 -> 22.77Improved
combine multiple ControlNet conditions (ablation)NVS-Adapter (SD1.5) · Google Scanned ObjectsPSNR: 22.77 -> 19.91Hurt
fine-tune all T2I parameters instead of adapter only (ablation)NVS-Adapter · Google Scanned ObjectsPSNR: 18.87 -> 19.00No clear effect
full cross-attention instead of learnable tokens (ablation)target views alignment · Google Scanned ObjectsPSNR: 18.87 -> 18.93No clear effect
compare to Zero123++ on its fixed viewpointsNVS-Adapter · GSO (Zero123++ viewpoints)PSNR: 21.64 -> 18.27Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy