atlas

Research map / 3D vision / NeRF and radiance fields

Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistency

CVPR 2024 · 3D vision › NeRF and radiance fields · approach: Single-view and streaming radiance fields · 7 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes ReVoRF, a voxel-based few-shot radiance field method that exploits unreliable warped pseudo-views via a bilateral geometric consistency loss (color/density for reliable regions, relative depth for unreliable ones) plus reliability-aware voxel smoothing and learning.

Problem

Few-shot novel view synthesis with radiance fields suffers from unreliable warped pseudo novel views (disoccluded holes and artifacts); prior methods mask these regions, losing supervision and causing ambiguous geometry.

Approach

Treat unreliable disoccluded regions as useful via relative depth ordering consistency rather than absolute color supervision, combined with a bilateral loss and reliability-weighted voxel smoothing and gradient weighting for voxel grids.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use ReVoRF instead of GeCoNeRFFew-shot radiance field reconstruction · Realistic Synthetic 360°, 4-viewPSNR: 19.78 -> 20.72Helped
Use ReVoRF instead of GeCoNeRFFew-shot radiance field reconstruction · Realistic Synthetic 360°, 4-viewSSIM: 0.880 -> 0.848Hurt
Use ReVoRF instead of GeCoNeRFFew-shot radiance field reconstruction · Realistic Synthetic 360°, 4-viewLPIPS: 0.185 -> 0.179Helped
Use ReVoRF instead of SparseNeRFFew-shot radiance field reconstruction · LLFF, 3-viewPSNR: 19.86 -> 19.26Hurt
Use ReVoRF instead of SparseNeRFFew-shot radiance field reconstruction · LLFF, 3-viewSSIM: 0.624 -> 0.644Helped
Add reliable-region reconstruction loss Lrel (ablation)DVGO baseline · Realistic Synthetic 360°, 4-viewPSNR: 17.19 -> 17.79Helped
Add unreliable-region relative depth loss Lunr (ablation)Baseline + Lrel · Realistic Synthetic 360°, 4-viewPSNR: 17.79 -> 19.01Helped
Add depth smoothness loss Lds (ablation)Baseline + Lrel + Lunr · Realistic Synthetic 360°, 4-viewPSNR: 19.01 -> 19.23Helped
Add reliability-aware voxel smoothing Lrs (ablation)Baseline + Lrel + Lunr + Lds · Realistic Synthetic 360°, 4-viewPSNR: 19.23 -> 20.72Helped

Surprising findings

Limitations

Experimental setup

Datasets: Realistic Synthetic 360 LLFF

Benchmarks: Realistic Synthetic 360 LLFF

Metrics: PSNR SSIM LPIPS training time

Baselines: NeRF PixelNeRF DietNeRF 3DGS InfoNeRF VGOS GeCoNeRF RegNeRF SparseNeRF SRF MVSNeRF Mip-NeRF

Builds on: DVGO VGOS GeCoNeRF InfoNeRF DPT

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy