atlas

Research map / 3D vision / Gaussian splatting

GaussianPro: 3D Gaussian Splatting with Progressive Propagation

ICML 2024 · 3D vision › Gaussian splatting · approach: Regularization and primitive design for 3DGS · 21 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes GaussianPro, which adds a PatchMatch-style progressive propagation of rendered depth/normal maps to 3DGS densification plus a planar normal/scale loss, improving novel view synthesis especially on textureless street scenes.

Problem

3DGS depends on SfM point-cloud initialization that is sparse on textureless surfaces in large-scale scenes, and its split/clone densification adds Gaussians without geometric priors, causing noisy geometry and poor novel-view rendering.

Approach

Render depth and normal maps from the Gaussians, propagate depth/normal candidates between neighboring pixels with PatchMatch and NCC photometric scoring, filter with multi-view geometric consistency, and back-project pixels whose propagated depth disagrees with rendered depth as new Gaussians; a planar loss aligns Gaussian normals with propagated normals.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add progressive propagation to 3DGS (ablation)3DGS · WaymoPSNR: 33.53 -> 34.48Helped
Add planar constraint to 3DGS (ablation)3DGS · WaymoPSNR: 33.53 -> 34.02Helped
Add planar constraint to propagation-based 3DGS (ablation)Propagation only · WaymoPSNR: 34.48 -> 34.68Helped
Add propagation to 3DGS with planar constraint (ablation)Planar constraint only · WaymoPSNR: 34.02 -> 34.68Helped
Use GaussianPro instead of 3DGS3DGS · WaymoPSNR: 33.53 -> 34.68; 1.15 dBHelped
Use GaussianPro instead of retrained 3DGS3DGS (Retrained) · MipNeRF360PSNR: 27.88 -> 27.92No clear effect
Use GaussianPro instead of 3DGS3DGS · MipNeRF360 room (30% training views)PSNR: 28.45 -> 28.64Helped
Use GaussianPro instead of 3DGS3DGS · MipNeRF360 room (50% training views)PSNR: 29.97 -> 30.27Helped
Use GaussianPro instead of 3DGS3DGS · MipNeRF360 room (70% training views)PSNR: 30.87 -> 30.93Helped
Use GaussianPro instead of 3DGS3DGS · MipNeRF360 room (100% training views)PSNR: 31.71 -> 31.98Helped
Initialize 3DGS with dense MVS points instead of SfM points3DGS · StreetPSNR: 35.05 -> 36.13Helped
Initialize 3DGS with dense MVS points instead of SfM points3DGS · RoomPSNR: 31.71 -> 32.05Helped

Surprising findings

Limitations

Experimental setup

Datasets: Waymo MipNeRF360

Benchmarks: Waymo MipNeRF360

Metrics: PSNR SSIM LPIPS FPS

Baselines: 3DGS Instant-NGP Mip-NeRF 360 Zip-NeRF

Builds on: 3D Gaussian Splatting ACMH NeuSG GaussianShader

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy