atlas

Research map / 3D vision / Gaussian splatting

FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization

CVPR 2024 · 3D vision › Gaussian splatting · approach: Compact and efficient Gaussian splatting · 89 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes FreGS, a 3D Gaussian splatting method that adds progressive (low-to-high) frequency regularization in Fourier space to fix over-reconstruction during Gaussian densification.

Problem

3D Gaussian splatting suffers from over-reconstruction during densification, where high-variance regions are covered by a few large Gaussians, causing blur and artifacts in novel view synthesis.

Approach

Regularize amplitude and phase discrepancies between rendered and ground-truth image spectra, annealing from low-frequency to high-frequency components via low-pass and dynamic high-pass Fourier filters, to guide coarse-to-fine Gaussian densification.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add frequency regularization (FR) on amplitude and phase discrepancies (ablation)3D Gaussian splatting · Mip-NeRF360PSNR: +0.42 (27.21 to 27.63)Helped
add frequency regularization (FR) on amplitude and phase discrepancies (ablation)3D Gaussian splatting · Tank&TemplePSNR: +0.62 (23.14 to 23.76)Helped
add frequency annealing (progressive low-to-high frequency regularization) (ablation)Base+FR · Mip-NeRF360PSNR: +0.22 (27.63 to 27.85)Helped
add frequency annealing (progressive low-to-high frequency regularization) (ablation)Base+FR · Tank&TemplePSNR: +0.20 (23.76 to 23.96)Helped
progressive frequency regularization with annealing (FreGS) vs 3D-GS3D Gaussian splatting · Mip-NeRF360PSNR: +0.64 (27.21 to 27.85)Helped
progressive frequency regularization with annealing (FreGS) vs 3D-GS3D Gaussian splatting · Tank&TemplePSNR: +0.82 (23.14 to 23.96)Helped
progressive frequency regularization with annealing (FreGS) vs 3D-GS3D Gaussian splatting · Deep BlendingPSNR: +0.52 (29.41 to 29.93)Helped

Surprising findings

Limitations

Experimental setup

Datasets: Mip-NeRF360 Tanks&Temples Deep Blending

Benchmarks: Mip-NeRF360 Tanks&Temples Deep Blending

Metrics: PSNR SSIM LPIPS

Baselines: 3D-GS Mip-NeRF360 InstantNGP Plenoxels

Builds on: 3D Gaussian splatting NeRF BARF

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy