atlas

Research map / 3D vision / NeRF and radiance fields

BerfScene: Bev-conditioned Equivariant Radiance Fields for Infinite 3D Scene Generation

CVPR 2024 · 3D vision › NeRF and radiance fields · approach: Single-view and streaming radiance fields · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes BerfScene, a BEV-conditioned equivariant radiance field (EG3D-style U-Net generator with SEL layers, padding and low-pass filters) that synthesizes local 3D scenes and stitches them into large or infinite-scale scenes.

Problem

Generating large-scale or infinite 3D scenes with consistent composition, since existing object-level 3D generators do not handle varying object scales and spatial layouts, and composing local scenes often produces jitter and inconsistency.

Approach

Condition a 3D-aware GAN radiance field on a bird's-eye-view map via spatial encoding layers, and enforce translation equivariance with wide BEV margins, positional Fourier features and low-pass filters before downsampling, so local BEV patches can be rendered and stitched consistently.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace the proposed representation with triplane (ablation)BerfScene · CLEVRFID: 18.11 -> 0.96Helped
replace the proposed representation with triplane (ablation)BerfScene · Front-3DFID: 39.17 -> 36.78Helped
replace the proposed representation with 2D-to-3D extrusion (ablation)BerfScene · CLEVRFID: 5.60 -> 0.96Helped
replace the proposed representation with 2D-to-3D extrusion (ablation)BerfScene · Front-3DFID: 50.40 -> 36.78Helped
add padding around the BEV map (ablation)BerfScene · CLEVREQT: 19.01 -> 22.02Helped
add padding around the BEV map (ablation)BerfScene · Front-3DEQT: 13.32 -> 15.76Helped
add low-pass filters (ablation)BerfScene · CLEVREQT: 18.19 -> 22.02Helped
add low-pass filters (ablation)BerfScene · Front-3DEQT: 14.45 -> 15.76Helped
use repeated SEL fusion of the BEV map (ablation)BerfScene · CLEVRFID: 6.27 -> 0.96Helped
use repeated SEL fusion of the BEV map (ablation)BerfScene · Front-3DFID: 45.90 -> 36.78Helped
use BerfScene instead of CC3D3D scene generation · CLEVRFID: 3.61 -> 0.96Helped
use BerfScene instead of CC3D3D scene generation · Front-3DFID: 42.88 -> 36.78Helped

Surprising findings

Limitations

Experimental setup

Datasets: CLEVR 3D-Front Carla

Benchmarks: CLEVR 3D-Front Carla

Metrics: FID EQT (equivariance PSNR)

Baselines: StyleGAN2 GSN EG3D CC3D Triplane representation Extruded plane

Builds on: EG3D CC3D StyleGAN2 Spatial Encoding Layer GSN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy