atlas

Research map / 3D vision / Gaussian splatting

Tetrahedron Splatting for 3D Generation

NeurIPS 2024 · 3D vision › Gaussian splatting · approach: Regularization and primitive design for 3DGS · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes TeT-Splatting, a 3D representation that splats alpha-blended tetrahedra from a deformable tetrahedral grid with SDF-based opacity, enabling real-time rendering, precise Marching Tetrahedra mesh extraction, and faster convergence for 3D generation.

Problem

3D generation with 2D diffusion priors needs a representation that converges quickly, renders in real time, and yields accurate meshes; NeRF is costly and inaccurate for meshes, DMTet converges poorly on large topology changes, and 3DGS yields poor meshes with holes.

Approach

Treat tetrahedra of a deformable tetrahedral grid as splatting primitives: project them to 2D, compute opacity from SDF values at ray-tetrahedron intersections (NeuS-style sigmoid), alpha-blend in a tile-based CUDA rasterizer, and regularize the SDF with eikonal and normal-consistency losses so the result can be meshed with Marching Tetrahedra.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use TeT-Splatting instead of RichDreamerRichDreamer text-to-3D pipeline with rich diffusion priors · RichDreamer prompts (183 objects)Geometry CLIP score: 23.0143 -> 23.1641Helped
Use TeT-Splatting instead of RichDreamerRichDreamer text-to-3D pipeline with rich diffusion priors · RichDreamer prompts (183 objects)Appearance CLIP score: 29.2198 -> 29.4197Helped
Use TeT-Splatting instead of RichDreamerRichDreamer text-to-3D pipeline with rich diffusion priors · Text-to-3D geometry optimizationoptimization time: 70 min -> 40 minHelped
Remove eikonal loss (ablation)TeT-Splatting · Text-to-3D with rich diffusion priorsshape qualityHurt
Add eikonal loss (ablation)TeT-Splatting · Text-to-3D with rich diffusion priorsshape qualityHelped
Remove normal consistency loss (ablation)TeT-Splatting · Text-to-3D with rich diffusion priorsmodel compactnessHurt
Add normal consistency loss (ablation)TeT-Splatting · Text-to-3D with rich diffusion priorssurface fragmentationHelped
Increase tetrahedral grid resolution from 128 to 256 (ablation)TeT-Splatting · Text-to-3D geometry generationgeometry detail: 128 -> 256Helped

Surprising findings

Limitations

Experimental setup

Datasets: prompts_dmtet.txt (183 objects, from RichDreamer GitHub)

Benchmarks: CLIP score (geometry and appearance) on 183-object prompt list qualitative text-to-3D and image-to-3D comparisons FPS and training time comparisons

Metrics: Geometry CLIP score Appearance CLIP score rendering FPS training time

Baselines: Magic3D Fantasia3D DreamGaussian Instant-NGP ProlificDreamer RichDreamer MVDream

Builds on: DMTet 3D Gaussian Splatting NeuS Voxurf Fantasia3D

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy