Research map / Probabilistic and scientific modeling / Differential equations and PDEs
Accurate Differential Operators for Hybrid Neural Fields
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a post hoc local polynomial-fitting differential operator and a self-supervised fine-tuning loss to make autodiff derivatives of hybrid neural fields (Instant NGP, Dense Grid, Tri-plane) accurate, evaluated on SDF normals/curvature and downstream rendering, collision, and PDE simulation.
Problem
Hybrid neural fields with explicit feature grids fit signals well but their autodiff derivatives (normals, curvature) are noisy because high-frequency grid components are amplified by differentiation, which breaks downstream rendering and simulation.
Approach
Replace direct autodiff derivatives with derivatives of a local least-squares polynomial (linear for gradients, quadratic for Hessian/Laplacian) fit to field samples drawn from a Gaussian neighborhood, and distill these smoothed derivatives back into the network via an auxiliary gradient-matching loss during fine-tuning.
Key results
- Post hoc polynomial-fitting operator reduces Instant NGP surface normal angular error from 12.40 (autodiff) to 2.80 degrees, a roughly 4x reduction versus finite differences (4.20).
- Fine-tuning with the polynomial-fit gradient loss lowers Instant NGP autodiff normal angular error from 12.40 to 3.19 degrees while Chamfer distance stays near 9.28e-4 (baseline 9.24e-4).
- In collision simulation, normals from the method give 0.85 degree error versus 11.51 degrees for autodiff normals averaged over 10^6 trials.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Replace automatic-differentiation gradients with local polynomial-fitting gradients | Instant NGP · FamousShape | Ang: 12.40 -> 2.80 | Helped |
| Replace finite differences with local polynomial fitting | Instant NGP · FamousShape | RRE: 3.67 -> 0.89 | Helped |
| Replace GAD with local polynomial fitting | Dense Grid · FamousShape | Ang: 3.24 -> 3.31 | Hurt |
| Replace GAD with local polynomial fitting | Tri-plane · FamousShape | Ang: 2.92 -> 3.23 | Hurt |
| Fine-tune using polynomial-fit gradient supervision | Instant NGP · FamousShape | Ang: 12.40 -> 3.19 | Helped |
| Use finite-difference supervision instead of polynomial-fit supervision (ablation) | Instant NGP fine-tuning · FamousShape | Ang: 3.19 -> 5.14 | Hurt |
| Add Eikonal regularization | Instant NGP · FamousShape | Ang: 12.40 -> 6.51 | Helped |
| Add finite-difference Eikonal regularization | Instant NGP · FamousShape | Ang: 12.40 -> 12.46 | No clear effect |
| Fine-tune using polynomial-fit gradient supervision | Dense Grid · FamousShape | Ang: 6.56 -> 4.40 | Helped |
| Use finite-difference supervision instead of polynomial-fit supervision (ablation) | Dense Grid fine-tuning · FamousShape | Ang: 4.40 -> 5.09 | Hurt |
| Increase the number of sampled neighbors k (ablation) | Local polynomial-fitting operator · Armadillo and Stanford Bunny | gradient/normal error | Helped |
| Increase neighborhood size σ (ablation) | Local polynomial-fitting operator · Armadillo and Stanford Bunny | gradient/normal error | Mixed |
Surprising findings
- Eikonal regularization degraded or failed to improve autodiff normal accuracy in some settings, e.g., FD-Eikonal barely changed Instant NGP normals (12.46 degrees vs 12.40 baseline).
Limitations
- Requires choosing the smoothing scale sigma per downstream application.
- Post hoc operator needs k neighborhood forward passes per query, adding cost.
- Only removes high-frequency noise; cannot fix low-frequency errors common in non-hybrid architectures like SIREN.
Experimental setup
Datasets: FamousShape
Benchmarks: FamousShape
Metrics: L2 normal error mean angular error AA@1 AA@2 rectified relative error (curvature) Chamfer distance F-score collision normal angle error MSE for advection PDE
Baselines: Automatic differentiation Finite differences Gaussian averaged derivatives (GAD) Stochastic finite differences (SFD) Eikonal regularization FD-Eikonal Grid solver
Builds on: Instant NGP Sobolev training eikonal regularization stochastic finite differences Implicit Neural Spatial Representations
Closest papers by meaning
- Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations (ICML 2024 · similarity 0.87)
- Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential Equations (ICML 2024 · similarity 0.87)
- Breakeven complexity: A new perspective on neural partial differential equation solvers (NeurIPS 2026 · similarity 0.86)
- Neural Processing of Tri-Plane Hybrid Neural Fields (ICLR 2024 · similarity 0.86)
- INC: An Indirect Neural Corrector for Auto-Regressive Hybrid PDE Solvers (NeurIPS 2025 · similarity 0.85)
- BENO: Boundary-embedded Neural Operators for Elliptic PDEs (ICLR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
