Research map / Probabilistic and scientific modeling / Uncertainty and Gaussian processes
Uncertainty Quantification for Physics-Informed Neural Networks with Extended Fiducial Inference
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a narrow-neck hyper-network extension of extended fiducial inference (EFI) that gives honest, prior-free uncertainty quantification for PINNs, validated on a 1-D Poisson equation against Bayesian PINNs and dropout.
Problem
Uncertainty quantification for physics-informed neural networks: Bayesian priors and dropout rates cannot be calibrated without extra information, so confidence sets are not honest.
Approach
Extends EFI to large-scale models by using a narrow-neck w-network (stochastic neck layer, StoNet-style) so that consistency of the inverse mapping holds without sparse priors, letting parameter number exceed sample size; random errors are imputed via adaptive SGLD and parameter uncertainty is propagated through the estimated inverse function.
Key results
- EFI achieves 95.17% coverage with CI-width 0.0504 on 1-D Poisson, averaged over 100 runs, closest to the nominal 95% level.
- Dropout (5%) yields inflated coverage 98.93% with CI-width 0.66; Bayesian with sigma_f=0.0005 yields coverage 58.84%, showing sensitivity to hyperparameters.
- Concrete Dropout attains MSE comparable to EFI (0.000184 vs 0.000148) but coverage only 11.85%.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use EFI rather than dropout-based uncertainty estimation | PINN · 1-D Poisson | Coverage Rate: 0.0757 (0.011795) -> 0.9517 (0.014186) | Helped |
| Use EFI rather than Dropout (0.5%) | PINN · 1-D Poisson | CI-Width: 0.191712 (0.004367) -> 0.050437 (0.000462) | Helped |
| Use EFI rather than Concrete Dropout | PINN · 1-D Poisson | Coverage Rate: 0.1185 (0.018002) -> 0.9517 (0.014186) | Helped |
| Use EFI rather than Bayesian inference with σ_f=0.005 | PINN · 1-D Poisson | MSE: 0.000170 (0.000020) -> 0.000148 (0.000016) | No clear effect |
| Vary the Bayesian σ_f setting from 0.05 to 0.005 to 0.0005 | Bayesian PINN · 1-D Poisson | Coverage Rate: 0.9997 (0.000302); 0.9914 (0.008600); 0.5884 (0.032390) | Mixed |
| Vary dropout rate from 0.5% to 1% to 5% | PINN · 1-D Poisson | CI-Width: 0.191712 (0.004367); 0.274651 (0.006734); 0.660927 (0.030789) | Hurt |
| Set dropout rate to zero rather than using dropout | PINN · 1-D Poisson | Coverage Rate: 0.0757 (0.011795) | Hurt |
Surprising findings
- Concrete Dropout matches EFI's MSE yet severely under-covers (11.85%), indicating underestimated predictive uncertainty.
Limitations
- Experiments are limited to relatively small-scale models; scaling to ResNets/CNNs is only proposed via transfer learning, untested.
- Consistency theorem relies on strong regularity and narrow-neck conditions (d_h much smaller than n) and assumptions in the appendix.
- Demonstrated on few PDE examples (1-D Poisson, Montroll, P-FKPP) with a single fixed hyper-parameter regime.
Experimental setup
Datasets: simulated 1-D Poisson data Chinese hamster V79 fibroblast tumor cell growth data scratch assay data
Benchmarks: 1-D Poisson equation
Metrics: MSE coverage rate CI-width
Baselines: PINN (no dropout) MC dropout Concrete Dropout Bayesian PINN (HMC)
Builds on: extended fiducial inference adaptive stochastic gradient MCMC stochastic neural network (StoNet) physics-informed neural networks concrete dropout
Closest papers by meaning
- Uncertainty Quantification with the Empirical Neural Tangent Kernel (NeurIPS 2025 · similarity 0.87)
- Epistemic Uncertainty Quantification For Pre-Trained Neural Networks (CVPR 2024 · similarity 0.86)
- S$^{2}$-PINN: Stochastic Separable Physics-Informed Neural Networks (NeurIPS 2026 · similarity 0.86)
- Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning (NeurIPS 2024 · similarity 0.85)
- Are Uncertainty Quantification Capabilities of Evidential Deep Learning a Mirage? (NeurIPS 2024 · similarity 0.85)
- Training Bayesian Neural Networks with Sparse Subspace Variational Inference (ICLR 2024 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
