AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Cross-Fitting for Neural Posterior Estimation

Jeffrey Regier

NeurIPS 2026 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Variational methods for sequence models · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes cross-fitting for neural posterior estimation in simulation-based inference; the abstract is truncated so details beyond the problem framing are unknown.

Problem

Neural Posterior Estimation trains an amortized conditional density estimator from single (latent, observation) pairs, so posterior variance must be inferred across pairs; a flexible variational distribution can collapse or be poorly calibrated in this setting.

Approach

Applies cross-fitting (a sample-splitting technique from semiparametric statistics) to NPE training; the abstract only partially states the idea, so the specific mechanism is not reported here.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace standard NPE with CF-NPE (M=1)NPE with Gaussian encoder · Gaussian-Gaussian (d=200)test log-likelihood: -141.30 -> -133.92Improved
replace standard NPE with CF-NPE (M=1)NPE with NSF · Funnel (d=200)test log-likelihood: -58.98 -> 38.09Improved
replace standard NPE with CF-NPENPE with NSF · Strong-lensing source reconstructiontest log-likelihood (median): 2.59 -> 60.05Improved
fit stage 2 to out-of-fold instead of in-fold residuals (cross-fitting) (ablation)CF-NPE · Gaussian-Gaussian (d=200), Gaussianchi-square d: 1.150 -> 0.993Improved
add K-fold cross-fitting and replicates to a single stage-1 mean fit (ablation)CF-NPE · Gaussian-Gaussian (d=200), Gaussiantest log-likelihood: -136.01 -> -128.42Improved
increase number of folds K from 2 to 16 (ablation)CF-NPE (M=3) · Gaussian-Gaussian (d=200)test log-likelihood: -132.93 -> -128.18Improved
increase stage-1 ensemble size M from 1 to 10 (ablation)CF-NPE · Gaussian-Gaussian (d=200), Gaussiantest log-likelihood: -133.92 -> -126.41Improved
use mixture of NPE networks (deep-ensemble style) instead of single NPE (ablation)Std-NPE · Gaussian-Gaussian (d=200), Gaussianchi-square d: LL -141.30 -> -133.28 but chi2 1.095 -> 0.875Mixed
form stage-2 mixture (CF-NPE-mixture) on top of CF-NPE (ablation)CF-NPE, M=3 · Gaussian-Gaussian (d=200)test log-likelihood: -128.42 -> -128.41No clear effect
form stage-2 mixture on top of CF-NPE with NSF (ablation)CF-NPE, M=3 · Strong-lensing source reconstructiontest log-likelihood (median): 83.21 -> 88.08Improved
oversize the stage-2 NSF (ablation)CF-NPE · Gaussian-Gaussian (d=200)test log-likelihoodHurt
apply temperature scaling to standard NPE (ablation)Std-NPE · Gaussian-Gaussian (d=200)test log-likelihoodNo clear effect

Experimental setup

Builds on: neural posterior estimation

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy