AI Paper Atlas

Research map / Probabilistic and scientific modeling / Uncertainty and Gaussian processes

Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect

Lorenzo Noci, Kevin Roth, Gregor Bachmann, Sebastian Nowozin, Thomas Hofmann

NeurIPS 2021 · Probabilistic and scientific modeling › Uncertainty and Gaussian processes · approach: Approximate inference in Bayesian neural networks · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Turn off data augmentation (ablation)SG-MCMC BNNs on SVHN and CIFAR-10 · SVHN and CIFAR-10test cross-entropyNo clear effect
Curate only the training set (ablation)SG-MCMC BNN on synthetically curated SVHN · SVHN, synthetic curationCPE presenceNo clear effect
Curate both training and test sets (ablation)SG-MCMC BNN on synthetically curated SVHN · SVHN, synthetic curationCPE presenceImproved
Add data augmentation (ablation)SG-MCMC BNN · SVHNtest cross-entropyImproved
Add data augmentation (ablation)SG-MCMC BNN · CIFAR-10test cross-entropyImproved
Train on smaller random subsets (ablation)SG-MCMC BNN · SVHNCPE ratioMixed
Train on smaller random subsets (ablation)SG-MCMC BNN · CIFAR-10CPE ratioNo clear effect
Train on smaller random subsets (ablation)1-hidden-layer MLP · Toy 2D classificationCPE ratioImproved
Overweight the likelihood (ablation)ResNet-20 on CIFAR-10H · CIFAR-10HCPE presenceImproved
Use fewer sampled annotator labels per image (ablation)ResNet-20 on CIFAR-10H · CIFAR-10H, subsampled labelsCPE presenceMixed
Increase prior influence by reducing dataset size (ablation)Bayesian neural networks · Random subsampling experimentsCPE strengthMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy