AI Paper Atlas

Research map / Probabilistic and scientific modeling / Uncertainty and Gaussian processes

Variational Bayesian Optimal Experimental Design

Adam Foster, Martin Jankowiak, Elias Bingham, Paul Horsfall, Yee Whye Teh, Thomas Rainforth, Noah Goodman

NeurIPS 2019 · Probabilistic and scientific modeling › Uncertainty and Gaussian processes · approach: Simulation-based inference · 47 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the variational EIG estimators instead of NMCEIG estimation across A/B test, Preference, Mixed effects, and Extrapolation · Four EIG-estimation benchmarksEIG estimation accuracyImproved
Use VNMC instead of NMCEIG estimation for A/B test and Preference · A/B test and PreferenceBias^2: 4.70\times 10^0 -> 3.44\times 10^{-3}; 7.60\times 10^{-2} -> 4.17\times 10^{-3}Improved
Use IML instead of DVEIG estimation for Mixed effects · Mixed effectsBias^2: 9.10 \times 10^{-3} -> 3.06\times 10^{-3}Improved
Use IML instead of DVEIG estimation for Extrapolation · ExtrapolationVar: 4.11\times 10^{-5} -> 1.84\times 10^{-5}Improved
Use Laplace instead of variational posteriorEIG estimation for A/B test · A/B testBias^2: 1.33\times 10^{-2} -> 1.92\times 10^{-4}Improved
Use variational marginal instead of variational posteriorEIG estimation for Preference · PreferenceBias^2: 4.26\times 10^{-2} -> 1.10\times 10^{-3}Improved
Train the VNMC proposal before the NMC refinementVNMC EIG estimation · A/B test exampleEIG estimation accuracyImproved
Increase the VNMC refinement sample counts N and M after proposal trainingVNMC EIG estimation · A/B test exampleEIG estimation accuracyImproved
Allocate part of the compute budget to variational training rather than using the prior as the NMC proposalSequential CES experiment · CES parameter-recovery experimentPosterior entropyImproved
Use BOED with IML instead of random designSequential adaptive psychology experiment · Mechanical Turk face-feature experimentPosterior entropyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy