AI Paper Atlas

Research map / Probabilistic and scientific modeling / Bayesian optimization

Bayesian Optimization for Policy Search via Online-Offline Experimentation

Benjamin Letham, Eytan Bakshy

JMLR 2019 · Probabilistic and scientific modeling › Bayesian optimization · approach: Regret bounds for Bayesian optimization · 22 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add simulator observations via multi-task GP to online-only GPGP for online value model outcomes · 99 outcomes from 11 News Feed experiments (20 online, 100 simulator observations)leave-one-out MSEImproved
use shared kernel fixed from simulator data instead of kernel inferred from online data only (ablation)single-task GP · empirical learning curvesprediction errorImproved
add multi-task modeling beyond offline kernel when inter-task correlation is medium or high (ablation)single-task GP with offline kernel · empirical learning curvesprediction errorImproved
add simulator observations when inter-task correlation is lowMTGP · learning curves, rho^2=0.09prediction errorMixed
add simulator observations when inter-task correlation is highMTGP · learning curves, rho^2=0.8prediction error: 2 online observations combined with 90 simulator observations produce a better model than 18 online observationsImproved
use offline observations as pre-test before online batches (interleaved simulator batches) rather than only in initialization (ablation)MTGP Bayesian optimization · synthetic online-offline problem, 30 runsbest feasible objectiveImproved
add MTGP with simulator to single-task BOBayesian optimization · synthetic online-offline problem, 30 runsbest feasible objectiveImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy