AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

High-Dimensional Contextual Policy Search with Unknown Context Rewards using Bayesian Optimization

Qing Feng, Ben Letham, Hongzi Mao, Eytan Bakshy

NeurIPS 2020 · Reinforcement learning › Policy gradient and actor-critic · approach: Tree search and policy optimization · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use LCE-A instead of standard GP BO under aggregate rewardsContextual BO · Contextual Hartmann5D, varying contextsfinal rewardImproved
observe context-level rewards (ICM, LCE-M) vs aggregate only (LCE-A) (ablation)Contextual BO · Contextual Hartmann5Dfinal rewardImproved
increase number of sparse contexts with skewed weights (0.01 each) (ablation)SAC and LCE-A · Contextual Hartmann5D skewed weightsbest reward foundNo clear effect
use LCE-A instead of SAC (ablation)aggregate-reward contextual BO · Rare-context reward (5 dense, 5 sparse contexts)reward on sparse contextsImproved
violate Assumption A3 with dynamic context weights wc depending on rewards (ablation)SAC and LCE-A · 50 contexts dynamic distributionbest rewardNo clear effect
contextual policy (LCE-A) instead of non-contextual policyABR controller · ABR video playbackQoE: 50% increase in QoEImproved
use linear subspace BO (ALEBO, HeSBO, REMBO) instead of LCE-AABR policy search · ABR video playbackfinal best QoE: 25% worseHurt
use Add-GP-UCB or TuRBO instead of LCE-AABR policy search · ABR video playbackfinal best QoE: 6% lessHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy