AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Bayesian Risk-Averse Q-Learning with Streaming Observations

Yuhao Wang, Enlu Zhou

NeurIPS 2023 · Reinforcement learning › Policy gradient and actor-critic · approach: Model-based RL with guarantees · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Bayesian-risk (VaR/CVaR) Q-learning with posterior updated from streaming real observations instead of distributionally robust Q-learning with a fixed ambiguity setBRQL-VaR and BRQL-CVaR · Coin Toss and Inventory Management (streaming observations)value function in real environment (expected performance and variation)Improved
Use risk functional VaR/CVaR rather than the risk-neutral expectation over the posterior (ablation)BRQL · Coin Toss and Inventory Management (streaming observations)expected value functionHurt
Use risk functional VaR/CVaR rather than the risk-neutral expectation over the posterior (ablation)BRQL · Coin Toss and Inventory Management (streaming observations)variation of value function (95% CI width)Improved
Use risk functional VaR/CVaR rather than risk-neutral mean when test demand is more adversarial (Poisson parameter below 3) (ablation)BRQL (insufficient data, fixed BRMDP) · Inventory Management with differing Poisson demandvalue functionImproved
Use VaR/CVaR risk functional instead of worst-case ambiguity set (DRQL) in the adversarial regimeBRQL vs DRQL-KL and DRQL-Wass · Inventory Management with demand Poisson parameter below 3value functionHurt
Use VaR/CVaR risk functional instead of worst-case ambiguity set (DRQL) in the non-adversarial regimeBRQL vs DRQL-KL and DRQL-Wass · Inventory Management with demand Poisson parameter near or above 3value functionImproved
Vary risk level alpha between 0.2 and 0.4 (ablation)BRQL-VaR and BRQL-CVaR · Coin Tossvalue functionNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy