AI Paper Atlas

Research map / Bandits and online learning / Contextual bandits and Thompson sampling

Impatient Bandits: Optimizing for the Long-Term Without Delay

Kelly W. Zhang, Thomas Baldwin-McDonald, Kamil Ciosek, Lucas Maystre, Daniel Russo

JMLR 2026 · Bandits and online learning › Contextual bandits and Thompson sampling · approach: Ranking bandits · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use progressive (intermediate) feedback via Bayesian filter instead of waiting for delayed reward (ablation)Impatient Bandit (Thompson sampling) · Synthetic environment (20 actions, J=25)cumulative regretImproved
reduce batch size m from 1000 to 10 (ablation)Impatient Bandit · Synthetic environment (20 actions, J=25)cumulative regretNo clear effect
increase informativeness of intermediate outcomes (alpha 0.1 to 0.4 to 0.8) (ablation)Impatient Bandit vs delayed Thompson sampling · Synthetic environmentlog regret ratio vs delayed TSImproved
increase batch size m used to fit prior on Spotify validation data (ablation)Fitted Bayesian predictive model · Spotify podcast validation setmean absolute error of reward predictionImproved
observe more days of engagement before predicting 60-day reward (ablation)Fitted Bayesian predictive model · Spotify podcast validation setmean absolute error of reward predictionImproved
increase batch size m (ablation)Value of Progressive Feedback (fitted prior) · Spotify podcast dataestimated VoPFImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy