AI Paper Atlas

Research map / Bandits and online learning / Multi-armed bandits

Regulating Greed Over Time in Multi-Armed Bandits

Stefano Tracà, Cynthia Rudin, Weiyu Yan

JMLR 2021 · Bandits and online learning › Multi-armed bandits · approach: Non-stationary and structured-reward bandits

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
regulate greed over time with a hard threshold (epsilon-z greedy)epsilon-greedy · Yahoo! Webscope (epsilon-greedy, immortal)mean reward per turn: 0.0406 -> 0.0493Improved
regulate greed over time softly (Soft epsilon-greedy)epsilon-greedy · Yahoo! Webscope (epsilon-greedy, immortal)mean reward per turn: 0.0406 -> 0.0588Improved
use variable arm pool algorithm instead of standard epsilon-greedyepsilon-greedy · Yahoo! Webscope (epsilon-greedy, immortal)mean reward per turn: 0.0406 -> 0.0688Improved
regulate greed with threshold (UCB-z)UCB · Yahoo! Webscope (UCB, immortal)mean reward per turn: 0.0365 -> 0.0441Improved
regulate greed softly (Soft UCB)UCB · Yahoo! Webscope (UCB, immortal)mean reward per turn: 0.0365 -> 0.0396Improved
use soft greed regulation with mortal arms (UCB soft mortal) instead of standard UCBUCB · Yahoo! Webscope (UCB, mortal)mean reward per turn: 0.0523 -> 0.0840Improved
use UCB soft mortal instead of UCB-LUCB-L · Yahoo! Webscope (UCB, mortal)mean reward per turn: 0.0787 -> 0.0840Improved
regulate greed over time versus smarter UCB and epsilon-greedy (G(t) discounting)bandit algorithms · simulated Wave, Christmas, Step greed (200 arms, 1500 turns)final cumulative rewardImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy