atlas

Research map / Bandits and online learning / Contextual bandits and Thompson sampling

Misspecified Linear Bandits

AAAI 2017 · Bandits and online learning › Contextual bandits and Thompson sampling · approach: Linear and generalized linear bandits · 80 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use RLB's linearity test to select OFUL or UCBBandit learning with perfectly linear rewards · Perfectly linear banditregret: O(d√T) for RLB; O(d√T) for OFULNo clear effect
Use RLB's linearity test to switch to UCB on large non-sparse deviationsOFUL · Large non-sparse deviationregret: Ω(T) for OFUL; O(√NT) for RLBHelped
Apply a sparse reward perturbation to one armAny linear bandit algorithm with optimal linear-model regret · Large sparse deviationexpected regret: O(d√T) -> Ω(T)Hurt
Use OFUL despite a large non-sparse deviationOFUL · Large non-sparse deviationexpected regret: Ω(T)Hurt
Allow small deviation from linear rewardsOFUL · Small deviationregret: O(d√T)No clear effect
Use RLB on synthetic perfectly linear dataRLB · Synthetic data, H0regret: 0.0001 false-alarm probability; 0.9999 probability of closely following OFULNo clear effect
Use RLB to select UCB on synthetic non-sparse deviationsOFUL · Synthetic data, H1 with |ε_i| > 2regret: 0.0001 miss-detection errorHelped
Increase RLB sampling count to k=70 (ablation)RLB · Yahoo! Learning to Rank set2.test.txt, N=500, d=50regret: k=70; 3570 roundsMixed
Reduce RLB sampling count to k=10 (ablation)RLB · Yahoo! Learning to Rank set2.test.txt, N=500, d=50regret: k=10Hurt
Use a reasonable sampling count k=50 rather than k=10 (ablation)RLB · Yahoo! Learning to Rank set2.test.txt, N=800, d=50regret: k=50; k=10Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy