Research map / Bandits and online learning / Contextual bandits and Thompson sampling
Expected Improvement for Contextual Bandits
Hung Tran-The, Sunil Gupta, Santu Rana, Tuan Truong, Long Tran-Thanh, Svetha Venkatesh
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| LinEI instead of LinUCB, LinTS, LinIDS | contextual bandit · bean, covertype, statlog (UCI) | cumulative regret | Improved |
| Linear Epsilon Greedy instead of LinUCB/LinTS/LinIDS | contextual bandit · bean, covertype, statlog | cumulative regret | Hurt |
| LinEI instead of LinUCB and LinTS in high dimension and large action space | LinEI · eurlex-4k (5000 features, 3993 labels) | cumulative regret | Improved |
| LinEI instead of LinUCB/LinTS | LinEI · eurlex-4k | computation cost | Improved |
| NeuralEI instead of NeuralUCB, NeuralTS, Neural Epsilon Greedy | neural contextual bandit · bean, covertype, statlog | cumulative regret | Improved |
| Neural-based methods instead of LinEI/LinUCB | neural bandits · covertype and statlog | cumulative regret | Improved |
| Neural-based methods instead of LinEI/LinUCB | neural bandits · bean | cumulative regret | Hurt |
Closest papers by meaning
- Learning Neural Contextual Bandits through Perturbed Rewards (ICLR 2022 · similarity 0.90)
- Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter Updates (ICML 2026 · similarity 0.90)
- Exploration via Feature Perturbation in Contextual Bandits (NeurIPS 2025 · similarity 0.90)
- Active Context Selection Improves Simple Regret in Contextual Bandits (NeurIPS 2026 · similarity 0.89)
- Mixed-Effects Contextual Bandits (AAAI 2024 · similarity 0.89)
- Catoni Contextual Bandits are Robust to Heavy-tailed Rewards (ICML 2025 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
