Research map / Bandits and online learning

Contextual bandits and Thompson sampling: research map

546 accepted papers on Contextual bandits and Thompson sampling in Bandits and online learning, from ICML, NeurIPS, ICLR, CVPR and AAAI (2016–2026), grouped into 2 clusters and 7 approaches. The busiest year so far is 2024.

Within Bandits and online learning, its share shrank from 26.8% in 2023–24 to 22.4% in 2025–26 (149 → 133 papers at ICML, NeurIPS, CVPR and AAAI, the venues with data for all four years).

Explore Contextual bandits and Thompson sampling in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

Approaches and key papers

Related topics in Bandits and online learning

• Online convex optimization and games (952)
• Multi-armed bandits (497)
• RL theory and MDPs (271)