AI Paper Atlas

Research map

Bandits and online learning: research map

Regret-minimizing decisions under uncertainty, from multi-armed bandits to RL theory.

2,385 papers at ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), in 4 topics. Within the annual conferences, its share shrank from 2.1% in 2023–24 to 1.3% in 2025–26 (557 → 594 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 84162017: 93172018: 91182019: 152192020: 205202021: 291212022: 265222023: 309232024: 278242025: 306252026: 31126

Explore Bandits and online learning in the interactive map

Topics

Most cited papers in Bandits and online learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy