AI Paper Atlas

Research map / Bandits and online learning

Contextual bandits and Thompson sampling: research map

567 papers on Contextual bandits and Thompson sampling in Bandits and online learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 7 approaches. The busiest year so far is 2023.

What it is

In a contextual bandit the learner sees side information (a user, a query) before choosing an action, as in recommendation. Thompson sampling is a popular Bayesian strategy: sample a plausible model of the world and act as if it were true.

Terms you will see on this page:

Context
the features observed before each decision.
Linear bandit
a bandit whose expected reward is linear in the features of the action.
Thompson sampling
choosing the action that is best under a model sampled from the posterior.

Start reading with the most cited papers here:

Within Bandits and online learning, its share shrank from 26.8% in 2023–24 to 22.4% in 2025–26 (149 → 133 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 25162017: 18172018: 29182019: 30192020: 38202021: 74212022: 61222023: 78232024: 76242025: 75252026: 6326

Explore Contextual bandits and Thompson sampling in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Contextual bandits · 452 papers
Keywords: contextual bandits, contexts, user

Approaches in this cluster:

Most cited and most cited since 2024:

Thompson sampling · 115 papers
Keywords: thompson sampling, bayesian, ts

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Bandits and online learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy