AI Paper Atlas

Research map / Bandits and online learning

Online convex optimization and games: research map

1,006 papers on Online convex optimization and games in Bandits and online learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 3 clusters and 13 approaches. The busiest year so far is 2026.

What it is

A learner makes decisions one after another and only then sees how good they were, possibly chosen by an adversary. This theory topic designs algorithms whose total loss is close to the best fixed choice in hindsight, and applies the same ideas to games, pricing and auctions.

Terms you will see on this page:

Regret
how much worse the learner did than the best fixed decision in hindsight.
Online convex optimization (OCO)
the online setting where each loss is a convex function.
No-regret dynamics
players in a game each running a no-regret algorithm.

Start reading with the most cited papers here:

Within Bandits and online learning, its share grew from 41.1% in 2023–24 to 46.5% in 2025–26 (229 → 276 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 37162017: 42172018: 32182019: 63192020: 98202021: 99212022: 109222023: 124232024: 117242025: 135252026: 15026

Explore Online convex optimization and games in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Online decisions, pricing and auctions · 683 papers
Keywords: price, pricing, auctions

Approaches in this cluster:

Most cited and most cited since 2024:

Online convex optimization · 203 papers
Keywords: convex optimization, online convex, functions

Approaches in this cluster:

Most cited and most cited since 2024:

Learning in games · 120 papers
Keywords: game, equilibrium, convergence

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Bandits and online learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy