Research map / Bandits and online learning / Online convex optimization and games
Online allocation with constraints
Solve online allocation and knapsack problems using dual mirror descent and primal-dual methods.
77 accepted papers at ICML, NeurIPS, ICLR, CVPR and AAAI (2016–2026) · an approach in Online convex optimization and games, keyword cluster “price · pricing · auctions”
State History Tried Checklist Preprints Who Export
Where it stands
Not enough benchmark data Fewer than four papers report the same benchmark, so there is no record to follow.
20 papers in 2023–24 and 24 in 2025–26 (at ICML, NeurIPS, ICLR, CVPR and AAAI); its share of the topic held steady, from 8.7% to 8.7%.
How this is decided
A benchmark is tracked when at least four papers of this approach report their own method on the same dataset and metric in at least two different years. Its record is the best number reported up to 2024 compared with the best reported in 2025–26: still improving means at least 1% better, flat means at most 0.2% better with at least two papers from 2025–26 trying. Numbers on a different scale from the rest (a fraction among percentages) and far outliers are left out. Results come from different papers with different setups, so they are signals, not head-to-head comparisons. The share of papers is counted at ICML, NeurIPS, ICLR, CVPR and AAAI.
How it got here
Most cited paper of each year
- 2016 · Hardness of Online Sleeping Combinatorial Optimization Problems (NeurIPS 2016 · 10 citations)
- 2017 · Online Influence Maximization under Independent Cascade Model with Semi-Bandit Feedback (NeurIPS 2017 · 52 citations)
- 2018 · Allocation Problems in Ride-Sharing Platforms: Online Matching With Offline Reusable Resources (AAAI 2018 · 71 citations)
- 2019 · Online Algorithms for Rent-Or-Buy with Expert Advice (ICML 2019 · 43 citations)
- 2020 · Dual Mirror Descent for Online Allocation Problems (ICML 2020 · 21 citations)
- 2021 · Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimization (NeurIPS 2021 · 10 citations)
- 2022 · Online Bipartite Matching with Advice: Tight Robustness-Consistency Tradeoffs for the Two-Stage Model (NeurIPS 2022 · 13 citations)
- 2023 · An Improved Algorithm for Online Min-Sum Set Cover (AAAI 2023 · 4 citations)
- 2024 · Improved Bandits in Many-to-One Matching Markets with Incentive Compatibility (AAAI 2024 · 2 citations)
- 2025 · On the Universal Near Optimality of Hedge in Combinatorial Settings (NeurIPS 2025 · 1 citation)
- 2026 · A Two-Layer Framework for Joint Online Configuration Selection and Admission Control (ICML 2026 · 0 citations)
Earliest papers here
- Hardness of Online Sleeping Combinatorial Optimization Problems (NeurIPS 2016 · 10 citations)
- Online Influence Maximization under Independent Cascade Model with Semi-Bandit Feedback (NeurIPS 2017 · 52 citations)
- Near Minimax Optimal Players for the Finite-Time 3-Expert Prediction Problem (NeurIPS 2017 · 8 citations)
What has been tried
56 papers here report 299 measured changes (a component added, removed or swapped, compared with a baseline): helped 67%, no clear effect 8%, hurt 18%, mixed 7%. Papers mostly publish changes that helped, so "helped" is over-represented.
Ablations in recent papers
| What was changed | Measured on | Result | Effect | Paper |
|---|---|---|---|---|
| Remove KWA's fill-up logic | Exact total weight · competitive ratio | W( 1/e (U−L)/L ) + 1 -> ln(U/L) + 1 | Hurt | Augmenting Online Algorithms for Knapsack Problem with Total Weight Information (AAAI 2025 · 0 citations) |
| Set ETCO exploration length to T^(2/3)(K ln T)^(1/3) | Bandit matching, small gaps · α-approximation stable regret | O((K ln T)^(1/3) T^(2/3)) | Helped | Stable Matching with Ties: Approximation Ratios and Learning (NeurIPS 2025 · 0 citations) |
| use learning rate η=10^-3 instead of η=10^-2 | AI inference provisioning, u3=3.5 · Total Cost | 237.07 -> 246.36 | Hurt | Fairness-Regularized Online Optimization with Switching Costs (NeurIPS 2025 · 0 citations) |
| use negative entropy potential instead of squared ℓ2 potential | Assignment problem, ε=1 across n=800, 1500, 3000 · optimality gap (%) | 1.8±3.9 -> 2.1±4.0; 4.3±3.4 -> 6.0±4.1; 4.3±5.1 -> 10.4±5.2 | Hurt | Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation (NeurIPS 2024 · 0 citations) |
What reviewers will expect
Datasets and baselines named in the 17 papers of this approach from 2025–2026 that have a full-text summary. Leaving out the common ones is a frequent review question.
Baselines
- Hedge · 2 of 17 papers
Recent preprints
Loading recent arXiv preprints…
Who publishes on it
Institutions on the most papers of this approach since 2023 (of 44 papers; from OpenAlex and the papers' affiliations).
- Nanyang Technological University · 3 papers
- Google · 3 papers
- Harvard University · 3 papers
- Bocconi University · 2 papers
- Meta · 2 papers
- University of California, Riverside · 2 papers
- Shanghai Jiao Tong University · 2 papers
- Peking University · 2 papers
- University of Michigan - Ann Arbor · 2 papers
- Purdue University · 2 papers
Use it
Download BibTeX of 40 key papersOpen the topic in the interactive map
Get alerts. Describe your idea in scime atlas and save it (free scime account): you get a weekly email when new preprints land close to it.
Related approaches
Same keyword cluster
- Online learning with feedback graphs (155 papers)
- Best-of-both-worlds bandit algorithms (125 papers)
- Learning for pricing and auctions (101 papers)
- Online decision-making with feedback structure (81 papers)
- Online linear-quadratic control regret (36 papers)
- Learning-augmented online algorithms (73 papers)
Elsewhere in the topic
- Constrained and unconstrained OCO algorithms (85 papers)
- Last-iterate convergence in games (65 papers)
- Dynamic and adaptive regret (57 papers)
- Parameter-free non-stationary online learning (45 papers)
- Fast no-regret dynamics in games (37 papers)
- Counterfactual regret minimization (15 papers)
Benchmark numbers, ablations and baseline numbers are extracted by AI from each paper's full text and can be wrong; the paper is the authority. Data: results index of 2026-11-02, citation counts from OpenAlex (2026-10-09).
