Research map / Bandits and online learning / Online convex optimization and games
Model-Free Online Learning in Unknown Sequential Decision Making Problems and Games
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use the proposed interactive bandit algorithm instead of NFSP, policy gradient, or online MCCFR | Approximate Nash equilibrium learning · Kuhn poker | exploitability | Helped |
| Use the proposed interactive bandit algorithm instead of NFSP, policy gradient, or online MCCFR | Approximate Nash equilibrium learning · Leduc poker | exploitability | Helped |
| Use the upfront-flipping rollout instead of on-path-flipping (ablation) | Interactive bandit algorithm · Kuhn poker and Leduc poker | exploitability | Hurt |
| Use the uniform exploration function instead of the terminal-node-count exploration function (ablation) | Interactive bandit algorithm · Kuhn poker and Leduc poker | exploitability | No clear effect |
| Set the exploration parameter k to 10 rather than the other tested values (ablation) | Interactive bandit algorithm · Kuhn poker and Leduc poker | exploitability | Helped |
Closest papers by meaning
- Regret Minimization in Behaviorally-Constrained Zero-Sum Games (ICML 2017 · similarity 0.94)
- Online Convex Optimization for Sequential Decision Processes and Extensive-Form Games (AAAI 2019 · similarity 0.93)
- Strategy-Based Warm Starting for Regret Minimization in Games (AAAI 2016 · similarity 0.92)
- Stable-Predictive Optimistic Counterfactual Regret Minimization (ICML 2019 · similarity 0.92)
- Best of Both Worlds: Regret Minimization versus Minimax Play (ICML 2025 · similarity 0.90)
- Optimism Without Regularization: Constant Regret in Zero-Sum Games (NeurIPS 2025 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.