atlas

Research map / Bandits and online learning / Online convex optimization and games

Online Learning in Stackelberg Games with an Omniscient Follower

ICML 2023 · Bandits and online learning › Online convex optimization and games · approach: Last-iterate convergence in games · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Have an omniscient follower best-respond rather than letting the leader control the follower actionLinear Stackelberg game · Worst-case linear Stackelberg gameregret: \cR(T) \gtrsim T^{{(d-4)}/{(d-2)}}Hurt
Use observed follower responses to imitate the followerImitation-based example · Imitation-based exampleregret: \cR_{UCB}(T) \lesssim \sigma_b^2 \log T \cdot(d +\log T) versus \Omega(\sigma_b d\sqrt{T})Helped
Use the observed response to restrict exploration to the well-conditioned action setUCB in the expert-guided example · Expert-guided exploration (strong reduction)regret: \widetilde{\bO}(d\sqrt{T})Helped
Observe the follower response and use it to reduce the action set\mathsf{Alg} in the expert-guided example · Expert-guided exploration (weak reduction)regret: \bO\big((C_\zeta^d T^{d+1})^{\frac{1}{d+2}}\big)Helped
Use the follower response as a proxy reward\mathsf{Alg} in the polynomial bandit example · Polynomial bandit examplesample complexity: \widetilde{\bO}(d^{2k-1}/\epsilon^2) versus \widetilde{\bO}(d^{2k}/\epsilon^2)Helped
Use traditional Eluder UCB instead of a tailored proxy-regret algorithmPolynomial bandit example · Polynomial bandit examplesample complexity: \widetilde{\bO}(d^{2k}/\epsilon^2) rather than \widetilde{\bO}(d^{2k-1}/\epsilon^2)Hurt
Choose an interior action a = 0 that reveals the true parameterLeader in the failure-of-optimism example · Failure of optimism examplerounds to identify optimal action: one roundHelped
Use an optimism-based method such as UCB instead of the informative interior actionLeader in the failure-of-optimism example · Failure of optimism examplelearning efficiencyHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy