AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Stackelberg Coupling of Online Representation Learning and Reinforcement Learning

Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen

ICLR 2026 · Reinforcement learning › Visual and representation RL · approach: Learned state and action representations · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Stackelberg two-timescale coupling (SCORER) on DQNDQN · MinAtar Breakoutfinal IQM return: 19.16 -> 65.69Improved
Use SCORER on DuelingDQNDuelingDQN · MinAtar Asterixfinal IQM return: 39.22 -> 52.28Improved
Use SCORER on DQNDQN · MinAtar Asterixfinal IQM return: 54.95 -> 54.78No clear effect
Use SCORER on PQNPQN · MinAtar (4 games)final IQM return: Breakout 69.97 -> 71.16; Freeway 61.77 -> 61.05Mixed
Invert roles so perception leads and control follows (ablation)SCORER · MinAtaraggregate IQMHurt
Use Bellman error variance as follower objective instead of MSBE (ablation)SCORER · MinAtaraggregate IQMImproved
Add hierarchical timescale separation versus synchronous coupling of two networks (ablation)SCORER · MinAtaraggregate IQMImproved
Use faster encoder learning rate in monolithic DQN (per-layer LR) (ablation)DQN · MinAtaraggregate IQMImproved
Use SCORER on R2D2R2D2 · MiniGrid Four Roomssuccess rate: 0% -> 97% successImproved
Use SCORER with linear networksLinear TD · Baird's counterexampleloss stabilityImproved
Use SCORER with Bootstrapped DQNBootstrapped DQN · Stochastic Deep Sea (depth 10)solved fraction: ~20% -> near-completeImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy