AI Paper Atlas

Research map / Reinforcement learning

MDPs and planning: research map

726 papers on MDPs and planning in Reinforcement learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 8 approaches. The busiest year so far is 2024.

What it is

The theory of reinforcement learning in Markov decision processes: how much data is needed to learn good policies, how policy optimisation converges, and how to act when the agent cannot observe the full state (POMDPs) or the model is uncertain.

Terms you will see on this page:

Sample complexity
how many interactions are needed to learn a near-optimal policy.
POMDP
a decision process where the agent sees only partial observations of the state.
Robust MDP
planning against the worst model within a set of plausible ones.

Start reading with the most cited papers here:

Within Reinforcement learning, its share shrank from 12.9% in 2023–24 to 7.6% in 2025–26 (203 → 175 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 25162017: 19172018: 24182019: 43192020: 67202021: 77212022: 73222023: 102232024: 113242025: 88252026: 9526

Explore MDPs and planning in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

MDPs and partial observability · 424 papers
Keywords: markov decision, processes, observable

Approaches in this cluster:

Most cited and most cited since 2024:

Sample complexity of RL · 302 papers
Keywords: sample complexity, function approximation, epsilon

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Reinforcement learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy