AI Paper Atlas

Research map / Reinforcement learning

Visual and representation RL: research map

2,264 papers on Visual and representation RL in Reinforcement learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 6 clusters and 23 approaches. The busiest year so far is 2026.

What it is

Practical deep reinforcement learning for agents that see images or act in rich environments, including robots. Key questions are how to learn good state representations and world models, how to explore with sparse rewards, how to reach goals and reuse skills, and how to adapt quickly to new tasks.

Terms you will see on this page:

World model
a learned model of how the environment responds, used for planning or imagination.
Intrinsic motivation
rewarding the agent for novelty or curiosity when the real reward is sparse.
Goal-conditioned policy
a policy told which goal to reach.

Start reading with the most cited papers here:

Within Reinforcement learning, its share shrank from 36.5% in 2023–24 to 30.0% in 2025–26 (572 → 696 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 23162017: 41172018: 90182019: 115192020: 169202021: 232212022: 232222023: 300232024: 313242025: 338252026: 41126

Explore Visual and representation RL in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

RL systems and decision-making · 1,062 papers
Keywords: search, decision, systems

Approaches in this cluster:

Most cited and most cited since 2024:

Representations and world models · 357 papers
Keywords: representation, latent, generalization

Approaches in this cluster:

Most cited and most cited since 2024:

Robot manipulation · 310 papers
Keywords: robot, manipulation, simulation

Approaches in this cluster:

Most cited and most cited since 2024:

Exploration and skill discovery · 268 papers
Keywords: exploration, intrinsic, skills

Approaches in this cluster:

Most cited and most cited since 2024:

Goal-conditioned and hierarchical RL · 162 papers
Keywords: goal, conditioned, hierarchical

Approaches in this cluster:

Most cited and most cited since 2024:

Meta-RL · 105 papers
Keywords: meta, adaptation, context

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Reinforcement learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy