AI Paper Atlas

Research map / Multi-agent systems and games

Cooperative multi-agent RL: research map

635 papers on Cooperative multi-agent RL in Multi-agent systems and games, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 8 approaches. The busiest year so far is 2026.

What it is

Teams of agents learning to cooperate with reinforcement learning, as in robot teams, games or traffic control. A central difficulty is giving each agent credit for the team's reward; value factorisation and centralised training with decentralised execution are standard tools.

Terms you will see on this page:

MARL
multi-agent reinforcement learning.
CTDE
centralised training, decentralised execution: train with shared information, act independently.
Value factorization
splitting a team value into per-agent parts.

Start reading with the most cited papers here:

Within Multi-agent systems and games, its share shrank from 22.4% in 2023–24 to 11.9% in 2025–26 (141 → 228 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 8162017: 7172018: 12182019: 30192020: 51202021: 53212022: 76222023: 78232024: 77242025: 105252026: 13826

Explore Cooperative multi-agent RL in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Cooperative MARL · 390 papers
Keywords: reinforcement marl, communication, marl algorithms

Approaches in this cluster:

Most cited and most cited since 2024:

Decentralized coordination · 245 papers
Keywords: decentralized, value, joint

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Multi-agent systems and games

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy