AI Paper Atlas

Research map / Architectures and efficiency

Mixture of experts: research map

318 papers on Mixture of experts in Architectures and efficiency, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 5 approaches. The busiest year so far is 2026.

What it is

A mixture-of-experts (MoE) model has many expert sub-networks and a router that sends each token to only a few of them, so the model can have many parameters while each input uses little computation. Research covers routing, expert specialisation, compression and efficient systems.

Terms you will see on this page:

Expert
one of the sub-networks inside an MoE layer.
Router
the small network that picks which experts process each token.
Sparse activation
only part of the model running for each input.

Start reading with the most cited papers here:

Within Architectures and efficiency, its share grew from 2.0% in 2023–24 to 6.7% in 2025–26 (39 → 239 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 0162017: 3172018: 0182019: 0192020: 1202021: 4212022: 15222023: 9232024: 31242025: 91252026: 16426

Explore Mixture of experts in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Routing and sparse MoE models · 283 papers
Keywords: sparse, scaling, moes

Approaches in this cluster:

Most cited and most cited since 2024:

MoE with LoRA and compression · 35 papers
Keywords: lora, rank, tuning

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Architectures and efficiency

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy