AI Paper Atlas

Research map / Large language models

Alignment and preferences: research map

672 papers on Alignment and preferences in Large language models, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 7 approaches. The busiest year so far is 2026.

What it is

Aligning a language model means making it helpful, honest and harmless as people judge it. This topic covers learning from preference data, either through a reward model and RL (RLHF) or directly (DPO), and how to build reward models and AI judges people can trust.

Terms you will see on this page:

Preference data
pairs of responses with a label saying which one people preferred.
DPO
direct preference optimization, which fits preferences without a separate reward model or RL.
Reward model
a model that scores responses to stand in for human judgment.

Start reading with the most cited papers here:

Within Large language models, its share grew from 6.6% in 2023–24 to 7.6% in 2025–26 (131 → 522 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 0162017: 2172018: 3182019: 1192020: 4202021: 0212022: 3222023: 16232024: 115242025: 241252026: 28726

Explore Alignment and preferences in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Reward models and human feedback · 418 papers
Keywords: feedback, human, rlhf

Approaches in this cluster:

Most cited and most cited since 2024:

Direct preference optimization · 254 papers
Keywords: preference optimization, dpo, direct preference

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Large language models

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy