AI Paper Atlas

Research map / Label-efficient and robust learning

Self-supervised and contrastive: research map

1,267 papers on Self-supervised and contrastive in Label-efficient and robust learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 3 clusters and 12 approaches. The busiest year so far is 2023.

What it is

Self-supervised learning learns useful features from unlabeled data by solving tasks the data poses itself, such as recognising two crops of the same image (contrastive learning) or filling in masked patches. The features are then reused for classification, detection and more with few labels.

Terms you will see on this page:

Contrastive learning
pulling together representations of two views of the same sample and pushing apart others.
Masked autoencoder (MAE)
a model trained to reconstruct hidden patches of its input.
Linear probe
judging learned features by training only a linear classifier on top of them.

Start reading with the most cited papers here:

Within Label-efficient and robust learning, its share held steady from 11.3% in 2023–24 to 10.5% in 2025–26 (324 → 321 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 5162017: 10172018: 11182019: 24192020: 74202021: 150212022: 190222023: 240232024: 181242025: 182252026: 20026

Explore Self-supervised and contrastive in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Masked and invariance-based self-supervision · 521 papers
Keywords: supervised ssl, representations, masked

Approaches in this cluster:

Most cited and most cited since 2024:

Pretext tasks and self-supervision in practice · 474 papers
Keywords: depth, self supervision, pre

Approaches in this cluster:

Most cited and most cited since 2024:

Contrastive learning · 272 papers
Keywords: supervised contrastive, contrastive self, negative

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Label-efficient and robust learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy