AI Paper Atlas

Research map / Vision-language and multimodal

Human and embodied modeling: research map

2,095 papers on Human and embodied modeling in Vision-language and multimodal, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 5 clusters and 21 approaches. The busiest year so far is 2025.

What it is

Models that connect vision and language in human-centred ways: captioning, grounding phrases in images, retrieval, decoding what people see from brain scans, and comparing model perception with human perception.

Terms you will see on this page:

Visual grounding
locating the image region a phrase refers to.
Image captioning
describing an image in a sentence.
Vision-language pretraining
pretraining on image-text pairs to learn joint representations.

Start reading with the most cited papers here:

Within Vision-language and multimodal, its share shrank from 33.5% in 2023–24 to 14.0% in 2025–26 (532 → 669 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 56162017: 72172018: 68182019: 89192020: 116202021: 141212022: 165222023: 265232024: 367242025: 419252026: 33726

Explore Human and embodied modeling in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Retrieval, captioning and scene graphs · 776 papers
Keywords: retrieval, scene, captioning

Approaches in this cluster:

Most cited and most cited since 2024:

Human perception and cognition · 463 papers
Keywords: computer vision, humans, abstract

Approaches in this cluster:

Most cited and most cited since 2024:

Vision-language pretraining · 462 papers
Keywords: pre, generation, unified

Approaches in this cluster:

Most cited and most cited since 2024:

Brain decoding and visual concepts · 235 papers
Keywords: concepts, brain, fmri

Approaches in this cluster:

Most cited and most cited since 2024:

Visual grounding · 159 papers
Keywords: grounding, referring, expression

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Vision-language and multimodal

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy