AI Paper Atlas

Research map / Vision-language and multimodal

Cross-modal learning: research map

1,766 papers on Cross-modal learning in Vision-language and multimodal, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 3 clusters and 12 approaches. The busiest year so far is 2026.

What it is

Learning from several modalities at once (images, text, audio, depth, medical scans): fusing them, coping when one is missing, retrieving across them, and using sound to locate or separate sources in video.

Terms you will see on this page:

Multimodal fusion
combining information from several input types.
Cross-modal retrieval
finding items in one modality (images) from a query in another (text).
Audio-visual learning
using sound and video together, such as locating what makes a sound.

Start reading with the most cited papers here:

Within Vision-language and multimodal, its share held steady from 18.3% in 2023–24 to 16.5% in 2025–26 (290 → 788 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 23162017: 25172018: 35182019: 48192020: 50202021: 86212022: 97222023: 146232024: 254242025: 353252026: 64926

Explore Cross-modal learning in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Multimodal fusion · 945 papers
Keywords: fusion, missing, multi modal

Approaches in this cluster:

Most cited and most cited since 2024:

Cross-modal retrieval · 533 papers
Keywords: cross, retrieval, image text

Approaches in this cluster:

Most cited and most cited since 2024:

Audio-visual learning · 288 papers
Keywords: audio, sound, speech

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Vision-language and multimodal

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy