AI Paper Atlas

Research map / Vision-language and multimodal

Multimodal LLMs: research map

3,132 papers on Multimodal LLMs in Vision-language and multimodal, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 4 clusters and 15 approaches. The busiest year so far is 2026.

What it is

Multimodal large language models (MLLMs) connect an image or video encoder to a language model, so one model can describe, reason about and chat about visual input. Research covers instruction tuning, benchmarks, reducing visual tokens for speed, visual reasoning and hallucination.

Terms you will see on this page:

MLLM / LVLM
a multimodal or large vision-language model that takes images and text.
Visual tokens
the image features fed to the language model as a token sequence.
Hallucination
describing objects or details that are not in the image.

Start reading with the most cited papers here:

Within Vision-language and multimodal, its share grew from 13.0% in 2023–24 to 45.1% in 2025–26 (207 → 2,156 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 2162017: 2172018: 3182019: 3192020: 9202021: 7212022: 7222023: 31232024: 286242025: 891252026: 189126

Explore Multimodal LLMs in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Visual reasoning in VLMs · 1,633 papers
Keywords: vlms, visual reasoning, chain

Approaches in this cluster:

Most cited and most cited since 2024:

Multimodal assistants and instruction tuning · 965 papers
Keywords: mllm, instruction, llms

Approaches in this cluster:

Most cited and most cited since 2024:

Visual token reduction · 297 papers
Keywords: tokens, pruning, visual token

Approaches in this cluster:

Most cited and most cited since 2024:

Hallucination in vision-language models · 237 papers
Keywords: hallucination, lvlms, mitigating

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Vision-language and multimodal

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy