AI Paper Atlas

Research map / Large language models

Instruction and fine-tuning: research map

888 papers on Instruction and fine-tuning in Large language models, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 8 approaches. The busiest year so far is 2026.

What it is

A pretrained language model becomes a useful assistant through fine-tuning on instructions and answers. This topic covers which data to use, cheap fine-tuning methods such as LoRA, and side effects such as lost safety or calibration after fine-tuning.

Terms you will see on this page:

Instruction tuning
fine-tuning on (instruction, response) pairs so the model follows requests.
Parameter-efficient fine-tuning
updating only a small set of added parameters, such as LoRA.
Data selection
choosing which training examples actually help.

Start reading with the most cited papers here:

Within Large language models, its share held steady from 10.5% in 2023–24 to 9.5% in 2025–26 (208 → 653 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 0162017: 0172018: 0182019: 1192020: 4202021: 3212022: 2222023: 31232024: 180242025: 295252026: 37226

Explore Instruction and fine-tuning in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Instruction tuning · 715 papers
Keywords: instruction tuning, instructions, instruction following

Approaches in this cluster:

Most cited and most cited since 2024:

Efficient fine-tuning and adaptation · 173 papers
Keywords: fine tuning, lora, adaptation

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Large language models

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy