AI Paper Atlas

Research map / Continual learning

Continual fine-tuning of LLMs: research map

315 papers on Continual fine-tuning of LLMs in Continual learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 5 approaches. The busiest year so far is 2026.

What it is

Large language and vision-language models are updated again and again with new data and instructions. This topic covers how to add knowledge or skills to such models cheaply (for example with LoRA adapters or model merging) without losing general abilities, and how to remove specific knowledge on request (unlearning).

Terms you will see on this page:

LoRA
a cheap fine-tuning method that trains small low-rank matrices next to the frozen weights.
Model merging
combining the weights of separately fine-tuned models into one model.
Machine unlearning
making a trained model forget specific data or facts.

Start reading with the most cited papers here:

Within Continual learning, its share grew from 14.8% in 2023–24 to 33.9% in 2025–26 (52 → 195 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 0162017: 0172018: 1182019: 3192020: 1202021: 2212022: 15222023: 19232024: 42242025: 78252026: 15426

Explore Continual fine-tuning of LLMs in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Continual pretraining, multimodal tuning and unlearning · 160 papers
Keywords: unlearning, multimodal, instruction

Approaches in this cluster:

Most cited and most cited since 2024:

Low-rank adaptation and merging · 155 papers
Keywords: pre trained, lora, fine tuning

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Continual learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy