AI Paper Atlas

Research map / Continual learning

Online and replay-based: research map

693 papers on Online and replay-based in Continual learning, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 2 clusters and 8 approaches. The busiest year so far is 2026.

What it is

A model that keeps learning from a stream of new data tends to forget what it learned before ("catastrophic forgetting"). This topic studies how to keep old skills while adding new ones, often by storing a small memory of past examples and replaying them, or by protecting the weights that old tasks depend on.

Terms you will see on this page:

Catastrophic forgetting
the sharp drop in accuracy on earlier tasks after training on new ones.
Replay buffer
a small store of past examples mixed into training on new data.
Plasticity
the ability to keep learning new things; the opposite worry to forgetting.

Start reading with the most cited papers here:

Within Continual learning, its share shrank from 46.4% in 2023–24 to 34.2% in 2025–26 (163 → 197 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 2162017: 6172018: 22182019: 27192020: 52202021: 72212022: 76222023: 105232024: 100242025: 115252026: 11626

Explore Online and replay-based in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Forgetting, plasticity and growing networks · 546 papers
Keywords: weight, transfer, growing

Approaches in this cluster:

Most cited and most cited since 2024:

Online learning with replay · 147 papers
Keywords: online continual, replay, experience

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Continual learning

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy