AI Paper Atlas

Research map / Learning theory and algorithms

Kernels and regression theory: research map

1,272 papers on Kernels and regression theory in Learning theory and algorithms, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 3 clusters and 14 approaches. The busiest year so far is 2024.

What it is

Theory of why models generalise from training to test data: generalisation bounds, kernel methods, and exact high-dimensional analyses of regression that explain effects such as double descent.

Terms you will see on this page:

Generalization bound
a guarantee that test error is close to training error.
Kernel method
learning with a similarity function that implicitly maps inputs to a rich feature space.
Double descent
test error falling again after the point where the model can fit the training data exactly.

Start reading with the most cited papers here:

Within Learning theory and algorithms, its share held steady from 11.1% in 2023–24 to 10.2% in 2025–26 (248 → 247 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 58162017: 55172018: 66182019: 88192020: 124202021: 128212022: 145222023: 151232024: 173242025: 135252026: 14926

Explore Kernels and regression theory in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

Kernel methods · 540 papers
Keywords: kernels, hilbert, reproducing

Approaches in this cluster:

Most cited and most cited since 2024:

Generalization bounds · 401 papers
Keywords: generalization bounds, pac, generalization error

Approaches in this cluster:

Most cited and most cited since 2024:

High-dimensional regression · 331 papers
Keywords: ridge, linear regression, regularization

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Learning theory and algorithms

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy