AI Paper Atlas

Research map / Optimization

Nonconvex and smooth optimization: research map

1,707 papers on Nonconvex and smooth optimization in Optimization, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 5 clusters and 18 approaches. The busiest year so far is 2025.

What it is

The mathematics of optimisation methods: convergence rates and complexity bounds for gradient methods on nonconvex, minimax and bilevel problems, variance reduction, acceleration and projection-free methods such as Frank-Wolfe.

Terms you will see on this page:

Stationary point
a point where the gradient is near zero, the usual goal in nonconvex problems.
Minimax problem
optimising one variable against another, as in GANs or games.
Variance reduction
techniques that make stochastic gradients less noisy.

Start reading with the most cited papers here:

Within Optimization, its share held steady from 36.9% in 2023–24 to 36.0% in 2025–26 (320 → 352 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).

2016: 74162017: 90172018: 111182019: 144192020: 159202021: 152212022: 180222023: 181232024: 207242025: 220252026: 18926

Explore Nonconvex and smooth optimization in the interactive map

Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.

What changed recently

Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):

Papers from 2025–2026 that are already cited most:

Approaches and key papers

First-order and stochastic methods · 890 papers
Keywords: coordinate, proximal, bounds

Approaches in this cluster:

Most cited and most cited since 2024:

Complexity of nonconvex and bilevel problems · 409 papers
Keywords: complexity, bilevel, stationary

Approaches in this cluster:

Most cited and most cited since 2024:

Variance reduction · 172 papers
Keywords: variance, reduction, reduced

Approaches in this cluster:

Most cited and most cited since 2024:

Minimax and games · 169 papers
Keywords: games, zero sum, player

Approaches in this cluster:

Most cited and most cited since 2024:

Frank-Wolfe methods · 67 papers
Keywords: frank, wolfe, conditional

Approaches in this cluster:

Most cited and most cited since 2024:

Related topics in Optimization

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy