AI Paper Atlas

Research map / Optimization / Optimizers

Optimizing Neural Networks via Koopman Operator Theory

NeurIPS 2020 · Optimization › Optimizers · approach: Differentiating through embedded optimization · 6 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Koopman training replaces Adam steps for NN DE solverKoopman training · NN DE solver 1:10:10:2speedup: 98xHelped
Koopman training replaces Adagrad stepsKoopman training · NN DE solver 1:10:10:2speedup: 132xHelped
Koopman training replaces Adadelta stepsKoopman training · NN DE solver 1:10:10:2speedup: 141xHelped
Koopman training replaces stochastic Adadelta stepsKoopman training · MNIST NN 784:20:20:20:10speedup: 15xHelped
choose Adam instead of Adadelta as underlying optimizerKoopman training · NN DE solversuccess rate: 100% -> 84%Hurt
choose Adagrad instead of Adadelta as underlying optimizerKoopman training · NN DE solversuccess rate: 100% -> 92%Hurt
choose Adam instead of Adadelta as underlying optimizerKoopman training · NN DE solverTeq/T: 1.00 -> 0.85Hurt
Koopman weight prediction vs true Adadelta weight evolutionKoopman training · NN DE solver, ten best NNserror / true evolution: median ratio 0.0044Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy