AI Paper Atlas

Research map / Optimization / Nonconvex and smooth optimization

Improving Neural Ordinary Differential Equations with Nesterov's Accelerated Gradient Method

Nghia Nguyen, Tan Minh Nguyen, Võ Thục Khánh Huyền, Stanley Osher, Thieu Vo

NeurIPS 2022 · Optimization › Nonconvex and smooth optimization · approach: Acceleration and Nesterov dynamics · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace NODE with GNesterovNODENODE · CIFAR10test accuracy: 0.5466 ± 0.0051 -> 0.6172 ± 0.0064Improved
replace NODE with GNesterovNODENODE · MNISTtest accuracy: 0.9531 ± 0.0042 -> 0.9807 ± 0.0013Improved
replace HBNODE with NesterovNODEHBNODE · CIFAR10test accuracy: 0.5989 ± 0.0035 -> 0.5996 ± 0.0033No clear effect
replace GHBNODE with GNesterovNODEGHBNODE · CIFAR10test accuracy: 0.6085 ± 0.0050 -> 0.6172 ± 0.0064Improved
replace GHBNODE with GNesterovNODEGHBNODE · MNISTtest accuracy: 0.9817 ± 0.0005 -> 0.9807 ± 0.0013No clear effect
replace SONODE with NesterovNODESONODE · MNISTtest accuracy: 0.9824 ± 0.0013 -> 0.9824 ± 0.0015No clear effect
add bounded activation and skip connection (NesterovNODE to GNesterovNODE) (ablation)NesterovNODE · CIFAR10test accuracy: 0.5996 ± 0.0033 -> 0.6172 ± 0.0064Improved
add bounded activation and skip connection (NesterovNODE to GNesterovNODE) (ablation)NesterovNODE · MNISTtest accuracy: 0.9824 ± 0.0015 -> 0.9807 ± 0.0013No clear effect
increase Nesterov factor r from 3 to 5 (ablation)GNesterovNODE · CIFAR10test accuracy: 0.6180 -> 0.6192Improved
increase Nesterov factor r from 5 to 10 (ablation)GNesterovNODE · CIFAR10test accuracy: 0.6192 -> 0.6296Improved
increase Nesterov factor r (ablation)GNesterovNODE · CIFAR10NFEsHurt
Euler solver with large step size 0.1/0.2/0.5: GNesterovNODE vs NODE (ablation)NODE · CIFAR10training stabilityImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy