AI Paper Atlas

Research map / Optimization / Implicit bias and generalization

Predictive Differential Training Guided by Training Dynamics

Fanqi Wang, Weisheng Tang, Landon Harris, Hairong Qi, Dan Wilson, Igor Mezic

ICLR 2026 · Optimization › Implicit bias and generalization · approach: Edge-of-stability dynamics

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add PDT (predictive differential training)SGD on FCN · CIFAR-10 FCNTime to baseline best train loss (s): 2174.32 -> 1313.52Improved
add PDTAdamW on ViT-Huge · ImageNet-1K ViT-HugeTime to baseline best train loss (s): 725564.86 -> 653854.05Improved
add PDTSGD-M on ResNet-50 · ImageNet-1K ResNet-50Time to baseline best train loss (s): 110063.72 -> 88752.33Improved
add PDTLAMB on AlexNet · CIFAR-10 AlexNetFinal accuracy: 0.8034 -> 0.8140Improved
add PDTSGD with Momentum on AlexNet · CIFAR-10 AlexNetFinal accuracy: 0.6672 -> 0.7298Improved
add PDTSGD on AlexNet · CIFAR-10 AlexNetFinal accuracy: 0.7930 -> 0.7978No clear effect
add PDTSimSiam SGD Momentum · CIFAR-10 SimSiamFinal accuracy: 0.7285 -> 0.7685Improved
add PDTSimSiam SGD Momentum · CIFAR-10 SimSiamTTB-Loss (s): 9611.35 -> 4922.92Improved
replace dynamic masking with random subset of Koopman predictions (ablation)PDT · CIFAR-10 AlexNettraining stabilityHurt
add PDT masking vs randomly raising learning rate of weight subset (ablation)AlexNet SGD · CIFAR-10 AlexNettrainingImproved
switch prediction vs SGD by validation loss trend instead of masking (ablation)PDT · CIFAR-10 AlexNetvalidation lossHurt
increase prediction steps beyond nine (ablation)PDT · CIFAR-10 AlexNettraining stabilityHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy