AI Paper Atlas

Research map / Optimization / Implicit bias and generalization

Regularization in ResNet with Stochastic Depth

Soufiane Hayou, Fadhel Ayed

NeurIPS 2021 · Optimization › Implicit bias and generalization · approach: Explicit and implicit regularization interplay · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
SenseMode instead of Uniform mode at budget 0.1Stable ResNet110 SD · CIFAR-10test error (%): 17.2 -> 15.4Improved
SenseMode instead of Uniform mode at budget 0.1Stable ResNet110 SD · CIFAR-100test error (%): 55.2 -> 51.3Improved
SenseMode instead of Uniform mode at budget 0.4Stable ResNet110 SD · CIFAR-100test error (%): 30.9 -> 28.5Improved
SenseMode instead of Uniform mode at budget 0.4Stable ResNet110 SD · CIFAR-10test error (%): 7.4 -> 7.3No clear effect
SenseMode instead of Uniform mode at budget 0.7Stable ResNet110 SD · CIFAR-10test error (%): 5.9 -> 7.3Hurt
SenseMode instead of Uniform mode at budget 0.8Stable ResNet110 SD · CIFAR-100test error (%): 25.5 -> 30.0Hurt
Linear mode instead of Uniform mode at budget 0.5Stable ResNet110 SD · CIFAR-10test error (%): 6.8 -> 9.1Hurt
Linear mode instead of Uniform mode at budget 0.5Stable ResNet110 SD · CIFAR-100test error (%): 28.4 -> 36.5Hurt
Linear mode instead of Uniform mode at budget 0.9Stable ResNet110 SD · CIFAR-100test error (%): 25.5 -> 25.5No clear effect
Uniform stochastic depth at budget 0.9 versus full networkStable ResNet110 · CIFAR-10test error (%): 6.37 -> 5.7Improved
Uniform stochastic depth at budget 0.9 versus full networkStable ResNet110 · CIFAR-100test error (%): 26.5 -> 25.5Improved
reduce training budget from 0.9 to 0.1 with Uniform modeStable ResNet110 SD · CIFAR-10test error (%): 5.7 -> 17.2Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy