atlas

Research map / Architectures and efficiency / CNN design

Zero Stability Well Predicts Performance of Convolutional Neural Networks

AAAI 2022 · Architectures and efficiency › CNN design · approach: Theory of convolutional inductive bias · 14 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Set PreResNet-32 feature coefficient α to 1 rather than a non-zero-stable setting such as α=2 (ablation)PreResNet-32 · CIFAR-10test accuracy: 79.13$\pm$0.30 -> 93.19$\pm$0.17Helped
Set LM-ResNet-44 coefficient k to 0.5 rather than k=-1.5 (ablation)LM-ResNet-44 · CIFAR-10test accuracy: 81.43$\pm$0.19 -> 93.69$\pm$0.21Helped
Use zero-stable rather than non-zero-stable third-order coefficients (ablation)Third-order-discretization CNNs · CIFAR-10, 32-, 44-, and 56-layer modelstest accuracy: 77.55$\pm$0.15 to 93.28$\pm$0.12; 77.91$\pm$0.62 to 93.72$\pm$0.10; 78.29$\pm$0.09 to 94.04$\pm$0.12Helped
Use theoretically optimal coefficients (root moduli 0.33, 0.33, 1.00) (ablation)Third-order-discretization CNNs · CIFAR-10, 32-, 44-, and 56-layer modelstest accuracy: 93.28$\pm$0.12; 93.68$\pm$0.15; 94.04$\pm$0.12Helped
Use zero-stable rather than non-zero-stable root moduli (ablation)Third-order-discretization CNNs · CIFAR-10, 56 layers, uniform noise [-0.08, 0]test accuracy: 69.38$\pm$0.40 -> 88.31$\pm$0.33Helped
Use zero-stable rather than non-zero-stable root moduli (ablation)Third-order-discretization CNNs · CIFAR-10, 56 layers, Gaussian noise δ=0.04test accuracy: 50.2$\pm$0.96 -> 76.74$\pm$0.13Helped
Use optimal root moduli 0.33, 0.33, 1.00 rather than non-zero-stable roots (ablation)Third-order-discretization CNNs · CIFAR-10, PGD adversarial examples, ε=8/255adversarial accuracy: 48.80 -> 63.76Helped
Use optimal root moduli 0.33, 0.33, 1.00 rather than non-zero-stable roots (ablation)Third-order-discretization CNNs · MNIST, FGSM adversarial examples, ε=0.3adversarial accuracy: 12 -> 59Helped
Reduce root moduli from 1, 0.87, 0.87 to 1, 0.33, 0.33 (ablation)ZeroSNet44 · CIFAR-100generalization gap: 26.45 -> 26.43Helped
Use ZeroSNet-Opt instead of LM-ResNet20-layer CNNs · CIFAR-10accuracy: 91.67$^{\dagger}$ -> 92.01$\pm$0.35Helped
Use ZeroSNet-Opt instead of LM-ResNet110-layer CNNs · CIFAR-100accuracy: 74.13$^{\dagger}$ -> 74.50$\pm$0.28Helped
Use ZeroSNet-Opt instead of PreResNet18-layer CNNs · ImageNet validationTop-1 accuracy: 69.66 -> 69.84Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy