atlas

Research map / Architectures and efficiency / CNN design

Deep Continuous Networks

ICML 2021 · Architectures and efficiency › CNN design · approach: Compact CNN architectures

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace pixel 3x3 kernels with SRF filters in ODE blocks (DCN-ODE)neural ODE CNN · CIFAR-10 small-data (52 images/class)accuracy (%): 44.5 vs 41.7 for ODE-NetHelped
Replace pixel 3x3 kernels with SRF filters in ODE blocks (DCN-ODE)neural ODE CNN · CIFAR-10 small-data (1024 images/class)accuracy (%): 79.7 vs 77.4 for ODE-NetHelped
Replace pixel 3x3 kernels with SRF filters in ODE blocks (DCN-ODE)neural ODE CNN · CIFAR-10 full training validationaccuracy (%): 89.5 vs 89.6 for ODE-NetNo clear effect
Replace pixel 3x3 kernels with SRF filters in ODE blocks (DCN-ODE) for reconstructionencoder-decoder with ODE blocks · CIFAR-10 reconstruction validationreconstruction loss (%): 17.1 vs 20.2 for ODE-Net (lower is better)Helped
Use SRF filters in ResNet blocks only (no ODE) (ablation)ResNet blocks · CIFAR-10 full training validationaccuracy (%): 88.3 vs 89.0 for ResNet-blocksHurt
Use SRF filters everywhere including downsampling layers (ResNet-SRF-full) (ablation)ResNet blocks · CIFAR-10 full training validationaccuracy (%): 89.3 vs 89.0 for ResNet-blocksHelped
Use SRF filters everywhere including downsampling layers (DCN-full) instead of DCN-ODE (ablation)DCN · CIFAR-10 full training validationaccuracy (%): 89.2 vs 89.5 for DCN-ODEHurt
Learn scale sigma independently per input and output channel pair (DCN σji) (ablation)DCN-ODE · CIFAR-10 full training validationaccuracy (%): 89.7 vs 89.5 for DCN-ODEHelped
Meta-parametrize sigma as a function of depth (linear or quadratic) or both sigma and alpha (ablation)DCN · CIFAR-10 validationaccuracy (%): 89.88 to 89.97 across variants; paper cites ~89.5 for static DCN-ODENo clear effect
Scale input feature maps by contrast c and scale integration time by c at test time (ablation)DCN and ODE-Net · CIFAR-10 validation, contrast robustnessvalidation accuracy and NFE: total NFE reduced from 102 to 60 at c=0.06 with <0.5% accuracy lossHelped
Mask n x n center pixels at test time (pattern completion)DCN vs ResNet-blocks and ODE-Net · CIFAR-10 validation with masksvalidation accuracy: DCNs marginally more robust to zero-masking than baselinesHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy