atlas

Research map / Architectures and efficiency / CNN design

Understanding the Effective Receptive Field in Deep Convolutional Neural Networks

NeurIPS 2016 · Architectures and efficiency › CNN design · approach: Large and dynamic kernel design

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Stack more layers of random-weight linear convolutions (ERF grows with depth)deep linear CNNs with random weights · synthetic networks, 5-40 layersERF size vs theoretical RF: ERF grows as sqrt(n); relative ratio shrinks as 1/sqrt(n)Hurt
Add ReLU nonlinearity to random-weight CNN20-layer random-weight CNN · synthetic networksERF GaussianityNo clear effect
Replace 3 of 15 conv layers with stride-2 subsampling or dilated convolutions (factors 2,4,8) (ablation)15-layer dense convnet · synthetic networkseffective receptive field sizeHelped
Train ResNet on CIFAR-10 and CamVid (ERF growth during training)ResNet classification and segmentation models · CamVid and CIFAR-10ERF size: CamVid ERF diameter grows from 100 to around 150Helped
Use scaled initialization with smaller center and larger outer kernel weightsCNN on CIFAR-10 · CIFAR-10training speed: 30% speed-up in a few cases; overall benefit not always significantMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy