Research map / Architectures and efficiency
CNN design: research map
1,051 papers on CNN design in Architectures and efficiency, from ICML, NeurIPS, ICLR, CVPR, AAAI, ICCV and ECCV, and the journals TPAMI, IJCV and JMLR (2016–2026), grouped into 3 clusters and 13 approaches. The busiest year so far is 2018.
What it is
Design and theory of convolutional neural networks: efficient scalable CNNs, large and dynamic kernels, and networks that build in symmetries such as rotation (equivariant CNNs), along with analysis of what trained filters learn.
Terms you will see on this page:
- Convolution
- sliding a small learned filter over an image.
- Equivariance
- the output transforming predictably when the input is rotated or shifted.
- Receptive field
- the region of the input that affects one output.
Start reading with the most cited papers here:
- Densely Connected Convolutional Networks (CVPR 2017 · 45,904 citations)
- Rethinking the Inception Architecture for Computer Vision (CVPR 2016 · 31,549 citations)
Within Architectures and efficiency, its share shrank from 7.0% in 2023–24 to 2.9% in 2025–26 (137 → 102 papers at ICML, NeurIPS, ICLR, CVPR and AAAI, the venues with data for all four years).
Explore CNN design in the interactive map
Working on something in this topic? Describe your idea in scime atlas to see which approach it falls under, the closest papers by meaning and how crowded the spot has become.
What changed recently
Approaches whose share of the topic moved most between 2023–24 and 2025–26 (ICML, NeurIPS, ICLR, CVPR and AAAI):
- Group symmetry equivariant networks rising: 12% → 22% of the topic (16 → 22 papers)
- Biologically inspired CNN explanation rising: 4% → 11% of the topic (5 → 11 papers)
- Dense matching and estimation CNNs rising: 15% → 19% of the topic (20 → 19 papers)
- Compact CNN architectures falling: 13% → 2% of the topic (18 → 2 papers)
- Efficient CNN scaling and dynamic inference falling: 9% → 4% of the topic (13 → 4 papers)
Papers from 2025–2026 that are already cited most:
- EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba (AAAI 2025 · 165 citations)
- Frequency Dynamic Convolution for Dense Image Prediction (CVPR 2025 · 92 citations)
- Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized? (CVPR 2025 · 13 citations)
- Rotation-Equivariant Self-Supervised Method in Image Denoising (CVPR 2025 · 5 citations)
Approaches and key papers
CNN filters and inductive bias · 507 papers
Keywords: cnn, filter, trained
Approaches in this cluster:
- Filter design and trained-filter analysis (184 papers)
Redesigns CNN filters through shaping, structured filter banks, and empirical analysis of learned filters. - Compact CNN architectures (139 papers)
Condenses and refines convolutional networks via binary structure, learned shapes, and PDE views. - Theory of convolutional inductive bias (73 papers)
Analyzes invariance, stability, and Lipschitz properties of convolutional layers and pooling geometry. - CNN filter pruning (55 papers)
Prunes or factorizes convolutional filters using frequency-domain, gating, and redundancy criteria. - Biologically inspired CNN explanation (56 papers)
Explains CNN behavior and links networks to human visual cortex and perceptual learning.
Most cited and most cited since 2024:
- Densely Connected Convolutional Networks (CVPR 2017 · 45,904 citations)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (ICLR 2021 · 21,812 citations)
- RepViT: Revisiting Mobile CNN From ViT Perspective (CVPR 2024 · 30 citations)
- Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methods (CVPR 2024 · 17 citations)
Convolution and kernel design · 415 papers
Keywords: convolution, kernel, spatial
Approaches in this cluster:
- Efficient CNN scaling and dynamic inference (139 papers)
Scales and compresses CNNs with compound scaling, dynamic spatial computation, and channel-wise convolutions. - Dense matching and estimation CNNs (107 papers)
Designs convolutional descriptors and fusion networks for matching, optical flow, and stereo confidence. - Invertible and wide-network analysis (67 papers)
Builds invertible convolutional networks and analyzes infinitely wide networks through kernel theory. - Large and dynamic kernel design (70 papers)
Rethinks convolution kernel size, shape, and dynamic composition to enlarge receptive fields. - Higher-order pooling (32 papers)
Replaces average pooling with kernel, wavelet, stochastic, and bilinear pooling in CNNs.
Most cited and most cited since 2024:
- Rethinking the Inception Architecture for Computer Vision (CVPR 2016 · 31,549 citations)
- Squeeze-and-Excitation Networks (CVPR 2018 · 30,472 citations)
- EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentation (CVPR 2024 · 506 citations)
- InceptionNeXt: When Inception Meets ConvNeXt (CVPR 2024 · 401 citations)
Equivariant networks · 129 papers
Keywords: equivariant, equivariance, group
Approaches in this cluster:
- Group symmetry equivariant networks (59 papers)
Builds networks equivariant to Lie groups, diffeomorphisms, and gauge symmetries. - Steerable rotation-equivariant CNNs (49 papers)
Designs steerable filters for rotation, scale, and Euclidean equivariance in convolutional networks. - Group convolution theory (21 papers)
Develops theory and efficient designs of group-equivariant convolutional networks on homogeneous spaces.
Most cited and most cited since 2024:
- Harmonic Networks: Deep Translation and Rotation Equivariance (CVPR 2017 · 594 citations)
- Group Equivariant Convolutional Networks (ICML 2016 · 552 citations)
- Making Vision Transformers Truly Shift-Equivariant (CVPR 2024 · 9 citations)
- Rotation-Equivariant Self-Supervised Method in Image Denoising (CVPR 2025 · 5 citations)
Related topics in Architectures and efficiency
- Pruning and efficient tuning (1,335)
- Attention and transformers (2,598)
- Neural architecture search (548)
- Quantization (785)
- RNNs and normalization (3,071)
- Spiking networks (333)
- Mixture of experts (318)
