ICCV 2021 accepted papers on Architectures and efficiency
96 of the 1,612 papers accepted at ICCV 2021 (6.0%) are on Architectures and efficiency, compared with 5.1% at ICCV 2019. They fall into 7 topics.
See ICCV 2021 in the interactive map
Submitting to ICCV? Checklist →
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 30 papers
- CvT: Introducing Convolutions to Vision Transformers (2,818 citations)
- Vision Transformers for Dense Prediction (2,692 citations)
- Tokens-to-Token ViT: Training Vision Transformers From Scratch on ImageNet (2,606 citations)
- CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification (2,350 citations)
- Multiscale Vision Transformers (1,594 citations)
- Going Deeper With Image Transformers (1,425 citations)
- LeViT: A Vision Transformer in ConvNet's Clothing for Faster Inference (1,067 citations)
- Rethinking Spatial Dimensions of Vision Transformers (750 citations)
- Incorporating Convolution Designs Into Visual Transformers (656 citations)
- Visual Saliency Transformer (634 citations)
- Understanding Robustness of Transformers for Image Classification (462 citations)
- Rethinking and Improving Relative Position Encoding for Vision Transformer (427 citations)
and 18 more in the interactive map.
Neural architecture search · 23 papers
- FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search (383 citations)
- Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition (197 citations)
- CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification (194 citations)
- BossNAS: Exploring Hybrid CNN-Transformers With Block-Wisely Self-Supervised Neural Architecture Search (112 citations)
- GLiT: Neural Architecture Search for Global and Local Image Transformer (105 citations)
- Pyramid Architecture Search for Real-Time Image Deblurring (46 citations)
- Direct Differentiable Augmentation Search (44 citations)
- Evolving Search Space for Neural Architecture Search (44 citations)
- Homogeneous Architecture Augmentation for Neural Predictor (41 citations)
- BN-NAS: Neural Architecture Search With Batch Normalization (35 citations)
- Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces (33 citations)
- NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization (30 citations)
and 11 more in the interactive map.
CNN design · 16 papers
- Refining Activation Downsampling With SoftPool (317 citations)
- FaPN: Feature-Aligned Pyramid Network for Dense Image Prediction (278 citations)
- Vector Neurons: A General Framework for SO(3)-Equivariant Networks (265 citations)
- MicroNet: Improving Image Recognition With Extremely Low FLOPs (131 citations)
- Towards Better Explanations of Class Activation Mapping (124 citations)
- Separable Flow: Learning Motion Cost Volumes for Optical Flow Estimation (113 citations)
- Dynamic Cross Feature Fusion for Remote Sensing Pansharpening (86 citations)
- Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transform (84 citations)
- Dynamic Dual Gating Neural Networks (58 citations)
- MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworks (52 citations)
- LFI-CAM: Learning Feature Importance for Better Visual Explanation (37 citations)
- Impact of Aliasing on Generalization in Deep Convolutional Networks (33 citations)
and 4 more in the interactive map.
Quantization · 13 papers
- ReCU: Reviving the Dead Weights in Binary Neural Networks (96 citations)
- Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimization (70 citations)
- Improving Neural Network Efficiency via Post-Training Quantization With Adaptive Floating-Point (69 citations)
- Once Quantization-Aware Training: High Performance Extremely Low-Bit Architecture Search (48 citations)
- Distance-Aware Quantization (38 citations)
- Improving Low-Precision Network Quantization via Bin Regularization (35 citations)
- Generalizable Mixed-Precision Quantization via Attribution Rank Preservation (27 citations)
- Bit-Mixer: Mixed-Precision Networks With Runtime Bit-Width Selection (26 citations)
- FATNN: Fast and Accurate Ternary Neural Networks (26 citations)
- Sub-Bit Neural Networks: Learning To Compress and Accelerate Binary Neural Networks (19 citations)
- Cluster-Promoting Quantization With Bit-Drop for Minimizing Network Quantization Loss (12 citations)
- RMSMP: A Novel Deep Neural Network Quantization Framework With Row-Wise Mixed Schemes and Multiple Precisions (8 citations)
and 1 more in the interactive map.
RNNs and normalization · 7 papers
- Task Switching Network for Multi-Task Learning (44 citations)
- Architecture Disentanglement for Deep Neural Networks (18 citations)
- Learning Specialized Activation Functions With the Piecewise Linear Unit (14 citations)
- Memory-Augmented Dynamic Neural Relational Inference (12 citations)
- Generating Attribution Maps With Disentangled Masked Backpropagation (5 citations)
- RDI-Net: Relational Dynamic Inference Networks (5 citations)
- Towards Memory-Efficient Neural Networks via Multi-Level In Situ Generation (4 citations)
Pruning and efficient tuning · 4 papers
- ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (205 citations)
- GDP: Stabilized Neural Network Pruning via Gates With Differentiable Polarization (41 citations)
- Exploiting Sample Correlation for Crowd Counting With Multi-Expert Network (36 citations)
- NASOA: Towards Faster Task-Oriented Online Fine-Tuning With a Zoo of Models (7 citations)
Spiking networks · 3 papers
- Incorporating Learnable Membrane Time Constant To Enhance Learning of Spiking Neural Networks (739 citations)
- Temporal-Wise Attention Spiking Neural Networks for Event Streams Classification (220 citations)
- DCT-SNN: Using DCT To Distribute Spatial Information Over Time for Low-Latency Spiking Neural Networks (50 citations)
