TPAMI 2022 papers on Architectures and efficiency
37 of the 583 papers published in TPAMI 2022 (6.3%) are on Architectures and efficiency, compared with 7.4% at TPAMI 2021. They fall into 7 topics.
See TPAMI 2022 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 14 papers
- A Survey on Vision Transformer (5,163 citations)
- Contextual Transformer Networks for Visual Recognition (795 citations)
- Beyond Self-Attention: External Attention Using Two Linear Layers for Visual Tasks (728 citations)
- Image De-Raining Transformer (426 citations)
- VOLO: Vision Outlooker for Visual Recognition (360 citations)
- Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition (234 citations)
- DS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Vision Transformers (76 citations)
- High-Performance Transformer Tracking (62 citations)
- CATs++: Boosting Cost Aggregation With Convolutions and Transformers (43 citations)
- TransCL: Transformer Makes Strong and Flexible Compressive Learning (40 citations)
- Quantformer: Learning Extremely Low-Precision Vision Transformers (24 citations)
- Learning Continuous-Time Dynamics With Attention (20 citations)
and 2 more in the interactive map.
Neural architecture search · 7 papers
- Learning With Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision (62 citations)
- RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks (57 citations)
- Neural Architecture Search via Proxy Validation (16 citations)
- Searching for Network Width With Bilaterally Coupled Network (12 citations)
- Searching a High Performance Feature Extractor for Text Recognition Network (11 citations)
- A Generic Graph-Based Neural Architecture Encoding Scheme With Multifaceted Information (5 citations)
- Cyclic Differentiable Architecture Search
RNNs and normalization · 5 papers
- PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning (744 citations)
- Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial Computing (40 citations)
- Reframing Neural Networks: Deep Structure in Overcomplete Representations (5 citations)
- A Function Space Analysis of Finite Neural Networks With Insights From Sampling Theory (3 citations)
- State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions (3 citations)
CNN design · 4 papers
- 1xN Pattern for Pruning Convolutional Neural Networks (59 citations)
- Glance and Focus Networks for Dynamic Visual Recognition (56 citations)
- Equivariant Wavelets: Fast Rotation and Translation Invariant Wavelet Scattering Transforms (30 citations)
- Optimising for Interpretability: Convolutional Dynamic Alignment Networks
Pruning and efficient tuning · 4 papers
- RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging (27 citations)
- Exploring Structural Sparsity of Deep Networks Via Inverse Scale Spaces (14 citations)
- exploring Fine-Grained Sparsity in Convolutional Neural Networks for Efficient Inference (11 citations)
- A Multi-Task Multi-Stage Transitional Training Framework for Neural Chat Translation (7 citations)
Quantization · 2 papers
- Optimization-Based Post-Training Quantization With Bit-Split and Stitching (36 citations)
- SiMaN: Sign-to-Magnitude Network Binarization (32 citations)
Spiking networks · 1 paper
- Time-Ordered Recent Event (TORE) Volumes for Event Cameras (141 citations)
