TPAMI 2021 papers on Architectures and efficiency
38 of the 516 papers published in TPAMI 2021 (7.4%) are on Architectures and efficiency, compared with 4.1% at TPAMI 2020. They fall into 7 topics.
See TPAMI 2021 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Neural architecture search · 12 papers
- Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL (248 citations)
- Neural Architecture Transfer (195 citations)
- NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size (190 citations)
- ZeroNAS: Differentiable Generative Adversarial Networks Search for Zero-Shot Learning (178 citations)
- Towards Accurate and Compact Architectures via Neural Architecture Transformer (106 citations)
- Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search (99 citations)
- Partially-Connected Neural Architecture Search for Reduced Computational Redundancy (82 citations)
- PVNAS: 3D Neural Architecture Search with Point-Voxel Convolution (53 citations)
- MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search (51 citations)
- An Analysis of Super-Net Heuristics in Weight-Sharing NAS (42 citations)
- Evolving Fully Automated Machine Learning via Life-Long Knowledge Anchors (17 citations)
- Winning Solutions and Post-Challenge Analyses of the ChaLearn AutoDL Challenge 2019 (17 citations)
RNNs and normalization · 10 papers
- Multi-Task Learning for Dense Prediction Tasks: A Survey (971 citations)
- Deep Declarative Networks (125 citations)
- Deep Polynomial Neural Networks (107 citations)
- Gating Revisited: Deep Multi-layer RNNs That Can Be Trained (88 citations)
- Robust Differentiable SVD (70 citations)
- Fast Support Vector Classification for Large-Scale Problems (57 citations)
- Infant-ID: Fingerprints for Global Good (46 citations)
- MODENN: A Shallow Broad Neural Network Model Based on Multi-Order Descartes Expansion (9 citations)
- Tweaking Deep Neural Networks (9 citations)
- CoDiNet: Path Distribution Modeling With Consistency and Diversity for Dynamic Routing (8 citations)
CNN design · 5 papers
- Power Normalizations in Fine-Grained Image, Few-Shot Image and Graph Classification (70 citations)
- Convolutional Neural Networks with Gated Recurrent Connections (66 citations)
- GPCA: A Probabilistic Framework for Gaussian Process Embedded Channel Attention (33 citations)
- Learning Spherical Convolution for 360 Recognition (21 citations)
- Learning Versatile Convolution Filters for Efficient Visual Recognition (12 citations)
Quantization · 4 papers
- Transform Quantization for CNN Compression (88 citations)
- Effective Training of Convolutional Neural Networks With Low-Bitwidth Weights and Activations (42 citations)
- A Little Bit More: Bitplane-Wise Bit-Depth Recovery (32 citations)
- Gradient Matters: Designing Binarized Neural Networks via Enhanced Information-Flow (9 citations)
Spiking networks · 3 papers
Pruning and efficient tuning · 2 papers
Attention and transformers · 2 papers
- Text Compression-aided Transformer Encoding (50 citations)
- Attention in Attention Networks for Person Retrieval (40 citations)
