TPAMI 2024 papers on Architectures and efficiency
41 of the 666 papers published in TPAMI 2024 (6.2%) are on Architectures and efficiency, compared with 6.8% at TPAMI 2023. They fall into 7 topics.
See TPAMI 2024 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 14 papers
- A Survey on Efficient Vision Transformers: Algorithms, Techniques, and Performance Benchmarking (213 citations)
- Vision Transformer With Quadrangle Attention (111 citations)
- QKSAN: A Quantum Kernel Self-Attention Network (93 citations)
- Pruning Self-Attentions Into Convolutional Layers in Single Path (72 citations)
- VST++: Efficient and Stronger Visual Saliency Transformer (69 citations)
- HIRI-ViT: Scaling Vision Transformer With High Resolution Inputs (58 citations)
- V2X-ViTv2: Improved Vision Transformers for Vehicle-to-Everything Cooperative Perception (50 citations)
- InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene Understanding (32 citations)
- B-Cos Alignment for Inherently Interpretable CNNs and Vision Transformers (31 citations)
- EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Training (26 citations)
- Latent Semantic and Disentangled Attention (20 citations)
- Demystify Transformers & Convolutions in Modern Image Deep Networks (10 citations)
and 2 more in the interactive map.
RNNs and normalization · 8 papers
- AIfES: A Next-Generation Edge AI Framework (65 citations)
- A Multiple Controlled Toffoli Driven Adaptive Quantum Neural Network Model for Dynamic Workload Prediction in Cloud Environments (34 citations)
- End-to-End Signal Classification in Signed Cumulative Distribution Transform Space (19 citations)
- Quantum Gated Recurrent Neural Networks (19 citations)
- Designing Universally-Approximating Deep Neural Networks: A First-Order Optimization Approach (13 citations)
- AutoNet-Generated Deep Layer-Wise Convex Networks for ECG Classification (10 citations)
- Dual Input Stream Transformer for Vertical Drift Correction in Eye-Tracking Reading Data (10 citations)
- On the Number of Linear Regions of Convolutional Neural Networks With Piecewise Linear Activations (7 citations)
Pruning and efficient tuning · 6 papers
- A Survey on Deep Neural Network Pruning: Taxonomy, Comparison, Analysis, and Recommendations (693 citations)
- Filter Pruning by High-Order Spectral Clustering (13 citations)
- Influence Function Based Second-Order Channel Pruning: Evaluating True Loss Changes for Pruning is Possible Without Retraining (11 citations)
- MoIL: Momentum Imitation Learning for Efficient Vision-Language Adaptation (10 citations)
- Dual-Grained Lightweight Strategy (6 citations)
- Practical Network Acceleration With Tiny Sets: Hypothesis, Theory, and Algorithm (6 citations)
Quantization · 4 papers
- Video Coding for Machines: Compact Visual Representation Compression for Intelligent Collaborative Analytics (91 citations)
- A Review of State-of-the-art Mixed-Precision Neural Network Frameworks (74 citations)
- Non-Serial Quantization-Aware Deep Optics for Snapshot Hyperspectral Imaging (17 citations)
- Multi-Objective Convex Quantization for Efficient Model Compression (10 citations)
Neural architecture search · 4 papers
- Neural Prompt Search (163 citations)
- Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities (66 citations)
- PATNAS: A Path-Based Training-Free Neural Architecture Search (51 citations)
- Training-Free Transformer Architecture Search With Zero-Cost Proxy Guided Evolution (21 citations)
Spiking networks · 3 papers
- Self-Supervised High-Order Information Bottleneck Learning of Spiking Neural Network for Robust Event-Based Optical Flow Estimation (132 citations)
- Developmental Plasticity-Inspired Adaptive Pruning for Deep Spiking and Artificial Neural Networks (21 citations)
- eFFT: An Event-Based Method for the Efficient Computation of Exact Fourier Transforms (11 citations)
