ICCV 2023 accepted papers on Architectures and efficiency
101 of the 2,156 papers accepted at ICCV 2023 (4.7%) are on Architectures and efficiency, compared with 6.0% at ICCV 2021. They fall into 8 topics.
See ICCV 2023 in the interactive map
Submitting to ICCV? Checklist →
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 39 papers
- Rethinking Vision Transformers for MobileNet Size and Speed (401 citations)
- FLatten Transformer: Vision Transformer using Focused Linear Attention (394 citations)
- Rethinking Mobile Block for Efficient Attention-based Models (360 citations)
- SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications (318 citations)
- MB-TaylorFormer: Multi-Branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing (295 citations)
- FastViT: A Fast Hybrid Vision Transformer Using Structural Reparameterization (278 citations)
- SwinLSTM: Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM (195 citations)
- Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Tracking (152 citations)
- Adaptive Frequency Filters As Efficient Global Token Mixers (136 citations)
- Adaptive and Background-Aware Vision Transformer for Real-Time UAV Tracking (84 citations)
- TransFace: Calibrating Transformer Training for Face Recognition from a Data-Centric Perspective (75 citations)
- SG-Former: Self-guided Transformer with Evolving Token Reallocation (74 citations)
and 27 more in the interactive map.
Pruning and efficient tuning · 22 papers
- DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-efficient Fine-Tuning (97 citations)
- Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning (82 citations)
- TransTIC: Transferring Transformer-based Image Compression from Human Perception to Machine Perception (70 citations)
- Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks (32 citations)
- Automatic Network Pruning via Hilbert-Schmidt Independence Criterion Lasso under Information Bottleneck Principle (31 citations)
- Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy (27 citations)
- Structural Alignment for Network Pruning through Partial Regularization (27 citations)
- Differentiable Transportation Pruning (22 citations)
- Vision Transformer Adapters for Generalizable Multitask Learning (20 citations)
- Towards Inadequately Pre-trained Models in Transfer Learning (18 citations)
- Pre-training Vision Transformers with Very Limited Synthesized Images (17 citations)
- Exploring Model Transferability through the Lens of Potential Energy (11 citations)
and 10 more in the interactive map.
Quantization · 11 papers
- I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference (174 citations)
- RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers (157 citations)
- EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization (43 citations)
- Dataset Quantization (35 citations)
- Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning (26 citations)
- A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance (22 citations)
- EQ-Net: Elastic Quantization Neural Networks (22 citations)
- Jumping through Local Minima: Quantization in the Loss Landscape of Vision Transformers (18 citations)
- INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold (17 citations)
- DenseShift: Towards Accurate and Efficient Low-Bit Power-of-Two Quantization (10 citations)
- Lossy and Lossless (L2) Post-training Model Size Compression (7 citations)
Neural architecture search · 9 papers
- MixPath: A Unified Approach for One-shot Neural Architecture Search (33 citations)
- ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices (30 citations)
- Extensible and Efficient Proxy for Neural Architecture Search (14 citations)
- ShiftNAS: Improving One-shot NAS via Probability Shift (11 citations)
- SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference (9 citations)
- Unleashing the Power of Gradient Signal-to-Noise Ratio for Zero-Shot NAS (9 citations)
- ROME: Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradient Accumulation (8 citations)
- Efficient Controllable Multi-Task Architectures (6 citations)
- TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching (2 citations)
Spiking networks · 8 papers
- Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks (85 citations)
- Membrane Potential Batch Normalization for Spiking Neural Networks (63 citations)
- Masked Spiking Transformer (62 citations)
- RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks (40 citations)
- Temporal-Coded Spiking Neural Networks with Dynamic Firing Threshold: Learning with Event-Driven Backpropagation (38 citations)
- Unleashing the Potential of Spiking Neural Networks with Dynamic Confidence (30 citations)
- Inherent Redundancy in Spiking Neural Networks (28 citations)
- SSF: Accelerating Training of Spiking Neural Networks with Stabilized Spiking Flow (5 citations)
RNNs and normalization · 7 papers
- LRRU: Long-short Range Recurrent Updating Networks for Depth Completion (86 citations)
- SHACIRA: Scalable HAsh-grid Compression for Implicit Neural Representations (33 citations)
- FCCNs: Fully Complex-valued Convolutional Networks using Complex-valued Color Model and Loss Function (17 citations)
- Deep Multitask Learning with Progressive Parameter Sharing (13 citations)
- Why do networks have inhibitory/negative connections? (10 citations)
- PRANC: Pseudo RAndom Networks for Compacting Deep Models (6 citations)
- Tiny Updater: Towards Efficient Neural Network-Driven Software Updating (1 citation)
CNN design · 4 papers
- XiNet: Efficient Neural Networks for tinyML (27 citations)
- Convolutional Networks with Oriented 1D Kernels (9 citations)
- Towards Improved Input Masking for Convolutional Neural Networks (7 citations)
- Poincare ResNet
Mixture of experts · 1 paper
- AdaMV-MoE: Adaptive Multi-Task Vision Mixture-of-Experts (102 citations)
