ECCV 2022 accepted papers on Architectures and efficiency
109 of the 1,645 papers accepted at ECCV 2022 (6.6%) are on Architectures and efficiency, compared with 6.3% at ECCV 2020. They fall into 7 topics.
See ECCV 2022 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 40 papers
- MaxViT: Multi-axis Vision Transformer (1,240 citations)
- V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer (671 citations)
- DeiT III: Revenge of the ViT (520 citations)
- DaViT: Dual Attention Vision Transformers (471 citations)
- AiATrack: Attention in Attention for Transformer Visual Tracking (418 citations)
- EdgeViTs: Competing Light-Weight CNNs on Mobile Devices with Vision Transformers (326 citations)
- Stripformer: Strip Transformer for Fast Image Deblurring (324 citations)
- ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformer (302 citations)
- Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learning (291 citations)
- Adaptive Token Sampling for Efficient Vision Transformers (223 citations)
- Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction (187 citations)
- SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning (187 citations)
and 28 more in the interactive map.
RNNs and normalization · 16 papers
- FlowFormer: A Transformer Architecture for Optical Flow (430 citations)
- GaitEdge: Beyond Plain End-to-End Gait Recognition for Better Practicality (111 citations)
- Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs (109 citations)
- Learning to Weight Samples for Dynamic Early-Exiting Networks (51 citations)
- Disentangling Architecture and Training for Optical Flow (30 citations)
- MegBA: A GPU-Based Distributed Library for Large-Scale Bundle Adjustment (26 citations)
- Meta-GF: Training Dynamic-Depth Neural Networks Harmoniously (12 citations)
- Scalable Learning to Optimize: A Learned Optimizer Can Train Big Models (5 citations)
- SP-Net: Slowly Progressing Dynamic Inference Networks (3 citations)
- Batch-Efficient EigenDecomposition for Small and Medium Matrices (2 citations)
- "L3: Accelerator-Friendly Lossless Image Format for High-Resolution, High-Throughput DNN Training" (1 citation)
- On the Angular Update and Hyperparameter Tuning of a Scale-Invariant Network (1 citation)
and 4 more in the interactive map.
Quantization · 15 papers
- PTQ4ViT: Post-Training Quantization for Vision Transformers with Twin Uniform Quantization (220 citations)
- Mixed-Precision Neural Network Quantization via Learned Layer-Wise Importance (97 citations)
- AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets (87 citations)
- Network Binarization via Contrastive Learning (27 citations)
- Non-uniform Step Size Quantization for Accurate Post-Training Quantization (24 citations)
- Bitwidth-Adaptive Quantization-Aware Neural Network Training: A Meta-Learning Approach (11 citations)
- You Already Have It: A Generator-Free Low-Precision DNN Training Framework Using Stochastic Rounding (9 citations)
- RDO-Q: Extremely Fine-Grained Channel-Wise Quantization via Rate-Distortion Optimization (8 citations)
- BASQ: Branch-Wise Activation-Clipping Search Quantization for Sub-4-Bit Neural Networks (6 citations)
- Explicit Model Size Control and Relaxation via Smooth Regularization for Mixed-Precision Quantization (5 citations)
- Towards Accurate Network Quantization with Equivalent Smooth Regularizer (3 citations)
- Bandwidth-Aware Adaptive Codec for DNN Inference Offloading in IoT (2 citations)
and 3 more in the interactive map.
Neural architecture search · 14 papers
- Neural Architecture Search for Spiking Neural Networks (124 citations)
- Spectrum-Aware and Transferable Architecture Search for Hyperspectral Image Restoration (17 citations)
- Learning Where to Look – Generative NAS Is Surprisingly Efficient (16 citations)
- UFO: Unified Feature Optimization (16 citations)
- SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning (8 citations)
- Data-Free Neural Architecture Search via Recursive Label Calibration (7 citations)
- EASNet: Searching Elastic and Accurate Network Architecture for Stereo Matching (7 citations)
- LANA: Latency Aware Network Acceleration (7 citations)
- U-Boost NAS: Utilization-Boosted Differentiable Neural Architecture Search (4 citations)
- "UniNet: Unified Architecture Search with Convolution, Transformer, and MLP"
- A Max-Flow Based Approach for Neural Architecture Search
- CLOSE: Curriculum Learning on the Sharing Extent towards Better One-Shot NAS
and 2 more in the interactive map.
Pruning and efficient tuning · 10 papers
- Visual Prompt Tuning (2,268 citations)
- Exploring Lottery Ticket Hypothesis in Spiking Neural Networks (45 citations)
- Revisiting a kNN-based Image Classification System with High-capacity Storage (24 citations)
- Disentangled Differentiable Network Pruning (16 citations)
- Soft Masking for Cost-Constrained Channel Pruning (16 citations)
- Ensemble Knowledge Guided Sub-network Search and Fine-Tuning for Filter Pruning (10 citations)
- Multi-Granularity Pruning for Model Acceleration on Mobile Devices (5 citations)
- Recover Fair Deep Classification Models via Altering Pre-trained Structure (5 citations)
- CPrune: Compiler-Informed Model Pruning for Efficient Target-Aware DNN Execution
- Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps
CNN design · 9 papers
- Pure Transformer with Integrated Experts for Scene Text Recognition (26 citations)
- Lipschitz Continuity Retained Binary Neural Network (24 citations)
- Augmenting Deep Classifiers with Polynomial Neural Networks (16 citations)
- Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies (9 citations)
- SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks (2 citations)
- Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks
- BA-Net: Bridge Attention for Deep Convolutional Neural Networks
- Filter Pruning via Feature Discrimination in Deep Neural Networks
- SSBNet: Improving Visual Recognition Efficiency by Adaptive Sampling
Spiking networks · 5 papers
- Neuromorphic Data Augmentation for Training Spiking Neural Networks (85 citations)
- Towards Ultra Low Latency Spiking Neural Networks for Vision and Sequential Tasks Using Temporal Pruning (38 citations)
- Real Spike: Learning Real-Valued Spikes for Spiking Neural Networks (31 citations)
- Reducing Information Loss for Spiking Neural Networks (28 citations)
- MENet: A Memory-Based Network with Dual-Branch for Efficient Event Stream Processing (2 citations)
