ECCV 2024 accepted papers on Architectures and efficiency
96 of the 2,387 papers accepted at ECCV 2024 (4.0%) are on Architectures and efficiency, compared with 6.6% at ECCV 2022. They fall into 7 topics.
See ECCV 2024 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Attention and transformers · 36 papers
- Agent Attention: On the Integration of Softmax and Linear Attention (289 citations)
- Restoring Images in Adverse Weather Conditions via Histogram Transformer (162 citations)
- Rotary Position Embedding for Vision Transformer (140 citations)
- Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data (138 citations)
- Denoising Vision Transformers (51 citations)
- AUFormer: Vision Transformers are Parameter-Efficient Facial Action Unit Detectors (39 citations)
- VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks (37 citations)
- Isomorphic Pruning for Vision Models (31 citations)
- PosFormer: Recognizing Complex Handwritten Mathematical Expression with Position Forest Transformer (29 citations)
- LPViT: Low-Power Semi-structured Pruning for Vision Transformers (26 citations)
- An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Grounding (15 citations)
- Efficient Vision Transformers with Partial Attention (15 citations)
and 24 more in the interactive map.
Pruning and efficient tuning · 21 papers
- "Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance" (88 citations)
- Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks (63 citations)
- Model Stock: All we need is just a few fine-tuned models (41 citations)
- Image Compression for Machine and Human Vision With Spatial-Frequency Adaptation (36 citations)
- PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task Adaptation (14 citations)
- Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization (9 citations)
- SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning (8 citations)
- Dropout Mixture Low-Rank Adaptation for Visual Parameters-Efficient Fine-Tuning (7 citations)
- Dyn-Adapter: Towards Disentangled Representation for Efficient Visual Recognition (7 citations)
- Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer: A Disentangled Approach (7 citations)
- Memory-Efficient Fine-Tuning for Quantized Diffusion Model (6 citations)
- Scaling Backwards: Minimal Synthetic Pre-training? (5 citations)
and 9 more in the interactive map.
RNNs and normalization · 12 papers
- YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information (5,705 citations)
- Deep Patch Visual SLAM (70 citations)
- Adaptive Parametric Activation (9 citations)
- Layer-Wise Relevance Propagation with Conservation Property for ResNet (9 citations)
- Momentum Auxiliary Network for Supervised Local Learning (8 citations)
- Teddy: Efficient Large-Scale Dataset Distillation via Taylor-Approximated Matching (7 citations)
- Tiny Models are the Computational Saver for Large Models (6 citations)
- Trainable Highly-expressive Activation Functions (5 citations)
- Efficient Learning of Event-based Dense Representation using Hierarchical Memories with Adaptive Update (3 citations)
- DεpS: Delayed ε-Shrinking for Faster Once-For-All Training (2 citations)
- On Spectral Properties of Gradient-based Explanation Methods (1 citation)
- BaSIC: BayesNet Structure Learning for Computational Scalable Neural Image Compression
Quantization · 11 papers
- AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizer (24 citations)
- CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs (18 citations)
- PQ-SAM: Post-training Quantization for Segment Anything Model (11 citations)
- Differentiable Product Quantization for Memory Efficient Camera Relocalization (10 citations)
- GenQ: Quantization in Low Data Regimes with Generative Synthetic Data (9 citations)
- Dataset Quantization with Active Learning based Adaptive Sampling (7 citations)
- OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks (6 citations)
- MetaAug: Meta-Data Augmentation for Post-Training Quantization (3 citations)
- Quantization-Friendly Winograd Transformations for Convolutional Neural Networks (3 citations)
- Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients (3 citations)
- POCA: Post-training Quantization with Temporal Alignment for Codec Avatars
Neural architecture search · 8 papers
- MobileNetV4: Universal Models for the Mobile Ecosystem (851 citations)
- Auto-GAS: Automated Proxy Discovery for Training-free Generative Architecture Search (14 citations)
- Auto-DAS: Automated Proxy Discovery for Training-free Distillation-aware Architecture Search (6 citations)
- MO-EMT-NAS: Multi-Objective Continuous Transfer of Architectural Knowledge Between Tasks from Different Datasets (6 citations)
- SuperFedNAS: Cost-Efficient Federated Neural Architecture Search for On-Device Inference (4 citations)
- Dependency-aware Differentiable Neural Architecture Search (3 citations)
- FreeAugment: Data Augmentation Search Across All Degrees of Freedom (3 citations)
- HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis (2 citations)
Spiking networks · 5 papers
- Spiking Wavelet Transformer (26 citations)
- FTBC: Forward Temporal Bias Correction for Optimizing ANN-SNN Conversion (4 citations)
- Asynchronous Bioplausible Neuron for Spiking Neural Networks for Event-Based Vision (2 citations)
- Efficient Training of Spiking Neural Networks with Multi-Parallel Implicit Stream Architecture
- ELSE: Efficient Deep Neural Network Inference through Line-based Sparsity Exploration
CNN design · 3 papers
- Wavelet Convolutions for Large Receptive Fields (654 citations)
- Deep Feature Surgery: Towards Accurate and Efficient Multi-Exit Networks (10 citations)
- Taming Lookup Tables for Efficient Image Retouching (9 citations)
