ICCV 2025 accepted papers on Architectures and efficiency
91 of the 2,701 papers accepted at ICCV 2025 (3.4%) are on Architectures and efficiency, compared with 4.7% at ICCV 2023. They fall into 8 topics.
See ICCV 2025 in the interactive map
Submitting to ICCV? Checklist →
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Pruning and efficient tuning · 31 papers
- Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (15 citations)
- QR-LoRA: Efficient and Disentangled Fine-tuning via QR Decomposition for Customized Generation (12 citations)
- On the Robustness Tradeoff in Fine-Tuning (9 citations)
- CVPT: Cross Visual Prompt Tuning (8 citations)
- Parameter-Efficient Adaptation of Geospatial Foundation Models through Embedding Deflection (8 citations)
- Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Experts (7 citations)
- DuoLoRA : Cycle-consistent and Rank-disentangled Content-Style Personalization (7 citations)
- Towards Higher Effective Rank in Parameter-Efficient Fine-tuning using Khatri-Rao Product (7 citations)
- Variance-Based Pruning for Accelerating and Compressing Trained Networks (7 citations)
- TR-PTS: Task-Relevant Parameter and Token Selection for Efficient Tuning (5 citations)
- Partial Forward Blocking: A Novel Data Pruning Paradigm for Lossless Training Acceleration (4 citations)
- ConsNoTrainLoRA: Data-driven Weight Initialization of Low-rank Adapters using Constraints (3 citations)
and 19 more in the interactive map.
Attention and transformers · 25 papers
- VSSD: Vision Mamba with Non-Causal State Space Duality (61 citations)
- LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivity (43 citations)
- Learned Image Compression with Hierarchical Progressive Context Modeling (23 citations)
- Devil is in the Uniformity: Exploring Diverse Learners within Transformer for Image Restoration (13 citations)
- Always Skip Attention (8 citations)
- MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling (8 citations)
- An Efficient Hybrid Vision Transformer for TinyML Applications (7 citations)
- Semantic Equitable Clustering: A Simple and Effective Strategy for Clustering Vision Tokens (7 citations)
- A Hidden Stumbling Block in Generalized Category Discovery: Distracted Attention (6 citations)
- CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matching (6 citations)
- Efficient Concertormer for Image Deblurring and Beyond (6 citations)
- ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models (6 citations)
and 13 more in the interactive map.
Quantization · 13 papers
- QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning (39 citations)
- AHCPTQ: Accurate and Hardware-Compatible Post-Training Quantization for Segment Anything Model (7 citations)
- Robust Machine Unlearning for Quantized Neural Networks via Adaptive Gradient Reweighting with Similar Labels (7 citations)
- OuroMamba: A Data-Free Quantization Framework for Vision Mamba (6 citations)
- Scheduling Weight Transitions for Quantization-Aware Training (6 citations)
- Memory-Efficient 4-bit Preconditioned Stochastic Optimization (5 citations)
- MixA-Q: Revisiting Activation Sparsity for Vision Transformers from a Mixed-Precision Quantization Perspective (4 citations)
- Task Vector Quantization for Memory-Efficient Model Merging (4 citations)
- ViM-VQ: Efficient Post-Training Vector Quantization for Visual Mamba (3 citations)
- Memory-Efficient Generative Models via Product Quantization (2 citations)
- SSVQ: Unleashing the Potential of Vector Quantization with Sign-Splitting (2 citations)
- Allowing Oscillation Quantization: Overcoming Solution Space Limitation in Low Bit-Width Quantization (1 citation)
and 1 more in the interactive map.
RNNs and normalization · 6 papers
- Addressing Representation Collapse in Vector Quantized Models with One Linear Layer (61 citations)
- A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization (8 citations)
- ETA: Efficiency through Thinking Ahead, A Dual Approach to Self-Driving with Large Models (5 citations)
- Removing Cost Volumes from Optical Flow Estimators (3 citations)
- Dataset Distillation as Data Compression: A Rate-Utility Perspective (1 citation)
- JPEG Processing Neural Operator for Backward-Compatible Coding
CNN design · 5 papers
- MobileIE: An Extremely Lightweight and Effective ConvNet for Real-Time Image Enhancement on Mobile Devices (21 citations)
- UniConvNet: Expanding Effective Receptive Field while Maintaining Asymptotically Gaussian Distribution for ConvNets of Any Scale (9 citations)
- Metric Convolutions: A Unifying Theory to Adaptive Image Convolutions (5 citations)
- Axis-level Symmetry Detection with Group-Equivariant Representation (2 citations)
- Transparent Vision: A Theory of Hierarchical Invariant Representations
Neural architecture search · 5 papers
- Loss Functions for Predictor-based Neural Architecture Search (3 citations)
- ProbRes: Probabilistic Jump Diffusion for Open-World Egocentric Activity Recognition (2 citations)
- TRNAS: A Training-Free Robust Neural Architecture Search (2 citations)
- CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor (1 citation)
- Beyond the Limits: Overcoming Negative Correlation of Activation-Based Training-Free NAS
Mixture of experts · 4 papers
- Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Experts (22 citations)
- GM-MoE: Low-Light Enhancement with Gated-Mechanism Mixture-of-Experts (17 citations)
- Dynamic-DINO: Fine-Grained Mixture of Experts Tuning for Real-time Open-Vocabulary Object Detection (5 citations)
- VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting (3 citations)
