TPAMI 2026 papers on Architectures and efficiency
46 of the 880 papers published in TPAMI 2026 (5.2%) are on Architectures and efficiency, compared with 4.7% at TPAMI 2025. They fall into 8 topics.
See TPAMI 2026 in the interactive map
Working on something in this area? Describe your idea in scime atlas to see the closest papers by meaning and how crowded the spot has become.
Topics and papers
Pruning and efficient tuning · 13 papers
- Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning (18 citations)
- TeZO: Empowering the Low-Rankness on the Temporal Dimension in the Zeroth-Order Optimization for Fine-Tuning LLMs (10 citations)
- Efficient Training of Large Vision Models via Advanced Automated Progressive Learning (5 citations)
- LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models (5 citations)
- LoRASculpt: Harmonious Low-Rank Adaptation for Multimodal Large Language Models (1 citation)
- Random Sparse Networks Training With Sharpness-Aware Regularization
- SPIRA: Sparse Information-Geometric Rank Adaptation for Parameter-Efficient Fine-Tuning of Large Pretrained Models
- STPP: Efficient and Progressive Structured Pruning via Enhanced Sparsification Paradigm
- Triplet Decomposition and Extensions: A General Framework for Parameter-Efficient Fine-Tuning
- Unlocking the Potential of Vision Foundation Models for Multi-Task Dense Prediction via Mixture of Task Adapters
- Weight Importance Is Not Enough: Neural Expressiveness for Model Compression
- Kernelized Sparse Fine-Tuning With Bi-Level Parameter Competition for Vision Models
and 1 more in the interactive map.
Attention and transformers · 9 papers
- SeqPE: Transformer With Sequential Position Encoding (5 citations)
- Task-KV: Task-Aware KV Cache Optimization via Semantic Differentiation of Attention Heads (5 citations)
- Exploring and Tailoring the Test-Time Augmentation for Sequential Recommendation (3 citations)
- On the Limitations and Capabilities of Position Embeddings for Length Generalization (1 citation)
- 3D Reconstruction from Transient Measurements with Time-Resolved Transformer
- Advancing Vision Transformer With Enhanced Spatial Priors
- From Local to Global to Mechanistic: An iERF-Centered Unified Framework for Interpreting Vision Models
- Information-Theoretic Analysis of Positional Encoding Strategies in Vision Transformers: A Comparative Study of Four Approaches
- Training-free Context-adaptive Attention for Efficient Long Context Modeling
RNNs and normalization · 9 papers
- Instance-Dependent Early Stopping for Adaptive Data Pruning (5 citations)
- No One-Size-Fits-All Neurons: Task-Based Neurons for Artificial Neural Networks (5 citations)
- NP-Hardness of Minimizing Neurons in Two-Hidden-Layer ReLU Neural Networks (1 citation)
- Toward the Spectral Bias Alleviation by Normalizations in Coordinate Networks (1 citation)
- Alignment-Invertibility Regularization for Explainable Neural Networks
- Certified Streaming Updates for Machine Learning Models under Limited Throughput
- GPU-Accelerated Computation of Persistent Homology for Topological Analysis of Image Data
- Guest Editors’ Introduction: Special Section on Computational Photography (ICCP)
- Toward the Connection Between Activation Sparsity and Flat Minima
CNN design · 4 papers
- Adaptive Aggregation of Monte Carlo Augmented Decomposed Filters for Efficient Group-Equivariant Convolutional Neural Network (2 citations)
- Neuron Abandoning Attention Flow: Visual Explanation of Dynamics Inside CNN Models (1 citation)
- Rotation Equivariant Mamba for Vision Tasks (1 citation)
- Winsor-CAM: Human-Tunable Visual Explanations From Deep Networks via Layer-Wise Winsorization
Quantization · 4 papers
- PrefixQuant: Eliminating Outliers by Prefixed Tokens for Large Language Models Quantization (35 citations)
- Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities (16 citations)
- Hyper-Compression: Model Compression via Hyperfunction (4 citations)
- BitNet v2: Low-Bit and Sparsified Activations for 1-Bit Large Language Models (2 citations)
