AI Paper Atlas

Research map / Architectures and efficiency / Quantization

Unveiling And Addressing Dimensional Collapse In Vector Quantization Models Via Codebook Regularization

Fang Zhang, Yongxin Zhu, Yihao Liu, Bin Fu, Linli Xu

ICML 2026 · Architectures and efficiency › Quantization · approach: Post-training weight quantization

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add codebook regularization (Lcr)IBQ · ImageNet 256x256, K=262144rFID: 1.00 -> 0.91Improved
add codebook regularization (Lcr)IBQ · ImageNet 256x256, K=16384rFID: 1.53 -> 1.32Improved
add codebook regularization (Lcr)IBQ · ImageNet 256x256, K=262144effective rank: 13.8 -> 21.8Improved
add codebook regularization (Lcr)SimVQ · ImageNet 128x128, K=262144rFID: 1.99 -> 1.55Improved
add codebook regularization (Lcr)VQGAN · ImageNet 128x128, K=16384rFID: 5.12 -> 3.98Improved
add codebook regularization (Lcr)VQGAN · ImageNet 128x128, K=16384effective rank: 7.1 -> 16.3Improved
add codebook regularization (Lcr) to tokenizer used for AR generationIBQ-B (342M) · ImageNet 256x256 class-conditional generationgFID: 2.88 -> 2.42Improved
add codebook regularization (Lcr) to tokenizer used for AR generationIBQ-XL/XXL (1.1B) · ImageNet 256x256 class-conditional generationgFID: 2.14 -> 2.02Improved
replace implicit decorrelation with hard Spectrum Hinge (ablation)VQGAN codebook regularization · ImageNet 128x128, K=65536rFID: 4.12 -> 9.45 (tau 0.2 -> 0.3); Lcr gives 3.06Hurt
apply Barlow Twins/VICReg to encoder output ze or quantized features zq instead of codebook (ablation)VQGAN regularization · ImageNet 128x128, K=65536rFID: 3.06 (Lcr on C) -> 19.38 (BT on ze), 36.4 (BT on zq), 21.2 (VICReg ze), 25.4 (VICReg zq)Hurt
replace Lcr by Barlow Twins/VICReg applied to the global codebook (ablation)VQGAN regularization · ImageNet 128x128, K=65536rFID: 3.06 -> 3.27 (Barlow Twins), 3.21 (VICReg)Hurt
truncate continuous AE spectrum to D90 via PCA (ablation)Continuous AE · ImageNet 128x128 reconstructionPSNRHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy