AI Paper Atlas

Research map / Architectures and efficiency / Pruning and efficient tuning

SINDER: Repairing the Singular Defects of DINOv2

Haoqi Wang, Tong Zhang, Mathieu Salzmann

ECCV 2024 · Architectures and efficiency › Pruning and efficient tuning · approach: Efficient ViT adaptation · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
repair singular defects with SINDER fine-tuningDINOv2 giant with STEGO · Cityscapes unsupervisedmIoU: 19.38 -> 21.77Improved
repair singular defects with SINDER fine-tuningDINOv2 giant with CAUSE · VOC2012 without CRFmIoU: 55.8 -> 62.9Improved
repair singular defects with SINDER fine-tuningDINOv2 giant · ImageNet-1K linear probetop-1 accuracy: 86.53 -> 86.29No clear effect
repair singular defects with SINDER fine-tuningDINOv2 giant · ADE20k linear segmentationmIoU: 48.83 -> 51.11Improved
SINDER versus register-token retrainingDINOv2 giant · NYUd depth DPTRMSE: 0.234 -> 0.249Hurt
repair singular defects with SINDER fine-tuningDINOv2 giant · NYUd depth Linear 1RMSE: 0.370 -> 0.337Improved
also fine-tune biases along with singular values (ablation)SINDER · ImageNet KNN and ADE20kADE20k mIoU: 51.11 -> 13.77Hurt
limit learnable layers to 10 per iteration instead of all layers (ablation)SINDER · ADE20kmIoU: 45.53 -> 51.11Improved
limit learnable layers to 5 instead of 10 (ablation)SINDER · ADE20kmIoU: 51.11 -> 50.61Hurt
raise skip threshold sigma from 3 to 5 (ablation)SINDER · ADE20kmIoU: 51.11 -> 50.71Hurt
raise mask threshold mu from 4 to 4.5 (ablation)SINDER · ADE20kmIoU: 51.11 -> 50.50Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy