AI Paper Atlas

Research map / Label-efficient and robust learning / Zero-/few-shot and meta-learning

Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning

Yanpeng Sun, Qiang Chen, Xiangyu He, Jian Wang, Haocheng Feng, Junyu Han, Errui Ding, Jian Cheng, Zechao Li, Jingdong Wang

NeurIPS 2022 · Label-efficient and robust learning › Zero-/few-shot and meta-learning · approach: Fine-grained and cross-domain few-shot baselines · 26 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
fine-tune singular values S only (SVF) on frozen backbonebaseline (ResNet-50) · Pascal-5i 1-shotmIoU: 65.07 -> 67.14Improved
add SVFBAM (ResNet-50) · Pascal-5i 1-shotmIoU: 67.81 -> 68.95Improved
add SVFBAM (ResNet-50) · COCO-20i 5-shotmIoU: 51.16 -> 53.87Improved
add SVFBAM (VGG-16) · COCO-20i 5-shotmIoU: 49.34 -> 49.07Hurt
add SVFPFENet (ResNet-50) · Pascal-5i 5-shotmIoU: 71.20 -> 71.82Improved
fully fine-tune the backbone instead of freezing (ablation)baseline · Pascal-5i 1-shotmIoU: 65.07 -> 60.90Hurt
fine-tune U or V subspace instead of S (ablation)SVF · Pascal-5i 1-shotmIoU: 67.14 -> 61.09 (U), 60.88 (V)Hurt
fine-tune S only rather than U,S,V (ablation)SVF · Pascal-5i 1-shotmIoU: 61.24 -> 67.14Improved
also fine-tune BN with SVF (ablation)SVF · Pascal-5i 1-shotmIoU: 67.14 -> 64.20Hurt
replace SVF with adapter (ablation)baseline · Pascal-5i 1-shotmIoU: 67.14 -> 20.71Hurt
replace SVF with BN bias tuning (ablation)baseline · Pascal-5i 1-shotmIoU: 67.14 -> 62.93Hurt
apply SVF to layers 3,4 vs 2,3,4 vs 1-4 (ablation)baseline · Pascal-5i 1-shotmIoU: 67.20 / 67.14 / 67.12No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy