AI Paper Atlas

Research map / Label-efficient and robust learning / Self-supervised and contrastive

Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning

Lang Huang, Chao Zhang, Change Institutions to: University of Waterloo

TPAMI 2022 · Label-efficient and robust learning › Self-supervised and contrastive · approach: Data-efficient and robust self-supervision · 45 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add EMA of model predictions as targets (ablation)supervised self-adaptive training · CIFAR-10 symmetric label noise 40%test accuracy: 72.00 -> 92.64Improved
add EMA of model predictions as targets (ablation)supervised self-adaptive training · CIFAR-100 symmetric label noise 80%test accuracy: 11.57 -> 38.72Improved
add sample re-weighting (ablation)supervised self-adaptive training · CIFAR-100 symmetric label noise 40%test accuracy: 69.52 -> 71.38Improved
add sample re-weighting (ablation)supervised self-adaptive training · CIFAR-10 symmetric label noise 40%test accuracy: 92.49 -> 92.64No clear effect
raise EMA momentum alpha from 0.9 to 0.99 (ablation)supervised self-adaptive training · CIFAR-10 symmetric label noise 40%test accuracy: 92.64 -> 84.38Hurt
start target updates at epoch 60 instead of 20 (ablation)supervised self-adaptive training · CIFAR-10 symmetric label noise 40%test accuracy: 89.58 -> 92.64Improved
replace ERM with self-adaptive trainingResNet-101 · ImageNet val, label noise 40%top-1 accuracy: 70.2 -> 73.5Improved
replace TRADES cross entropy with self-adaptive trainingTRADES · CIFAR-10 adversarial trainingrobust accuracy: 1% to 3% robust accuracy gainImproved
use two views instead of one view (ablation)self-supervised self-adaptive training · ImageNet linear evaluation (200 epochs)linear top-1 accuracy: 67.4 -> 72.8Improved
use two views instead of one view (ablation)self-supervised self-adaptive training · CIFAR-10 linear evaluation (single view)linear top-1 accuracy: 92.27 -> 91.56No clear effect
use one view instead of two views (ablation)BYOL · CIFAR-10 linear evaluation (single view)linear top-1 accuracy: 91.78 -> 44.36Hurt
add predictor (momentum 0.99) (ablation)BYOL · CIFAR-10 linear evaluationlinear top-1 accuracy: 26.87 -> 91.78Improved

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 1 of 2 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy