AI Paper Atlas

Research map / Label-efficient and robust learning / Semi-supervised learning

Unsupervised Data Augmentation for Consistency Training

NeurIPS 2020 · Label-efficient and robust learning › Semi-supervised learning · approach: Holistic semi-supervised pipelines · 1,598 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Replace simple input noise with advanced task-specific augmentation in consistency trainingUDA on CIFAR-10 and Yelp-5 · CIFAR-10 and Yelp-5error rate: Cutout: 5.43; RandAugment: 4.32. Switchout: 43.38; Back-translation: 41.35Helped
Add RandAugment instead of simpler cropping and flippingUDA on CIFAR-10 · CIFAR-10 (4k labeled, 50k unlabeled)error rate: 10.94 -> 4.32Helped
Add back-translation instead of no augmentationUDA on Yelp-5 · Yelp-5 (2.5k labeled)error rate: 50.80 -> 41.35Helped
Add UDA consistency trainingBERT fine-tuned on in-domain unlabeled data · IMDb (20 labeled)error rate: 6.50 -> 4.20Helped
Add unlabeled examples to UDA training (ablation)UDA · CIFAR-10error rate: With 250 labeled: 35.41 at 5,000 unlabeled; 5.43 ± 0.96 at 50,000 unlabeledHelped
Use a richer set of possible RandAugment transformations (ablation)UDA on CIFAR-10 · CIFAR-10error rateHelped
Add training signal annealing (ablation)UDA on Yelp-5 · Yelp-5 (2.5k labeled, 6m unlabeled)error rate: 50.81 -> 41.35Helped
Use an exponential TSA schedule instead of log or linear schedules (ablation)UDA on Yelp-5 · Yelp-5 (2.5k labeled, 6m unlabeled)error rate: log-schedule 49.06; linear-schedule 45.41; exp-schedule 41.35Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy