atlas

Research map / Label-efficient and robust learning / Self-supervised and contrastive

Partial success in closing the gap between human and machine vision

NeurIPS 2021 · Label-efficient and robust learning › Self-supervised and contrastive · approach: Pretext-task visual pre-training · 63 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Train a standard model on a much larger datasetImageNet-trained vision models · 17 OOD datasetsOOD accuracy: 0.559 -> 0.829Helped
Pre-train a vision transformer on 14M imagesViT-L · 17 OOD datasetsOOD accuracy: 0.706 -> 0.733Helped
Use self-supervised learning rather than standard supervisionImageNet-trained CNNs · OOD datasetsOOD accuracyNo clear effect
Use SimCLR's training augmentations in supervised training (ablation)SimCLR-matched supervised baselines · OOD datasetsOOD accuracyHelped
Increase adversarial-training strength (ablation)ResNet-50 · 17 OOD datasetsOOD accuracy: 0.545 -> 0.501Hurt
Increase adversarial-training strength (ablation)ResNet-50 · Cue conflict imagesshape biasHelped
Train on large-scale datasetsStandard CNNs · 17 OOD datasetserror consistencyHelped
Train a ResNet-50 using CLIP hard or soft labels (ablation)ResNet-50 · 17 OOD datasetsOOD accuracyNo clear effect
Use CLIP's joint image-text loss with a ResNet-50 backbone (ablation)CLIP · OOD datasetsOOD accuracyHurt
Train the same ResNet-50 on Stylized-ImageNet rather than ImageNet (ablation)ResNet-50 · Sketch imageserror consistency: 0.74 -> 0.44Hurt
Replace ResNet-50 with ViT-S (ablation)ImageNet-trained vision model · Sketch imageserror consistency: 0.31 -> 0.67Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy