atlas

Research map / Label-efficient and robust learning / Zero-/few-shot and meta-learning

MAML is a Noisy Contrastive Learner in Classification

ICLR 2022 · Label-efficient and robust learning › Zero-/few-shot and meta-learning · approach: Meta-augmentation and meta-objectives · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Apply the zeroing trick during training (ablation)FOMAML · mini-ImageNettesting accuracyHelped
Apply the zeroing trick during training (ablation)SOMAML · mini-ImageNettesting accuracyHelped
Zero the linear layer at the beginning of meta-testing (ablation)FOMAML · mini-ImageNet meta-testingtesting accuracyHelped
Zero-initialize the linear layer (ablation)FOMAML · mini-ImageNettesting accuracyHelped
Scale the initial linear layer by 0.7 (ablation)FOMAML · mini-ImageNettesting accuracyHelped
Scale the initial linear layer by 0.5 (ablation)FOMAML · mini-ImageNettesting accuracyHelped
Use one inner-loop update instead of more updates (ablation)FOMAML with zeroing trick · mini-ImageNet 5-way 1-shotconvergence speedNo clear effect
Drop the interference term (ablation)FOMAML reformulated loss · mini-ImageNet 5-way 1-shottesting accuracyHelped
Drop the noisy part of the contrastive coefficient (ablation)FOMAML reformulated loss · mini-ImageNet 5-way 1-shottesting accuracyHelped
Apply the zeroing trick (ablation)MAML · mini-ImageNet 5-way 1-shotnegative contrastive-term ratio: larger than 0.2 -> 0.2Helped
Apply the zeroing trick (ablation)FOMAML · mini-ImageNet feature spacebetween-class cosine-similarity contrastHelped
Use the zeroing trick (ablation)FOMAML · mini-ImageNet, semantically similar classesbetween-class cosine-similarity contrastHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy