atlas

Research map / Label-efficient and robust learning / Zero-/few-shot and meta-learning

Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learning

CVPR 2021 · Label-efficient and robust learning › Zero-/few-shot and meta-learning · approach: Alignment-based few-shot metric learning · 133 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
jointly enforce transformation invariance and equivariance rather than invariance alone (ablation)few-shot representation learning · miniImageNet 5-way 1-shotaccuracy: 64.64±0.80 -> 66.82± 0.80Helped
jointly enforce transformation invariance and equivariance rather than equivariance alone (ablation)few-shot representation learning · miniImageNet 5-way 1-shotaccuracy: 66.09±0.80 -> 66.82± 0.80Helped
add multi-head distillation instead of supervised logit-level distillation (ablation)joint invariant-equivariant model · miniImageNet 5-way 1-shotaccuracy: 66.95±0.78 -> 67.28±0.80Helped
increase the transformation set from M=16 to M=20 (ablation)few-shot representation learning · CIFAR-FS validation 5-way 1-shotaccuracy: 68.20±0.92 -> 68.07±0.90Hurt
add jointly sampled affine transformations (ablation)invariant-equivariant representation learning · miniImageNet 5-way 5-shotaccuracy: 82.96±0.53 vs 84.35±0.51Hurt
add the proposed invariant and equivariant objectives to supervised training (ablation)few-shot learning · CIFAR-FS 5-way 1-shotaccuracy: 71.50±0.80 -> 76.83±0.82Helped
add invariant and equivariant objectives (ablation)few-shot learning · FC100 5-way 1-shotaccuracy: 42.60±0.70 -> 47.38±0.79Helped
add invariant and equivariant objectives (ablation)few-shot learning · miniImageNet 5-way 1-shotaccuracy: 62.02±0.63 -> 66.82± 0.80Helped
add multi-head self-distillation to the proposed model (ablation)Ours · CIFAR-FS 5-way 1-shotaccuracy: 76.83±0.82 -> 77.87±0.85Helped
add multi-head self-distillation to the proposed model (ablation)Ours · FC100 5-way 5-shotaccuracy: 64.43±0.77 -> 65.30±0.76Helped
add jointly learned invariant and equivariant representations (ablation)few-shot representation learning · miniImageNet, CIFAR-FS, and FC100 5-way 1-shotaccuracyHelped
add standard auxiliary SSL tasks instead of the proposed joint invariant-equivariant objectives (ablation)miniImageNet few-shot learning · miniImageNet 5-way 1-shotaccuracy: 66.82± 0.80 vs 65.25±0.80Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy