atlas

Research map / Label-efficient and robust learning / Zero-/few-shot and meta-learning

On Episodes, Prototypical Networks, and Few-Shot Learning

NeurIPS 2021 · Label-efficient and robust learning › Zero-/few-shot and meta-learning · approach: Fine-tuning strategies for few-shot · 15 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace Prototypical Network episodic loss with non-episodic NCA loss (nearest centroid eval)Prototypical Networks · miniImageNet 1-shotaccuracy (%): 61.32 -> 62.55Helped
replace Prototypical Network episodic loss with NCA lossPrototypical Networks · CIFAR-FS 5-shotaccuracy (%): 84.61 -> 85.15Helped
replace Prototypical Network episodic loss with NCA lossPrototypical Networks · miniImageNet 5-shotaccuracy (%): 77.77 -> 78.27Mixed
replace Matching Network episodic loss with NCA soft assignmentMatching Networks · CIFAR-FS 1-shotaccuracy (%): 71.86 -> 72.49Helped
tune episode configuration (batch size, shots, m+n) instead of original Snell/Vinyals settings (ablation)Prototypical Networks · miniImageNet 5-shotaccuracy (%): 75.42 -> 77.77Helped
increase the training m+n for 1-shot episodes from 8 to 32 (ablation)Prototypical and Matching Networks · CIFAR-FS 1-shotaccuracy (%): 10% worse in the best caseHurt
sample batches with replacement for NCA (ablation)NCA · miniImageNet and CIFAR-FS valaccuracyNo clear effect
disable prototypes during training of PNs (5-shot) (ablation)Prototypical Networks · miniImageNet and CIFAR-FS valaccuracyHurt
ignore support/query separation and compute loss on all pairs (ablation)Prototypical Networks · miniImageNet and CIFAR-FS valaccuracyHelped
enable all ablations (replacement sampling, no S/Q split, no prototypes) (ablation)Prototypical Networks · miniImageNet and CIFAR-FS valaccuracyHelped
randomly subsample distance pairs in NCA batch (ablation)NCA · miniImageNet valaccuracyHurt
use nearest centroid instead of soft assignment for NCA evaluation (5-shot) (ablation)NCA · CIFAR-FS 5-shotaccuracy (%): 83.38 -> 85.15Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy