Research map / Label-efficient and robust learning / Zero-/few-shot and meta-learning
Embedding adaptation for few-shot classification
Adapts feature embeddings with set functions and feature-wise transforms, including cross-domain settings.
71 accepted papers at ICML, NeurIPS, ICLR, CVPR and AAAI (2017–2026) · an approach in Zero-/few-shot and meta-learning, keyword cluster “fsl · shot classification · support”
State History Benchmarks Tried Baselines Checklist Preprints Who Export
Where it stands
Quiet None of the tracked benchmarks has a report from 2025–26.
14 papers in 2023–24 and 6 in 2025–26 (at ICML, NeurIPS, ICLR, CVPR and AAAI); its share of the topic shrank, from 6.8% to 3.4%.
Open questions the data points to
- Papers report SoSN on miniImageNet 5-way 1-shot (accuracy) anywhere from 52.96 to 59.01: comparisons against it depend on whose number you take.
No longer reported by papers here: miniImageNet 5-way 1-shot (accuracy, last in 2024); miniImageNet 5-way 5-shot (accuracy, last in 2024); tieredImageNet 5-way 1-shot (accuracy, last in 2024); tieredImageNet 5-way 5-shot (accuracy, last in 2024); CIFAR-FS 5-way 1-shot (accuracy, last in 2024); CIFAR-FS 5-way 5-shot (accuracy, last in 2024).
How this is decided
A benchmark is tracked when at least four papers of this approach report their own method on the same dataset and metric in at least two different years. Its record is the best number reported up to 2024 compared with the best reported in 2025–26: still improving means at least 1% better, flat means at most 0.2% better with at least two papers from 2025–26 trying. Numbers on a different scale from the rest (a fraction among percentages) and far outliers are left out. Results come from different papers with different setups, so they are signals, not head-to-head comparisons. The share of papers is counted at ICML, NeurIPS, ICLR, CVPR and AAAI.
How it got here
Most cited paper of each year
- 2017 · Prototypical Networks for Few-shot Learning (NeurIPS 2017 · 5,178 citations)
- 2018 · Dynamic Few-Shot Visual Learning Without Forgetting (CVPR 2018 · 1,151 citations)
- 2019 · Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning (CVPR 2019 · 674 citations)
- 2020 · Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions (CVPR 2020 · 776 citations)
- 2021 · Few-Shot Classification With Feature Map Reconstruction Networks (CVPR 2021 · 358 citations)
- 2022 · Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification (CVPR 2022 · 298 citations)
- 2023 · Glocal Energy-Based Learning for Few-Shot Open-Set Recognition (CVPR 2023 · 44 citations)
- 2024 · Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning (CVPR 2024 · 18 citations)
- 2025 · Multi-Label Few-Shot Image Classification via Pairwise Feature Augmentation and Flexible Prompt Learning (AAAI 2025 · 2 citations)
- 2026 · Exploiting Low-Dimensional Manifold of Features for Few-shot Whole Slide Image Classification (ICLR 2026 · 0 citations)
Earliest papers here
- Prototypical Networks for Few-shot Learning (NeurIPS 2017 · 5,178 citations)
- Dynamic Few-Shot Visual Learning Without Forgetting (CVPR 2018 · 1,151 citations)
- Meta-Learning for Semi-Supervised Few-Shot Classification (ICLR 2018 · 726 citations)
Benchmark records
The best number each year that beat every earlier one, among papers of this approach reporting their own method. Numbers are extracted by AI from each paper's text; check the paper before citing.
miniImageNet 5-way 1-shot · accuracy (higher is better)
28 papers, 2017–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2017 | 49.42 | Prototypical Networks for Few-shot Learning (NeurIPS 2017 · 5,178 citations) |
| 2018 | 59.6 | Few-Shot Image Recognition by Predicting Parameters From Activations (CVPR 2018 · 583 citations) |
| 2019 | 67.19 | Cross Attention Network for Few-shot Classification (NeurIPS 2019 · 139 citations) |
| 2021 | 69.28 | Rectifying the Shortcut Learning of Background for Few-Shot Learning (NeurIPS 2021 · 45 citations) |
| 2022 | 77.56 | CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification (CVPR 2022 · 48 citations) |
| 2024 | 93.7 | Self-Prompt Mechanism for Few-Shot Image Recognition (AAAI 2024 · 12 citations) |
miniImageNet 5-way 5-shot · accuracy (higher is better)
28 papers, 2017–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2017 | 68.2 | Prototypical Networks for Few-shot Learning (NeurIPS 2017 · 5,178 citations) |
| 2018 | 73.74 | Few-Shot Image Recognition by Predicting Parameters From Activations (CVPR 2018 · 583 citations) |
| 2019 | 80.64 | Cross Attention Network for Few-shot Classification (NeurIPS 2019 · 139 citations) |
| 2020 | 81.25 | Adaptive Subspaces for Few-Shot Learning (CVPR 2020 · 464 citations) |
| 2021 | 85.16 | Rectifying the Shortcut Learning of Background for Few-Shot Learning (NeurIPS 2021 · 45 citations) |
| 2022 | 87.68 | CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification (CVPR 2022 · 48 citations) |
| 2024 | 98.3 | Self-Prompt Mechanism for Few-Shot Image Recognition (AAAI 2024 · 12 citations) |
tieredImageNet 5-way 1-shot · accuracy (higher is better)
18 papers, 2019–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2019 | 73.21 | Cross Attention Network for Few-shot Classification (NeurIPS 2019 · 139 citations) |
| 2021 | 78.19 | Free Lunch for Few-shot Learning: Distribution Calibration (ICLR 2021 · 179 citations) |
tieredImageNet 5-way 5-shot · accuracy (higher is better)
18 papers, 2019–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2019 | 84.93 | Cross Attention Network for Few-shot Classification (NeurIPS 2019 · 139 citations) |
| 2021 | 89.9 | Free Lunch for Few-shot Learning: Distribution Calibration (ICLR 2021 · 179 citations) |
| 2022 | 90.73 | CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification (CVPR 2022 · 48 citations) |
CIFAR-FS 5-way 1-shot · accuracy (higher is better)
9 papers, 2020–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2020 | 72.3 | Adaptive Subspaces for Few-Shot Learning (CVPR 2020 · 464 citations) |
| 2022 | 79.97 | CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification (CVPR 2022 · 48 citations) |
| 2024 | 82.4 | Self-Prompt Mechanism for Few-Shot Image Recognition (AAAI 2024 · 12 citations) |
CIFAR-FS 5-way 5-shot · accuracy (higher is better)
9 papers, 2020–2024 · not reported since 2024
| Year | Best so far | Set by |
|---|---|---|
| 2020 | 85.1 | Adaptive Subspaces for Few-Shot Learning (CVPR 2020 · 464 citations) |
| 2022 | 94.13 | CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification (CVPR 2022 · 48 citations) |
What has been tried
68 papers here report 778 measured changes (a component added, removed or swapped, compared with a baseline): helped 71%, no clear effect 8%, hurt 16%, mixed 5%. Papers mostly publish changes that helped, so "helped" is over-represented.
Ablations in recent papers
| What was changed | Measured on | Result | Effect | Paper |
|---|---|---|---|---|
| Use the discriminative sample-aware loss for fine-tuning instead of NCCmean | Meta-Dataset MDL · accuracy | up to 2.8% improvement in seen domains and 1.6% in unseen domains | Helped | Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning (CVPR 2024 · 18 citations) |
| add spatial selection | Mini-ImageNet, 5-way 1-shot · accuracy | 93.35 -> 93.72 | Helped | Self-Prompt Mechanism for Few-Shot Image Recognition (AAAI 2024 · 12 citations) |
| add local-view sampling and FeatWalk rather than the single-branch FC baseline | miniImageNet and CUB 5-way 1-shot and 5-shot · accuracy | 67.80 ± 0.45 -> 70.21 ± 0.44; 85.21 ± 0.28 -> 87.38 ± 0.27; 83.97 ± 0.39 -> 85.67 ± 0.38; 94.40 ± 0.17 -> 95.44 ± 0.16 | Helped | FeatWalk: Enhancing Few-Shot Classification through Local View Leveraging (AAAI 2024 · 7 citations) |
| Add instance-wise iterative prototypes to DR+RDM | optdigits, 1-shot · accuracy | 77.41 -> 81.13 | Helped | D2R2: Diffusion-based Representation with Random Distance Matching for Tabular Few-shot Learning (NeurIPS 2024 · 3 citations) |
| add pairwise feature augmentation | COCO · micro AP | 75.02 -> 79.36 | Helped | Multi-Label Few-Shot Image Classification via Pairwise Feature Augmentation and Flexible Prompt Learning (AAAI 2025 · 2 citations) |
| distill universal vision-language knowledge into prototypes | FSC-147 → FSCD-LVIS few-shot · MAE | 30.15 -> 21.87 | Helped | Single Domain Generalization for Few-Shot Counting via Universal Representation Matching (CVPR 2025 · 2 citations) |
| Use NDA augmentation instead of the proposed query augmentations | Bongard-HOI test sets, Avg. · accuracy | 65.97 -> 65.30 | Hurt | Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOI (AAAI 2024 · 2 citations) |
| Add discrepancy and robustness regularization | EuroSAT · accuracy | 93.5 -> 94.7 | Helped | Provably Improving Generalization of Few-shot models with Synthetic Data (ICML 2025 · 1 citation) |
| add test power maximization | Meta-Dataset · accuracy | Helped | MOKD: Cross-domain Finetuning for Few-shot Classification via Maximizing Optimized Kernel Dependence (ICML 2024 · 0 citations) |
Baseline numbers that disagree
The same baseline on the same benchmark and metric, reported more than 5% apart by different papers here. Training budgets, data splits and reimplementations differ, so state which number you compare with.
| Baseline | Benchmark | Metric | Reported | Papers |
|---|---|---|---|---|
| SoSN | miniImageNet 5-way 1-shot | accuracy | 52.96 – 59.01 | 2 papers, e.g. CVPR 2019 and CVPR 2021 |
What reviewers will expect
Datasets and baselines named in the 10 papers of this approach from 2024–2026 that have a full-text summary. Leaving out the common ones is a frequent review question.
Datasets
- ImageNet · 4 of 10 papers
- miniImageNet · 2 of 10 papers
- EuroSAT · 2 of 10 papers
- MS COCO · 2 of 10 papers
- Meta-Dataset · 2 of 10 papers
- DTD · 2 of 10 papers
Baselines
- ProtoNet · 3 of 10 papers
- PMF · 2 of 10 papers
- URT · 2 of 10 papers
- FLUTE · 2 of 10 papers
Recent preprints
Loading recent arXiv preprints…
Who publishes on it
Institutions on the most papers of this approach since 2023 (of 20 papers; from OpenAlex and the papers' affiliations).
- Peking University · 2 papers
- Dalian University of Technology · 2 papers
- Pennsylvania State University · 2 papers
- University of Melbourne · 2 papers
- University of Electronic Science and Technology of China · 2 papers
- Shanghai Jiao Tong University · 2 papers
Use it
Download BibTeX of 32 key papersOpen the topic in the interactive map
Get alerts. Describe your idea in scime atlas and save it (free scime account): you get a weekly email when new preprints land close to it.
Related approaches
Same keyword cluster
- Fine-tuning strategies for few-shot (67 papers)
- Fine-grained and cross-domain few-shot baselines (59 papers)
- Alignment-based few-shot metric learning (38 papers)
Elsewhere in the topic
- Generative feature synthesis for zero-shot (117 papers)
- Zero-shot robustness and transfer (101 papers)
- Robust fine-tuning of zero-shot models (92 papers)
- Transductive and semantic-dictionary zero-shot (90 papers)
- Meta-augmentation and meta-objectives (60 papers)
- Meta-learning analysis and benchmarks (50 papers)
- Normalization and unsupervised meta-learning (39 papers)
Benchmark numbers, ablations and baseline numbers are extracted by AI from each paper's full text and can be wrong; the paper is the authority. Data: results index of 2026-11-02, citation counts from OpenAlex (2026-10-09).
