AI Paper Atlas

Research map / Label-efficient and robust learning / Domain adaptation and generalization

Optimization-based domain generalization

Studies failure modes and gradient-guided or meta-learning methods for domain generalization.

101 accepted papers at ICML, NeurIPS, ICLR, CVPR and AAAI (2018–2026) · an approach in Domain adaptation and generalization, keyword cluster “domain generalization · dg · unseen”

State History Benchmarks Tried Baselines Checklist Preprints Who Export

Where it stands

Still moving The best reported result is still improving on 5 of 5 tracked benchmarks.

32 papers in 2023–24 and 24 in 2025–26 (at ICML, NeurIPS, ICLR, CVPR and AAAI); its share of the topic shrank, from 9.4% to 7.5%.

Open questions the data points to

How this is decided

A benchmark is tracked when at least four papers of this approach report their own method on the same dataset and metric in at least two different years. Its record is the best number reported up to 2024 compared with the best reported in 2025–26: still improving means at least 1% better, flat means at most 0.2% better with at least two papers from 2025–26 trying. Numbers on a different scale from the rest (a fraction among percentages) and far outliers are left out. Results come from different papers with different setups, so they are signals, not head-to-head comparisons. The share of papers is counted at ICML, NeurIPS, ICLR, CVPR and AAAI.

How it got here

2016: 0162017: 0172018: 6182019: 4192020: 6202021: 14212022: 15222023: 16232024: 16242025: 9252026: 1526

Most cited paper of each year

Earliest papers here

Benchmark records

The best number each year that beat every earlier one, among papers of this approach reporting their own method. Numbers are extracted by AI from each paper's text; check the paper before citing.

PACS · accuracy (higher is better)

11 papers, 2021–2025 · still improving

2021: 84.52022: 88.92023: 96.72024: 97.32025: 98.6
20212025

OfficeHome · accuracy (higher is better)

9 papers, 2021–2025 · still improving

2021: 68.92022: 72.52023: 85.32025: 91.3
20212025

DomainNet · accuracy (higher is better)

8 papers, 2021–2025 · still improving

2021: 43.92023: 49.22024: 54.62025: 66.5
20212025

VLCS · accuracy (higher is better)

8 papers, 2021–2025 · still improving

2021: 78.52022: 802023: 81.42024: 82.42025: 84.4
20212025

TerraIncognita · accuracy (higher is better)

7 papers, 2021–2025 · still improving

2021: 48.12022: 52.32023: 532024: 60.72025: 65.2
20212025

What has been tried

80 papers here report 903 measured changes (a component added, removed or swapped, compared with a baseline): helped 69%, no clear effect 7%, hurt 20%, mixed 4%. Papers mostly publish changes that helped, so "helped" is over-represented.

Ablations in recent papers

What was changedMeasured onResultEffectPaper
Add GAim1 to GAim2+GReg1HomeOffice · average accuracy84.0±0.2 -> 84.5±0.2HelpedRethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations)
add autoencoderUnseen datasets (Avg) · ACC+0.97HelpedGeneralizable Sleep Staging via Multi-Level Domain Alignment (AAAI 2024 · 17 citations)
Add RandAug to the FedAvg baselinePACS · accuracy (Avg)81.3 -> 83.9HelpedMulti-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalization (AAAI 2024 · 15 citations)
Reverse the vital and non-vital phase assignmentsImageNet-100 · mCE (%)63.2 -> 68.2HurtDomain Generalization with Vital Phase Augmentation (AAAI 2024 · 12 citations)
Replace SSPL with classic SPLDigits (MNIST, MNIST-M, SVHN, SYN) · accuracy96.4 ± .2 -> 90.5 ± .5; 62.6 ± .1 -> 55.4 ± .4; 66.7 ± .1 -> 48.7 ± .4; 83.8 ± .2 -> 64.9 ± .8HurtSymmetric Self-Paced Learning for Domain Generalization (AAAI 2024 · 11 citations)
Use both invariant and dynamic features rather than only invariant featuresRMNIST · accuracy (%)45.7 ± 1.1 -> 47.5 ± 1.3HelpedEnhancing Evolving Domain Generalization through Dynamic Latent Representations (AAAI 2024 · 7 citations)
add global weight averaging with SWADDomainBed average · accuracy65.0 -> 66.7HelpedBalanced Direction from Multifarious Choices: Arithmetic Meta-Learning for Domain Generalization (CVPR 2025 · 5 citations)
Use larger parameter perturbations during GGAPACS · accuracyHurtGradient-Guided Annealing for Domain Generalization (CVPR 2025 · 3 citations)
add the λ1 sharpness penalty, λ2 consistency penalty, and PCE lossOfficeHome · accuracy85.0 → 86.5HelpedSeeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
use learned rather than predefined measurement functionsRMNIST · accuracy (%)86.6 ± 0.2 -> 87.5 ± 0.1HelpedGeneralizing across Temporal Domains with Koopman Operators (AAAI 2024 · 3 citations)
add AAUA to AAD + JS lossPACS · Avg.63.91 -> 67.91HelpedTowards Combating Frequency Simplicity-biased Learning for Domain Generalization (NeurIPS 2024 · 3 citations)
add fixed domain relations to prediction weightingFMoW-WILDS · Worst accuracy35.32 ± 0.66% -> 39.37 ± 0.34%HelpedImproving Domain Generalization with Domain Relations (ICLR 2024 · 2 citations)

Baseline numbers that disagree

The same baseline on the same benchmark and metric, reported more than 5% apart by different papers here. Training budgets, data splits and reimplementations differ, so state which number you compare with.

BaselineBenchmarkMetricReportedPapers
ERMDomainNetaccuracy41.1 – 65.43 papers, e.g. CVPR 2021 and CVPR 2025

What reviewers will expect

Datasets and baselines named in the 15 papers of this approach from 2025–2026 that have a full-text summary. Leaving out the common ones is a frequent review question.

Datasets

  • PACS · 7 of 15 papers
  • Office-Home · 6 of 15 papers
  • DomainNet · 6 of 15 papers
  • VLCS · 4 of 15 papers
  • TerraIncognita · 3 of 15 papers

Baselines

  • ERM · 7 of 15 papers
  • MLDG · 3 of 15 papers
  • CORAL · 3 of 15 papers
  • IRM · 3 of 15 papers
  • Fish · 2 of 15 papers
  • SWAD · 2 of 15 papers
  • GroupDRO · 2 of 15 papers
  • MMD · 2 of 15 papers

Recent preprints

Loading recent arXiv preprints…

    Who publishes on it

    Institutions on the most papers of this approach since 2023 (of 56 papers; from OpenAlex and the papers' affiliations).

    Use it

    Download BibTeX of 40 key papersOpen the topic in the interactive map

    Get alerts. Describe your idea in scime atlas and save it (free scime account): you get a weekly email when new preprints land close to it.

    Same keyword cluster

    Elsewhere in the topic

    Benchmark numbers, ablations and baseline numbers are extracted by AI from each paper's full text and can be wrong; the paper is the authority. Data: results index of 2026-11-02, citation counts from OpenAlex (2026-10-09).

    Get the next scime Dispatch and a monthly field update

    Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy