Research map / Label-efficient and robust learning / Domain adaptation and generalization
Optimization-based domain generalization
Studies failure modes and gradient-guided or meta-learning methods for domain generalization.
101 accepted papers at ICML, NeurIPS, ICLR, CVPR and AAAI (2018–2026) · an approach in Domain adaptation and generalization, keyword cluster “domain generalization · dg · unseen”
State History Benchmarks Tried Baselines Checklist Preprints Who Export
Where it stands
Still moving The best reported result is still improving on 5 of 5 tracked benchmarks.
32 papers in 2023–24 and 24 in 2025–26 (at ICML, NeurIPS, ICLR, CVPR and AAAI); its share of the topic shrank, from 9.4% to 7.5%.
Open questions the data points to
- PACS (accuracy): best went from 97.3 (up to 2024) to 98.6 in 2025 — Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
- OfficeHome (accuracy): best went from 85.3 (up to 2024) to 91.3 in 2025 — Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
- DomainNet (accuracy): best went from 54.6 (up to 2024) to 66.5 in 2025 — Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
- VLCS (accuracy): best went from 82.4 (up to 2024) to 84.4 in 2025 — Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
- TerraIncognita (accuracy): best went from 60.7 (up to 2024) to 65.2 in 2025 — Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations)
- Papers report ERM on DomainNet (accuracy) anywhere from 41.1 to 65.4: comparisons against it depend on whose number you take.
How this is decided
A benchmark is tracked when at least four papers of this approach report their own method on the same dataset and metric in at least two different years. Its record is the best number reported up to 2024 compared with the best reported in 2025–26: still improving means at least 1% better, flat means at most 0.2% better with at least two papers from 2025–26 trying. Numbers on a different scale from the rest (a fraction among percentages) and far outliers are left out. Results come from different papers with different setups, so they are signals, not head-to-head comparisons. The share of papers is counted at ICML, NeurIPS, ICLR, CVPR and AAAI.
How it got here
Most cited paper of each year
- 2018 · Domain Generalization With Adversarial Feature Learning (CVPR 2018 · 1,271 citations)
- 2019 · Domain Generalization by Solving Jigsaw Puzzles (CVPR 2019 · 862 citations)
- 2020 · Learning to Learn Single Domain Generalization (CVPR 2020 · 468 citations)
- 2021 · A Fourier-Based Framework for Domain Generalization (CVPR 2021 · 561 citations)
- 2022 · PCL: Proxy-Based Contrastive Learning for Domain Generalization (CVPR 2022 · 133 citations)
- 2023 · Deep Frequency Filtering for Domain Generalization (CVPR 2023 · 93 citations)
- 2024 · Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations)
- 2025 · Balanced Direction from Multifarious Choices: Arithmetic Meta-Learning for Domain Generalization (CVPR 2025 · 5 citations)
- 2026 · MGT-Prism: Enhancing Domain Generalization for Machine-Generated Text Detection via Spectral Alignment (AAAI 2026 · 1 citation)
Earliest papers here
- Domain Generalization With Adversarial Feature Learning (CVPR 2018 · 1,271 citations)
- Learning to Generalize: Meta-Learning for Domain Generalization (AAAI 2018 · 1,265 citations)
- MetaReg: Towards Domain Generalization using Meta-Regularization (NeurIPS 2018 · 391 citations)
Benchmark records
The best number each year that beat every earlier one, among papers of this approach reporting their own method. Numbers are extracted by AI from each paper's text; check the paper before citing.
PACS · accuracy (higher is better)
11 papers, 2021–2025 · still improving
| Year | Best so far | Set by |
|---|---|---|
| 2021 | 84.5 | Adaptive Methods for Real-World Domain Generalization (CVPR 2021 · 77 citations) |
| 2022 | 88.9 | Towards Principled Disentanglement for Domain Generalization (CVPR 2022 · 102 citations) |
| 2023 | 96.7 | Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization (ICML 2023 · 0 citations) |
| 2024 | 97.3 | Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations) |
| 2025 | 98.6 | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
OfficeHome · accuracy (higher is better)
9 papers, 2021–2025 · still improving
| Year | Best so far | Set by |
|---|---|---|
| 2021 | 68.9 | Adaptive Methods for Real-World Domain Generalization (CVPR 2021 · 77 citations) |
| 2022 | 72.5 | Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization (NeurIPS 2022 · 47 citations) |
| 2023 | 85.3 | Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization (ICML 2023 · 0 citations) |
| 2025 | 91.3 | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
DomainNet · accuracy (higher is better)
8 papers, 2021–2025 · still improving
| Year | Best so far | Set by |
|---|---|---|
| 2021 | 43.9 | Adaptive Methods for Real-World Domain Generalization (CVPR 2021 · 77 citations) |
| 2023 | 49.2 | Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization (ICML 2023 · 0 citations) |
| 2024 | 54.6 | Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations) |
| 2025 | 66.5 | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
VLCS · accuracy (higher is better)
8 papers, 2021–2025 · still improving
| Year | Best so far | Set by |
|---|---|---|
| 2021 | 78.5 | Adaptive Methods for Real-World Domain Generalization (CVPR 2021 · 77 citations) |
| 2022 | 80 | Towards Principled Disentanglement for Domain Generalization (CVPR 2022 · 102 citations) |
| 2023 | 81.4 | Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization (ICML 2023 · 0 citations) |
| 2024 | 82.4 | Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations) |
| 2025 | 84.4 | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
TerraIncognita · accuracy (higher is better)
7 papers, 2021–2025 · still improving
| Year | Best so far | Set by |
|---|---|---|
| 2021 | 48.1 | Adaptive Methods for Real-World Domain Generalization (CVPR 2021 · 77 citations) |
| 2022 | 52.3 | Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization (NeurIPS 2022 · 47 citations) |
| 2023 | 53 | Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization (ICML 2023 · 0 citations) |
| 2024 | 60.7 | Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations) |
| 2025 | 65.2 | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
What has been tried
80 papers here report 903 measured changes (a component added, removed or swapped, compared with a baseline): helped 69%, no clear effect 7%, hurt 20%, mixed 4%. Papers mostly publish changes that helped, so "helped" is over-represented.
Ablations in recent papers
| What was changed | Measured on | Result | Effect | Paper |
|---|---|---|---|---|
| Add GAim1 to GAim2+GReg1 | HomeOffice · average accuracy | 84.0±0.2 -> 84.5±0.2 | Helped | Rethinking Multi-domain Generalization with A General Learning Objective (CVPR 2024 · 30 citations) |
| add autoencoder | Unseen datasets (Avg) · ACC | +0.97 | Helped | Generalizable Sleep Staging via Multi-Level Domain Alignment (AAAI 2024 · 17 citations) |
| Add RandAug to the FedAvg baseline | PACS · accuracy (Avg) | 81.3 -> 83.9 | Helped | Multi-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalization (AAAI 2024 · 15 citations) |
| Reverse the vital and non-vital phase assignments | ImageNet-100 · mCE (%) | 63.2 -> 68.2 | Hurt | Domain Generalization with Vital Phase Augmentation (AAAI 2024 · 12 citations) |
| Replace SSPL with classic SPL | Digits (MNIST, MNIST-M, SVHN, SYN) · accuracy | 96.4 ± .2 -> 90.5 ± .5; 62.6 ± .1 -> 55.4 ± .4; 66.7 ± .1 -> 48.7 ± .4; 83.8 ± .2 -> 64.9 ± .8 | Hurt | Symmetric Self-Paced Learning for Domain Generalization (AAAI 2024 · 11 citations) |
| Use both invariant and dynamic features rather than only invariant features | RMNIST · accuracy (%) | 45.7 ± 1.1 -> 47.5 ± 1.3 | Helped | Enhancing Evolving Domain Generalization through Dynamic Latent Representations (AAAI 2024 · 7 citations) |
| add global weight averaging with SWAD | DomainBed average · accuracy | 65.0 -> 66.7 | Helped | Balanced Direction from Multifarious Choices: Arithmetic Meta-Learning for Domain Generalization (CVPR 2025 · 5 citations) |
| Use larger parameter perturbations during GGA | PACS · accuracy | Hurt | Gradient-Guided Annealing for Domain Generalization (CVPR 2025 · 3 citations) | |
| add the λ1 sharpness penalty, λ2 consistency penalty, and PCE loss | OfficeHome · accuracy | 85.0 → 86.5 | Helped | Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes (CVPR 2025 · 3 citations) |
| use learned rather than predefined measurement functions | RMNIST · accuracy (%) | 86.6 ± 0.2 -> 87.5 ± 0.1 | Helped | Generalizing across Temporal Domains with Koopman Operators (AAAI 2024 · 3 citations) |
| add AAUA to AAD + JS loss | PACS · Avg. | 63.91 -> 67.91 | Helped | Towards Combating Frequency Simplicity-biased Learning for Domain Generalization (NeurIPS 2024 · 3 citations) |
| add fixed domain relations to prediction weighting | FMoW-WILDS · Worst accuracy | 35.32 ± 0.66% -> 39.37 ± 0.34% | Helped | Improving Domain Generalization with Domain Relations (ICLR 2024 · 2 citations) |
Baseline numbers that disagree
The same baseline on the same benchmark and metric, reported more than 5% apart by different papers here. Training budgets, data splits and reimplementations differ, so state which number you compare with.
| Baseline | Benchmark | Metric | Reported | Papers |
|---|---|---|---|---|
| ERM | DomainNet | accuracy | 41.1 – 65.4 | 3 papers, e.g. CVPR 2021 and CVPR 2025 |
What reviewers will expect
Datasets and baselines named in the 15 papers of this approach from 2025–2026 that have a full-text summary. Leaving out the common ones is a frequent review question.
Datasets
- PACS · 7 of 15 papers
- Office-Home · 6 of 15 papers
- DomainNet · 6 of 15 papers
- VLCS · 4 of 15 papers
- TerraIncognita · 3 of 15 papers
Baselines
- ERM · 7 of 15 papers
- MLDG · 3 of 15 papers
- CORAL · 3 of 15 papers
- IRM · 3 of 15 papers
- Fish · 2 of 15 papers
- SWAD · 2 of 15 papers
- GroupDRO · 2 of 15 papers
- MMD · 2 of 15 papers
Recent preprints
Loading recent arXiv preprints…
Who publishes on it
Institutions on the most papers of this approach since 2023 (of 56 papers; from OpenAlex and the papers' affiliations).
- Huawei · 2 papers
- Beihang University · 2 papers
- University of Western Ontario · 2 papers
- The Chinese University of Hong Kong · 2 papers
- Columbia University · 2 papers
- Indian Institute of Technology · 2 papers
- University of Science and Technology of China · 2 papers
- Microsoft · 2 papers
- Shanghai Jiao Tong University · 2 papers
- Beijing Institute of Technology · 2 papers
Use it
Download BibTeX of 40 key papersOpen the topic in the interactive map
Get alerts. Describe your idea in scime atlas and save it (free scime account): you get a weekly email when new preprints land close to it.
Related approaches
Same keyword cluster
- Foundation-model domain generalization (56 papers)
- Augmentation and mixture-of-experts generalization (51 papers)
- Generalizable person re-identification (11 papers)
Elsewhere in the topic
- Conditional distribution alignment (162 papers)
- Cross-domain few-shot with transformers (116 papers)
- Feature alignment for unsupervised adaptation (105 papers)
- Adversarial domain adaptation (95 papers)
- Geometric alignment and synthetic-to-real adaptation (93 papers)
- Source-free domain adaptation (92 papers)
- Adaptation for semantic segmentation (81 papers)
- Statistical alignment and hypothesis testing (80 papers)
Benchmark numbers, ablations and baseline numbers are extracted by AI from each paper's full text and can be wrong; the paper is the authority. Data: results index of 2026-11-02, citation counts from OpenAlex (2026-10-09).
