atlas

Research map / Label-efficient and robust learning / OOD and anomaly detection

Pareto Invariant Risk Minimization: Towards Mitigating the Optimization Dilemma in Out-of-Distribution Generalization

ICLR 2023 · Label-efficient and robust learning › OOD and anomaly detection · approach: Out-of-distribution generalization theory · 10 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the preference-aware PAIR optimizer with IRMx objectives instead of linear weightingIRMx · WILDSAvg. Rank (↓): 4.00 -> 2.17Helped
Use the preference-aware PAIR optimizer with IRMx objectives instead of linear weightingIRMx · CMNIST-maccuracy: 81.6 ± 2.0 -> 83.7 ± 1.2Helped
Use the preference-aware PAIR optimizer with IRMx objectives instead of linear weightingIRMx · Camelyon17Avg. acc. (%): 67.0 ± 6.6 -> 74.0 ± 7.0Mixed
Use the preference-aware PAIR optimizer with IRMx objectives instead of linear weightingIRMx · CivilCommentsWorst acc. (%): 74.3 ± 0.8 -> 75.2 ± 0.7Helped
Use classifier-only gradients to determine objective weights rather than full-model gradients (ablation)PAIR optimizer · CMNISTaccuracy: 68.6 ± 0.9 -> 69.2 ± 0.7No clear effect
Use classifier-only gradients to determine objective weights rather than featurizer gradients (ablation)PAIR optimizer · CMNIST-maccuracy: 83.7 ± 1.2 -> 83.7 ± 1.2No clear effect
Select models by jointly trading off ERM and OOD performance (ablation)DANN · CMNISTΔ wr.: +0.9Helped
Select models by jointly trading off ERM and OOD performance (ablation)GroupDRO · CMNISTΔ wr.: +3.1Helped
Select models by jointly trading off ERM and OOD performance (ablation)IRMv1 · CMNISTΔ wr.: +14.3Helped
Select models by jointly trading off ERM and OOD performance (ablation)Fishr · CMNISTΔ wr.: +12.7Helped
Select models by jointly trading off ERM and OOD performance (ablation)GroupDRO · PACSΔ wr.: +1.8Helped
Select models by jointly trading off ERM and OOD performance (ablation)GroupDRO · TerraΔ wr.: +0.0No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy