AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Chroma-VAE: Mitigating Shortcut Learning with Generative Classifiers

Wanqian Yang, Polina Kirichenko, Micah Goldblum, Andrew Gordon Wilson

NeurIPS 2022 · Label-efficient and robust learning › Recognition and long-tail · approach: Contrastive representation theory

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use Chroma-VAE instead of JTTCelebA Blond/Gender · CelebA Blond/Genderworst-group accuracy: 28.3 -> 54.4Improved
Use Chroma-VAE instead of JTTCelebA Attractive/Smiling · CelebA Attractive/Smilingworst-group accuracy: 30.0 -> 53.1Improved
Use Chroma-VAE instead of JTTMF-Dominoes · MF-Dominoesworst-group accuracy: 0.81 -> 73.8Improved
Use Chroma-VAE instead of JTTChest X-Ray · Chest X-Rayworst-group accuracy: 52.3 -> 57.8Improved
Use Chroma-VAE instead of Naive-ClassChest X-Ray · Chest X-Rayaverage accuracy: 85.0 -> 59.9Hurt
Train the prediction classifier on z2 rather than use the z1 classifier (ablation)Chroma-VAE · CelebA synthetic patch D_antiaccuracy: 6.03 -> 87.24Improved
Add a generative component without separating latent subspacesNaive-VAE-Class versus Naive-Class · ColoredMNIST D_outaccuracy: 4.45 -> 4.69No clear effect
Increase beta above 1 in the ELBO (ablation)Chroma-VAE · ColoredMNIST D_outaccuracy: 72.4 -> 70.3; 72.4 -> 62.8; 72.4 -> 49.4Hurt
Set beta to 0.5 instead of 1 (ablation)Chroma-VAE · ColoredMNIST D_outaccuracy: 72.4 -> 71.2No clear effect
Increase latent dimension (ablation)Chroma-VAE · ColoredMNISTreconstruction fidelityImproved
Increase partition fraction z_p (ablation)Chroma-VAE · ColoredMNISTz2-classifier predictive performanceHurt
Make the shortcut completely correlated with the label during trainingChroma-VAE · CelebA and MF-Dominoesworst-group accuracyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy