AI Paper Atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

DEPICT: Diffusion-Enabled Permutation Importance for Image Classification Tasks

Sarah Jabbour, Gregory Kondas, Ella Kazerooni, Michael Sjoding, David Fouhey, Jenna Wiens

ECCV 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Post-hoc explanation analysis · 3 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
permute concepts in text space and regenerate images with diffusion instead of using GradCAM/LIME IOU rankingsfeature-importance explanation of image classifiers · Synthetic shapescorrelation with oracle weights: 0.73 -> 0.92 (vs LIME); 0.08 -> 0.92 (vs GradCAM)Improved
DEPICT versus baselines on COCO primary feature modelsDEPICT · COCO primary feature modelscorrelation with oracle: 0.15 -> 0.73 (vs LIME)Improved
DEPICT versus baselines on COCO mixed feature modelsDEPICT · COCO mixed feature modelscorrelation with oracle: 0.27 -> 0.35 (vs LIME), CIs overlapMixed
permute BMI/age/sex in text prompts of a chest X-ray diffusion modelMIMIC-CXR pneumonia classifiers · MIMIC-CXRAUROC: sex: 1.00 -> 0.53; age: 0.85 -> 0.59; BMI: 0.97 -> 0.70Hurt
diffusion model conditioned on non-permutable text mentioning the permuted conceptDEPICT · MIMIC-CXRindependent permutation validityHurt
weaker agreement between DEPICT and bottleneck-permutation oracleDEPICT · COCOcorrelation with logistic regression weights: 0.98 (synthetic) -> 0.90 (primary) -> 0.49 (mixed)Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy