atlas

Research map / Image generation / Fast diffusion sampling

Denoising Diffusion Path: Attribution Noise Reduction with An Auxiliary Diffusion Model

NeurIPS 2024 · Image generation › Fast diffusion sampling · approach: Denoising diffusion probabilistic models · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Denoising Diffusion Path (DDPath), which builds an attribution path from samples of a classifier-guided diffusion model centered on the target image, and integrates it with IG, BlurIG and GIG to reduce attribution noise.

Problem

Path-based attribution methods like integrated gradients accumulate noise along paths whose intermediate images drift away from the training data distribution, distorting explanations.

Approach

Replace hand-designed interpolation paths with a piece-wise linear path formed by reverse diffusion samples from a classifier-guided diffusion model, with sampling mean centered on the target image and scaled classifier guidance (rho = 1 - t/T, kappa = t/T), so intermediate images stay near the data distribution and noise decreases progressively.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace the linear IG path with a denoising diffusion pathIG · ImageNet-1k validation, VGG-16Insertion: 21.7 -> 25.9Helped
replace the linear IG path with a denoising diffusion pathIG · ImageNet-1k validation, VGG-19Insertion: 23.2 -> 27.8Helped
replace the linear IG path with a denoising diffusion pathIG · ImageNet-1k validation, ResNet-50Insertion: 33.8 -> 45.1Helped
replace the linear IG path with a denoising diffusion pathIG · ImageNet-1k validation, VGG-19Deletion: 13.5 -> 12.1Helped
replace the linear IG path with a denoising diffusion pathIG · ImageNet-1k validation, ResNet-50Deletion: 13.5 -> 12.7Hurt
use DDPath counterparts instead of baseline path methodsIG, BlurIG, and GIG · MS COCO 2017 validationPointing game: IG: 42.3 -> 44.7, 43.4 -> 45.2, 45.2 -> 46.9; BlurIG: 45.0 -> 47.2, 45.3 -> 48.9, 46.6 -> 50.0; GIG: 45.2 -> 46.3, 44.9 Helped
reverse the default scaling scheme (ablation)DDPath-IG · ImageNet validationAIC: 18.9 -> 16.2Hurt
reverse the default scaling scheme (ablation)DDPath-IG · ImageNet validationDeletion: 12.1 -> 14.5Hurt
use scaling exponent a = 2.0 rather than a = 1.0 (ablation)DDPath-IG · ImageNet validation, VGG-19 target modelInsertion: 45.3 -> 48.9Helped
add manually sampled noise to the baseline attribution path (ablation)IG, BlurIG, and GIG · ImageNet validationInsertion: IG: 21.7 -> 23.5; BlurIG: 19.2 -> 20.6; GIG: 21.2 -> 21.0Mixed
add manually sampled noise to the baseline attribution path (ablation)IG, BlurIG, and GIG · ImageNet validationDeletion: IG: 14.8 -> 13.3; BlurIG: 13.3 -> 13.6; GIG: 14.1 -> 12.5Mixed
increase DDPath sampling steps (ablation)DDPath-IG · ImageNet-1k validationInsertionHelped

Surprising findings

Limitations

Experimental setup

Datasets: ImageNet-1k MS COCO 2017

Benchmarks: ImageNet-1k validation (insertion/deletion, AIC) MS COCO 2017 validation (pointing game)

Metrics: insertion AUC deletion AUC overall (insertion minus deletion) AIC pointing game hit rate

Baselines: IG SmoothGrad BlurIG GIG Guided-BP Smooth IG

Builds on: integrated gradients BlurIG guided integrated gradients classifier-guided diffusion SmoothGrad

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy