atlas

Research map / Architectures and efficiency / RNNs and normalization

Empowering CAM-Based Methods with Capability to Generate Fine-Grained and High-Faithfulness Explanations

AAAI 2024 · Architectures and efficiency › RNNs and normalization · approach: Mechanistic circuit interpretability · 5 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes FG-CAM, which extends CAM-based explanation methods to shallow layers and the input layer by propagating last-layer explanation components backward through adjacent layers with z+/z-beta rules, plus a denoising variant using SVD.

Problem

CAM-based explanations are coarse-grained at deep layers because they use global per-channel weights, while LRP-style explanations are fine-grained but have low faithfulness.

Approach

Compute CAM explanation components at the last convolutional layer, then layer by layer redistribute their importance to higher-resolution previous layers using z+/z-beta relevance rules, filtering non-contributing pixels, so any CAM variant yields fine-grained, high-faithfulness maps; denoising applies SVD truncation to the components before redistribution.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Apply FG-CAM using Grad-CAM weights instead of Grad-CAM aloneVGG-16 with batch normalization · ILSVRC2012 val, Layer13A.D.: 83.80 -> 19.65Helped
Apply FG-CAM using Grad-CAM weights instead of Grad-CAM aloneVGG-16 with batch normalization · ILSVRC2012 val, Layer13A.I.: 3.25 -> 32.35Helped
Apply FG-CAM using Score-CAM weights instead of Score-CAM aloneVGG-16 with batch normalization · ILSVRC2012 val, Layer13A.D.: 57.06 -> 23.50Helped
Apply FG-CAM using Score-CAM weights instead of Score-CAM aloneVGG-16 with batch normalization · ILSVRC2012 val, Layer13A.I.: 12.00 -> 25.85Helped
Add denoising to FG-Grad-CAM (ablation)FG-Grad-CAM · ILSVRC2012 val, Layer13A.D.: 19.65 -> 17.90Helped
Add denoising to FG-Grad-CAM (ablation)FG-Grad-CAM · ILSVRC2012 val, input layerOver-all: 0.52089 -> 0.50115No clear effect
Add denoising to FG-Score-CAM (ablation)FG-Score-CAM · ILSVRC2012 val, Layer13A.D.: 23.50 -> 19.24Helped
Add denoising to FG-Score-CAM (ablation)FG-Score-CAM · ILSVRC2012 val, input layerOver-all: 0.49628 -> 0.49423No clear effect
Apply FG-CAM using Grad-CAM weights instead of LRPVGG-16 with batch normalization · ILSVRC2012 val, input layerOver-all: 0.45369 -> 0.52089Helped

Surprising findings

Limitations

Experimental setup

Datasets: ILSVRC2012 val

Benchmarks: ILSVRC2012 val

Metrics: Average Drop Average Increase deletion/insertion Over-all (AUC difference) Proportion (bounding-box localization)

Baselines: Grad-CAM Score-CAM Layer-CAM LRP CLRP SGLRP

Builds on: Grad-CAM Score-CAM Layer-CAM LRP CLRP SGLRP

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy