AI Paper Atlas

Research map / Architectures and efficiency / RNNs and normalization

Neural Basis Models for Interpretability

NeurIPS 2022 · Architectures and efficiency › RNNs and normalization · approach: Mechanistic circuit interpretability · 13 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace per-feature networks (NAM) with shared basis functions (NBM)NAM · CA Housing, FICO, CoverType, CUB, iNat Birds, Common Objectsaccuracy/AUROC/mAP: iNat acc@1 0.4194 -> 0.4227; Common Objects mAP 0.2056 -> 0.2168Helped
replace NAM with NBM on CA HousingNAM · CA HousingRMSE: 0.5721 -> 0.5638 (lower is better)Hurt
use shared bases instead of per-feature MLPsNAM · feature count > 10number of parameters: 5x-50x fewer parametersHelped
use shared bases with sparse optimizationNAM · Newsgroupsthroughput: 23 -> 9K x/sec (x391)Helped
NBM versus NAM on shape-function stabilityNAM · CA Housingmean std of shape functions: 0.9921 -> 0.1987Helped
add pairwise interactions via shared bivariate bases (NB2M vs NBM) (ablation)NBM · CA HousingRMSE: 0.5638 -> 0.4779Helped
add pairwise interactions (NB2M vs NBM) (ablation)NBM · CoverTypeacc@1: 0.7369 -> 0.8908Helped
add pairwise interactions (NB2M vs NBM) (ablation)NBM · iNaturalist Birdsacc@1: 0.4227 -> 0.4684Helped
NB2M versus black-box MLPNB2M · CoverTypeacc@1: 0.9694 vs 0.8908Hurt
add triplet interactions (NB3M) (ablation)NB2M · CoverTypeacc@1: 0.8908 -> 0.9634Helped
NBM versus NODE-GAMNODE-GAM · MIMIC-II, Credit, Click, Epsilon, Higgs, Microsoft, Yahoo, YearAUROC/error/MSE: MIMIC-II 0.8320 -> 0.8549; Year 85.09 vs 85.10Helped
vary number of bases B (ablation)NBM · Newsgroups, CoverType, CUBaccuracyNo clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy