AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

Interpreting and Steering State-Space Models via Activation Subspace Bottlenecks

Vamshi Sunku Mohan, Kaustubh Gupta, Aneesha Das, Chandan Singh

ICML 2026 · Architectures and efficiency › Attention and transformers · approach: State space and recurrent sequence models · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
steer delta-sensitive subspaces at Layer 20 (scale activations by scalar)Mamba-130M · RULER NIAHaccuracy (%): 84.00 -> 92.00Improved
steer delta-sensitive subspaces at Layer 20Mamba-130M · RULER QAaccuracy (%): 66.70 -> 76.00Improved
steer delta-sensitive subspaces at Layer 20Mamba-130M · Long Range Arena AVGaverage (%): 52.00 -> 60.88Improved
steer delta-sensitive subspaces at Layer 207 SSMs across 6 benchmarks · TriviaQA, SQuAD, MuSiQue, IFEval, RULER, DROPaverage improvement (%): +8.27%Improved
steer Layer 20 instead of other layers (ablation)Mamba-130M steering · IFEvalaccuracy (%): 59.0 -> 72.5 (Layer 21 vs Layer 20)Improved
select delta-sensitive subspaces instead of random subspaces (ablation)Mamba-130M steering · IFEvalaccuracy (%): 67.0 -> 72.5Improved
select delta-sensitive instead of high-variance subspaces (ablation)Mamba-130M steering · IFEvalaccuracy (%): 33.5 -> 72.5Improved
steer delta-sensitive instead of uniform steering across subspaces (ablation)Mamba-130M steering · IFEvalaccuracy (%): 61.5 -> 72.5Improved
retrain with Stable-Mamba architectureMamba-130M · Long Range Arena PathFinderaccuracy (%): 60.00 -> 95.00Improved
retrain with Stable-Mamba architectureMamba-130M · RULER NIAHaccuracy (%): 84.00 -> 90.00Improved
retrain with Stable-Mamba architectureMamba-130M · RULER QAaccuracy (%): 66.70 -> 82.00Improved
retrain with Stable-Mamba architectureMamba-130M · SAE sparsitysparsity (%): 98.12 -> 58.37Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy