AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

The Expressive Limits of Diagonal SSMs for State-Tracking

Mehran Shakerinava, Behnoush Khavari, Siamak Ravanbakhsh, Sarath Chandar

ICLR 2026 · Architectures and efficiency › Attention and transformers · approach: State space and recurrent sequence models · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
allow negative eigenvalues (Negative Mamba instead of Mamba)Mamba · Group state-tracking C2 (1-layer)longest length >=100 with accuracy >90%: fail -> 1000Improved
stack a second layer on Negative MambaNegative Mamba · Group state-tracking C2xC4longest length >=100 with accuracy >90%: fail -> 360Improved
use complex-valued rotations (AUSSM instead of Negative Mamba)Negative Mamba · Group state-tracking C6 (1-layer)longest length >=100 with accuracy >90%: fail -> 940Improved
add a second layer to AUSSMAUSSM · Group state-tracking S3longest length >=100 with accuracy >90%: fail -> failNo clear effect
add a second layer to AUSSMAUSSM · Group state-tracking C6longest length >=100 with accuracy >90%: 940 -> 100Hurt
add a second layer to Simple AUSSMSimple AUSSM · Group state-tracking C2longest length >=100 with accuracy >90%: 160 -> 1000Improved
increase group size from C2 to C60RNN · Group state-tracking (1-layer)longest length >=100 with accuracy >90%: 1000 -> failHurt
initialize AUSSM near analytical S3 solution (ablation)AUSSM · Group state-tracking S3longest length >=100 with accuracy >90%: fail -> extrapolates at least four times training lengthImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy