AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

TyphoonMLA: A Mixed Naive-Absorb MLA Kernel For Shared Prefix

Ahmet Caner Yüzügüler, Ahmet Çelik, Jiawei Zhuang, Lukas Cavigelli

ICLR 2026 · Architectures and efficiency › Attention and transformers · approach: Block-sparse attention kernels · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use naive formulation for shared prefix and absorb for non-shared partMLA decode kernel · MMLU DeepSeek-v3 Prompt Atoken generation rate (kToken/s): 1.01 -> 1.48Improved
use hybrid kernel with shorter system prompt (Prompt C)MLA decode kernel · MMLU DeepSeek-v3 Prompt Ctoken generation rate (kToken/s): 2.33 -> 2.56Improved
hybrid naive-absorb vs absorb-only on NPUMLA decode kernel · attention throughput, NPUspeedup: 1.2x to 3xImproved
hybrid naive-absorb vs FlashMLA/FlashInfer on GPUMLA decode kernel · attention throughput, GPUspeedup: up to 3.24xImproved
longer shared system prompt (Prompt A vs C)TyphoonMLA · attention time DeepSeek-v3 MMLUattention time (ms): 99.1 -> 58.1 (A); 26.9 -> 22.0 (C)Improved
fewer attention heads (Kimi K2 vs DeepSeek-v3) (ablation)TyphoonMLA · attention throughputspeedupImproved
fall back to absorb kernel below batch threshold (about 61-64) (ablation)TyphoonMLA · small batch sizesthroughputImproved
store shared prefix KV uncompressedTyphoonMLA · HBM footprintoverhead (%): about 3%Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy