AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

HilbertA: Hilbert-Curve–Aligned Sparse Attention for 2D Structured Data

Shaoyi Zheng, Wenbo Lu, Yuxuan Xia, Shenji Wan

ICML 2026 · Architectures and efficiency › Attention and transformers · approach: Block-sparse attention kernels

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add central shared region (16x16 vs none) (ablation)HilbertA · diffusion ablationLPIPS: 0.592 -> 0.516Improved
add central shared region (16x16 vs none) (ablation)HilbertA · diffusion ablationCLIP-I: 0.871 -> 0.901Improved
change sliding cycle length from 2 to 4 (ablation)HilbertA · diffusion ablationLPIPS: 0.521 vs 0.520No clear effect
use Hilbert ordering instead of Swin attention at 75% sparsityHilbertA · Qwen3-VL-8B MMBenchscore: 0.645 -> 0.705Improved
use Hilbert ordering instead of Swin attentionHilbertA · Qwen3-VL-8B OCRBenchscore: 606 -> 686Improved
use 16 tiles instead of 4 tilesHilbertA · Flux.1-dev 2048x2048attention speedup: 2.46x -> 4.16xImproved
use 16 tiles instead of 4 tilesHilbertA · Flux.1-dev 2048x2048FID: 38.4 -> 47.5Hurt
use HilbertA instead of CLEARHilbertA · Flux.1-dev 2048x2048end-to-end speedup: 1.37x -> 1.44xImproved
Sparge Attention sparse pattern vs denseSparge Attention · Flux.1-dev 1024attention latency: 0.48x of denseHurt
Hilbert token reordering overheadHilbertA · 1024 and 2048 resolutionoverhead vs full attention (%): 7.20 and 1.92No clear effect
use HilbertA with LoRA on 10k imagesHilbertA · FLUX.2-Klein-9BFID: 26.39 -> 25.67Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy