AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane

Haoyu Liu, Sucheng Ren, Tingyu Zhu, Peng Wang, Cihang Xie, Alan Yuille, Zeyu Zheng, Feng Wang

ICML 2026 · Architectures and efficiency › Attention and transformers · approach: Transformer expressivity and learnability · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use Spiral RoPE instead of Axial 2D RoPEDeiT-L · ImageNet-1k val (448)top-1 accuracy (%): 85.42 -> 85.67Improved
use Spiral RoPE instead of Axial 2D RoPEDeiT-L · ADE20k valmIoU (%): 47.90 -> 49.12Improved
use Spiral RoPE instead of Axial 2D RoPEDiT-B/2 · ImageNet 256 generationFID: 39.88 -> 37.74Improved
use Spiral RoPE instead of RoPE-Mixed (learnable frequencies) on DeiT-S 224DeiT-S · ImageNet-1k val (224)top-1 accuracy (%): 80.48 -> 80.39Hurt
use Spiral RoPE instead of Axial RoPE on diagonal OOD placementsDeiT-Tiny from scratch · synthetic distance task OODerror rate (%): 70.38 -> 41.72Improved
add Spiral RoPE direction groups to ViT for rotated imagesDeiT-B · ImageNet-1k val rotated 45 degtop-1 accuracy gap vs Axial: +2.65 at 45 deg; +0.18 at 0 degImproved
increase number of directions K from 16 to 32 (ablation)Spiral RoPE · ImageNet-1k DeiT-B 224top-1 accuracy (%): 83.39 -> 83.32Hurt
use K=4 directions vs axial K=2 (ablation)Spiral RoPE · ImageNet-1k DeiT-B 224top-1 accuracy (%): 83.21 -> 83.31Improved
scale frequencies by 1.5 vs 1.0 (ablation)Spiral RoPE · ImageNet-1k DeiT-B 224top-1 accuracy (%): 83.33 -> 83.39No clear effect
increase frequency scale to 2.0 (ablation)Spiral RoPE · ImageNet-1k DeiT-B 224top-1 accuracy (%): 83.39 -> 83.23Hurt
train Spiral RoPE DiT-XL/2 for 7M steps vs SiTSpiral RoPE · ImageNet 256 generationFID: 2.06 -> 1.74Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy