AI Paper Atlas

Research map / Learning theory and algorithms / Matrix and tensor methods

Group Representational Position Encoding

Yifan Zhang, Zixiang Chen, Yifeng Liu, Zhen Qin, Huizhuo Yuan, Kangping Xu, Yang Yuan, Quanquan Gu, Andrew C Yao

ICLR 2026 · Learning theory and algorithms › Matrix and tensor methods · approach: Randomized sketching for matrices · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace RoPE with GRAPE-AP positional encodingLlama 353M · FineWeb-Edu 0-shot avgaverage accuracy: 51.73 -> 53.25Improved
replace RoPE with GRAPE-AP positional encodingLlama 770M · FineWeb-Edu 0-shot avgaverage accuracy: 55.76 -> 56.91Improved
use multiplicative GRAPE-M (ctx or non-ctx) instead of RoPELlama 353M · FineWeb-Edu 0-shot avgaverage accuracy: 51.73 -> 51.78 / 51.79No clear effect
use multiplicative GRAPE-M instead of RoPELlama 770M · FineWeb-Edu 0-shot avgaverage accuracy: 55.76 -> 54.73 / 54.81Hurt
add GRAPE-AP vs FoX with KV-shiftLlama 770M · FineWeb-Edu 0-shot avg (with KV-shift)average accuracy: 57.09 -> 56.86Hurt
GRAPE-AP in place of RoPE with KV-shiftLlama 353M · FineWeb-Edu 0-shot avg (with KV-shift)average accuracy: 52.89 -> 53.46Improved
gate additive slope on both query and key (A-QK) rather than key only (A-K) (ablation)GRAPE-A · FineWeb-Edu 0-shot avgaverage accuracy: 52.43 -> 53.00Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy