AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

Driving on Registers

Ellington Kirby, Alexandre Boulch, Yihong Xu, Yuan Yin, Gilles Puy, Éloi Zablocki, Andrei Bursuc, Spyros Gidaris, Renaud Marlet, Florent Bartoccioni, Anh-Quan Cao, Nermin Samet and 2 more

CVPR 2026 · Architectures and efficiency › Attention and transformers · approach: Efficient and robust vision transformers · 25 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
initialize backbone with pretrained DINOv2 instead of random (ablation)DrivoR · navvalPDMS: 70.1 -> 90.0Improved
use DINOv2 instead of ImageNet-21k pretraining (ablation)DrivoR · navvalPDMS: 87.5 -> 90.0Improved
use camera registers instead of pooling for token compression (ablation)DrivoR · navvalPDMS: 89.7 -> 90.0Improved
use registers instead of a transformer decoder compressor (ablation)DrivoR · navvalPDMS: 89.3 -> 90.0Improved
compress 16k tokens to 64 register tokens (ablation)DrivoR · navvalPDMS: 90.2 -> 90.0No clear effect
LoRA finetuning instead of frozen backbone (ablation)DrivoR registers · navvalPDMS: 84.4 -> 90.0Improved
LoRA finetuning instead of full finetuning (ablation)DrivoR registers · navvalPDMS: 88.4 -> 90.0Improved
keep pre-existing DINOv2 registers in addition to new ones (ablation)DrivoR · navvalPDMS: 89.8 vs 90.0No clear effect
increase registers per camera from 16 to 32 (ablation)DrivoR · navvalPDMS: 90.0 -> 89.8No clear effect
increase trajectory queries from 1 to 64 (ablation)DrivoR · navvalPDMS: 80.1 -> 90.0Improved
use separate scoring and trajectory decoders instead of one branch (ablation)DrivoR · navvalPDMS: 84.7 -> 86.8Improved
add disentanglement (stop-gradient plus trajectory re-embedding) to scorer (ablation)DrivoR · navvalPDMS: 86.8 -> 90.0Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy