AI Paper Atlas

Research map / Detection and segmentation / 3D detection and driving

Make Your ViT-based Multi-view 3D Detectors Faster via Token Compression

Dingyuan Zhang, Dingkang Liang, Zichang Tan, Xiaoqing Ye, Cheng Zhang, Jingdong Wang, Xiang Bai

ECCV 2024 · Detection and segmentation › 3D detection and driving · approach: Multi-camera BEV detection · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
replace random token selection with motion-query-guided selection (ablation)ToC3D on StreamPETR · nuScenes val (ViT-L, 12 epochs)NDS (%): 48.5 -> 60.3Improved
use motion query-guided selection instead of DynamicViT / SparseDETR (ablation)ToC3D · nuScenes val (ViT-L, 12 epochs)mAP (%): 49.3 -> 51.2 (vs DynamicViT)Improved
compute importance score via attention between tokens and history queries (ablation)ToC3D-Faster · nuScenes val (ViT-L)mAP (%): 50.4 -> 51.2Improved
add motion vector encoding of history queries (ablation)ToC3D-Faster · nuScenes val (ViT-L)mAP (%): 50.1 -> 51.2Improved
sample top-confidence history queries instead of using all (ablation)ToC3D-Faster · nuScenes val (ViT-L)mAP (%): 50.4 -> 51.2Improved
add bridge token in dynamic router (ablation)ToC3D-Faster · nuScenes val (ViT-L)mAP (%): 50.5 -> 51.2Improved
use too few history queries (N_q too small) (ablation)MQTS · nuScenes valperformanceHurt
keeping ratio too small (0.3, 0.2, 0.1) (ablation)ToC3D · nuScenes valNDS/mAPHurt
update importance score at deeper layers (10, 16, 22 vs 6, 12, 18) (ablation)ToC3D-Faster · nuScenes val (ViT-L)NDS (%): 60.3 -> 61.0 NDS; 237.2 -> 264.0 msMixed
apply ToC3D to Sparse4Dv2 as plug-and-playSparse4Dv2 · nuScenes val (ViT-L)NDS/speed: NDS 58.8 -> 58.8; 322.0 -> 244.8 msImproved
apply ToC3D-Fast to StreamPETR ViT-BStreamPETR ViT-B · nuScenes valwhole pipeline time (ms): 115.0 -> 94.0 with NDS 55.4 -> 55.2Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy