AI Paper Atlas

Research map / Detection and segmentation / 3D detection and driving

OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation

Zhenyu Wang, Ya-Li Li, TAICHI LIU, Hengshuang Zhao, Shengjin Wang

ECCV 2024 · Detection and segmentation › 3D detection and driving · approach: Unified LiDAR 3D detection · 18 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add 2D to 3D semantic propagation from a 2D open-vocab detector (ablation)OV-Uni3DETR · SUN RGB-D (P+I)AP25 novel: N/A -> 11.21Improved
add 3D to 2D geometric propagation on top of 2D to 3D (ablation)OV-Uni3DETR · SUN RGB-D (image-only)AP25 novel: 3.86 -> 5.41Improved
add 3D to 2D geometric propagation on top of 2D to 3D (ablation)OV-Uni3DETR · SUN RGB-D (P+I)AP25 novel: 11.21 -> 12.96Improved
add switched-modality training (ablation)OV-Uni3DETR · SUN RGB-D (image-only)AP25 novel: 1.12 -> 5.41Improved
add 3D convolution with BN to regularize modality features (ablation)OV-Uni3DETR · SUN RGB-D (image-only)AP25 novel: 3.37 -> 5.41Improved
add dual-branch output layers for noisy 3D boxes (ablation)OV-Uni3DETR · SUN RGB-D (point cloud)AP25 novel: 6.34 -> 9.66Improved
multi-modal switched training vs single-modality training, point cloud inference (ablation)OV-Uni3DETR · SUN RGB-D (point cloud)AP25 novel: 9.64 -> 9.66No clear effect
unified multi-modal detector vs CoDA, point cloud inferenceOV-Uni3DETR · SUN RGB-DAP25 novel: 6.71 -> 9.66Improved
RGB-only inference vs CoDA with point cloudsOV-Uni3DETR · ScanNet (60 classes)AP25 novel: 6.54 -> 8.10Improved
OV-Uni3DETR vs OV-3DET and CoDA with no seen classesOV-Uni3DETR · ScanNet 20-classmean AP25: 19.32 -> 25.33Improved
image-only RGB training/inference vs point cloud input for 2D boxesOV-Uni3DETR · SUN RGB-D 2D detectionAP novel (2D): 5.21 (I) vs 0.40 (P)Hurt

Later papers that compared with this method

4 later accepted papers report OV-Uni3DETR as a baseline in their results tables; 4 of them report a better number on most of the results they share with it.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy