AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Context-Aware Alignment and Mutual Masking for 3D-Language Pre-Training

Zhao Jin, Munawar Hayat, Yuwei Yang, Yulan Guo, Yinjie Lei

CVPR 2023 · Vision-language and multimodal › Human and embodied modeling · approach: Region-level vision-language alignment · 55 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use CSA and mutual 3D-language masked modeling for pre-training rather than training from scratch (ablation)3D-language model · ScanReferAcc@0.5: 37.01 -> 39.46Improved
Add semantic-level alignment (ablation)3D-language pre-training · ScanReferAcc@0.5: 37.01 -> 38.10Improved
Add contextual alignment (ablation)3D-language pre-training · ScanReferAcc@0.5: 37.01 -> 37.63Improved
Add both semantic-level and contextual alignment (ablation)3D-language pre-training · ScanReferAcc@0.5: 37.01 -> 38.20Improved
Add masked language modeling to CSA (ablation)3D-language pre-training · ScanReferAcc@0.5: 38.20 -> 38.91Improved
Add masked proposal modeling to CSA (ablation)3D-language pre-training · ScanReferAcc@0.5: 38.20 -> 39.12Improved
Use semantic-class reconstruction instead of no MPM reconstruction objective (ablation)MPM · ScanReferAcc@0.5: 38.20 -> 38.52Improved
Reconstruct raw xyz points instead of using no MPM objective (ablation)MPM · ScanReferAcc@0.5: 38.20 -> 38.18No clear effect
Reconstruct raw xyz and RGB points instead of using no MPM objective (ablation)MPM · ScanReferAcc@0.5: 38.20 -> 38.35No clear effect
Restrict proposal-class reconstruction to text-relevant proposals (ablation)MPM · ScanReferAcc@0.5: 38.52 -> 38.85Improved
Add masked-feature consistency to text-relevant proposal-class reconstruction (ablation)MPM · ScanReferAcc@0.5: 38.85 -> 39.12Improved
Increase proposal mask ratio from 0% to 75% (ablation)M3LM · ScanReferAcc@0.5: 38.91 -> 39.46Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy