atlas

Research map / Continual learning / Domain and prompt-based

PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understanding

NeurIPS 2024 · Continual learning › Domain and prompt-based · approach: Continual test-time adaptation · 4 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes PCoTTA, a continual test-time adaptation framework for multi-task point cloud understanding (reconstruction, denoising, registration) using a prototype bank with source and learnable prototypes, Gaussian-splatted graph attention feature shifting, and contrastive prototype repulsion.

Problem

Test-time adaptation of point cloud models to continually changing target domains fails due to catastrophic forgetting and error accumulation, and existing CoTTA methods are task-specific or designed for 2D images.

Approach

Mixes source prototypes with learnable target prototypes via a similarity-balancing factor, shifts test features using Gaussian-splatted graph attention over prototype-pair nodes, and uses a contrastive repulsion loss to keep learnable prototypes distinct, all within one unified masked-point-modeling model without pseudo-labels or teacher-student training.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ModelNet40 round 3 reconstructionCD (× 10⁻³): 30.1 -> 5.4Helped
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ModelNet40 round 3 denoisingCD (× 10⁻³): 41.6 -> 18.6Helped
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ModelNet40 round 3 registrationCD (× 10⁻³): 32.8 -> 12.1Helped
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ScanObjectNN round 3 reconstructionCD (× 10⁻³): 40.6 -> 8.2Helped
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ScanObjectNN round 3 denoisingCD (× 10⁻³): 51.1 -> 25.2Helped
Use PCoTTA instead of the strongest reported CoTTA baselineContinual multi-task point cloud adaptation · ScanObjectNN round 3 registrationCD (× 10⁻³): 34.7 -> 19.3Helped
Add APM to the baseline (ablation)PCoTTA · ModelNet40 reconstructionCD (× 10⁻³): 78.9 -> 23.5Helped
Add APM to the baseline (ablation)PCoTTA · ModelNet40 denoisingCD (× 10⁻³): 123.6 -> 37.4Helped
Add APM to the baseline (ablation)PCoTTA · ModelNet40 registrationCD (× 10⁻³): 110.6 -> 30.1Helped
Add GSFS to APM (ablation)PCoTTA · ModelNet40 reconstructionCD (× 10⁻³): 23.5 -> 14.6Helped
Add CPR to APM and GSFS (ablation)PCoTTA · ModelNet40 reconstructionCD (× 10⁻³): 14.6 -> 5.4Helped
Set learnable prototype quantity to 0 instead of 2 (ablation)PCoTTA · ModelNet40 reconstructionCD (× 10⁻³): 5.4 -> 15.5Hurt

Surprising findings

Limitations

Experimental setup

Datasets: ModelNet40 ShapeNet ScanNet ScanObjectNN

Benchmarks: ModelNet40 ScanObjectNN

Metrics: Chamfer Distance (CD) runtime (s) FLOPs (G) parameters (M)

Baselines: PointNet DGCNN PCT Pointmixup PointCutMix Baseline PIC AdaBN TENT CoTTA ViDA RMT

Builds on: PIC CoTTA Point-MAE

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy