Research map / 3D vision / 3D generation
Curvature-Aware Captioning: Leveraging Geodesic Attention for 3D Scene Understanding
Ziyao He, Yingjie Liu, Zhang Yangrui, Mingsong Chen, Xuan Tang, Xian Wei
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add Lorentz (hyperbolic) manifold alongside Oblique manifold (ablation) | CAC · 3D dense captioning (IoU 0.50, MLE) | CIDEr@0.5: 68.07 -> 69.92 | Improved |
| map decoder self-attention to Oblique manifold (ablation) | CAC(O) · 3D dense captioning (IoU 0.50, MLE) | CIDEr@0.5: 68.07 -> 62.96 | Hurt |
| map encoder and decoder both to Oblique manifold (ablation) | CAC(O) · 3D dense captioning (IoU 0.50, SCST) | CIDEr@0.5: 79.09 -> 70.40 | Hurt |
| map encoder to Hyperbolic instead of Oblique manifold (ablation) | CAC · 3D dense captioning (IoU 0.50, SCST) | CIDEr@0.5: 79.09 -> 77.46 CIDEr; BLEU-4 38.96 -> 39.47 | Mixed |
| use Version 1 bidirectional attention input configuration (ablation) | BiCA · 3D dense captioning (IoU 0.50, MLE) | CIDEr@0.5: 63.17 / 64.91 -> 65.22 | Improved |
| replace baseline attention with Version 1 input scheme (Version 4) (ablation) | CAC(O) · 3D dense captioning (IoU 0.50, MLE) | CIDEr@0.5: 68.07 -> 67.07 | Hurt |
| use Oblique plus Lorentz manifolds instead of Oblique only (ablation) | CAC · Convergence speed (ScanRefer MLE) | peak epoch: 337 -> 225 | Improved |
| use CAC(O&H) instead of Vote2Cap-DETR++ | 3D dense captioning · Convergence speed (ScanRefer MLE) | total time (s): 19,872.9 -> 19,667.7 | Improved |
| set Lorentz temperature to 0.1 and curvature c to 2 (ablation) | CAC · Hyperparameter sensitivity (MLE) | CIDEr@0.5: 50.03 -> 50.87 | Improved |
| lower curvature to c=0.5 (ablation) | CAC · Hyperparameter sensitivity (MLE) | CIDEr@0.5: 50.61 -> 49.90 | Hurt |
| set Oblique temperature to 0.5 instead of 1 in pretraining (ablation) | CAC pretraining · Pretraining detection (epoch 119) | mAP@0.50: 38.05 -> 36.43 | Hurt |
Closest papers by meaning
- G^3-LQ: Marrying Hyperbolic Alignment with Explicit Semantic-Geometric Modeling for 3D Visual Grounding (CVPR 2024 · similarity 0.87)
- Cross-Modal and Uncertainty-Aware Agglomeration for Open-Vocabulary 3D Scene Understanding (CVPR 2025 · similarity 0.86)
- Context and Geometry Aware Voxel Transformer for Semantic Scene Completion (NeurIPS 2024 · similarity 0.86)
- H2GFormer: Horizontal-to-Global Voxel Transformer for 3D Semantic Scene Completion (AAAI 2024 · similarity 0.86)
- On the Generalization Capacities of MLLMs for Spatial Intelligence (ICLR 2026 · similarity 0.86)
- OneCanvas: 3D Scene Understanding via Panoramic Reprojection (NeurIPS 2026 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
