AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

Runmin Zhang, Jun Ma, Lun Luo, Beinan Yu, Shu-Jie Chen, Junwei Li, Hui-Liang Shen, Si-Yuan Cao

ECCV 2024 · Vision-language and multimodal › Cross-modal learning · approach: Multi-modality image fusion · 6 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add intra-modal self-supervised learning (versus cross-modal intensity loss only) (ablation)SCPNet · GoogleMapMACE: 24.64 -> 10.01 (with projection)Improved
add correlation to the self-supervised network (ablation)SCPNet · GoogleMapMACE: 13.06 -> 9.68Improved
add consistent feature map projection to the self-supervised network (ablation)SCPNet · GoogleMapMACE: 13.06 -> 10.01Improved
add cross-modal intensity-based learning on top of self-supervised, correlation and projection (ablation)SCPNet · GoogleMapMACE: 7.70 -> 4.35Improved
add correlation to cross-modal-only training with projection (ablation)SCPNet · GoogleMapMACE: 24.64 -> 24.80No clear effect
SCPNet vs supervised MHN on GoogleMapSCPNet · GoogleMapMACE: 5.06 -> 4.35Improved
SCPNet vs stronger supervised methods (LocalTrans, IHN, RHWF)SCPNet · Flash/no-flashMACE: 2.67 vs IHN 0.80Hurt
SCPNet vs supervised MHN on HarvardSCPNet · HarvardMACE: 5.35 -> 4.00Improved
add two-branch intra-modal self-supervised learning (ablation)SCPNet · Training costtraining time (hours): 3.18 -> 6.98 hours; memory 4622 -> 9144 MBHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy