atlas

Research map / Vision-language and multimodal / Cross-modal learning

Towards Versatile Pedestrian Detector with Multisensory-Matching and Multispectral Recalling Memory

AAAI 2022 · Vision-language and multimodal › Cross-modal learning · approach: Multi-modality image fusion · 37 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use multisensory-matching contrastive loss and multispectral recalling memory/loss with single-modality inputsFaster R-CNN with VGG16 · KAIST mixed modalityMR: 20.76 -> 11.39Helped
Use the proposed detector instead of the strongest listed thermal-based baselineKAIST thermal input · KAISTMR: 19.16 -> 15.87Helped
Use the proposed detector instead of the two-modality baselineCVC-14 mixed modality · CVC-14MR: 28.54 -> 19.88Helped
Add multisensory-matching contrastive loss to training (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 15.89Helped
Add multispectral recalling loss and MSR Memory to training (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 14.72Helped
Combine Lmmc and Lmsr (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 11.39Helped
Use 25 MSR Memory slots instead of no memory (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 12.98Helped
Set MSR Memory slot number to 50 (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 11.39Helped
Increase MSR Memory slot number to 100 (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 12.19Helped
Increase MSR Memory slot number to 200 (ablation)Proposed detector · KAIST mixed modalityMR: 20.76 -> 12.58Helped
Add the proposed method to FPN with ResNet-50 (ablation)FPN with ResNet-50 · KAIST mixed modalityMR: 18.50 -> 10.68Helped
Add the proposed method to FPN with ResNet-101 (ablation)FPN with ResNet-101 · KAIST mixed modalityMR: 17.98 -> 10.32Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy