AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Noise-Resistant Multimodal Transformer for Emotion Recognition

Yuanyuan Liu, Haoyu Zhang, Yibing Zhan, Zijing Chen, Guanghao Yin, Lin Wei, Zhe Chen

IJCV 2024 · Vision-language and multimodal › Cross-modal learning · approach: Multimodal sentiment analysis · 36 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add NRGF extractor (ablation)NORM-TR · MOSIAcc-7: 46.8 -> 48.5Improved
add NRGF extractor (ablation)NORM-TR · MOSEIAcc-7: 52.3 -> 54.6Improved
add MF extractor (ablation)NORM-TR · MOSIAcc-7: 48.1 -> 48.5Improved
add MF extractor (ablation)NORM-TR · MOSEIAcc-7: 53.6 -> 54.6Improved
add multimodal fusion Transformer (ablation)NORM-TR · MOSIAcc-7: 45.6 -> 48.5Improved
add multimodal fusion Transformer (ablation)NORM-TR · MOSEIAcc-7: 53.8 -> 54.6Improved
add noise-aware learning scheme (ablation)NORM-TR · MOSIAcc-7: 46.9 -> 48.5Improved
add noise-aware learning scheme (ablation)NORM-TR · MOSEIAcc-7: 53.2 -> 54.6Improved
add text modality (ablation)NORM-TR · MOSIAcc-7: 18.1 -> 48.5Improved
add audio modality (ablation)NORM-TR · MOSIAcc-7: 43.6 -> 48.5Improved
add video modality (ablation)NORM-TR · MOSEIAcc-7: 51.8 -> 54.6Improved
use NRGFs as query and MFs as key and value instead of the reverse (ablation)NORM-TR · MOSIAcc-7: 47.1 -> 48.5Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy