AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Incomplete Multimodality-Diffused Emotion Recognition

Yuanzhi Wang, Yong Li, Zhen Cui

NeurIPS 2023 · Vision-language and multimodal › Cross-modal learning · approach: Multimodal sentiment analysis · 27 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the diffusion score model s_k for modality recovery (ablation)IMDer · CMU-MOSI random missing avgACC2: 75.8 -> 79.6Improved
add the reconstruction/refinement module D_k (ablation)IMDer · CMU-MOSI random missing avgACC2: 77.8 -> 79.6Improved
add the diffusion score model s_k (ablation)IMDer · CMU-MOSEI random missing avgACC2: 78.0 -> 80.9Improved
add the reconstruction module D_k (ablation)IMDer · CMU-MOSEI random missing avgACC2: 79.8 -> 80.9Improved
add both s_k and D_k versus neither (ablation)IMDer · CMU-MOSI random missing avgACC2: 74.5 -> 79.6Improved
score-model recovery versus reconstruction-only recovery (ablation)IMDer · CMU-MOSEI random missing avgACC2: 78.0 (s_k removed) vs 79.8 (D_k removed)Mixed
diffusion-based recovery versus graph completion (GCNet)IMDer · CMU-MOSI random missing MR 0.7ACC2: 65.7 -> 71.9Improved
diffusion-based recovery versus GCNet when only language is availableIMDer · CMU-MOSI fixed {l}ACC2: 83.7 -> 84.8Improved
IMDer versus GCNet with full modalitiesIMDer · CMU-MOSEI MR 0.0ACC2: 85.2 -> 85.1No clear effect
condition recovery on available modalities (conditional vs unconditional) (ablation)IMDer · CMU-MOSEI t-SNEclass separability (qualitative)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy