Research map / Label-efficient and robust learning / Self-supervised and contrastive
Multimodal Patient Representation Learning with Missing Modalities and Labels
Zhenbang Wu, Anant Dadu, Nicholas Tustison, Brian Avants, Mike Nalls, Jimeng Sun, Faraz Faghri
Read the paperCheck your idea against 137,217 papers
AI-extracted summary. Written by AI from the paper's abstract only. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes a multimodal patient representation learning approach that handles both missing modalities and missing labels for clinical prediction.
Problem
Multimodal patient representation learning for clinical prediction, where patient data often has both missing modalities and missing labels; existing methods assume full modalities and labels or handle only missing modalities.
Approach
Targets the joint setting of missing modalities and missing labels, rather than only one of the two as prior approaches do.
Closest papers by meaning
- Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts (NeurIPS 2024 · similarity 0.87)
- Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024 · similarity 0.87)
- Mitigating Pervasive Modality Absence Through Multimodal Generalization and Refinement (AAAI 2025 · similarity 0.87)
- DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency (AAAI 2024 · similarity 0.86)
- Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities (NeurIPS 2024 · similarity 0.86)
- Modalities Contribute Unequally: Enhancing Medical Multi-modal Learning through Adaptive Modality Token Re-balancing (ICML 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
