Research map / Vision-language and multimodal / Cross-modal learning
Cross-Modal Guided Visual Synthesis for Data-Efficient Multimodal Depression Recognition
Shanliang Yang, Xiaoxiao Wang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add cross-modal guided visual feature synthesis to the recognizer (ablation) | Multimodal recognizer · DAIC-WOZ classification | F1-Score: 0.825 -> 0.860 | Improved |
| add task-guided feedback (augmented loss gradient into synthesizer) versus two-stage decoupled synthesis (ablation) | CMG-VS · DAIC-WOZ classification | F1-Score: 0.841 -> 0.860 | Improved |
| add two-stage synthesis without task guidance (ablation) | Recognizer-Only · DAIC-WOZ classification | F1-Score: 0.825 -> 0.841 | Improved |
| condition synthesis on both audio and text instead of text only (ablation) | Conditional visual synthesizer · DAIC-WOZ classification | F1-Score: 0.851 -> 0.860 | Improved |
| condition synthesis on both audio and text instead of audio only (ablation) | Conditional visual synthesizer · DAIC-WOZ classification | F1-Score: 0.845 -> 0.860 | Improved |
| synthesize all visual features rather than only AUs (ablation) | Conditional visual synthesizer · DAIC-WOZ classification | F1-Score: 0.857 -> 0.860 | No clear effect |
| synthesize all visual features rather than only pose and gaze (ablation) | Conditional visual synthesizer · DAIC-WOZ classification | F1-Score: 0.837 -> 0.860 | Improved |
| add visual synthesis to the recognizer (confusion matrix) (ablation) | Multimodal recognizer · DAIC-WOZ test set | false positives: 5 -> 2 false positives; 13 -> 12 depressed identified | Improved |
Closest papers by meaning
- CtrlSynth: Controllable Image Text Synthesis for Data-Efficient Multimodal Learning (ICML 2025 · similarity 0.86)
- Multi-to-Single: Reducing Multimodal Dependency in Emotion Recognition Through Contrastive Learning (AAAI 2025 · similarity 0.85)
- CoVFT: Context-aware Visual Fine-tuning for Multimodal Large Language Models (CVPR 2026 · similarity 0.84)
- When to Align, When to Predict: A Phase Diagram for Multimodal Learning (NeurIPS 2026 · similarity 0.84)
- Mitigating Pervasive Modality Absence Through Multimodal Generalization and Refinement (AAAI 2025 · similarity 0.84)
- A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter (AAAI 2025 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
