AI Paper Atlas

Research map / Vision-language and multimodal / Visual question answering

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images

Richard J. Chen, Ming Y. Lu, Wei-Hung Weng, Tiffany Y. Chen, Drew F.K. Williamson, Trevor Manz, Maha Shady, Faisal Mahmood

ICCV 2021 · Vision-language and multimodal › Visual question answering · approach: Multimodal LLM question answering · 450 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add genomic features via co-attention instead of WSI only (MCAT vs Attention MIL WSI Only)Attention MIL · TCGA 5 cancers overallc-Index: 0.614 -> 0.653Improved
use MCAT instead of DeepAttnMISL WSI onlyDeepAttnMISL · TCGA 5 cancers overallc-Index: 0.581 -> 0.653Improved
use co-attention fusion instead of concatenation late fusionAttention MIL (Concat) · TCGA 5 cancers overallc-Index: 0.630 -> 0.653Improved
use co-attention fusion instead of bilinear pooling late fusionAttention MIL (Bilinear Pooling) · TCGA 5 cancers overallc-Index: 0.611 -> 0.653Improved
use MCAT instead of DeepAttnMISL concat fusionDeepAttnMISL (Concat) · TCGA BRCAc-Index: 0.545 ± 0.071 -> 0.580 ± 0.069Improved
add genomic concat to Attention MIL (WSI only) in UCECAttention MIL · TCGA UCECc-Index: 0.625 ± 0.057 -> 0.614 ± 0.052Hurt
add genomic concat to Deep Sets WSI onlyDeep Sets · TCGA 5 cancers overallc-Index: 0.499 -> 0.629Improved
add Transformer layers before global attention pooling (both TH and TG) (ablation)MCAT · TCGA overall c-Indexc-IndexImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy