Research map / Vision-language and multimodal / Human and embodied modeling
Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine
Emma Chen, Aman Kansal, Julie Chen, Boyang Tom Jin, Julia Rachel Reisler, David A Kim, Pranav Rajpurkar
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| train one multitask model instead of task-specific models | LightGBM · MC-BEC decompensation 60 min | AUPRC: 0.33 -> 0.25 | Hurt |
| train one multitask model instead of task-specific models | LightGBM · MC-BEC decompensation 120 min | AUPRC: 0.40 -> 0.35 | Hurt |
| train one multitask model instead of task-specific models | LightGBM · MC-BEC disposition | AUPRC: 0.87 -> 0.82 | Hurt |
| train one multitask model instead of task-specific models | LightGBM · MC-BEC revisit 14 days | AUPRC: 0.24 -> 0.25 | No clear effect |
| train one multitask model instead of task-specific models | XGBoost · MC-BEC decompensation 120 min | AUPRC: 0.28 -> 0.33 | Improved |
| train one multitask model instead of task-specific models | Random Forest · MC-BEC disposition | AUPRC: 0.83 -> 0.80 | Hurt |
| add orders data to multitask model (ablation) | LightGBM multitask · MC-BEC decompensation 60 min | AUPRC: 0.22 -> 0.18 | Hurt |
| add orders data to multitask model (ablation) | LightGBM multitask · MC-BEC disposition | AUPRC: 0.71 -> 0.79 | Improved |
| add continuous monitoring to multitask model (ablation) | LightGBM multitask · MC-BEC decompensation 60 min | AUPRC: 0.15 -> 0.24 | Improved |
| add waveforms to multitask model (ablation) | LightGBM multitask · MC-BEC disposition | AUPRC: 0.80 -> 0.82 | Improved |
| drop continuous monitoring at inference (ablation) | LightGBM multitask · MC-BEC decompensation 60 min | AUPRC: 0.25 -> 0.14 | Hurt |
| drop orders at inference (ablation) | LightGBM multitask · MC-BEC disposition | AUPRC: 0.82 -> 0.73 | Hurt |
Closest papers by meaning
- Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML (ICLR 2024 · similarity 0.84)
- ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Room (NeurIPS 2026 · similarity 0.84)
- CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models (ICML 2025 · similarity 0.83)
- EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge Summaries (NeurIPS 2024 · similarity 0.82)
- One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Models (NeurIPS 2026 · similarity 0.81)
- EHRNote-ChatQA: A Benchmark for Evidence-Grounded Multi-Turn Clinical Question Answering over Longitudinal Discharge Summaries (NeurIPS 2026 · similarity 0.81)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
