AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine

Emma Chen, Aman Kansal, Julie Chen, Boyang Tom Jin, Julia Rachel Reisler, David A Kim, Pranav Rajpurkar

NeurIPS 2023 · Vision-language and multimodal › Human and embodied modeling · approach: Medical vision-language models · 5 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train one multitask model instead of task-specific modelsLightGBM · MC-BEC decompensation 60 minAUPRC: 0.33 -> 0.25Hurt
train one multitask model instead of task-specific modelsLightGBM · MC-BEC decompensation 120 minAUPRC: 0.40 -> 0.35Hurt
train one multitask model instead of task-specific modelsLightGBM · MC-BEC dispositionAUPRC: 0.87 -> 0.82Hurt
train one multitask model instead of task-specific modelsLightGBM · MC-BEC revisit 14 daysAUPRC: 0.24 -> 0.25No clear effect
train one multitask model instead of task-specific modelsXGBoost · MC-BEC decompensation 120 minAUPRC: 0.28 -> 0.33Improved
train one multitask model instead of task-specific modelsRandom Forest · MC-BEC dispositionAUPRC: 0.83 -> 0.80Hurt
add orders data to multitask model (ablation)LightGBM multitask · MC-BEC decompensation 60 minAUPRC: 0.22 -> 0.18Hurt
add orders data to multitask model (ablation)LightGBM multitask · MC-BEC dispositionAUPRC: 0.71 -> 0.79Improved
add continuous monitoring to multitask model (ablation)LightGBM multitask · MC-BEC decompensation 60 minAUPRC: 0.15 -> 0.24Improved
add waveforms to multitask model (ablation)LightGBM multitask · MC-BEC dispositionAUPRC: 0.80 -> 0.82Improved
drop continuous monitoring at inference (ablation)LightGBM multitask · MC-BEC decompensation 60 minAUPRC: 0.25 -> 0.14Hurt
drop orders at inference (ablation)LightGBM multitask · MC-BEC dispositionAUPRC: 0.82 -> 0.73Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy