Research map / Probabilistic and scientific modeling / Molecules and proteins
GlucoBench: Curated List of Continuous Glucose Monitoring Datasets with Prediction Benchmarks
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Presents GlucoBench, a curated set of five public CGM datasets with a standardized preprocessing pipeline, two prediction tasks (accuracy and uncertainty), and baseline benchmarks of shallow, deep, and hybrid models with analysis of performance factors.
Problem
CGM-based glucose trajectory prediction is evaluated on small private datasets with no standardized tasks or comparisons, which hinders reproducibility and clinical adoption.
Approach
Consolidates public CGM datasets with a uniform preprocessing pipeline, defines two standardized tasks (predictive accuracy via RMSE/MAE and uncertainty quantification via likelihood and calibration error), and benchmarks a common set of shallow, deep, and hybrid models under a fixed out-of-the-box tuning protocol.
Key results
- On predictive accuracy, ARIMA or linear regression achieve the lowest error on most datasets, with Latent ODE best on Hall and Transformer best on Weinstock.
- Gluformer achieves the best likelihood on all five datasets, and the best calibration on all but two (TFT best on Colas and Weinstock per the tables).
- Deep models generalize better to out-of-distribution patients than simple baselines (ARIMA, linear regression), though performance generally degrades OD vs ID.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use deep or hybrid models instead of shallow baselines on larger datasets | CGM glucose forecasting · Weinstock and Hall | RMSE | Mixed |
| Add covariates to Linear (ablation) | Linear · Broll ID | RMSE: 11.68 -> 9.95 | Helped |
| Add covariates to Linear (ablation) | Linear · Colas, Dubosson, and Hall ID | RMSE: 5.26 -> 5.56; 12.07 -> 12.41; 7.38 -> 7.84 | Hurt |
| Add covariates to Linear (ablation) | Linear · Weinstock ID | RMSE: 13.60 -> 13.39 | Helped |
| Add covariates to Transformer (ablation) | Transformer · Broll and Hall ID | RMSE: 15.12 -> 12.83; 7.89 -> 7.49 | Helped |
| Add covariates to Transformer (ablation) | Transformer · Colas, Dubosson, and Weinstock ID | RMSE: 6.47 -> 8.44; 16.62 -> 27.43; 13.22 -> 14.46 | Hurt |
| Evaluate on out-of-distribution rather than in-distribution patients | Most benchmark models · CGM datasets | prediction performance | Hurt |
| Use Gluformer for likelihood-based uncertainty quantification | Benchmark models · All five datasets | log-likelihood | Helped |
Surprising findings
- Simple ARIMA and linear regression beat deep models on most datasets for accuracy.
- Adding covariates hurt performance on several datasets, likely due to overfitting on small data.
Limitations
- Out-of-the-box baselines without model-specific tuning, pre-training, or augmentation, so results may not reflect best achievable performance.
- Datasets are small and mostly Type 1; few Type 2 datasets and only one has time-varying covariates.
- Deep models underperform on several datasets due to limited observations per patient.
Experimental setup
Datasets: Broll Colas Dubosson Hall Weinstock
Benchmarks: Broll Colas Dubosson Hall Weinstock
Metrics: RMSE MAE log-likelihood calibration error
Baselines: ARIMA Linear regression XGBoost Transformer Temporal Fusion Transformer NHiTS Latent ODE Gluformer
Builds on: Darts NHiTS Temporal Fusion Transformer Latent ODE Gluformer
Closest papers by meaning
- GlucoFM-Bench: Benchmarking Time-Series Foundation Models for Blood Glucose Forecasting (NeurIPS 2026 · similarity 0.89)
- Hybrid$^2$ Neural ODE Causal Modeling and an Application to Glycemic Response (ICML 2024 · similarity 0.80)
- NutriBench: A Dataset for Evaluating Large Language Models in Nutrition Estimation from Meal Descriptions (ICLR 2025 · similarity 0.79)
- Adaptive Shrinkage Estimation for Personalized Deep Kernel Regression in Modeling Brain Trajectories (ICLR 2025 · similarity 0.79)
- Uncertainty-Calibrated Prediction of Randomly-Timed Biomarker Trajectories with Conformal Bands (NeurIPS 2025 · similarity 0.78)
- Modeling All-Atom Glycan Structures via Hierarchical Message Passing and Multi-Scale Pre-training (ICML 2025 · similarity 0.78)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
