Enhancing clinical decision support with physiological waveforms - A multimodal benchmark in emergency care
Open accessAbstract
BACKGROUND: AI-driven prediction algorithms have the potential to enhance emergency medicine by enabling rapid and accurate decision-making regarding patient status and potential deterioration. However, the integration of multimodal data, including raw waveform signals, remains underexplored in clinical decision support. METHODS: We present a dataset and benchmarking protocol designed to advance multimodal decision support in emergency care. Our models utilize demographics, biometrics, vital signs, laboratory values, and electrocardiogram (ECG) waveforms as inputs to predict both discharge diagnoses and patient deterioration. RESULTS: The diagnostic model achieves area under the receiver operating curve (AUROC) scores above 0.8 for 609 out of 1,428 conditions, covering both cardiac (e.g., myocardial infarction) and non-cardiac (e.g., renal disease, diabetes) diagnoses. The deterioration model attains AUROC scores above 0.8 for 14 out of 15 targets, accurately predicting critical events such as cardiac arrest, mechanical ventilation, ICU admission, and mortality. CONCLUSIONS: Our study highlights the positive impact of incorporating raw waveform data into decision support models, improving predictive performance. By introducing a unique, publicly available dataset and baseline models, we provide a foundation for measurable progress in AI-driven decision support for emergency care.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Continuous physiological waveforms such as ECGs are often excluded from existing ICU models, despite evidence that they can outperform traditional clinical variables across prognostic and non-cardiovascular tasks.
“In particular, continuous physiological waveforms such as electrocardiograms (ECGs) are often excluded [7, 8], despite evidence that they can outperform traditional clinical variables across prognostic and non-cardiovascular tasks [3].”
From A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarking (2026) · cites this paper as [3]
Section 4.1 (page unavailable) reports that ECG-waveform-only models outperform clinical-routine-data models for diagnoses, which include non-cardiac conditions discussed in Section 4.2. But for deterioration prediction, the clinical-routine-data model outperforms the waveform-only model; superior performance there comes from multimodal models that combine waveforms with clinical data. The claim therefore overstates the evidence that waveforms outperform traditional clinical variables across prognostic tasks. (LLM, conf=0.88)
Experimental — accuracy not yet measuredECG waveforms are included due to prior evidence demonstrating their statistically significant added value for related clinical prediction tasks [3].
“ECG waveforms are included due to prior evidence demonstrating their statistically significant added value for related clinical prediction tasks [3].”
From A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarking (2026) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,037 · see citing works
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522 · see citing works
MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-022-01899-x · Cited by 3,401 · see citing works
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · see citing works
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854 · see citing works
Machine Learning in Drug Discovery: A Review
Dara, S., Dhamercherla, S., Jadav, S. S., Babu, C. M., & Ahsan, M. J. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10058-4 · Cited by 843 · see citing works
Efficiently Modeling Long Sequences with Structured State Spaces
Gu, A., Goel, K., & Ré, C. (2021) · arXiv · doi:10.48550/arxiv.2111.00396 · Cited by 805 · see citing works
Evaluation and mitigation of the limitations of large language models in clinical decision-making
Hager, P., Jungmann, F., Holland, R., Bhagat, K., Hubrecht, I., Knauer, M., Vielhauer, J., Makowski, M., Braren, R., Kaissis, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03097-1 · Cited by 798 · cited 1× · see citing works
“An obvious extension along these lines would be to include free-text data as in the recent of Hager et al [17].”
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755 · see citing works
Machine Learning for Survival Analysis
Wang, P., Li, Y., & Reddy, C. K. (2019) · ACM Computing Surveys · doi:10.1145/3214306 · Cited by 473 · see citing works
Predicting urinary tract infections in the emergency department with machine learning
Taylor, R. A., Moore, C. L., Cheung, K., & Brandt, C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194085 · Cited by 220 · see citing works
Author Correction: MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-023-02136-9 · Cited by 181 · see citing works
Privacy-Preserving Techniques in Generative AI and Large Language Models: A Narrative Review
Feretzakis, G., Papaspyridis, K., Gkoulalas-Divanis, A., & Verykios, V. S. (2024) · Information · doi:10.3390/info15110697 · Cited by 176 · see citing works
Deep Learning for Chest Radiograph Diagnosis in the Emergency Department
Hwang, E. J., Nam, J. G., Lim, W. H., Park, S. J., Jeong, Y. S., Kang, J. H., Hong, E. K., Kim, T. M., Goo, J. M., Park, S., et al. (2019) · Radiology · doi:10.1148/radiol.2019191225 · Cited by 164 · see citing works
Covino, M., Sandroni, C., Santoro, M. C., Sabia, L., Simeoni, B., Bocci, M. G., Ojetti, V., Candelli, M., Antonelli, M. M., Gasbarrini, A., et al. (2020) · Resuscitation · doi:10.1016/j.resuscitation.2020.08.124 · Cited by 146 · see citing works
Moor, M., Bennett, N., Plečko, D., Horn, M., Rieck, B., Meinshausen, N., Bühlmann, P., & Borgwardt, K. (2023) · eClinicalMedicine · doi:10.1016/j.eclinm.2023.102124 · Cited by 118 · see citing works
A Closer Look at AUROC and AUPRC under Class Imbalance
McDermott, M. B. A., Zhang, H., Hansen, L., Angelotti, G., & Gallifant, J. (2024) · neural information processing systems · doi:10.52202/079017-1400 · Cited by 101 · see citing works
Forecasting emergency department overcrowding: A deep learning framework
Harrou, F., Dairi, A., Kadri, F., & Sun, Y. (2020) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2020.110247 · Cited by 71 · see citing works
Don't be misled: 3 misconceptions about external validation of clinical prediction models
la Roi-Teeuw, H. M., van Royen, F. S.-A., de Hond, A., Zahra, A., de Vries, S., Bartels, R., Carriero, A., van Doorn, S., Dunias, Z. S., Kant, I. M. J., et al. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111387 · Cited by 57 · see citing works
MIMIC-IV-ECG: Diagnostic Electrocardiogram Matched Subset
Gow, B., Pollard, T., Nathanson, L. A., Johnson, A., Moody, B., Fernandes, C., Greenbaum, N., Waks, J. W., Eslami, P., Carbonati, T., et al. (2023) · PhysioNet · doi:10.13026/4nqg-sb35 · Cited by 54
Predicting patient decompensation from continuous physiologic monitoring in the emergency department
Sundrani, S. C., Chen, J., Jin, B. T., Abad, Z. S. H., Rajpurkar, P., & Kim, D. A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00803-0 · Cited by 53 · see citing works
Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery
Wagner, P., Mehari, T., Haverkamp, W., & Strodthoff, N. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108525 · Cited by 48 · see citing works
Self-citationHong, S., Lee, S., Lee, J.-H., Cha, W. C., & Kim, K. (2020) · JMIR Medical Informatics · doi:10.2196/15932 · Cited by 47 · see citing works
EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Models
Wornow, M., Thapa, R., Steinberg, E., Fries, J., & Shah, N. H. (2023) · neural information processing systems · doi:10.52202/075280-2933 · Cited by 41 · see citing works
Cohort profile of Acutelines: a large data/biobank of acute and emergency medicine
ter Avest, E., Munster, B. C. V., van Wijk, R. J., Tent, S., Horst, S. T., Hu, T. T., van Heijst, L. E., van der Veer, F. S., van Beuningen, F. E., ter Maaten, J. C., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047349 · Cited by 36 · see citing works
Self-citationMehari, T., & Strodthoff, N. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3310989 · Cited by 29 · see citing works
Self-citationDefining Physiological Decompensation: An Expert Consensus and Retrospective Outcome Validation
Mitchell, O. J. L., Dewan, M. L., Wolfe, H. A., Roberts, K. J., Neefe, S., Lighthall, G. K., Sands, N. A., Weissman, G. E., Ginestra, J. C., Shashaty, M. G. S., et al. (2022) · Critical Care Explorations · doi:10.1097/cce.0000000000000677 · Cited by 24 · see citing works
Strodthoff, N., Lopez Alcaraz, J. M., & Haverkamp, W. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae039 · Cited by 22 · see citing works
Self-citationClinical decision support using pseudo-notes from multiple streams of EHR data
Lee, S. A., Jain, S., Chen, A., Ono, K., Biswas, A., Rudas, Á., Fang, J., & Chiang, J. N. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01777-x · Cited by 22 · see citing works
S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification models
Wang, T., & Strodthoff, N. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109735 · Cited by 11 · see citing works
Self-citationChen, E., Kansal, A., Chen, J., Jin, B. T., Reisler, J., Kim, D. A., & Rajpurkar, P. (2023) · neural information processing systems · doi:10.52202/075280-1984 · Cited by 11 · see citing works
ED-Copilot: Reduce Emergency Department Wait Time with Language Model Diagnostic AssistancePreprint
Sun, L., Agarwal, A., Kornblith, A. E., Yu, B., & Xiong, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.13448 · Cited by 5 · see citing works
CardioLab: Laboratory Values Estimation from Electrocardiogram Features - An Exploratory Study
Alcaraz, J. M. L., & Strodthoff, N. (2024) · Computing in cardiology · doi:10.22489/cinc.2024.112 · Cited by 4 · see citing works
Self-citationHenna, S., & Alcaraz, J. M. L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.12958 · Cited by 3 · see citing works
Self-citationExplaining Time Series Classification Predictions via Causal Attributions
Alcaraz, J. M. L., & Strodthoff, N. (2025) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai66417.2025.00014 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- [19][19] S. A. Lee, S. Jain, A. Chen, A. Biswas, J. Fang, A. Rudas, J. N. Chiang, Multimodal clinical pseudo-notes for emergency department prediction tasks using multiple embedding model for ehr (meme), ArXiv Preprint arXiv:2402.00160 (2024). - · arXiv
- [22][22] J. M. Lopez Alcaraz, N. Strodthoff, Mimic-iv-ext-mds-ed: Multimodal decision support in the emergency department - a benchmark dataset for diagnoses and deterioration prediction in emergency medicine (version 1.0.0), doi: https://doi.org/10.13026/p90d-vd84 (2024). doi:10.13026/p90d-vd84 . - · DOI
- [33][33] J. M. L. Alcaraz, N. Strodthoff, Causalconceptts: Causal attributions for time series classification using high fidelity diffusion models, ArXiv Preprint arXiv:2405.15871 (2024). - · arXiv
Cited by
Sorted by citations
Transforming sepsis management: AI-driven innovations in early detection and tailored therapies
Papareddy, P., Lobo, T. J., Holub, M., Bouma, H., Maca, J., Strodthoff, N., & Herwald, H. (2025) · Critical Care · doi:10.1186/s13054-025-05588-0 · Cited by 49 · see citing works
Self-citationDepression diagnosis from patient interviews using multimodal machine learning
Weber, J., Weber, M., & Alcaraz, J. M. L. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1694762 · Cited by 10 · see citing works
Self-citationBoie, S. D., Giesa, N., Sekutowicz, M., Zhumagambetov, R., Haufe, S., Grünewald, E., & Balzer, F. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1746867 · Cited by 9 · see citing works
Alcaraz, J. M. L., Haverkamp, W., & Strodthoff, N. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103242 · Cited by 9 · see citing works
Self-citationAlcaraz, J. M. L., & Strodthoff, N. (2025) · Scientific Reports · doi:10.1038/s41598-025-26715-5 · Cited by 5 · see citing works
Self-citationCardioLab: Laboratory Values Estimation from Electrocardiogram Features - An Exploratory Study
Alcaraz, J. M. L., & Strodthoff, N. (2024) · Computing in cardiology · doi:10.22489/cinc.2024.112 · Cited by 4 · see citing works
Self-citationAlcaraz, J. M. L., Haverkamp, W., & Strodthoff, N. (2025) · Cardio-Oncology · doi:10.1186/s40959-025-00370-1 · Cited by 4 · see citing works
Self-citationExplainable and externally validated machine learning for neurocognitive diagnosis via ECGs
Alcaraz, J. M. L., Oloyede, E., Taylor, D. M., Haverkamp, W., & Strodthoff, N. (2025) · General Psychiatry · doi:10.1136/gpsych-2025-102107 · Cited by 3 · see citing works
Self-citationEstimation of Cardiac and Non-cardiac Diagnosis from Electrocardiogram Features
Alcaraz, J. M. L., & Strodthoff, N. (2024) · Computing in cardiology · doi:10.22489/cinc.2024.049 · Cited by 2 · see citing works
Self-citationRamdhan, W., Hutahaean, J., Jollyta, D., & Karim, A. K. (2026) · Jurnal Teknik Informatika (Jutif) · doi:10.52436/1.jutif.2026.7.2.5684 · Cited by 1 · see citing works
Alcaraz, J. M. L., Moran, X. L., Zaragoza, E. D., Händel, C., Koebe, R., Haverkamp, W., & Strodthoff, N. (2026) · arXiv · doi:10.48550/arxiv.2601.06645
“AI-driven systems have shown promise in enabling early detection of adverse events, improving triage, forecasting deterioration, and supporting diagnostic reasoning [3].”
Self-citationOpen Science to Foster Progress in Automatic ECG Analysis: Status and Future Directions
Strodthoff, N. (2024) · Computing in cardiology · doi:10.22489/cinc.2024.057
Self-citationvan Wijk, R. J., Schoonhoven, A. D., Vree, L. D., Horst, S. T., Gaidhane, C., Alcaraz, J. M. L., Strodthoff, N., ter Maaten, J. C., Bouma, H. R., & Li, J. (2026) · medRxiv · doi:10.64898/2026.03.26.26349371
Self-citationMachine Learning-Powered Smart Wearable for Continuous Health Monitoring and Emergency Prediction
Swetha, P. B., Vennakandla, C. S. R., Kumar, N. U., Sonti, S. R., Naresh, A., & Gali, S. (2026) · International Conference on Visual Analytics and Data Visualization (ICVADV) · doi:10.1109/icvadv67766.2026.11470544
Toward an Intelligent Clinical Decision Support System in the Prehospital Setting
Aziz, O. F. A., Benhadou, S., & Maria, M. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-23035-5_12
Advancing ICU decision making through multimodal data fusion in predicting cardiovascular disorders
Krones, F., Papastylianou, T., Qian, G., Parsons, G., Shukla, B., Papież, B. W., & Mahdi, A. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104573
Zhu, X., Gao, H., Ren, S., Zhang, Y., Zhao, J., Zhang, J., & Han, F. (2026) · Digital Health · doi:10.1177/20552076261473790
van Wijk, R. J., Alcaraz, J. M. L., Schoonhoven, A. D., Li, J., Horst, S. T., ter Voert, M. A., Eerens, A., la Bastide, A. J., Postema, J., ter Maaten, J. C., et al. (2026) · medRxiv · doi:10.64898/2026.07.30.26359325
Self-citationSinhal, A., Sinhal, A., & Sinhal, A. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.22732984
CXRMET: A Data-Efficient Multi-modal Framework for Chest X-Ray-Based Mortality Prediction
Daphne, S., Mary, A. R. V., Sivasurya, M. K., & Akash, V. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30963-1_44
Kyung, H., Suh, D., Lee, J. H., & Kwon, H. (2026) · Diagnostics · doi:10.3390/diagnostics16193153
- Authors
- Alcaraz, J. M. L., Bouma, H., & Strodthoff, N.
- Affiliations
- Carl von Ossietzky Universität Oldenburg (DE)
- University Medical Center Groningen (NL)
- Corresponding author
- Strodthoff, Nils
- Venue
- Computers in Biology and Medicine
- Publisher
- Elsevier BV
- Published
- 2025-06
- Volume
- 192
- Issue
- Pt A
- Pages
- 110196
- ISSN
- 0010-4825 (ISSN-L)
- OpenAlex
- W4409978917
- Cited by
- 13
- References
- 33
- Citations by year
- 2026: 7 · 2025: 6
- FWCI
- 5.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Computers in Biology and Medicine (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Carl von Ossiezky University of Oldenburg (acceptedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Keywords
- clinical decision support, physiological waveforms, electrocardiogram, multimodal data, emergency medicine, clinical deterioration prediction, benchmark dataset, vital signs, laboratory parameters, cardiac arrest prediction, ICU admission prediction, mortality prediction
- MeSH terms
- Clinical Decision-Making, Machine Learning, Deep Learning, Aged, Algorithms, Artificial Intelligence, Electrocardiography, Emergency Medical Services, Female, Humans, Male, Middle Aged, Models, Statistical, Benchmarking, Decision Support Systems, Clinical, Workflow, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review