Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To demonstrate the incremental benefit of using free text data in addition to vital sign and demographic data to identify patients with suspected infection in the emergency department. METHODS: This was a retrospective, observational cohort study performed at a tertiary academic teaching hospital. All consecutive ED patient visits between 12/17/08 and 2/17/13 were included. No patients were excluded. The primary outcome measure was infection diagnosed in the emergency department defined as a patient having an infection related ED ICD-9-CM discharge diagnosis. Patients were randomly allocated to train (64%), validate (20%), and test (16%) data sets. After preprocessing the free text using bigram and negation detection, we built four models to predict infection, incrementally adding vital signs, chief complaint, and free text nursing assessment. We used two different methods to represent free text: a bag of words model and a topic model. We then used a support vector machine to build the prediction model. We calculated the area under the receiver operating characteristic curve to compare the discriminatory power of each model. RESULTS: A total of 230,936 patient visits were included in the study. Approximately 14% of patients had the primary outcome of diagnosed infection. The area under the ROC curve (AUC) for the vitals model, which used only vital signs and demographic data, was 0.67 for the training data set, 0.67 for the validation data set, and 0.67 (95% CI 0.65-0.69) for the test data set. The AUC for the chief complaint model which also included demographic and vital sign data was 0.84 for the training data set, 0.83 for the validation data set, and 0.83 (95% CI 0.81-0.84) for the test data set. The best performing methods made use of all of the free text. In particular, the AUC for the bag-of-words model was 0.89 for training data set, 0.86 for the validation data set, and 0.86 (95% CI 0.85-0.87) for the test data set. The AUC for the topic model was 0.86 for the training data set, 0.86 for the validation data set, and 0.85 (95% CI 0.84-0.86) for the test data set. CONCLUSION: Compared to previous work that only used structured data such as vital signs and demographic information, utilizing free text drastically improves the discriminatory ability (increase in AUC from 0.67 to 0.86) of identifying infection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Pipeline for natural language processing and prediction. Our algorithm first takes as input a triage note and processes it by applying tokenization followed by bigram and negation detection, the latter using a customized version of the NegEx tool [14]. The processed text is then transformed into a set of features. The Bag-of-Words features count how many times each word in our vocabulary appears in the processed note, and the Topic model features (derived using the Mallet [17] tool) measure how much certain topics are represented in the note. A Support Vector Machine (SVM) is then trained on these sets of features to determine whether the patient presents an infection, using the SVMperf software [15].](https://figures.cochat.ai/paper-figures/e1d943f1ae2142d9aabc81a223e9a23b/creating-an-automated-trigger-for-sepsis-clinical-decision-support-at-emergency-figure-1.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Three papers using their own hospital data reported inquiries for data sharing were possible [28, 32, 35], two papers reported data would not be shared [25, 31].”
From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [35]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, our model had a lower PPV than those of other studies,13,23 possibly due to imbalanced data.”
From Development and validation of a screening tool for sepsis without laboratory results in the emergency department: a machine learning study (2025) · cites this paper as [23]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“very few papers reported they accept data inquiries [32, 35, 47]”
From Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy (2020) · cites this paper as [35]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Angus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,464
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Levy, M. M., Dellinger, R. P., Townsend, S. R., Linde-Zwirble, W. T., Marshall, J. C., Bion, J., Schorr, C., Artigas, A., Ramsay, G., Beale, R., et al. (2010) · Intensive Care Medicine · doi:10.1007/s00134-009-1738-3 · Cited by 868 · cited 1×
“Early protocolized care for sepsis can improve outcomes, but emergency departments are still struggling to consistently implement early protocolized care for sepsis [8,9].”
BackgroundA support vector method for multivariate performance measures
Joachims, T. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102399 · Cited by 786
Ferrer, R. (2008) · JAMA · doi:10.1001/jama.299.19.2294 · Cited by 741
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“However, whereas our paper focuses on the very early detection of sepsis, at Emergency Department triage, previous work considered identification of sepsis much later in a patient’s hospital stay, using data such as laboratory test results or continuous vital signs that are not available in our setting [22,23,24,25].”
MethodGrand challenges in clinical decision support
Sittig, D. F., Wright, A., Osheroff, J. A., Middleton, B., Teich, J. M., Ash, J. S., Campbell, E., & Bates, D. W. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.09.003 · Cited by 582
Cited by
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Benjamens, S., Dhunnoo, P., & Meskó, B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00324-0 · Cited by 1,215
An interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832
“[13, 16–18] EMR alerts to detect existing sepsis can improve adherence to treatment protocols, decreases time until antibiotic administration and length of hospital stay, and can improve mortality [19–21] They can predict septic shock with 85% accuracy using either EMR data or high-resolution vital…”
MethodFleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
Peiffer-Smadja, N., Rawson, T. M., Ahmad, R., Buchard, A., Georgiou, P., Lescure, F.-X., Birgand, G., & Holmes, A. H. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2019.09.009 · Cited by 561
Early prediction of circulatory failure in the intensive care unit using machine learning
Hyland, S. L., Faltys, M., Hüser, M., Lyu, X., Gumbsch, T., Esteban, C., Bock, C., Horn, M., Moor, M., Rieck, B., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0789-4 · Cited by 477
Goh, K. H., Wang, L., Yeow, A. Y. K., Poh, H., Li, K., Yeow, J. J. L., & Tan, G. Y. H. (2021) · Nature Communications · doi:10.1038/s41467-021-20910-4 · Cited by 415
The Application of Deep Learning in Cancer Prognosis Prediction
Zhu, W., Xie, L., Han, J., & Guo, X. (2020) · Cancers · doi:10.3390/cancers12030603 · Cited by 380
How the nursing profession should adapt for a digital future
Booth, R. G., Strudwick, G., McBride, S., O’Connor, S., & Solano López, A. L. (2021) · BMJ · doi:10.1136/bmj.n1190 · Cited by 330
Adams, R., Henry, K. E., Sridharan, A., Soleimani, H., Zhan, A., Rawat, N., Johnson, L., Hager, D. N., Cosgrove, S. E., Markowski, A., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01894-0 · Cited by 365
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358
“Only 9 studies used data from 2 institutions [36,47,50,56,61,100,103,109,112].”
BackgroundMethodInfluentialMao, Q., Jay, M., Hoffman, J. L., Calvert, J., Barton, C., Shimabukuro, D., Shieh, L., Chettipally, U., Fletcher, G., Kerem, Y., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017833 · Cited by 336
Predicting hospital admission at emergency department triage using machine learning
Hong, W. S., Haimovich, A. D., & Taylor, R. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201016 · Cited by 326
Giannini, H. M., Ginestra, J. C., Chivers, C., Draugelis, M., Hanish, A., Schweickert, W. D., Fuchs, B. D., Meadows, L., Lynch, M., Donnelly, P. J., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003891 · Cited by 269
Prediction of sepsis patients using machine learning approach: a meta-analysis
Islam, M. M., Nasrin, T., Walther, B. A., Wu, C.-C., Yang, H.-C., & Li, Y.-C. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.12.027 · Cited by 259
Delahanty, R. J., Alvarez, J., Flynn, L. M., Sherwin, R. L., & Jones, S. S. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2018.11.036 · Cited by 206
Fontana, M. A., Lyman, S., Sarker, G. K., Padgett, D. E., & MacLean, C. H. (2019) · Clinical Orthopaedics & Related Research · doi:10.1097/corr.0000000000000687 · Cited by 195
Early detection of sepsis utilizing deep learning on electronic health record event sequences
Lauritsen, S. M., Kalør, M. E., Kongsgaard, E. L., Lauritsen, K. M., Jørgensen, M. J., Lange, J., & Thiesson, B. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101820 · Cited by 190
Masino, A. J., Harris, M. C., Forsyth, D., Ostapenko, S., Srinivasan, L., Bonafide, C. P., Balamuth, F., Schmatz, M., & Grundmeier, R. W. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212665 · Cited by 183
Applications of Artificial Intelligence in Nursing Care: A Systematic Review
Martinez-Ortigosa, A., Martinez-Granados, A., Gil-Hernández, E., Rodriguez-Arrastia, M., Ropero-Padilla, C., & Roman, P. (2023) · Journal of Nursing Management · doi:10.1155/2023/3219127 · Cited by 131
Dzobo, K., Adotey, S. K., Thomford, N. E., & Dzobo, W. (2019) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2019.0038 · Cited by 174
He, S., Leanse, L. G., & Feng, Y. (2021) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2021.113922 · Cited by 141
Artificial intelligence sepsis prediction algorithm learns to say “I don’t know”
Shashikumar, S. P., Wardi, G., Malhotra, A., & Nemati, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00504-6 · Cited by 125
Artificial Intelligence in Clinical Decision Support: a Focused Literature Survey
Montani, S., & Striani, M. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677911 · Cited by 129
Artificial intelligence in emergency medicine: A scoping review
Kirubarajan, A., Taher, A., Khan, S., & Masood, S. (2020) · JACEP Open · doi:10.1002/emp2.12277 · Cited by 127
Developing successful environmental decision support systems: Challenges and best practices
Walling, E., & Vaneeckhaute, C. (2020) · Journal of Environmental Management · doi:10.1016/j.jenvman.2020.110513 · Cited by 149
Krakower, D., Gruber, S., Hsu, K., Menchaca, J. T., Maro, J. C., Kruskal, B. A., Wilson, I. B., Mayer, K. H., & Klompas, M. (2019) · The Lancet HIV · doi:10.1016/s2352-3018(19)30139-0 · Cited by 135
Islam, K. R., Prithula, J., Kumar, J., Tan, T. L., Reaz, M. B. I., Sumon, M. S. I., & Chowdhury, M. E. H. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12175658 · Cited by 155
DeepAISE – An interpretable and recurrent neural survival model for early prediction of sepsis
Shashikumar, S. P., Josef, C. S., Sharma, A., & Nemati, S. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102036 · Cited by 109
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
How artificial intelligence could transform emergency department operations
Berlyand, Y., Raja, A. S., Dorner, S. C., Prabhakar, A. M., Sonis, J. D., Gottumukkala, R. V., Succi, M. D., & Yun, B. J. (2018) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2018.01.017 · Cited by 127
Clinical Predictive Models for COVID-19: Systematic Study
Schwab, P., DuMont Schütte, A., Dietz, B., & Bauer, S. (2020) · Journal of Medical Internet Research · doi:10.2196/21439 · Cited by 101
Machine learning for early detection of sepsis: an internal and temporal validation study
Bedoya, A. D., Futoma, J., Clement, M. E., Corey, K., Brajer, N., Lin, A., Simons, M. G., Gao, M., Nichols, M., Balu, S., et al. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa006 · Cited by 109
Hu, C.-A., Chen, C.-M., Fang, Y.-C., Liang, S.-J., Wang, H.-C., Fang, W.-F., Sheu, C.-C., Perng, W.-C., Yang, K.-Y., Kao, K.-C., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-033898 · Cited by 106
Machine learning for prediction of septic shock at initial triage in emergency department
Kim, J., Chang, H., Kim, D., Jang, D.-H., Park, I., & Kim, K. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2019.09.024 · Cited by 104
Tomašev, N., Harris, N., Baur, S., Mottram, A., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Magliulo, V., et al. (2021) · Nature Protocols · doi:10.1038/s41596-021-00513-5 · Cited by 130
Chen, P., Zafar, H. M., Galperin-Aizenberg, M., & Cook, T. S. (2017) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-017-0027-x · Cited by 110
van Doorn, W. P. T. M., Stassen, P. M., Borggreve, H. F., Schalkwijk, M. J., Stoffers, J., Bekers, O., & Meex, S. J. R. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245157 · Cited by 96
Applications of Machine Learning Approaches in Emergency Medicine; a Review Article.
Shafaf, N., & Malek, H. (2019) · Archives of Academic Emergency Medicine · doi:10.22037/aaem.v7i1.410 · Cited by 95
Gholami, B., Phan, T. S., Haddad, W. M., Cason, A. D., Mullis, J. C., Price, L. T., & Bailey, J. M. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.04.016 · Cited by 106
Tackling COVID-19 through Responsible AI Innovation: Five Steps in the Right Direction
Leslie, D. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.4bb9d7a7 · Cited by 94
Kommiya Mothilal, R., Mahajan, D., Tan, C., & Sharma, A. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462597 · Cited by 76
Automated prediction of sepsis using temporal convolutional network
Kok, C., Jahmunah, V., Oh, S. L., Zhou, X., Gururajan, R., Tao, X., Cheong, K. H., Gururajan, R., Molinari, F., & Acharya, U. R. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103957 · Cited by 105
Hwang, G.-J., Tang, K.-Y., & Tu, Y.-F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2086579 · Cited by 87
Boonstra, A., & Laven, M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08070-7 · Cited by 87
“…of events from the literature contains acute abdominal pain [17], cardiac arrest [18, 25], exacerbation of asthma or COPD [20], sepsis or septic shock [23, 27], CVD [26], need for a head CT [28], clinical adverse events in general [45], hospitalization or discharge [22, 37], and mortality [18, 29).”
BackgroundSSP: Early prediction of sepsis using fully connected LSTM-CNN model
Rafiei, A., Rezaee, A., Hajati, F., Gheisari, S., & Golzan, M. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104110 · Cited by 100
Salman, O. H., Taha, Z. K., Alsabah, M. Q., Hussein, Y. S., Mohammed, A. S., & Aal-Nouman, M. I. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106357 · Cited by 102
Meta-learning with implicit gradients in a few-shot setting for medical image segmentation
Khadka, R., Jha, D., Hicks, S. A., Thambawita, V. L., Riegler, M. A., Ali, S., & Halvorsen, P. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105227 · Cited by 100
A Time-Phased Machine Learning Model for Real-Time Prediction of Sepsis in Critical Care
Li, X., Xu, X., Xie, F., Xu, X., Sun, Y., Liu, X., Jia, X., Kang, Y., Xie, L., Wang, F., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004494 · Cited by 82
Burdick, H., Pino, E., Gabel-Comeau, D., McCoy, A., Gu, C., Roberts, J., Le, S., Slote, J., Pellegrini, E., Green-Saxena, A., et al. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100109 · Cited by 80
An interpretable deep-learning model for early prediction of sepsis in the emergency department
Zhang, D., Yin, C., Hunold, K. M., Jiang, X., Caterino, J. M., & Zhang, P. (2021) · Patterns · doi:10.1016/j.patter.2020.100196 · Cited by 76
Schwartz, J. M., Moy, A. J., Rossetti, S. C., Elhadad, N., & Cato, K. D. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa296 · Cited by 83
Wellner, B., Grand, J., Canzone, E., Coarr, M., Brady, P. W., Simmons, J., Kirkendall, E., Dean, N., Kleinman, M., & Sylvester, P. (2017) · JMIR Medical Informatics · doi:10.2196/medinform.8680 · Cited by 78
Machine Learning To Predict Serious Bacterial Infections in Young Febrile Infants
Ramgopal, S., Horvat, C. M., Yanamala, N. V. K., & Alpern, E. R. (2020) · PEDIATRICS · doi:10.1542/peds.2019-4096 · Cited by 81
Nijeweme-d’Hollosy, W. O., van Velsen, L., Poel, M., Groothuis‐Oudshoorn, C. G. M., Soer, R., & Hermens, H. J. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.11.010 · Cited by 77
Artificial Intelligence: Review of Current and Future Applications in Medicine
Thomas, L. B. (2021) · Federal Practitioner · doi:10.12788/fp.0174 · Cited by 89
Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective
Giacobbe, D. R., Signori, A., Del Puente, F., Mora, S., Carmisciano, L., Briano, F., Vena, A., Ball, L., Robba, C., Pelosi, P., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.617486 · Cited by 65
Kijpaisalratana, N., Sanglertsinlapachai, D., Techaratsami, S., Musikatavorn, K., & Saoraya, J. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104689 · Cited by 65
Survival prediction of patients with sepsis from age, sex, and septic episode number alone
Chicco, D., & Jurman, G. (2020) · Scientific Reports · doi:10.1038/s41598-020-73558-3 · Cited by 79
Mohr, N. M., Vakkalanka, J. P., Faine, B. A., Skow, B., Harland, K. K., Dick-Perez, R., Fuller, B. M., Ahmed, A., & Simson, S. Q. (2017) · Journal of Critical Care · doi:10.1016/j.jcrc.2017.10.043 · Cited by 67
Machine learning in patient flow: a review
El-Bouri, R., Taylor, T., Youssef, A., Zhu, T., & Clifton, D. A. (2021) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/abddc5 · Cited by 72
Big data and targeted machine learning in action to assist medical decision in the ICU
Pirracchio, R., Cohen, M. J., Malenica, I., Cohen, J., Chambaz, A., Cannesson, M., Lee, C., Resche-Rigon, M., & Hubbard, A. (2019) · Anaesthesia Critical Care & Pain Medicine · doi:10.1016/j.accpm.2018.09.008 · Cited by 59
Joseph, J. W., Leventhal, E. L., Grossestreuer, A. V., Wong, M. L., Joseph, L. J., Nathanson, L. A., Donnino, M. W., Elhadad, N., & Sanchez, L. D. (2020) · doi:10.1101/2020.05.02.20089052 · Cited by 57
Self-citationO'Reilly, D., McGrath, J., & Martin-Loeches, I. (2024) · Journal of Intensive Medicine · doi:10.1016/j.jointm.2023.10.001 · Cited by 55
Guo, F., Zhu, X., Wu, Z., Zhu, L., Wu, J., & Zhang, F. (2022) · Journal of Translational Medicine · doi:10.1186/s12967-022-03469-6 · Cited by 66
Baddal, B., Taner, F., & Ozsahin, D. U. (2024) · Diagnostics · doi:10.3390/diagnostics14050484 · Cited by 67
Applications of natural language processing at emergency department triage: A narrative review
Stewart, J. E., Lü, J., Goudie, A., Arendts, G., Meka, S., Freeman, S., Walker, K., Sprivulis, P., Sanfilippo, F. M., Bennamoun, M., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279953 · Cited by 70
Phạm, Q., Gamble, A., Hearn, J., & Cafazzo, J. A. (2021) · Journal of Medical Internet Research · doi:10.2196/22320 · Cited by 56
Burdick, H., Pino, E., Gabel-Comeau, D., Gu, C., Roberts, J., Le, S., Slote, J., Saber, N., Pellegrini, E., Green‐Saxena, A., et al. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01284-x · Cited by 58
Raymond, L., Castonguay, A., Doyon, O., & Paré, G. (2022) · Applied Nursing Research · doi:10.1016/j.apnr.2022.151604 · Cited by 45
Yadgarov, M. Y., Landoni, G., Бондоевич, Б. Л., Polyakov, P. A., Kadantseva, K., Smirnova, A. V., Kuznetsov, I. V., Shemetova, M. M., Yakovlev, A. А., & Likhvantsev, V. V. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1491358 · Cited by 64
Multi-Branching Temporal Convolutional Network for Sepsis Prediction
Wang, Z., & Yao, B. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3092835 · Cited by 55
Topaz, M., Koleck, T. A., Onorato, N., Smaldone, A. M., & Henry, S. B. (2020) · Nursing Outlook · doi:10.1016/j.outlook.2020.12.007 · Cited by 49
A Review of Predictive Analytics Solutions for Sepsis Patients
Teng, A. K., & Wilcox, A. B. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1710525 · Cited by 41
Exploring Applications of Artificial Intelligence in Critical Care Nursing: A Systematic Review
Porcellato, E., Lanera, C., Ocagli, H., & Danielis, M. (2025) · Nursing Reports · doi:10.3390/nursrep15020055 · Cited by 54
Leveraging Data Science for Global Health
Celi, L. A., Majumder, M. S., Ordóñez, P., Osorio, J. S., Paik, K., & Somai, M. M. (2020) · Springer eBooks · doi:10.1007/978-3-030-47994-7 · Cited by 55
Shashikumar, S. P., Mohammadi, S., Krishnamoorthy, R., Patel, A., Wardi, G., Ahn, J. C., Singh, K., Aronoff-Spencer, E. S., & Nemati, S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01689-w · Cited by 58
A neural network approach to predict early neonatal sepsis
Martínez, F., Núñez‐Valdéz, E. R., Gómez, J. L., & García‐Díaz, V. (2019) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2019.04.015 · Cited by 44
Adegbosin, A. E., Stantić, B., & Sun, J. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034524 · Cited by 45
Machine learning-based prediction of critical illness in children visiting the emergency department
Hwang, S., & Lee, B. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264184 · Cited by 45
Hunter-Zinck, H., Peck, J. S., Strout, T. D., & Gaehde, S. A. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz171 · Cited by 46
A Deep Learning Approach to Diagnosing Multiple Sclerosis from Smartphone Data
Schwab, P., & Karlen, W. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3021143 · Cited by 42
Revolutionary Potential of ChatGPT in Constructing Intelligent Clinical Decision Support Systems
Liao, Z., Wang, J., Shi, Z., Lu, L., & Tabata, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03288-w · Cited by 42
Sepsis 2019: What Surgeons Need to Know
Ho, V. P., Kaafarani, H. M. A., Rattan, R., Namias, N., Evans, H. L., & Zakrison, T. L. (2020) · Surgical Infections · doi:10.1089/sur.2019.126 · Cited by 43
Comparison of rule-based and neural network models for negation detection in radiology reports
Sykes, D., Grivas, A., Grover, C., Tobin, R., Sudlow, C. L. M., Whiteley, W. N., McIntosh, A. M., Whalley, H. C., & Alex, B. (2020) · Natural Language Engineering · doi:10.1017/s1351324920000509 · Cited by 37
Detection of self-harm and suicidal ideation in emergency department triage notes
Rozova, V. S., Witt, K., Robinson, J., Li, Y., & Verspoor, K. M. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab261 · Cited by 44
Early Prediction of Sepsis From Clinical Data Using Ratio and Power-Based Features
Nesaragi, N., & Patidar, S. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004691 · Cited by 36
Predicting Infections Using Computational Intelligence – A Systematic Review
Baldominos, A., Puello, A., Oğul, H., Aşuroğlu, T., & Colomo‐Palacios, R. (2020) · IEEE Access · doi:10.1109/access.2020.2973006 · Cited by 41
Nesaragi, N., Patidar, S., & Veerakumar, T. (2021) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2021.06.009 · Cited by 36
Ahmed, A., Ashour, O. M., Ali, H., & Firouz, M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117314 · Cited by 36
A survey of multimodal event detection based on data fusion
Mondal, M., Khayati, M., Sandlin, H.-Â., & Cudré-Mauroux, P. (2024) · The VLDB Journal · doi:10.1007/s00778-024-00878-5 · Cited by 41
Kwon, Y. S., & Baek, M. S. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9030875 · Cited by 34
Lin, P.-C., Chen, K.-T., Chen, H.-C., Islam, M. M., & Lin, M. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11111055 · Cited by 35
Lee, H.-G., Seo, Y., Kim, J. H., Han, S. B., Im, J. H., Jung, C. Y., & Durey, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-30290-y · Cited by 35
Machine Learning for Clinical Predictive Analytics
Weng, W. (2020) · Springer eBooks · doi:10.1007/978-3-030-47994-7_12 · Cited by 39
A Sensor Fault-Tolerant Accident Diagnosis System
Choi, J., & Lee, S. J. (2020) · Sensors · doi:10.3390/s20205839 · Cited by 29
Towards Pharma 4.0 in clinical trials: A future-orientated perspective
Hariry, R. E., Barenji, R. V., & Paradkar, A. R. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.09.002 · Cited by 34
Design of a Clinical Decision Support System for Fracture Prediction Using Imbalanced Dataset
Chen, Y.-F., Lin, C.-S., Wang, K.-A., Rahman, L. O. A., Lee, D.-J., Chung, W., & Lin, H. (2018) · Journal of Healthcare Engineering · doi:10.1155/2018/9621640 · Cited by 33
Kijpaisalratana, N., Saoraya, J., Nhuboonkaew, P., Vongkulbhisan, K., & Musikatavorn, K. (2024) · Internal and Emergency Medicine · doi:10.1007/s11739-024-03535-5 · Cited by 40
A Machine Learning Approach to Identification of Unhealthy Drinking
Bonnell, L. N., Littenberg, B., Wshah, S., & Rose, G. L. (2020) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2020.03.190421 · Cited by 30
Metadata
- Authors
- Horng, S., Sontag, D. A., Halpern, Y., Jernite, Y., Shapiro, N. I., & Nathanson, L. A.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Massachusetts Institute of Technology (US)
- Google (United States) (US)
- Courant Institute of Mathematical Sciences (US)
- Corresponding author
- Sontag, David A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-04-06
- Volume
- 12
- Issue
- 4
- Pages
- e0174708
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5383046
- OpenAlex
- W2604972438
- Cited by
- 310
- References
- 25
- Citations by year
- 2026: 26 · 2025: 32 · 2024: 22 · 2023: 29 · 2022: 37 · 2021: 54 · 2020: 59 · 2019: 32 · 2018: 11 · 2017: 8
- FWCI
- 17.94
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Funders
- Consortia for Improving Medicine with Innovation and Technology (W81XWH-09-2-0001)
- National Institutes of Health (-0001, UL1TR000038, W81XWH, TR000038, UL1TR001445)
- National Center for Advancing Translational Sciences (TR000038)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- sepsis, clinical decision support, emergency department triage, infection prediction, free-text data, nursing assessment, vital signs, topic modeling, bag-of-words, negation detection, chief complaint, support vector machine, electronic health records, emergency department visits, diagnostic accuracy
- MeSH terms
- Machine Learning, Adult, Aged, Automation, Emergency Service, Hospital, Female, Humans, Male, Middle Aged, Retrospective Studies, Triage, Decision Support Systems, Clinical, International Classification of Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.