Sepsis prediction, early detection, and identification using clinical text for machine learning: a systematic review
Open accessThe DOI matches its Crossref record; 153 of the 153 references it cites were found in a registry or an index.
Abstract
Objective: To determine the effects of using unstructured clinical text in machine learning (ML) for prediction, early detection, and identification of sepsis. Materials and methods: PubMed, Scopus, ACM DL, dblp, and IEEE Xplore databases were searched. Articles utilizing clinical text for ML or natural language processing (NLP) to detect, identify, recognize, diagnose, or predict the onset, development, progress, or prognosis of systemic inflammatory response syndrome, sepsis, severe sepsis, or septic shock were included. Sepsis definition, dataset, types of data, ML models, NLP techniques, and evaluation metrics were extracted. Results: The clinical text used in models include narrative notes written by nurses, physicians, and specialists in varying situations. This is often combined with common structured data such as demographics, vital signs, laboratory data, and medications. Area under the receiver operating characteristic curve (AUC) comparison of ML methods showed that utilizing both text and structured data predicts sepsis earlier and more accurately than structured data alone. No meta-analysis was performed because of incomparable measurements among the 9 included studies. Discussion: Studies focused on sepsis identification or early detection before onset; no studies used patient histories beyond the current episode of care to predict sepsis. Sepsis definition affects reporting methods, outcomes, and results. Many methods rely on continuous vital sign measurements in intensive care, making them not easily transferable to general ward units. Conclusions: Approaches were heterogeneous, but studies showed that utilizing both unstructured text and structured data in ML can improve identification and early detection of sepsis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Numerous studies have indicated that ML algorithms outperform SIRS, SOFA, qSOFA, and MEWS scores.19,27,28”
From Development and validation of a screening tool for sepsis without laboratory results in the emergency department: a machine learning study (2025) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 2×
“The advantage of using embeddings is that it retains the sequential information lost in a BoW representation and does feature extraction automatically.(103) Utilized text processing operations are in Table 3.”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Bone, R. C., Balk, R. A., Cerra, F. B., Dellinger, R. P., Fein, A. M., Knaus, W. A., Schein, R. M. H., & Sibbald, W. J. (1992) · Chest · doi:10.1378/chest.101.6.1644 · Cited by 13,198
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Vincent, J. L., Moreno, R., Takala, J., Willatts, S., De Mendonça, A., Bruining, H., Reinhart, C. K., Suter, P. M., & Thijs, L. G. (1996) · Intensive Care Medicine · doi:10.1007/bf01709751 · Cited by 11,674
Early goal-directed therapy in the treatment of severe sepsis and septic shock
Rivers, E., Nguyen, B., Havstad, S., Ressler, J., Muzzin, A., Knoblich, B., Peterson, E., & Tomlanovich, M. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa010307 · Cited by 10,743 · cited 1×
“Suggestions for future studies Predicting sepsis earlier than 12 h prior to sepsis onset can reduce treatment delays and improve patient outcomes.(3,4) Because predictions 48–12 h before sepsis onset appear to rely more on clinical text than structured data, additional NLP techniques should be considered for future ML…”
Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock
Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., Jaeschke, R., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827e83af · Cited by 9,694
Angus, D. C., Linde-Zwirble, W. T., Lidicker, J., Clermont, G., Carcillo, J., & Pinsky, M. R. (2001) · Critical Care Medicine · doi:10.1097/00003246-200107000-00002 · Cited by 8,503
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Koller, D., & Friedman, N. (2009) · The MIT Press eBooks · Cited by 7,555
Friedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
Intravenous Fluids and Acute Kidney Injury
Ding, X., Cheng, Z., & Qian, Q. (2017) · Blood Purification · doi:10.1159/000452702 · Cited by 6,827
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4683-6 · Cited by 6,621
(2009) · Cited by 6,153
Kumar, A., Roberts, D., Wood, K. E., Light, B., Parrillo, J. E., Sharma, S., Suppes, R., Feinstein, D., Zanotti, S., Taiberg, L., et al. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217961.75225.e9 · Cited by 6,109 · cited 2×
“6%.(4) Unfortunately, sepsis is commonly misdiagnosed and mistreated because deterioration with organ failure is also common in”
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939
Fleischmann, C., Scherag, A., Adhikari, N. K. J., Hartog, C. S., Tsaganos, T., Schlattmann, P., Angus, D. C., & Reinhart, K. (2016) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201504-0781oc · Cited by 3,548
Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
Rhee, C., Dantes, R., Epstein, L., Murphy, D. J., Seymour, C. W., Iwashyna, T. J., Kadri, S. S., Angus, D. C., Danner, R. L., Fiore, A. E., et al. (2017) · JAMA · doi:10.1001/jama.2017.13836 · Cited by 1,884
Validation of a modified Early Warning Score in medical admissions
Subbe, C. P. (2001) · QJM · doi:10.1093/qjmed/94.10.521 · Cited by 1,762
Alsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736 · cited 2×
“Embedding techniques include Global Vectors for Word Representation (GloVe),(104) Word2Vec as a continuous bag-of-words (CBOW) model or skip-gram model,(105) Bidirectional Encoder Representations from Transformers (BERT),(106) and ClinicalBERT.(107) The advantage of using embeddings is that it retains the sequential i…”
Hotchkiss, R. S., Moldawer, L. L., Opal, S. M., Reinhart, K., Turnbull, I. R., & Vincent, J.-L. (2016) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2016.45 · Cited by 1,620
Saeed, M., Villarroel, M., Reisner, A. T., Clifford, G., Lehman, L.-W., Moody, G., Heldt, T., Kyaw, T. H., Moody, B., & Mark, R. G. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820a92c6 · Cited by 1,162
Clinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
The immune system’s role in sepsis progression, resolution, and long-term outcome
Delano, M. J., & Ward, P. A. (2016) · Immunological Reviews · doi:10.1111/imr.12499 · Cited by 880
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755 · cited 1×
“Sepsis definition impact In ML, many studies rely heavily on sepsis definitions and ICDcodes to identify patient cohort datasets for sepsis studies.(9,11,13) Table 4.”
MethodKreimeyer, K., Foster, M., Pandey, A., Arya, N., Halford, G., Jones, S. F., Forshee, R., Walderhaug, M., & Botsis, T. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.07.012 · Cited by 616
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“Delahanty et al,(51) Hammoud et al,(54) Goh et al,(52) and Qin et al(55) compared their algorithm to scoring systems used in clinical practice, such as SIRS,(121) sequential organ failure assessment (SOFA),(122) quick SOFA (qSOFA),(123) modified early warning system (MEWS),(124) or a targeted real-time early warning s…”
Peiffer-Smadja, N., Rawson, T. M., Ahmad, R., Buchard, A., Georgiou, P., Lescure, F.-X., Birgand, G., & Holmes, A. H. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2019.09.009 · Cited by 561
Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Review
Sheikhalishahi, S., Miotto, R., Dudley, J. T., Lavelli, A., Rinaldi, F., & Osmani, V. (2019) · JMIR Medical Informatics · doi:10.2196/12239 · Cited by 558
Deep learning in clinical natural language processing: a methodical review
Wu, S., Roberts, K., Datta, S., Du, J., Ji, Z., Si, Y., Soni, S., Wang, Q., Wei, Q., Xiang, Y., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz200 · Cited by 491
Murff, H. J., FitzHenry, F., Matheny, M. E., Gentry, N., Kotter, K. L., Crimin, K., Dittus, R. S., Rosen, A. K., Elkin, P. L., Brown, S. H., et al. (2011) · JAMA · doi:10.1001/jama.2011.1204 · Cited by 476
Sepsis: Multiple Abnormalities, Heterogeneous Responses, and Evolving Understanding
Iskander, K. N., Osuchowski, M. F., Stearns-Kurosawa, D. J., Kurosawa, S., Stepien, D., Valentine, C., & Remick, D. G. (2013) · Physiological Reviews · doi:10.1152/physrev.00037.2012 · Cited by 453
Goh, K. H., Wang, L., Yeow, A. Y. K., Poh, H., Li, K., Yeow, J. J. L., & Tan, G. Y. H. (2021) · Nature Communications · doi:10.1038/s41467-021-20910-4 · Cited by 415
Ford, E., Carroll, J. A., Smith, H. E., Scott, D., & Cassell, J. A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv180 · Cited by 408
Koleck, T. A., Dreisbach, C., Bourne, P. E., & Bakken, S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy173 · Cited by 408
Jawad, I., Lukšić, I., & Rafnsson, S. B. (2012) · Journal of Global Health · doi:10.7189/jogh.01.010404 · Cited by 389
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358
Electronic medical records for discovery research in rheumatoid arthritis
Liao, K. P., Cai, T., Gainer, V., Goryachev, S., Zeng‐treitler, Q., Raychaudhuri, S., Szolovits, P., Churchill, S., Murphy, S., Kohane, I., et al. (2010) · Arthritis Care & Research · doi:10.1002/acr.20184 · Cited by 325
Horng, S., Sontag, D. A., Halpern, Y., Jernite, Y., Shapiro, N. I., & Nathanson, L. A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174708 · Cited by 310
Challenges and opportunities beyond structured data in analysis of electronic health records
Tayefi, M., Ngo, P., Chomutare, T., Dalianis, H., Salvi, E., Budrionis, A., & Godtliebsen, F. (2021) · WIREs Computational Statistics · doi:10.1002/wics.1549 · Cited by 290
Jawad, I., Lukšić, I., & Rafnsson, S. B. (2012) · PubMed · doi:10.7189/jogh.02.010404 · Cited by 288
The Clinical Challenge of Sepsis Identification and Monitoring
Vincent, J.-L. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002022 · Cited by 259
Prediction of sepsis patients using machine learning approach: a meta-analysis
Islam, M. M., Nasrin, T., Walther, B. A., Wu, C.-C., Yang, H.-C., & Li, Y.-C. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.12.027 · Cited by 259 · cited 1×
“Sepsis definition impact In ML, many studies rely heavily on sepsis definitions and ICDcodes to identify patient cohort datasets for sepsis studies.(9,11,13) Table 4.”
Portability of an algorithm to identify rheumatoid arthritis in electronic health records
Carroll, R. J., Thompson, W. K., Eyler, A. E., Mandelin, A. M., Cai, T., Zink, R. M., Pacheco, J. A., Boomershine, C. S., Lasko, T. A., Xu, H., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000583 · Cited by 235
A survey of word embeddings for clinical text
Khattak, F. K., Jeblee, S., Pou-Prom, C., Abdalla, M., Meaney, C., & Rudzicz, F. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.yjbinx.2019.100057 · Cited by 225
Jackson, R. G., Patel, R., Jayatilleke, N., Kolliakou, A., Ball, M., Gorrell, G., Roberts, A., Dobson, R. J., & Stewart, R. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012012 · Cited by 221
Delahanty, R. J., Alvarez, J., Flynn, L. M., Sherwin, R. L., & Jones, S. S. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2018.11.036 · Cited by 206
Sepsis and Septic Shock: Current Treatment Strategies and New Approaches
Halici, Z., Cadirci, E., Polat, G., & Ugan, R. A. (2019) · The Eurasian Journal of Medicine · doi:10.5152/eurasianjmed.2017.17062 · Cited by 192
Diagnosing sepsis is subjective and highly variable: A survey of intensivists using case vignettes.
Rhee, C., Kadri, S. S., Danner, R. L., Suffredini, A. F., Massaro, A. F., Kitch, B. T., Lee, G., & Klompas, M. (2016) · Critical Care · doi:10.1186/s13054-016-1266-9 · Cited by 187
Rhee, C., Murphy, M. V., Li, L., Platt, R., Klompas, M., & Program, F. T. C. F. D. C. A. P. E. (2015) · Clinical Infectious Diseases · doi:10.1093/cid/ciu750 · Cited by 175
Sepsis trends: increasing incidence and decreasing mortality, or changing denominator?
Rhee, C., & Klompas, M. (2020) · Journal of Thoracic Disease · doi:10.21037/jtd.2019.12.51 · Cited by 170
Ananthakrishnan, A. N., Cai, T., Savova, G., Cheng, S.-C., Chen, P., Perez, R. G., Gainer, V. S., Murphy, S. N., Szolovits, P., Xia, Z., et al. (2013) · Inflammatory Bowel Diseases · doi:10.1097/mib.0b013e31828133fd · Cited by 168
Electronic medical record phenotyping using the anchor and learn framework
Halpern, Y., Horng, S., Choi, Y., & Sontag, D. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw011 · Cited by 153
Chronic Medical Conditions and Risk of Sepsis
Wang, H. E., Shapiro, N. I., Griffin, R., Safford, M. M., Judd, S., & Howard, G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048307 · Cited by 142
Analysis of free text in electronic health records for identification of cancer patient trajectories
Jensen, K., Soguero-Ruiz, C., Oyvind Mikalsen, K., Lindsetmo, R.-O., Kouskoumvekaki, I., Girolami, M., Olav Skrovseth, S., & Augestad, K. M. (2017) · Scientific Reports · doi:10.1038/srep46226 · Cited by 132
Clinical applications of artificial intelligence in sepsis: A narrative review
Schinkel, M., Paranjape, K., Nannan Panday, R. S., Skyttberg, N., & Nanayakkara, P. W. B. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103488 · Cited by 130
Identifying Patients With Sepsis on the Hospital Wards
Bhattacharjee, P., Edelson, D. P., & Churpek, M. M. (2017) · Chest · doi:10.1016/j.chest.2016.06.020 · Cited by 120
Freeman, R., Moore, L. S. P., Álvarez, L. G., Charlett, A., & Holmes, A. H. (2013) · Journal of Hospital Infection · doi:10.1016/j.jhin.2012.11.031 · Cited by 112
Naïve Electronic Health Record phenotype identification for Rheumatoid arthritis.
Carroll, R. J., Eyler, A. E., & Denny, J. C. (2011) · PubMed Central · Cited by 111
Mendonça, E. A., Haas, J., Shagina, L., Larson, E., & Friedman, C. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.003 · Cited by 111
A frame semantic overview of NLP-based information extraction for cancer-related EHR notes
Datta, S., Bernstam, E. V., & Roberts, K. E. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103301 · Cited by 109
Severe Sepsis and Septic Shock: Clinical Overview and Update on Management
Cawcutt, K. A., & Peters, S. G. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2014.07.009 · Cited by 106
Luz, C. F., Vollmer, M., Decruyenaere, J., Nijsten, M. W., Glasner, C., & Sinha, B. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.02.003 · Cited by 106
The Revival of the Notes Field: Leveraging the Unstructured Content in Electronic Health Records
Assale, M., Dui, L. G., Cina, A., Seveso, A., & Cabitza, F. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00066 · Cited by 94
FitzHenry, F., Murff, H. J., Matheny, M. E., Gentry, N., Fielstein, E. M., Brown, S. H., Reeves, R. M., Aronsky, D., Elkin, P. L., Messina, V. P., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31828d1210 · Cited by 85
Predicting colorectal surgical complications using heterogeneous clinical data and kernel methods
Soguero-Ruíz, C., Hindberg, K., Mora-Jiménez, I., Rojo‐Álvarez, J. L., Skrøvseth, S. O., Godtliebsen, F., Mortensen, K. E., Revhaug, A., Lindsetmo, R., Augestad, K. M., et al. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.03.008 · Cited by 84
Sohn, S., Wang, Y., Wi, C.-I., Krusemark, E. A., Ryu, E., Ali, M. H., Juhn, Y. J., & Liu, H. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx138 · Cited by 82
Flink, M., & Ekstedt, M. (2017) · International Journal of Integrated Care · doi:10.5334/ijic.3003 · Cited by 79
Data-driven discovery of a novel sepsis pre-shock state predicts impending septic shock in the ICU
Liu, R., Greenstein, J. L., Granite, S. J., Fackler, J. C., Bembea, M. M., Sarma, S. V., & Winslow, R. L. (2019) · Scientific Reports · doi:10.1038/s41598-019-42637-5 · Cited by 79
Automated identification of adverse events related to central venous catheters
Penz, J. F. E., Wilcox, A. B., & Hurdle, J. F. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2006.06.003 · Cited by 75
Modeling Disease Severity in Multiple Sclerosis Using Electronic Health Records
Xia, Z., Secor, E., Chibnik, L. B., Bove, R. M., Cheng, S., Chitnis, T., Cagan, A., Gainer, V. S., Chen, P. J., Liao, K. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078927 · Cited by 74
de Bruin, J. S., Seeling, W., & Schuh, C. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002089 · Cited by 73
How Do Doctors in Different Countries Manage the Same Patient? Results of a Factorial Experiment
McKinlay, J., Link, C., Arber, S., Marceau, L., O'Donnell, A., & Adams, A. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00595.x · Cited by 72
International differences in medical care practices.
McPherson, K. (1989) · PubMed Central · Cited by 72
NLP-based identification of pneumonia cases from free-text radiological reports.
Elkin, P. L., Froehling, D. A., Wahner‐Roedler, D. L., Trusko, B. E., Welsh, G., Ma, H., Asatryan, A., Tokars, J. I., Rosenbloom, S. T., & Brown, S. H. (2008) · PubMed Central · Cited by 72
Natural Language Processing to identify pneumonia from radiology reports
Dublin, S., Baldwin, E., Walker, R. L., Christensen, L. M., Haug, P. J., Jackson, M. L., Nelson, J. C., Ferraro, J., Carrell, D., & Chapman, W. W. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3418 · Cited by 65
Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective
Giacobbe, D. R., Signori, A., Del Puente, F., Mora, S., Carmisciano, L., Briano, F., Vena, A., Ball, L., Robba, C., Pelosi, P., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.617486 · Cited by 65
Information handling in the nursing discharge note
Hellesø, R. (2005) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2005.01235.x · Cited by 64
Van Vleck, T. T., Chan, L., Coca, S. G., Craven, C. K., Do, R., Ellis, S. B., Kannry, J. L., Loos, R. J. F., Bonis, P. A., Cho, J., et al. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.06.028 · Cited by 61
Rothberg, M. B., Pekow, P. S., Priya, A., & Lindenauer, P. K. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1419 · Cited by 60
Comparing methods for identifying pancreatic cancer patients using electronic data sources.
Friedlin, J., Overhage, J. M., Al-Haddad, M. A., Waters, J. A., Aguilar-Saavedra, J. R., Kesterson, J., & Schmidt, C. M. (2010) · PubMed · Cited by 59
for the JAAM SPICE Study Group, Abe, T., Tokuda, Y., Shiraishi, A., Fujishima, S., Mayumi, T., Sugiyama, T., Deshpande, G. A., Shiino, Y., Hifumi, T., et al. (2019) · Critical Care · doi:10.1186/s13054-019-2475-9 · Cited by 57
Use of Electronic Health Record Documentation by Healthcare Workers in an Acute Care Hospital System
Penoyer, D., Cortelyou-Ward, K. H., Noblin, A. M., Bullard, T., Talbert, S., Wilson, J., Schafhauser, B., & Briscoe, J. G. (2014) · Journal of Healthcare Management · doi:10.1097/00115514-201403000-00008 · Cited by 53
Bouam, S., Girou, E., Brun‐Buisson, C., Karadimas, H., & Lepage, É. (2003) · Infection Control and Hospital Epidemiology · doi:10.1086/502115 · Cited by 51
Matheny, M. E., FitzHenry, F., Speroff, T., Green, J. K., Griffith, M. L., Vasilevskis, E. E., Fielstein, E. M., Elkin, P. L., & Brown, S. H. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.11.005 · Cited by 48
DeLisle, S., South, B., Anthony, J. A., Kalp, E., Gundlapallli, A., Curriero, F. C., Glass, G. E., Samore, M., & Perl, T. M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013377 · Cited by 47
Automated Detection of Sepsis Using Electronic Medical Record Data: A Systematic Review
Despins, L. A. (2017) · Journal for Healthcare Quality · doi:10.1097/jhq.0000000000000066 · Cited by 47
Lopansri, B. K., Miller, R. R., III, Burke, J. P., Levy, M. M., Opal, S. M., Rothman, R. E., D’Alessio, F. R., Sidhaye, V. K., BALK, R. A., Greenberg, J. A., et al. (2019) · Journal of Intensive Care · doi:10.1186/s40560-019-0368-2 · Cited by 47
Wulff, A., Montag, S., Marschollek, M., & Jack, T. (2019) · Methods of Information in Medicine · doi:10.1055/s-0039-1695717 · Cited by 47
Early Prediction of Sepsis from Clinical Data: the PhysioNet/Computing in Cardiology Challenge 2019
Reyna, M. A., Josef, C. S., Seyedi, S. S., Jeter, R., Shashikumar, S. P., Westover, M. B., Sharma, A., Nemati, S., & Clifford, G. D. (2019) · Computing in cardiology · doi:10.23919/cinc49843.2019.9005736 · Cited by 47
Predicting Complications in Critical Care Using Heterogeneous Clinical Data
Huddar, V., Desiraju, B. K., Rajan, V., Bhattacharya, S., Roy, S., & Reddy, C. K. (2016) · IEEE Access · doi:10.1109/access.2016.2618775 · Cited by 45
Faisal, M., Scally, A., Richardson, D., Beatson, K., Howes, R., Speed, K., & Mohammed, M. A. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002967 · Cited by 44
Marks, M., Pollock, E., Armstrong, M., Morris-Jones, S., Kidd, M., Gothard, P., Noursadeghi, M., & Doherty, J. F. (2013) · Journal of Infection · doi:10.1016/j.jinf.2012.10.004 · Cited by 43
A Review of Predictive Analytics Solutions for Sepsis Patients
Teng, A. K., & Wilcox, A. B. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1710525 · Cited by 41
DeLisle, S., Kim, B., Deepak, J., Siddiqui, T., Gundlapalli, A. V., Samore, M. H., & DʼAvolio, L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070944 · Cited by 40
Bouzbid, S., Gicquel, Q., Gerbier-Colomban, S., Chomarat, M., Pradat, E., Fabry, J., Lepape, A., & Metzger, M.-H. (2011) · Journal of Hospital Infection · doi:10.1016/j.jhin.2011.05.006 · Cited by 38
Contextual Embeddings from Clinical Notes Improves Prediction of SepsisPreprint
Amrollahi, F., Shashikumar, S. P., Razmi, F., & Nemati, S. (2021) · medRxiv · doi:10.1101/2021.03.02.21252779 · Cited by 38
Sepsis mortality prediction with the Quotient Basis Kernel
Ribas, V. J., Vellido, A., Romero, E. E., & Ruiz‐Rodríguez, J. C. (2014) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2014.03.004 · Cited by 33
Time Series Analysis of Nursing Notes for Mortality Prediction via a State Transition Topic Model
Jo, Y., Loghmanpour, N. A., & Rosé, C. P. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806541 · Cited by 32
History and Physical Examination
Davis, J. L., & Murray, J. F. (2015) · Elsevier eBooks · doi:10.1016/b978-1-4557-3383-5.00016-6 · Cited by 32
Liu, R., Greenstein, J. L., Sarma, S. V., & Winslow, R. L. (2019) · 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857819 · Cited by 30
Furniss, D. J., Lyons, I., Franklin, B. D., Mayer, A., Chumbley, G. M., Wei, L., Cox, A. L., Vos, J., Galal‐Edeen, G. H., & BLANDFORD, A. E. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3025-x · Cited by 29
Comparison of Sepsis Definitions as Automated Criteria
Yu, S. C., Betthauser, K. D., Gupta, A., Lyons, P. G., Lai, A. M., Kollef, M. H., Payne, P. R. O., & Michelson, A. P. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004875 · Cited by 29
Ribelles, N., Jerez, J. M., Rodríguez-Brazzarola, P., Jiménez, B., Díaz-Redondo, T., Mesa, H., Márquez, A., Sánchez‐Muñoz, A., Pajares, B., Carabantes, F., et al. (2020) · European Journal of Cancer · doi:10.1016/j.ejca.2020.11.030 · Cited by 28
Mortality Measures to Profile Hospital Performance for Patients With Septic Shock*
Walkey, A. J., Shieh, M., Liu, V. X., & Lindenauer, P. K. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003184 · Cited by 24
Chief Complaints and ICD Codes
Wagner, M. M., Hogan, W. R., Chapman, W. W., & Gesteland, P. H. (2006) · Elsevier eBooks · doi:10.1016/b978-012369378-5/50025-9 · Cited by 23
Gundlapalli, A. V., South, B. R., Phansalkar, S., Kinney, A. Y., Shen, S., DeLisle, S., Perl, T. M., & Samore, M. H. (2008) · PubMed Central · Cited by 22
Paths into Sepsis: Trajectories of Presepsis Healthcare Use
Prescott, H. C., Carmichael, A. G., Langa, K. M., Gonzalez, R., & Iwashyna, T. J. (2018) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201806-391oc · Cited by 22
Predicting Severe Sepsis Using Text from the Electronic Health RecordPreprint
Culliton, P., Levinson, M., Ehresman, A., Wherry, J., Steingrub, J. S., & Gallant, S. I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11536 · Cited by 22
Nursing documentation and recording systems of nursing care
Ioanna, P. (2007) · ICUS and Nursing Web Journal · Cited by 21
Liu, Y., Chu, R., Lee, A. S. Y., Gomersall, C. D., Zhang, L., Gin, T., Chan, M. T. V., Wu, W. K. K., & Ling, L. (2020) · BMC Infectious Diseases · doi:10.1186/s12879-020-05330-x · Cited by 19
Sepsis: the importance of an accurate final diagnosis
Tidswell, R., Inada-Kim, M., & Singer, M. (2020) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30520-8 · Cited by 19
Jensdóttir, A. B., Jónsson, P. V., Noro, A., Jonsén, E., Ljunggren, G., Finne‐Soveri, H., Schroll, M., Grue, E. V., & Björnsson, J. (2008) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2007.00534.x · Cited by 18
Koller, W., Blacky, A., Bauer, C., Mandl, H., & Adlassnig, K.-P. (2010) · PubMed · Cited by 18
Baghdadi, Y., Bourrée, A., Robert, A., Rey, G., Gallay, A., Zweigenbaum, P., Grouin, C., & Fouillet, A. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.06.022 · Cited by 18
Organization structure and the performance of hospital emergency services
Georgopoulos, B. S. (1985) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(85)80887-8 · Cited by 17
Ippolito, P. R., Larson, E., Furuya, E. Y., Liu, J., & Seres, D. S. (2014) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607114536580 · Cited by 16
Névéol, A., Zweigenbaum, P., & Processing, S. E. F. T. I. Y. S. O. C. N. L. (2018) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1667080 · Cited by 15
Toward Automated Early Sepsis Alerting: Identifying Infection Patients from Nursing Notes
Apostolova, E., & Velez, T. (2017) · doi:10.18653/v1/w17-2332 · Cited by 15
Zheng, H., Gaff, H. D., Smith, G., & DeLisle, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100845 · Cited by 13
Improving Early Sepsis Prediction with Multi Modal LearningPreprint
Qin, F., Madan, V., Ratan, U., Karnin, Z. S., Kapoor, V., Bhatia, P., & Kass‐Hout, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11094 · Cited by 11
Pneumonia in the context of severe sepsis: a significant diagnostic problem: Table 1—
Bewick, T. A., Simmonds, M., Chikhani, M., Meyer, J., & Lim, W. S. (2008) · European Respiratory Journal · doi:10.1183/09031936.00104808 · Cited by 10
Arnold, C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1803551115 · Cited by 10
Wang, T., Velez, T., Apostolova, E., Tschampel, T., Ngo, T. L., & Hardison, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10174 · Cited by 10
Analysis of communicative behaviour: Profiling roles and activities
Sørby, I. D., & Øystein Nytrø, A. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.08.003 · Cited by 9
How to write a discharge summary
Stopford, E., Ninan, S. G., & Spencer, N. J. B. (2015) · BMJ · doi:10.1136/sbmj.h2696 · Cited by 9
Multimodal Early Septic Shock Prediction Model using Lasso Regression with Decaying Response
Hammoud, I., Ramakrishnan, I. V., Henry, M. C., & Morley, E. J. (2020) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi48887.2020.9374377 · Cited by 9
The challenge of early identification of the hospital patient at risk of septic complications
Vincent, J. (2017) · Annals of Translational Medicine · doi:10.21037/atm.2017.01.49 · Cited by 8
Sørby, I. D., & Øystein Nytrø, A. (2005) · Health Information Management Journal · doi:10.1177/183335830503400404 · Cited by 7
Vermassen, J., Colpaert, K. E., Bus, L. D., Depuydt, P. O., & Decruyenaere, J. M. A. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2020.01.007 · Cited by 7
A Keyword Approach to Identify Adverse Events Within Narrative Documents From 4 Italian Institutions
Piscitelli, A., Bevilacqua, L., Labella, B., Parravicini, E., & Auxilia, F. (2020) · Journal of Patient Safety · doi:10.1097/pts.0000000000000783 · Cited by 7
Aghili, H., Mushlin, R. A., Williams, R. M., & Rose, J. S. (1997) · Europe PMC (PubMed Central) · Cited by 6
Visualizing patient journals by combining vital signs monitoring and natural language processing
Vilic, A., Petersen, J. A., Hoppe, K., & Sørensen, H. B. D. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591245 · Cited by 5
Identifying catheter-related events through sentence classification
Øystein Nytrø, A., Berg, I. A., Husby, H., Røst, T. B., & Tvedt, C. R. (2020) · International Journal of Data Mining and Bioinformatics · doi:10.1504/ijdmb.2020.107877 · Cited by 5
A Time-Critical Topic Model for Predicting the Survival Time of Sepsis Patients
Guo, W., Xu, Z., Ye, X., Zhang, S., Zhao, X., & Li, X. (2020) · Scientific Programming · doi:10.1155/2020/8884539 · Cited by 4
History and Physical Examination
Durham, H. E. (2017) · Wiley eBooks · doi:10.1002/9781119357407.ch3 · Cited by 2
Embedding, aligning and reconstructing clinical notes to explore sepsis
Zhu, X., Plasek, J. M., Tang, C., Assad, W. A., Zhang, Z., Xiong, Y., Wang, L., Yerneni, S., Ortega, C. A., Kang, M., et al. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05529-4 · Cited by 1
Research works printed but not linked: 1
- Kind, 2011, Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 2: Culture and Redesign. AHRQ Publication No. 08-0034-2)
Cited by
AI-driven triage in emergency departments: A review of benefits, challenges, and future directions
Da’Costa, A., Teke, J., Origbo, J. E., Osonuga, A., Egbon, E., & Olawade, D. B. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105838 · Cited by 151
Islam, K. R., Prithula, J., Kumar, J., Tan, T. L., Reaz, M. B. I., Sumon, M. S. I., & Chowdhury, M. E. H. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12175658 · Cited by 153
Mathis, W. S., Zhao, S., Pratt, N., Weleff, J., & Paoli, S. D. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108356 · Cited by 131
Systematic reviews of machine learning in healthcare: a literature review
Kolasa, K., Admassu, B. Y., Hołownia-Voloskova, M. E., Kędzior, K. J., Poirrier, J., & Perni, S. (2023) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2023.2279107 · Cited by 116
Schopow, N., Osterhoff, G., & Baur, D. (2023) · JMIR Medical Informatics · doi:10.2196/48933 · Cited by 80
Metadata
- Authors
- Yan, M. Y., Gustad, L. T., & Nytrø, Ø.
- Affiliations
- Norwegian University of Science and Technology (NO)
- Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
- Corresponding author
- Yan, Melissa Y
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-12-13
- Volume
- 29
- Issue
- 3
- Pages
- 559-575
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC8800516
- OpenAlex
- W4200334578
- Cited by
- 119
- References
- 137
- Citations by year
- 2026: 26 · 2025: 41 · 2024: 24 · 2023: 23 · 2022: 5
- FWCI
- 0.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Funders
- Computational Sepsis Mining and Modelling project through the Norwegian University of Science and Technology Health Strategic Area
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- sepsis, sepsis prediction, early detection, clinical text, natural language processing, unstructured clinical notes, structured data, septic shock, systemic inflammatory response syndrome, machine learning, vital signs, intensive care
- MeSH terms
- Machine Learning, Humans, Natural Language Processing, Shock, Septic, Sepsis, Vital Signs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.