Cited by 4Sepsis Diagnosis and TreatmentMachine Learning in HealthcareArtificial Intelligence in Healthcare

A machine learning model for the early diagnosis of bloodstream infection in patients admitted to the pediatric intensive care unit

Open access
Liporaci, Felipe, Carlotti, Danilo, Carlotti, Ana·2024·PLOS ONE

Abstract

Bloodstream infection (BSI) is associated with increased morbidity and mortality in the pediatric intensive care unit (PICU) and high healthcare costs. Early detection and appropriate treatment of BSI may improve patient’s outcome. Data on machine-learning models to predict BSI in pediatric patients are limited and neither study included time series data. We aimed to develop a machine learning model to predict an early diagnosis of BSI in patients admitted to the PICU. This was a retrospective cohort study of patients who had at least one positive blood culture result during stay at a PICU of a tertiary-care university hospital, from January 1 st to December 31 st 2019. Patients with positive blood culture results with growth of contaminants and those with incomplete data were excluded. Models were developed using demographic, clinical and laboratory data collected from the electronic medical record. Laboratory data (complete blood cell counts with differential and C-reactive protein) and vital signs (heart rate, respiratory rate, blood pressure, temperature, oxygen saturation) were obtained 72 hours before and on the day of blood culture collection. A total of 8816 data from 76 patients were processed by the models. The machine committee was the best-performing model, showing accuracy of 99.33%, precision of 98.89%, sensitivity of 100% and specificity of 98.46%. Hence, we developed a model using demographic, clinical and laboratory data collected on a routine basis that was able to detect BSI with excellent accuracy and precision, and high sensitivity and specificity. The inclusion of vital signs and laboratory data variation over time allowed the model to identify temporal changes that could be suggestive of the diagnosis of BSI. Our model might help the medical team in clinical-decision making by creating an alert in the electronic medical record, which may allow early antimicrobial initiation and better outcomes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0299884

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent studies have explored various ML algorithms, such as logistic regression, random forest, support vector machines, and gradient boosting, to assess the risk of BSIs in real time.

    “Recent studies have explored various ML algorithms, such as logistic regression, random forest, support vector machines, and gradient boosting, to assess the risk of BSIs in real time [10–14].”

    From Early prediction of bloodstream infections in ICU patients using machine learning methods based on routine laboratory parameters (2025) · cites this paper as [10]

    The Methods (Data processing; Model training and testing, page not provided) describe logistic regression and gradient boosting models for classifying patients with or without BSI. The Discussion (page not provided) reports a random-forest model for predicting central line-associated BSI. Our copy does not identify a support vector machine model, and it describes automatic evaluation as something the trained model could do, rather than real-time risk assessment that these studies performed. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Most reported ML-based BSI prediction models integrate a combination of vital signs, clinical scores, and laboratory values.

    “However, most reported ML-based BSI prediction models integrate a combination of vital signs, clinical scores, and laboratory values.”

    From Early prediction of bloodstream infections in ICU patients using machine learning methods based on routine laboratory parameters (2025) · cites this paper as [10]

    The Methods (Model development; page not available) say this paper’s model combines clinical data, vital signs, and laboratory data. The Discussion describes several other BSI prediction models with differing inputs, but does not establish that most reported models combine all three categories or use clinical scores. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Machine learning models have demonstrated significant potential in predicting BSIs by analyzing readily available clinical and laboratory data.

    “Machine learning models have demonstrated significant potential in predicting BSIs by analyzing readily available clinical and laboratory data.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 22

  1. [1]Timsit JF, Ruppé E, Barbier F, Tabah A, Bassetti M. Bloodstream infections in critically ill patients: an expert statement. Intensive Care Med. 2020; 46(2): 266– 284. doi: 10.1007/s00134-020-05950-6 32047941 PMC7223992 · DOI
  2. [2]Ista E, van der Hoven B, Kornelisse RF, van der Starre C, Vos MC, Boersma E, et al. Effectiveness of insertion and maintenance bundles to prevent central-line-associated bloodstream infections in critically ill patients of all ages: a systematic review and meta-analysis. Lancet Infect Dis. 2016; 16(6): 724– 734. doi: 10.1016/S1473-3099(15)00409-0 26907734 · DOI
  3. [3]Haque M, Sartelli M, McKimm J, Abu Bakar M. Health care-associated infections—an overview. Infect Drug Resist. 2018; 11: 2321– 2333. doi: 10.2147/IDR.S177247 30532565 PMC6245375 · DOI
  4. [4]Bennett EE, VanBuren J, Holubkov R, Bratton SL. Presence of invasive devices and risks of healthcare-associated infections and sepsis. J Pediatr Intensive Care. 2018; 7(4): 188– 195. doi: 10.1055/s-0038-1656535 31073493 PMC6506685 · DOI
  5. [5]Edwards JD, Herzig CT, Liu H, Pogorzelska-Maziarz M, Zachariah P, Dick AW, et al. Central line-associated blood stream infections in pediatric intensive care units: Longitudinal trends and compliance with bundle strategies. Am J Infect Control. 2015; 43(5): 489– 93. doi: 10.1016/j.ajic.2015.01.006 25952048 PMC4430334 · DOI
  6. [6]Niedner MF, Huskins WC, Colantuoni E, Muschelli J, Harris JM 2nd, Rice TB, et al. Epidemiology of central line-associated bloodstream infections in the pediatric intensive care unit. Infect Control Hosp Epidemiol. 2011; 32(12): 1200– 8. doi: 10.1086/662621 22080659 · DOI
  7. [7]Chesshyre E, Goff Z, Bowen A, Carapetis J. The prevention, diagnosis and management of central venous line infections in children. J Infect. 2015; 71 Suppl 1: S59– 75. doi: 10.1016/j.jinf.2015.04.029 25934326 · DOI
  8. [8]Savage RD, Fowler RA, Rishu AH, Bagshaw SM, Cook D, Dodek P, et al. The effect of inadequate initial empiric antimicrobial treatment on mortality in critically ill patients with bloodstream infections: a multi-centre retrospective cohort study. PLoS One. 2016; 11(5): e0154944. doi: 10.1371/journal.pone.0154944 27152615 PMC4859485 · DOI
  9. [9]Eliakim-Raz N, Bates DW, Leibovici L. Predicting bacteraemia in validated models—a systematic review. Clin Microbiol Infect. 2015; 21(4): 295– 301. doi: 10.1016/j.cmi.2015.01.023 25677625 · DOI
  10. [10]Roimi M, Neuberger A, Shrot A, Paul M, Geffen Y, Bar-Lavie Y. Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms. Intensive Care Med. 2020; 46(3): 454– 462. doi: 10.1007/s00134-019-05876-8 31912208 · DOI · Paper page
  11. [11]Van Steenkiste T, Ruyssinck J, De Baets L, Decruyenaere J, De Turck F, Ongenae F, et al. Accurate prediction of blood culture outcome in the intensive care unit using long short-term memory neural networks. Artif Intell Med. 2019; 97: 38– 43. doi: 10.1016/j.artmed.2018.10.008 30420241 · DOI
  12. [12]Beeler C, Dbeibo L, Kelley K, Thatcher L, Webb D, Bah A, et al. Assessing patient risk of central line-associated bacteremia via machine learning. Am J Infect Control. 2018; 46(9): 986– 991. doi: 10.1016/j.ajic.2018.02.021 29661634 · DOI
  13. [13]Bonello K, Emani S, Sorensen A, Shaw L, Godsay M, Delgado M, et al. Prediction of impending central-line-associated bloodstream infections in hospitalized cardiac patients: development and testing of a machine-learning model. J Hosp Infect. 2022; 127: 44– 50. doi: 10.1016/j.jhin.2022.06.003 35738317 · DOI
  14. [14]Shah N, Arshad A, Mazer MB, Carroll CL, Shein SL, Remy KE. The use of machine learning and artificial intelligence within pediatric critical care. Pediatr Res. 2023; 93(2): 405– 412. doi: 10.1038/s41390-022-02380-6 36376506 PMC9660024 · DOI
  15. [15]Kirk D, Kok E, Tufano M, Tekinerdogan B, Feskens EJM, Camps G. Machine Learning in Nutrition Research. Adv Nutr. 2022 Dec 22; 13(6): 2573– 2589. doi: 10.1093/advances/nmac103 36166846 PMC9776646 · DOI
  16. [16]Pollack MM, Patel KM, Ruttimann UE. PRISM III: an updated Pediatric Risk of Mortality score. Crit Care Med. 1996; 24(5): 743– 52. doi: 10.1097/00003246-199605000-00004 8706448 · DOI
  17. [17]Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, et al. Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003; 362(9379): 192– 197. doi: 10.1016/S0140-6736(03)13908-6 12885479 · DOI
  18. [18]Bose E, Hravnak M, Clermont G. Vector Auto-Regressive (VAR) model for exploring causal dynamics of cardiorespiratory instability. Critical Care Med. 2014; 42(12): A1428– A1429 doi: 10.1097/01.ccm.0000457780.29828.f7 · DOI
  19. [19]Alanazi HO, Abdullah AH, Qureshi KN, Ismail AS. Accurate and dynamic predictive model for better prediction in medicine and healthcare. Ir J Med Sci. 2018; 187(2): 501– 513. doi: 10.1007/s11845-017-1655-3 28756541 · DOI
  20. [21]Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research. 2011; 12: 2825– 2830.
  21. [22]Joksas D, Freitas P, Chai Z et al. Committee machines—a universal method to deal with non-idealities in memristor-based neural networks. Nat Commun. 2020; 11: 4273. doi: 10.1038/s41467-020-18098-0 32848139 PMC7450095 · DOI
  22. [25]Ramgopal S, Horvat CM, Yanamala N, Alpern ER. Machine learning to predict serious bacterial infections in young febrile infants. Pediatrics. 2020; 146(3): e20194096. doi: 10.1542/peds.2019-4096 32855349 PMC7461239 · DOI

Cited by

Sorted by citations

Authors
Liporaci, F., Carlotti, D., & Carlotti, A.
Affiliations
Universidade de São Paulo (BR)
Corresponding author
Carlotti, Ana
Venue
PLOS ONE
Published
2024-05-01
Volume
19
Issue
5
Pages
e0299884
ISSN
1932-6203 (ISSN-L)
OpenAlex
W4396566652
Cited by
4
References
1
Citations by year
2026: 1 · 2025: 3
FWCI
1.21
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (001)
Topics
  • Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
bloodstream infection, early diagnosis, pediatric intensive care unit, machine learning, ensemble classifiers, blood culture, vital signs, laboratory findings, C-reactive protein, electronic health record alerts, clinical decision support, pediatric patients
MeSH terms
Machine Learning, Adolescent, Child, Child, Preschool, Female, Humans, Infant, Infant, Newborn, Male, Retrospective Studies, Intensive Care Units, Pediatric, Bacteremia, Sepsis, Early Diagnosis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review