Early Prediction Model of Patient Hospitalization From the Pediatric Emergency Department
Abstract
BACKGROUND AND OBJECTIVES: Emergency departments (EDs) in the United States are overcrowded and nearing a breaking point. Alongside ever-increasing demand, one of the leading causes of ED overcrowding is the boarding of hospitalized patients in the ED as they await bed placement. We sought to develop a model for early prediction of hospitalizations, thus enabling an earlier start for the placement process and shorter boarding times. METHODS: We conducted a retrospective cohort analysis of all visits to the Boston Children's Hospital ED from July 1, 2014 to June 30, 2015. We used 50% of the data for model derivation and the remaining 50% for validation. We built the predictive model by using a mixed method approach, running a logistic regression model on results generated by a naive Bayes classifier. We performed sensitivity analyses to evaluate the impact of the model on overall resource utilization. RESULTS: Our analysis comprised 59 033 patient visits, of which 11 975 were hospitalized (cases) and 47 058 were discharged (controls). Using data available within the first 30 minutes from presentation, our model identified 73.4% of the hospitalizations with 90% specificity and 35.4% of hospitalizations with 99.5% specificity (area under the curve = 0.91). Applying this model in a real-time setting could potentially save the ED 5917 hours per year or 30 minutes per hospitalization. CONCLUSIONS: This approach can accurately predict patient hospitalization early in the ED encounter by using data commonly available in most electronic medical records. Such early identification can be used to advance patient placement processes and shorten ED boarding times.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A progressive modeling approach that uses information available at later time-points has been able to achieve high predictive power and indicates the utility of these features.
“Notably, a progressive modeling approach that uses information available at later time-points, such as lab tests ordered, medications given, and diagnoses entered by the ED provider during the patient’s current visit, has been able to achieve high predictive power and indicates the utility of these features [20,21].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [21]
Some prior models predicting hospital admission at ED triage include additional features such as hospital usage statistics and past medical history.
“while some models include additional features such as hospital usage statistics and past medical history [9,12,20,21].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [21]
Many prior studies have been limited by technical factors, where continuous variables are often reduced to categorical variables through binning or to binary variables encoding presence or missing-ness of data due to the challenges of imputation.
“Furthermore, many prior studies have been limited by technical factors, where continuous variables are often reduced to categorical variables through binning or to binary variables encoding presence or missing-ness of data due to the challenges of imputation [9,15,16,19–21].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [21]
Logistic regression and Naive Bayes are commonly used, with few studies using more complex algorithms like random-forests, artificial neural networks, and support vector machines.
“Logistic regression and Naive Bayes are commonly used [9,11,16,18–22], with few studies using more complex algorithms like random-forests, artificial neural networks, and support vector machines [12,15,17].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [21]
Cites
Effect of Emergency Department Crowding on Outcomes of Admitted Patients
Sun, B., Hsia, R. Y.-J., Weiss, R. E., Zingmond, D. S., Liang, L.-J., Han, W., McCreath, H. E., & Asch, S. M. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.10.026 · Cited by 716 · see citing works
The Association Between Length of Emergency Department Boarding and Mortality
Singer, A. J., Thode, H. C., Viccellio, P., & Pines, J. M. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01236.x · Cited by 662 · see citing works
The Effect of Emergency Department Crowding on Patient Satisfaction for Admitted Patients
Pines, J. M., Iyer, S., Disbot, M., Hollander, J. E., Shofer, F. S., & Datner, E. M. (2008) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2008.00200.x · Cited by 349 · see citing works
Predicting emergency department inpatient admissions to improve same-day patient flow
Peck, J. S., Benneyan, J. C., Nightingale, D. J., & Gaehde, S. A. (2012) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2012.01435.x · Cited by 138 · see citing works
The Opportunity Loss of Boarding Admitted Patients in the Emergency Department
Falvo, T., Grove, L., Stachura, R., Vega, D., Stike, R., Schlenker, M. K., & Zirkin, W. (2007) · Academic Emergency Medicine · doi:10.1197/j.aem.2006.11.011 · Cited by 135 · see citing works
The Financial Consequences of Lost Demand and Reducing Boarding in Hospital Emergency Departments
Pines, J. M., Batt, R. J., Hilton, J. A., et al. (2011) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2011.03.004 · Cited by 119 · see citing works
The impact of delays to admission from the emergency department on inpatient outcomes
Huang, Q., Thind, A., Dreyer, J. F., et al. (2010) · BMC Emergency Medicine · doi:10.1186/1471-227x-10-16 · Cited by 100 · see citing works
Challenges to inter-departmental coordination of patient transfers: A workflow perspective
Abraham, J., & Reddy, M. C. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.11.001 · Cited by 91 · see citing works
Chamberlain, J. M., Patel, K. M., & Pollack, M. M. (2005) · PEDIATRICS · doi:10.1542/peds.2004-0586 · Cited by 74 · see citing works
McLellan, M. C., Gauvreau, K., & Connor, J. A. (2013) · Congenital Heart Disease · doi:10.1111/chd.12132 · Cited by 73 · see citing works
Financial impact of emergency department crowding.
Foley, M. S., Kifaieh, N., & Mallon, W. K. (2011) · PubMed · Cited by 57 · see citing works
Can emergency medical service staff predict the disposition of patients they are transporting?
Clesham, K., Mason, S. M., Gray, J. T., et al. (2008) · Emergency Medicine Journal · doi:10.1136/emj.2007.054924 · Cited by 47 · see citing works
Intas, G., Stergiannis, P. I., Chalari, E., Tsoumakas, K., & Fildissis, G. (2012) · Advanced Emergency Nursing Journal · doi:10.1097/tme.0b013e318251515f · Cited by 47 · see citing works
Predicting hospital admission for Emergency Department patients using a Bayesian network.
Leegon, J., Jones, I. R., Lanaghan, K., & Aronsky, D. (2005) · PubMed Central · Cited by 42 · see citing works
Ten solutions for emergency department crowding.
Derlet, R. W., & Richards, J. R. (2008) · PubMed · Cited by 42 · see citing works
Leegon, J., Jones, I. R., Lanaghan, K., & Aronsky, D. (2006) · Europe PMC (PubMed Central) · Cited by 33 · see citing works
Revised Pediatric Emergency Assessment Tool (RePEAT): A Severity Index for Pediatric Emergency Care
Gorelick, M. H., Alessandrini, E. A., Cronan, K. M., & Justine Shults, A. (2007) · Academic Emergency Medicine · doi:10.1197/j.aem.2006.11.015 · Cited by 30 · see citing works
Lucas, R. H., Farley, H. L., Twanmoh, J. R., et al. (2009) · Journal of Healthcare Management · doi:10.1097/00115514-200903000-00009 · Cited by 25 · see citing works
van Ierland, Y., Seiger, N., van Veen, M., et al. (2012) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2012.09.044 · Cited by 21 · see citing works
A Hybrid Generative/Discriminative Bayesian Classifier.
Kang, C., & Tian, J. W. (2006) · Cited by 15 · see citing works
The impact of ‘admit no bed’ and long boarding times in the emergency department on stroke outcome
Al-Khathaami, A. M., Abulaban, A. A., Mohamed, G. E. D., Alamry, A., Kojan, S. M., & Aljumah, M. (2014) · Saudi Medical Journal · doi:10.15537/1658-3175.6033 · Cited by 13 · see citing works
Horeczko, T., & Wintemute, G. J. (2013) · Pediatric Emergency Care · doi:10.1097/pec.0b013e3182809a45 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Predicting hospital admission at emergency department triage using machine learning
Hong, W. S., Haimovich, A. D., & Taylor, R. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201016 · Cited by 326 · see citing works
Yang, J., Soltan, A. A. S., & Clifton, D. A. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00614-9 · Cited by 181 · see citing works
- Authors
- Barak-Corren, Y., Fine, A. M., & Reis, B. Y.
- Affiliations
- Boston Children's Hospital (US)
- ORCID
- Reis, Ben Y.
- Venue
- PEDIATRICS
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2017-04-25
- Volume
- 139
- Issue
- 5
- Pages
- e20162785
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2609161091
- Cited by
- 56
- References
- 22
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 7 · 2023: 4 · 2022: 8 · 2021: 11 · 2020: 3 · 2019: 7 · 2018: 4
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Emergency Medical Services › Healthcare Operations and Scheduling Optimization
- Keywords
- pediatric emergency department, emergency department overcrowding, patient boarding, hospitalization prediction, early prediction model, resource utilization (health care), Naive Bayes classifier, logistic regression, electronic health records
- MeSH terms
- Bayes Theorem, Boston, Emergency Service, Hospital, Female, Hospitalization, Hospitals, Pediatric, Humans, Length of Stay, Male, Models, Theoretical, Patient Admission, Retrospective Studies, Sensitivity and Specificity, United States, Cohort Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review