Predicting emergency department inpatient admissions to improve same-day patient flow
Open accessAbstract
OBJECTIVES: The objectives were to evaluate three models that use information gathered during triage to predict, in real time, the number of emergency department (ED) patients who subsequently will be admitted to a hospital inpatient unit (IU) and to introduce a new methodology for implementing these predictions in the hospital setting. METHODS: Three simple methods were compared for predicting hospital admission at ED triage: expert opinion, naïve Bayes conditional probability, and a generalized linear regression model with a logit link function (logit-linear). Two months of data were gathered from the Boston VA Healthcare System's 13-bed ED, which receives approximately 1,100 patients per month. Triage nurses were asked to estimate the likelihood that each of 767 triaged patients from that 2-month period would be admitted after their ED treatment, by placing them into one of six categories ranging from low to high likelihood. Logit-linear regression and naïve Bayes models also were developed using retrospective data and used to estimate admission probabilities for each patient who entered the ED within a 2-month time frame, during triage hours (1,160 patients). Predictors considered included patient age, primary complaint, provider, designation (ED or fast track), arrival mode, and urgency level (emergency severity index assigned at triage). RESULTS: Of the three methods considered, logit-linear regression performed the best in predicting total bed need, with a receiver operating characteristic (ROC) area under the curve (AUC) of 0.887, an R(2) of 0.58, an average estimation error of 0.19 beds per day, and on average roughly 3.5 hours before peak demand occurred. Significant predictors were patient age, primary complaint, bed type designation, and arrival mode (p < 0.0001 for all factors). The naïve Bayesian model had similar positive predictive value, with an AUC of 0.841 and an R(2) of 0.58, but with average difference in total bed need of approximately 2.08 per day. Triage nurse expert opinion also had some predictive capability, with an R(2) of 0.52 and an average difference in total bed need of 1.87 per day. CONCLUSIONS: Simple probability models can reasonably predict ED-to-IU patient volumes based on basic data gathered at triage. This predictive information could be used for improved real-time bed management, patient flow, and discharge processes. Both statistical models were reasonably accurate, using only a minimal number of readily available independent variables.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most prior models predicting hospital admission at ED triage include only information collected at triage such as demographics, vital signs, chief complaint, nursing notes, and early diagnostics.
“Most models only include information collected at triage such as demographics, vital signs, chief complaint, nursing notes, and early diagnostics [11,14–19]”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [11]
Logistic regression and Naive Bayes are commonly used, with few studies using more complex algorithms like random-forests, artificial neural networks, and support vector machines.
“Logistic regression and Naive Bayes are commonly used [9,11,16,18–22], with few studies using more complex algorithms like random-forests, artificial neural networks, and support vector machines [12,15,17].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [11]
Notification of administrators and inpatient teams regarding potential admissions may help alleviate ED crowding.
“Notification of administrators and inpatient teams regarding potential admissions may help alleviate this problem [11].”
From Predicting hospital admission at emergency department triage using machine learning (2018) · cites this paper as [11]
One study in emergency medicine derived an expected number of admissions among a roomful of patients in ED by summing their individual probabilities of admission, but there was no presentation of the uncertainty of their point estimates.
“One study in emergency medicine derived an expected number of admissions among a roomful of patients in ED by summing their individual probabilities of admission27, but there was no presentation of the uncertainty of their point estimates.”
From Machine learning for real-time aggregated prediction of hospital admission for emergency patients (2022) · cites this paper as [27]
Peck et al.'s proposed summation of probabilities to calculate running bed need does not quantify uncertainty, and England et al.'s simulations do not benefit from real-time data.
“Peck et al.’s27 proposed summation of probabilities to calculate running bed need does not quantify uncertainty, and England et al.’s32 simulations do not benefit from real-time data.”
From Machine learning for real-time aggregated prediction of hospital admission for emergency patients (2022) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Data Mining: Practical Machine Learning Tools and Techniques
Witten, I. H., Frank, E., & Hall, M. A. (2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,493 · see citing works
Designing and Managing the Supply Chain
Simchi‐Levi, D. (2002) · Cited by 1,767 · see citing works
Systematic Review of Emergency Department Crowding: Causes, Effects, and Solutions
Hoot, N. R., & Aronsky, D. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2008.03.014 · Cited by 1,689 · see citing works
A conceptual model of emergency department crowding
Asplin, B. R., Magid, D. J., Rhodes, K. V., Solberg, L. I., Lurie, N., & Camargo, C. A. (2003) · Annals of Emergency Medicine · doi:10.1067/mem.2003.302 · Cited by 977 · see citing works
Weiss, S. J., Derlet, R. W., Arndahl, J., et al. (2004) · Academic Emergency Medicine · doi:10.1197/j.aem.2003.07.017 · Cited by 383 · see citing works
Forecasting Daily Patient Volumes in the Emergency Department
Jones, S. S., Thomas, A., Evans, R. S., Welch, S. J., Haug, P. J., & Snow, G. L. (2008) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2007.00032.x · Cited by 267 · see citing works
Olshaker, J. S., & Rathlev, N. K. (2006) · Journal of Emergency Medicine · doi:10.1016/j.jemermed.2005.05.023 · Cited by 239 · see citing works
Shmueli, G., Patel, N. R., & Bruce, P. C. (2006) · Cited by 228 · see citing works
Development and Validation of a New Index to Measure Emergency Department Crowding
Bernstein, S. L., Verghese, V., Leung, W., Lunney, A. T., & Perez, I. (2003) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2003.tb00647.x · Cited by 211 · see citing works
Sun, Y., Heng, B. H., Tay, S. Y., & Seow, E. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01125.x · Cited by 154 · see citing works
Development and Validation of a New Index to Measure Emergency Department Crowding
Bernstein, S. L., Verghese, V., Leung, W., et al. (2003) · Academic Emergency Medicine · doi:10.1197/s1069-6563(03)00311-7 · Cited by 145 · see citing works
The Opportunity Loss of Boarding Admitted Patients in the Emergency Department
Falvo, T., Grove, L., Stachura, R., Vega, D., Stike, R., Schlenker, M. K., & Zirkin, W. (2007) · Academic Emergency Medicine · doi:10.1197/j.aem.2006.11.011 · Cited by 135 · see citing works
Viccellio, A. W., Santora, C., Singer, A. J., et al. (2009) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2009.03.005 · Cited by 133 · see citing works
Forecasting Demand of Emergency Care
Jones, S., Joy, M., & Pearson, J. (2002) · Health Care Management Science · doi:10.1023/a:1020390425029 · Cited by 123 · see citing works
Forecasting Models of Emergency Department Crowding
Schweigler, L. M., Desmond, J. S., McCarthy, M. L., et al. (2009) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2009.00356.x · Cited by 121 · see citing works
Time Series Forecasts of Emergency Department Patient Volume, Length of Stay, and Acuity
Tandberg, D., & Qualls, C. (1994) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(94)70044-3 · Cited by 110 · see citing works
Short-Term Forecasting of Emergency Inpatient Flow
Abraham, G., Byrnes, G. B., & Bain, C. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2014565 · Cited by 101 · see citing works
How well do paramedics predict admission to the hospital? A prospective study
Levine, S. D., Colwell, C. B., Pons, P. T., et al. (2006) · Journal of Emergency Medicine · doi:10.1016/j.jemermed.2005.08.007 · Cited by 87 · see citing works
Development of an Emergency Department Work Score to Predict Ambulance Diversion
Epstein, S. K., & Tian, L. (2006) · Academic Emergency Medicine · doi:10.1197/j.aem.2005.11.081 · Cited by 72 · see citing works
Walsh, P. F., Rothenberg, S. J., Doherty, S. O., HOEY, H. M. C. V., & Healy, R. (2004) · European Journal of Emergency Medicine · doi:10.1097/00063110-200410000-00005 · Cited by 69 · see citing works
Forecasting Emergency Department Crowding: A Prospective, Real-time Evaluation
Hoot, N. R., LeBlanc, L. J., Jones, I., Levin, S. R., Zhou, C., Gadd, C. S., & Aronsky, D. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2772 · Cited by 64 · see citing works
A Comprehensive Set of Coded Chief Complaints for the Emergency Department
Aronsky, D., Kendall, D., Merkley, K., et al. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb01098.x · Cited by 62 · see citing works
Strategies to Improve Flow in the Pediatric Emergency Department
Yen, K., & Gorelick, M. H. (2007) · Pediatric Emergency Care · doi:10.1097/pec.0b013e3181568efe · Cited by 50 · see citing works
Can emergency medical service staff predict the disposition of patients they are transporting?
Clesham, K., Mason, S. M., Gray, J. T., et al. (2008) · Emergency Medicine Journal · doi:10.1136/emj.2007.054924 · Cited by 47 · see citing works
Arslanian-Engoren, C. (2004) · Journal of Cardiovascular Nursing · doi:10.1097/00005082-200407000-00008 · Cited by 31 · see citing works
Hospital Admission Prediction Using Pre-hospital Variables
Li, J., Guo, L., & Handly, N. (2009) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2009.45 · Cited by 16 · see citing works
Hospitals and Clinical Facilities, Processes and Design for Patient Flow
Williams, M. J. S. (2006) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-0-387-33636-7_2 · Cited by 11 · see citing works
Hospitals and Clinical Facilities, Processes, and Design for Patient Flow
Williams, M. J. S. (2013) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-1-4614-9512-3_3 · Cited by 10 · see citing works
Innovative Approach to the Aims for Improvement
Rubino, L., Stahl, L., & Chan, M. (2007) · Journal of Ambulatory Care Management · doi:10.1097/01.jac.0000290401.51166.1e · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Sun Y, Heng BH, Tay SY, Seow E. Predicting hospi- tal admissions at emergency department triage using routine administrative data. Acad Emerg Med. 2011; 18:844-50.
Cited by
Sorted by citations
Predicting hospital admission at emergency department triage using machine learning
Hong, W. S., Haimovich, A. D., & Taylor, R. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0201016 · Cited by 326 · see citing works
Predicting hospital admission at the emergency department triage: A novel prediction model
Parker, C. A., Liu, N., Wu, S. X., Shen, Y., Lam, S. S. W., & Ong, M. E. H. (2019) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2018.10.060 · Cited by 100 · see citing works
Machine learning for real-time aggregated prediction of hospital admission for emergency patients
King, Z., Farrington, J., Utley, M., Kung, E., Elkhodair, S., Harris, S., Sekula, R., Gillham, J., Li, K., & Crowe, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00649-y · Cited by 87 · see citing works
Kaushal, A., Zhao, Y., Peng, Q., Strome, T., Weldon, E., Zhang, M., & Chochinov, A. (2015) · Socio-Economic Planning Sciences · doi:10.1016/j.seps.2015.02.002 · Cited by 74 · see citing works
De Hond, A., Raven, W., Schinkelshoek, L., Gaakeer, M., Ter Avest, E., Sir, O., Lameijer, H., Hessels, R. A., Reijnen, R., De Jonge, E., et al. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104496 · Cited by 66 · see citing works
Early Prediction Model of Patient Hospitalization From the Pediatric Emergency Department
Barak-Corren, Y., Fine, A. M., & Reis, B. Y. (2017) · PEDIATRICS · doi:10.1542/peds.2016-2785 · Cited by 56 · see citing works
Reduction in laboratory turnaround time decreases emergency room length of stay
Kaushik, N., Khangulov, V. S., O’Hara, M., & Arnaout, R. (2018) · Open Access Emergency Medicine · doi:10.2147/oaem.s155988 · Cited by 51 · see citing works
Barak-Corren, Y., Israelit, S. H., & Reis, B. Y. (2017) · Emergency Medicine Journal · doi:10.1136/emermed-2014-203819 · Cited by 52 · see citing works
An Examination of Early Transfers to the ICU Based on a Physiologic Risk Score
Hu, W., Chan, C. W., Zubizarreta, J. R., & Escobar, G. J. (2018) · Manufacturing & Service Operations Management · doi:10.1287/msom.2017.0658 · Cited by 44 · see citing works
- Authors
- Peck, J. S., Benneyan, J. C., Nightingale, D. J., & Gaehde, S. A.
- Affiliations
- Northeastern University (US)
- Corresponding author
- Peck, Jordan S.
- Venue
- Academic Emergency Medicine
- Publisher
- Wiley
- Published
- 2012-09
- Volume
- 19
- Issue
- 9
- Pages
- E1045-54
- ISSN
- 1069-6563 (ISSN-L)
- 1553-2712
- OpenAlex
- W2146767951
- Cited by
- 138
- References
- 29
- Citations by year
- 2025: 10 · 2024: 6 · 2023: 5 · 2022: 14 · 2021: 13 · 2020: 20 · 2019: 12 · 2018: 23 · 2017: 10 · 2016: 6 · 2015: 8 · 2014: 10 · 2013: 1
- FWCI
- 6.76
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Academic Emergency Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Veterans Affairs
- Topics
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Health Sciences › Health Professions › Emergency Medical Services › Healthcare Operations and Scheduling Optimization
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- emergency department admission, hospital bed management, triage, admission prediction, naive Bayes, expert opinion, Emergency Severity Index, fast tracking
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Bayes Theorem, Boston, Child, Emergency Medicine, Emergency Service, Hospital, Female, Hospitalization, Humans, Inpatients, Length of Stay, Male, Middle Aged, Patient Admission, Patient Transfer, Predictive Value of Tests, Triage, Waiting Lists, Linear Models, Total Quality Management, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review