Hospital Admission Location Prediction via Deep Interpretable Networks for the Year-Round Improvement of Emergency Patient Care
Open accessAbstract
OBJECTIVE: This paper presents a deep learning method of predicting where in a hospital emergency patients will be admitted after being triaged in the Emergency Department (ED). Such a prediction will allow for the preparation of bed space in the hospital for timely care and admission of the patient as well as allocation of resource to the relevant departments, including during periods of increased demand arising from seasonal peaks in infections. METHODS: The problem is posed as a multi-class classification into seven separate ward types. A novel deep learning training strategy was created that combines learning via curriculum and a multi-armed bandit to exploit this curriculum post-initial training. RESULTS: We successfully predict the initial hospital admission location with area-under-receiver-operating-curve (AUROC) ranging between 0.60 to 0.78 for the individual wards and an overall maximum accuracy of 52% where chance corresponds to 14% for this seven-class setting. Our proposed network was able to interpret which features drove the predictions using a 'network saliency' term added to the network loss function. CONCLUSION: We have proven that prediction of location of admission in hospital for emergency patients is possible using information from triage in ED. We have also shown that there are certain tell-tale tests which indicate what space of the hospital a patient will use. SIGNIFICANCE: It is hoped that this predictor will be of value to healthcare institutions by allowing for the planning of resource and bed space ahead of the need for it. This in turn should speed up the provision of care for the patient and allow flow of patients out of the ED thereby improving patient flow and the quality of care for the remaining patients within the ED.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some features used in other studies are not available here, particularly chief complaint and imaging.
“Some features used in other studies18,20 are not available here, particularly chief complaint and imaging.”
From Machine learning for real-time aggregated prediction of hospital admission for emergency patients (2022) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809 · see citing works
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824 · see citing works
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · see citing works
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 5× · see citing works
“network parameters) is more likely to be convex [5].”
BackgroundMethodInfluentialDeep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076 · see citing works
Maesschalck, R. D., Jouan-Rimbaud, D., & Massart, D. L. (2000) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(99)00047-7 · Cited by 2,336 · see citing works
(2002) · doi:10.1137/s0097539701398375 · Cited by 2,275 · see citing works
Saeed, M., Villarroel, M., Reisner, A. T., Clifford, G., Lehman, L.-W., Moody, G., Heldt, T., Kyaw, T. H., Moody, B., & Mark, R. G. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820a92c6 · Cited by 1,162 · see citing works
Samek, W., Wiegand, T., & Müller, K.-R. (2017) · arXiv · doi:10.48550/arxiv.1708.08296 · Cited by 1,080 · see citing works
Multi-Armed Bandit Allocation Indices.
Bather, J. A., & Gittins, J. C. (1990) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982809 · Cited by 1,043 · see citing works
Numerical Continuation Methods--An Introduction.
Watson, L. T., Allgower, E. L., & Georg, K. (1992) · Mathematics of Computation · doi:10.2307/2153001 · Cited by 1,016 · see citing works
Multi‐Armed Bandit Allocation Indices
Gittins, J. C., Glazebrook, K. D., & Weber, R. (2011) · Wiley eBooks · doi:10.1002/9780470980033 · Cited by 695 · see citing works
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 636 · see citing works
Ma, F., Chitta, R., Zhou, J., You, Q., Sun, T., & Gao, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098088 · Cited by 576 · see citing works
Hospital Readmission in General Medicine Patients: A Prediction Model
Hasan, O., Meltzer, D. O., Shaykevich, S., Bell, C. M., Kaboli, P. J., Auerbach, A. D., Wetterneck, T. B., Arora, V. M., Zhang, J., & Schnipper, J. L. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1196-1 · Cited by 399 · see citing works
Teacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 351 · see citing works
Curriculum learning of multiple tasks
Pentina, A., Sharmanska, V., & Lampert, C. H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299188 · Cited by 218 · see citing works
Deep learning for healthcare decision making with EMRs
Liang, Z., Zhang, G., Huang, J. X., & Hu, Q. V. (2014) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2014.6999219 · Cited by 187 · see citing works
Improving emergency department patient flow
Jarvis, P. R. E. (2016) · Clinical and Experimental Emergency Medicine · doi:10.15441/ceem.16.127 · Cited by 137 · see citing works
Use of Advanced Machine-Learning Techniques for Noninvasive Monitoring of Hemorrhage
Convertino, V. A., Moulton, S. L., Grudić, G. Z., et al. (2011) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e3182211601 · Cited by 126 · see citing works
Diagnosing diabetes using neural networks on small mobile devices
Karan, O., Bayraktar, C., Gümüşkaya, H., & Karlık, B. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.06.046 · Cited by 120 · see citing works
Detecting acute cardiac ischemia in the emergency department
McCarthy, B. D., Wong, J. B., & Selker, H. P. (1990) · Journal of General Internal Medicine · doi:10.1007/bf02600409 · Cited by 112 · see citing works
Zhai, H., Brady, P. W., Li, Q., Lingren, T., Ni, Y., Wheeler, D. S., & Solti, I. (2014) · Resuscitation · doi:10.1016/j.resuscitation.2014.04.009 · Cited by 82 · see citing works
Image similarity using Deep CNN and Curriculum LearningPreprint
Appalaraju, S., & Chaoji, V. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.08761 · Cited by 78 · see citing works
Machine learning-based patient specific prompt-gamma dose monitoring in proton therapy
Gueth, P., Dauvergne, D., Freud, N., et al. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/13/4563 · Cited by 61 · see citing works
Use of Calendar and Weather Data to Predict Walk-In Attendance
Diehl, A. K., MORRIS, M. D., & MANNIS, S. A. (1981) · Southern Medical Journal · doi:10.1097/00007611-198106000-00020 · Cited by 61 · see citing works
Patient Flow Prediction via Discriminative Learning of Mutually-Correcting Processes
Xu, H., Wu, W., Nemati, S., & Hongyuan Zha, B. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2618925 · Cited by 57 · see citing works
A Neural-network Approach to Predicting Admission Decisions in a Psychiatric Emergency Room
Somoza, E. C., & Somoza, J. R. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300402 · Cited by 47 · see citing works
Stroke as the First Manifestation of Calcific Aortic Stenosis
Filho, J. O., Massaro, A. R., Yamamoto, F. I., et al. (2000) · Cerebrovascular Diseases · doi:10.1159/000016099 · Cited by 36 · see citing works
Labarère, J., Schüetz, P., Renaud, B., et al. (2012) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2012.01424.x · Cited by 26 · see citing works
A descriptive analysis of Emergency Department overcrowding in a selected hospital in Kigali, Rwanda
Pascasie, K., & Mtshali, G. N. (2014) · African Journal of Emergency Medicine · doi:10.1016/j.afjem.2013.10.001 · Cited by 23 · see citing works
Predicting ICU admission in community-acquired pneumonia: clinical scores and biomarkers
Fernandez, J. F., Sibila, O., & Restrepo, M. I. (2012) · Expert Review of Clinical Pharmacology · doi:10.1586/ecp.12.28 · Cited by 20 · see citing works
Sullivan, C. M., Staib, A. N., Eley, R. M., et al. (2015) · Australian Health Review · doi:10.1071/ah14162 · Cited by 15 · see citing works
Uniting emergency and inpatient clinicians across the ED–inpatient interface: The last frontier?
Staib, A. N., Sullivan, C. M., Prins, J. B., et al. (2017) · Emergency Medicine Australasia · doi:10.1111/1742-6723.12883 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Y. Bengio, J. Louradour, R. Collobert, and J. Weston, "Curriculum learn- ing," in Proc. 26th Annu. Int. Conf. Mach. Learn, 2009, pp. 41-48.
- R. Francis, Report of the Mid Staffordshire NHS Foundation Trust public Inquiry: Executive Summary. vol. 947. The Stationery Office, 2013.
- P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire, "The nonstochas- tic multiarmed bandit problem," SIAM J. Comput., vol. 32, no. 1, pp. 48-77, 2002.
- R. De Maesschalck, D. Jouan-Rimbaud, and D. L. Massart, "The maha- lanobis distance," Chemometrics Intell. Lab. Syst., vol. 50, no. 1, pp. 1-18, 2000.
Cited by
Sorted by citations
Explainable AI for clinical and remote health applications: A survey on tabular and time series data
Di Martino, F., & Delmastro, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10304-3 · Cited by 216 · see citing works
Machine learning for real-time aggregated prediction of hospital admission for emergency patients
King, Z., Farrington, J., Utley, M., Kung, E., Elkhodair, S., Harris, S., Sekula, R., Gillham, J., Li, K., & Crowe, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00649-y · Cited by 87 · see citing works
- Authors
- El-Bouri, R., Eyre, D. W., Watkinson, P., Zhu, T., & Clifton, D. A.
- Affiliations
- University of Oxford (GB)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2021-01
- Volume
- 25
- Issue
- 1
- Pages
- 289-300
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W3028279553
- Cited by
- 30
- References
- 35
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 5 · 2023: 5 · 2022: 5 · 2021: 4 · 2020: 1
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- EPSRC Doctoral Training
- U.K.'s high-priority
- National Institute for Health Research Oxford Biomedical Research Centre
- Royal Academy of Engineering Research Fellowship
- Big Data Institute Robertson Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- emergency department triage, multi-class classification, curriculum learning, multi-armed bandits, explainable deep learning, patient flow, healthcare resource allocation
- MeSH terms
- Emergency Service, Hospital, Hospitalization, Hospitals, Humans, Triage
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
