Cited by 89Healthcare Operations and Scheduling OptimizationMachine Learning in HealthcareArtificial Intelligence in Healthcare

Predicting Inpatient Flow at a Major Hospital Using Interpretable Analytics

Open access
Bertsimas, Dimitris, Pauphilet, Jean, Stevens, Jennifer, Tandon, Manu·2022·Manufacturing & Service Operations Management

Published version of a preprint

Abstract

Problem definition: Translate data from electronic health records (EHR) into accurate predictions on patient flows and inform daily decision making at a major hospital. Academic/practical relevance: In a constrained hospital environment, forecasts on patient demand patterns could help match capacity and demand and improve hospital operations. Methodology: We use data from 63,432 admissions at a large academic hospital (50% female, median age 64 years old, median length of stay 3.12 days). We construct an expertise-driven patient representation on top of their EHR data and apply a broad class of machine learning methods to predict several aspects of patient flows. Results: With a unique patient representation, we estimate short-term discharges, identify long-stay patients, predict discharge destination, and anticipate flows in and out of intensive care units with accuracy in the 80%+ range. More importantly, we implement this machine learning pipeline into the EHR system of the hospital and construct prediction-informed dashboards to support daily bed placement decisions. Managerial implications: Our study demonstrates that interpretable machine learning techniques combined with EHR data can be used to provide visibility on patient flows. Our approach provides an alternative to deep learning techniques that is equally accurate, interpretable, frugal in data and computational power, and production ready. History: This paper has been accepted for the Manufacturing & Service Operations Management Special Section on Responsible Research in Operations Management. Funding: The research was funded by Beth Israel Deaconess Medical Center. Supplemental Material: The e-companion is available at https://doi.org/10.1287/msom.2021.0971 .

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1287/msom.2021.0971

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • An accurate forecast of patient stay enhances patient satisfaction, hospital resource allocations, and doctors' ability to make more effective treatment planning.

    “An accurate forecast of patient stay enhances patient satisfaction, hospital resource allocations, and doctors’ ability to make more effective treatment planning42.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 26

  1. Angelo SA, Arruda EF, Goldwasser R, Lobo MS, Salles A, et al. (2017) Demand forecast and optimal planning of intensive care unit (icu) capacity. Pesquisa Operacional 37(2):229-245.
  2. Awad A, Bader-El-Den M, McNicholas J (2017) Patient length of stay and mortality prediction: A survey. Health Services Management Research 30(2):105-120, ISSN 17581044, URL http: //dx.doi.org/10.1177/0951484817696212. · DOI · Paper page
  3. Barnes S, Hamrock E, Toerper M, Siddiqui S, Levin S (2016) Real-time prediction of inpatient length of stay for discharge prioritization. Journal of the American Medical Informatics Asso- ciation 23(e1):e2-e10, ISSN 1527974X, URL http://dx.doi.org/10.1093/jamia/ocv106. · DOI
  4. Bertsimas D, Dunn J (2017) Optimal classification trees. Machine Learning 106(7):1039-1082, ISSN 15730565, URL http://dx.doi.org/10.1007/s10994-017-5633-9. · DOI
  5. Bertsimas D, Pawlowski C, Zhuo YD (2018) From Predictive Methods to Missing Data Imputation : An Optimization Approach. Journal of Machine Learning Research 18:1-39, ISSN 15337928.
  6. Breiman L, et al. (1996) Heuristics of instability and stabilization in model selection. The annals of statistics 24(6):2350-2383.
  7. Friedman JH (2001) Greedy function approximation: A gradient boosting machine. Annals of Statistics ISSN 00905364.
  8. Kim SH, Chan CW, Olivares M, Escobar GJ (2016) Association among icu congestion, icu admission decision, and patient outcomes. Critical care medicine 44(10):1814-1821.
  9. M, Maimon O, Minkov E (2002) Improving stability of decision trees. International Journal of Pattern Recognition and Artificial Intelligence 16(02):145-159.
  10. Long EF, Mathews KS (2018) The boarding patient: Effects of icu and hospital occupancy surges on patient flow. Production and Operations Management 27(12):2122-2143.
  11. Luo L, Xu X, Li J, Shen W (2017) Short-term forecasting of hospital discharge volume based on time series analysis. 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom), 1-6 (IEEE).
  12. Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB (2016) Smart on fhir: a standards- based, interoperable apps platform for electronic health records. Journal of the American Medical Informatics Association 23(5):899-908.
  13. Mathews KS, Durst MS, Vargas-Torres C, Olson AD, Mazumdar M, Richardson LD (2018) Effect of emergency department and icu occupancy on admission decisions and outcomes for critically ill patients. Critical care medicine 46(5):720-727.
  14. McCoy TH, Pellegrini AM, Perlis RH (2018) Assessment of Time-Series Machine Learning Methods for Forecasting Hospital Discharge Volume. JAMA Network Open 1(7):e184087, URL http: //dx.doi.org/10.1001/jamanetworkopen.2018.4087. · DOI
  15. Mirzamomen Z, Kangavari MR (2017) A framework to induce more stable decision trees for pattern classification. Pattern Analysis and Applications 20(4):991-1004.
  16. Nguyen P, Tran T, Wickramasinghe N, Venkatesh S (2016) Deepr: a convolutional net for medical records. IEEE journal of biomedical and health informatics 21(1):22-30.
  17. Quinlan JR (2014) C4. 5: programs for machine learning (Elsevier).
  18. Safavi KC, Khaniyev T, Copenhaver M, Seelen M, Langle ACZ, Zanger J, Daily B, Levi R, Dunn P (2019) Development and validation of a machine learning model to aid discharge processes for inpatient surgical care. JAMA Network Open 2(12):e1917221-e1917221.
  19. Scornet E, Biau G, Vert JP, et al. (2015) Consistency of random forests. The Annals of Statistics 43(4):1716-1741.
  20. Strubell E, Ganesh A, McCallum A (2019) Energy and policy considerations for deep learning in nlp. arXiv preprint arXiv:1906.02243 . · arXiv
  21. Tabak YP, Sun X, Nunez CM, Johannes RS (2014) Using electronic health record data to develop inpatient mortality predictive model: Acute Laboratory Risk of Mortality Score (ALaRMS). Journal of the American Medical Informatics Association 21(3):455-463, ISSN 1067-5027, URL http://dx.doi.org/10.1136/amiajnl-2013-001790. · DOI · Paper page
  22. Tibshirani R (1996) Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58(1):267-288.
  23. Troy PM, Rosenberg L (2009) Using simulation to determine the need for icu beds for surgery patients. Surgery 146(4):608-620.
  24. Van Walraven C, Forster A (2017) The TEND (Tomorrow's Expected Number of Discharges) Model Accurately Predicted the Number of Patients Who Were Discharged from the Hospital the Next Day. Journal of Hospital Medicine 13(3):1-6, URL http://dx.doi.org/10.12788/jhm. 2802. · DOI
  25. Zhu T, Luo L, Zhang X, Shi Y, Shen W (2015) Time-series approaches for forecasting the number of hospital daily discharged inpatients. IEEE journal of biomedical and health informatics 21(2):515-526.
  26. Zimmermann A (2008) Ensemble-trees: Leveraging ensemble power inside decision trees. Interna- tional Conference on Discovery Science, 76-87 (Springer).

Cited by

Sorted by citations

Authors
Bertsimas, D., Pauphilet, J., Stevens, J., & Tandon, M.
Affiliations
  • Massachusetts Institute of Technology (US)
  • London Business School (GB)
  • Beth Israel Deaconess Medical Center (US)
Corresponding author
Pauphilet, Jean
Venue
Manufacturing & Service Operations Management
Published
2022-11
Volume
24
Issue
6
Pages
2809-2824
ISSN
  • 1523-4614 (ISSN-L)
  • 1526-5498
OpenAlex
W3169217830
Cited by
89
References
6
Citations by year
2026: 14 · 2025: 29 · 2024: 20 · 2023: 16 · 2022: 5 · 2021: 4 · 2020: 1
FWCI
13.19
Type
journal article
Language
en
Open access
Locations
  • Manufacturing & Service Operations Management (publishedVersion)
  • medRxiv (acceptedVersion)
  • London Business School Research Online (London Business School) (submittedVersion)
  • DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
Topics
  • Health Sciences › Health Professions › Emergency Medical Services › Healthcare Operations and Scheduling Optimization
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
hospital operations, electronic health records, model interpretability, intensive care unit admission, capacity planning, long-stay patients

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review