The Potential Cost-Effectiveness of a Machine Learning Tool That Can Prevent Untimely Intensive Care Unit Discharge
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
OBJECTIVES The machine learning prediction model Pacmed Critical (PC), currently under development, may guide intensivists in their decision-making process on the most appropriate time to discharge a patient from the intensive care unit (ICU). Given the financial pressure on healthcare budgets, this study assessed whether PC has the potential to be cost-effective compared with standard care, without the use of PC, for Dutch patients in the ICU from a societal perspective. METHODS A 1-year, 7-state Markov model reflecting the ICU care pathway and incorporating the PC decision tool was developed. A hypothetical cohort of 1000 adult Dutch patients admitted in the ICU was entered in the model. We used the literature, expert opinion, and data from Amsterdam University Medical Center for model parameters. The uncertainty surrounding the incremental cost-effectiveness ratio was assessed using deterministic and probabilistic sensitivity analyses and scenario analyses. RESULTS PC was a cost-effective strategy with an incremental cost-effectiveness ratio of €18 507 per quality-adjusted life-year. PC remained cost-effective over standard care in multiple scenarios and sensitivity analyses. The likelihood that PC will be cost-effective was 71% at a willingness-to-pay threshold of €30 000 per quality-adjusted life-year. The key driver of the results was the parameter "reduction in ICU length of stay." CONCLUSIONS We showed that PC has the potential to be cost-effective for Dutch ICUs in a time horizon of 1 year. This study is one of the first cost-effectiveness analyses of a machine learning device. Further research is needed to validate the effectiveness of PC, thereby focusing on the key parameter "reduction in ICU length of stay" and potential spill-over effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Griffiths, J., Hatch, R. A., Bishop, J., Morgan, K., Jenkinson, C., Cuthbertson, B. H., & Brett, S. J. (2013) · Critical Care · doi:10.1186/cc12745 · Cited by 400
Thoral, P. J., Peppink, J. M., Driessen, R. H., Sijbrands, E. J. G., Kompanje, E. J. O., Kaplan, L., Bailey, H., Kesecioglu, J., Cecconi, M., Churpek, M., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004916 · Cited by 257
Self-citationThe future of precision medicine: potential impacts for health technology assessment
Love-Koh, J., Peel, A., Rejon-Parrilla, J. C., Ennis, K., Lovett, R., Manca, A., Chalkidou, A., Wood, H., & Taylor, M. (2018) · PharmacoEconomics · doi:10.1007/s40273-018-0686-6 · Cited by 131
Research works printed but not linked: 34
- Haas, 2015, Trends in hospital and intensive care admissions in The Netherlands attributable to the very elderly in an ageing population, Crit Care, 19, 353, 10.1186/s13054-015-1061-z · DOI
- Wild, 2005, Evaluating and planning ICUs: methods and approaches to differentiate between need and demand, Health Policy, 71, 289, 10.1016/j.healthpol.2003.12.020 · doi:10.1016/j.healthpol.2003.12.020
- Higgins, 2010, Expensive care - a rationale for economic evaluations in intensive care, Crit Care Resusc, 12, 62
- Wong, 2016, Association of severity of illness and intensive care unit readmission: a systematic review, Heart Lung, 45, 3, 10.1016/j.hrtlng.2015.10.040 · DOI
- Rosenberg, 2000, Patients readmitted to ICUs∗: a systematic review of risk factors and outcomes, Chest, 118, 492, 10.1378/chest.118.2.492 · DOI · Paper page
- Thoral, 2018, Right data, right now: developing a big data machine-learning based prediction model to prevent ICU readmission, Intensive Care Med Exp, 6, 40
- Desautels, 2017, Prediction of early unplanned intensive care unit readmission in a UK tertiary care hospital: a cross-sectional machine learning approach, BMJ Open, 7, 10.1136/bmjopen-2017-017199 · DOI · Paper page
- Rojas, 2018, Predicting intensive care unit readmission with machine learning using electronic health record data, Ann Am Thorac Soc, 15, 846, 10.1513/AnnalsATS.201710-787OC · DOI · Paper page
- Lin, 2019, Analysis and prediction of unplanned intensive care unit readmission using recurrent neural networks with long short-term memory, PLoS One, 14, 10.1371/journal.pone.0218942 · DOI · Paper page
- Buisman, 2016, The early bird catches the worm: early cost-effectiveness analysis of new medical tests, Int J Technol Assess Health Care, 32, 46, 10.1017/S0266462316000064 · doi:10.1017/s0266462316000064
- Ijzerman, 2011, Early assessment of medical technologies to inform product development and market access: a review of methods and applications, Appl Health Econ Health Policy, 9, 331, 10.2165/11593380-000000000-00000 · DOI · Paper page
- Vallejo-Torres, 2008, Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach, Int J Technol Assess Health Care, 24, 459, 10.1017/S0266462308080604 · DOI
- Wolff, 2020, The economic impact of artificial intelligence in health care: systematic review, J Med Internet Res, 22, 10.2196/16866 · DOI · Paper page
- Brinkman, 2013, Mortality after hospital discharge in ICU patients, Crit Care Med, 41, 1229, 10.1097/CCM.0b013e31827ca4e1 · DOI · Paper page
- van de Klundert, 2015, Data resource profile: the Dutch National Intensive Care Evaluation (NICE) registry of admissions to adult intensive care units, Int J Epidemiol, 44, 10.1093/ije/dyv291 · DOI
- Wilcox, 2015, Is critical care ready for an economic surrogate endpoint?, Crit Care, 19, 248, 10.1186/s13054-015-0947-0 · DOI
- Dong, 2006, Early assessment of the likely cost-effectiveness of a new technology: a Markov model with probabilistic sensitivity analysis of computer-assisted total knee replacement, Int J Technol Assess Health Care, 22, 191, 10.1017/S0266462306051014 · DOI
- van Beusekom, 2018, Healthcare costs of ICU survivors are higher before and after ICU admission compared to a population based control group: a descriptive study combining healthcare insurance data and data from a Dutch national quality registry, J Crit Care, 44, 345, 10.1016/j.jcrc.2017.12.005 · DOI
- van Beusekom, 2019, Dutch ICU survivors have more consultations with general practitioners before and after ICU admission compared to a matched control group from the general population, PLoS One, 14, 10.1371/journal.pone.0217225 · DOI
- Hill, 2016, Long-term outcomes and healthcare utilization following critical illness -- a population-based study, Crit Care, 20, 76, 10.1186/s13054-016-1248-y · DOI · Paper page
- van Beusekom, 2016, Reported burden on informal caregivers of ICU survivors: a literature review, Crit Care, 20, 16, 10.1186/s13054-016-1185-9 · DOI · Paper page
- Soliman, 2015, Single-center large-cohort study into quality of life in Dutch intensive care unit subgroups, 1 year after admission, using EuroQoL EQ-6D-3L, J Crit Care, 30, 181, 10.1016/j.jcrc.2014.09.009 · DOI
- Hofhuis, 2009, Health-related quality of life in critically ill patients: how to score and what is the clinical impact?, Curr Opin Crit Care, 15, 425
- Vainiola, 2011, Effect of health-related quality-of-life instrument and quality-adjusted life year calculation method on the number of life years gained in the critical care setting, Value Health, 14, 1130, 10.1016/j.jval.2011.05.047 · DOI
- Kaarlola, 2006, Long-term survival, quality of life, and quality-adjusted life-years among critically ill elderly patients, Crit Care Med, 34, 2120, 10.1097/01.CCM.0000227656.31911.2E · DOI · Paper page
- Ferguson, 2013, Integrating mortality and morbidity outcomes: using quality-adjusted life years in critical care trials, Am J Respir Crit Care Med, 187, 256, 10.1164/rccm.201206-1057OC · DOI
- Oeyen, 2010, Quality of life after intensive care: a systematic review of the literature, Crit Care Med, 38, 2386, 10.1097/CCM.0b013e3181f3dec5 · DOI · Paper page
- Lone, 2016, Five-year mortality and hospital costs associated with surviving intensive care, Am J Respir Crit Care Med, 194, 198, 10.1164/rccm.201511-2234OC · DOI · Paper page
- Klok, 2004, Four quadrants of the cost-effectiveness plane: some considerations on the south-west quadrant, Expert Rev Pharmacoecon Outcomes Res, 4, 599, 10.1586/14737167.4.6.599 · DOI
- de Windt, 2017, Early health economic modelling of single-stage cartilage repair. Guiding implementation of technologies in regenerative medicine, J Tissue Eng Regen Med, 11, 2950, 10.1002/term.2197 · DOI
- Gravesteijn, 2019, Cost-effectiveness of extracorporeal cardiopulmonary resuscitation after in-hospital cardiac arrest: a Markov decision model, Resuscitation, 143, 150, 10.1016/j.resuscitation.2019.08.024 · DOI
- Sevick, 2017, Prospective economic evaluation of an electronic discharge communication tool: analysis of a randomised controlled trial, BMJ Open, 7, 10.1136/bmjopen-2017-019139 · DOI
- Talmor, 2006, When is critical care medicine cost-effective? A systematic review of the cost-effectiveness literature, Crit Care Med, 34, 2738, 10.1097/01.CCM.0000241159.18620.AB · DOI
- Sevick, 2017, A systematic review of the cost and cost-effectiveness of electronic discharge communications, BMJ Open, 7, 10.1136/bmjopen-2016-014722 · doi:10.1136/bmjopen-2016-014722
Cited by
Systematic review of cost effectiveness and budget impact of artificial intelligence in healthcare
El Arab, R. A., & Al Moosa, O. A. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01722-y · Cited by 149
Vithlani, J., Hawksworth, C., Elvidge, J., Ayiku, L., & Dawoud, D. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1220950 · Cited by 65
van der Meijden, S. L., de Hond, A. A. H., Thoral, P. J., Steyerberg, E. W., Kant, I. M. J., Cinà, G., & Arbous, M. S. (2023) · JMIR Human Factors · doi:10.2196/39114 · Cited by 39
“Pacmed Critical is a machine learning–based AI-CDS tool that predicts a patient’s combined readmission and mortality risk within 7 days of ICU discharge to support physicians in their decisions to discharge patients to lower care wards [25,26].”
Self-citationFischer, A., Rietveld, A., Teunissen, P., Hoogendoorn, M., & Bakker, P. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076017 · Cited by 26
Metadata
- Authors
- de Vos, J., Visser, L. A., de Beer, A. A., Fornasa, M., Thoral, P. J., Elbers, P. W. G., & Cinà, G.
- Venue
- Value in Health
- Publisher
- Elsevier BV
- Published
- 2022-03
- Volume
- 25
- Issue
- 3
- Pages
- 359-367
- ISSN
- 1098-3015 (ISSN-L)
- OpenAlex
- W3210230840
- Cited by
- 28
- References
- 3
- FWCI
- 3.04
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 365 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Potential Cost-Effectiveness of a Machine Learning Tool That Can Prevent Untimely Intensive Care Unit Discharge. https://app.cochat.ai/papers/10.1016/j.jval.2021.06.018
- The paper
- de Vos, J., Visser, L. A., de Beer, A. A., Fornasa, M., Thoral, P. J., Elbers, P. W. G., & Cinà, G. (2022). The Potential Cost-Effectiveness of a Machine Learning Tool That Can Prevent Untimely Intensive Care Unit Discharge. Value in Health. https://doi.org/10.1016/j.jval.2021.06.018
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.