Data Science for Extubation Prediction and Value of Information in Surgical Intensive Care Unit
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Besides the traditional indices such as biochemistry, arterial blood gas, rapid shallow breathing index (RSBI), acute physiology and chronic health evaluation (APACHE) II score, this study suggests a data science framework for extubation prediction in the surgical intensive care unit (SICU) and investigates the value of the information our prediction model provides. A data science framework including variable selection (e.g., multivariate adaptive regression splines, stepwise logistic regression and random forest), prediction models (e.g., support vector machine, boosting logistic regression and backpropagation neural network (BPN)) and decision analysis (e.g., Bayesian method) is proposed to identify the important variables and support the extubation decision. An empirical study of a leading hospital in Taiwan in 2015–2016 is conducted to validate the proposed framework. The results show that APACHE II and white blood cells (WBC) are the two most critical variables, and then the priority sequence is eye opening, heart rate, glucose, sodium and hematocrit. BPN with selected variables shows better prediction performance (sensitivity: 0.830; specificity: 0.890; accuracy 0.860) than that with APACHE II or RSBI. The value of information is further investigated and shows that the expected value of experimentation (EVE), 0.652 days (patient staying in the ICU), is saved when comparing with current clinical experience. Furthermore, the maximal value of information occurs in a failure rate around 7.1% and it reveals the “best applicable condition” of the proposed prediction model. The results validate the decision quality and useful information provided by our predicted model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of Failed Extubation on the Outcome of Mechanical Ventilation
Epstein, S. K., Ciubotaru, R. L., & Wong, J. B. (1997) · Chest · doi:10.1378/chest.112.1.186 · Cited by 892 · cited 1×
“found that patients who need reintubation had significantly increased duration of mechanical ventilation and prolonged ICU stay [7].”
BackgroundAn interpretable machine learning model for accurate prediction of sepsis in the ICU
Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000002936 · Cited by 832 · cited 2×
“More and more machine learning techniques are used in medical care, in particular, ICU [25].”
MethodCorrelation and process in species distribution models: bridging a dichotomy
Dormann, C. F., Schymanski, S. J., Cabral, J., Chuine, I., Graham, C., Hartig, F., Kearney, M., Morin, X., Römermann, C., Schröder, B., et al. (2012) · Journal of Biogeography · doi:10.1111/j.1365-2699.2011.02659.x · Cited by 748
The Decision to Extubate in the Intensive Care Unit
Thille, A. W., Richard, J.-C. M., & Brochard, L. (2013) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201208-1523ci · Cited by 576
Outcomes of extubation failure in medical intensive care unit patients*
Thille, A. W., Harrois, A., Schortgen, F., Brun-Buisson, C., & Brochard, L. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e3182282a5a · Cited by 540 · cited 2×
“Patients who su ff er EF are usually associated with extremely poor outcomes, including high probability of mortality from 25 to 50% [2].”
BackgroundMethodWeaning Patients from the Ventilator
McConville, J. F., & Kress, J. P. (2012) · New England Journal of Medicine · doi:10.1056/nejmra1203367 · Cited by 270
Extubation failure in intensive care unit: Predictors and management
Kulkarni, A. P., & Agarwal, V. (2008) · Indian Journal of Critical Care Medicine · doi:10.4103/0972-5229.40942 · Cited by 159
Kim, S., Kim, W., & Park, R. W. (2011) · Healthcare Informatics Research · doi:10.4258/hir.2011.17.4.232 · Cited by 132
Predicting Extubation Failure After Successful Completion of a Spontaneous Breathing Trial
Mokhlesi, B., Tulaimat, A., Gluckman, T. J., Wang, Y., Evans, A. T., & Corbridge, T. C. (2007) · Respiratory Care · doi:10.4187/respcare.07521710 · Cited by 129 · cited 3×
“Even among patients who meet all weaning criteria and successfully perform a weaning readiness test, 10 to 20% still experience extubation failure (EF) [1].”
BackgroundMethodMining data from intensive care patients
Ramon, J., Daan Fierens, A., Güiza, F., Meyfroidt, G., Blockeel, H., Bruynooghe, M., & den Berghe, G. V. (2007) · Advanced Engineering Informatics · doi:10.1016/j.aei.2006.12.002 · Cited by 98
Predictors of Reintubation in Critically Ill Patients
Miu, T., Joffe, A. M., Yanez, N. D., Khandelwal, N., Dagal, A. H., Deem, S., & Treggiari, M. M. (2014) · Respiratory Care · doi:10.4187/respcare.02527 · Cited by 79 · cited 1×
“[4] listed the criteria for endotracheal extubation such as heart rate, blood pressure, Glasgow coma scale, FiO2, SpO2, PaO2, PaCO2, pH, rapid shallow breathing index (RSBI), tidal volume (VT), respiratory rate (RR), etc.”
BackgroundAn Artificial Neural Network Model for Predicting Successful Extubation in Intensive Care Units
Hsieh, M.-H., Hsieh, M.-J., Chen, C.-M., Hsieh, C.-C., Chao, C.-M., & Lai, C.-C. (2018) · Journal of Clinical Medicine · doi:10.3390/jcm7090240 · Cited by 78
Kuo, H.-J., Chiu, H.-W., Lee, C.-N., Chen, T.-T., Chang, C.-C., & Bien, M.-Y. (2015) · Respiratory Care · doi:10.4187/respcare.03648 · Cited by 72 · cited 5×
“Prediction with the BPN model provides high accuracy, and this result is consistent with previous studies, which reported that the predictive performance of artificial neural networks (ANNs) was better than those of RSBI and maximum expiratory pressure [26] and better than those of RSBI and maximal inspiration pressur…”
ResultInfluentialSelf-citationMutually-exclusive-and-collectively-exhaustive feature selection scheme
Lee, C., & Chen, B.-S. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.04.055 · Cited by 68 · cited 3×
“Finally, we use the variance inflation factor (VIF) to address the collinearity problem potentially resulting in wrong identification of relevant predictors in statistical models [20–22].”
BackgroundMethodSelf-citationPitfalls and protocols of data science in manufacturing practice
Lee, C., & Chien, C.-F. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01711-w · Cited by 65
Self-citationPredictors of Weaning After 6 Weeks of Mechanical Ventilation
Scheinhorn, D. J., Hassenpflug, M. S., Artinian, B. M., LABREE, L. D., & Catlin, J. L. (1995) · CHEST Journal · doi:10.1378/chest.107.2.500 · Cited by 64 · cited 1×
“In previous studies, the factors that a ff ect the EF are APACHE II, RSBI, sex, creatinine, PIMAX, ABG, etc. [3,4,26–28].”
MethodExtubation Readiness in Critically Ill Stroke Patients
Suntrup‐Krueger, S., Schmidt, S., Warnecke, T., Steidl, C., Muhle, P., Schroeder, J. B., Labeit, B., Minnerup, J., & Dziewas, R. (2019) · Stroke · doi:10.1161/strokeaha.118.024643 · Cited by 61 · cited 1×
“…biochemistry, arterial blood gas (ABG), Glasgow coma scale, etc., there are several environmental factors (e.g., family care, time interval of doctor’s review, etc.) and neurological dysfunctions (e.g., dysphagia) [31] which can be considered to improve the extubation decision and patient’s status.”
BackgroundLiu, Y., Wei, L.-Q., Li, G.-Q., Lv, F.-Y., Wang, H., Zhang, Y.-H., & Cao, W.-L. (2010) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e3181f4e82e · Cited by 43 · cited 1×
“They are statistical analysis [8], acute physiologic and chronic health evaluation (APACHE) score and sequential organ failure assessment (SOFA) [2,9–12], machine learning [13–15] and Bayesian decision [16–18].”
MethodPredictors of extubation failure in patients with chronic obstructive pulmonary disease
Robriquet, L., Georges, H., Leroy, O., Devos, P., D'escrivan, T., & Guery, B. P. (2006) · Journal of Critical Care · doi:10.1016/j.jcrc.2005.08.007 · Cited by 40
Can Machine Learning Methods Predict Extubation Outcome in Premature Infants as well as Clinicians?
Jonas S Almeida, M. M. (2013) · Journal of Neonatal Biology · doi:10.4172/2167-0897.1000118 · Cited by 38 · cited 1×
“They are statistical analysis [8], acute physiologic and chronic health evaluation (APACHE) score and sequential organ failure assessment (SOFA) [2,9–12], machine learning [13–15] and Bayesian decision [16–18].”
MethodBayesʼ Theorem and the Physical Examination: Probability Assessment and Diagnostic Decision Making
Herrle, S. R., Corbett, E. C., Fagan, M. J., Moore, C. G., & Elnicki, D. M. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318212eb00 · Cited by 34
Incorporating Uncertainty Into Medical Decision Making: An Approach to Unexpected Test Results
Bianchi, M. T., Alexander, B. M., & Cash, S. S. (2008) · Medical Decision Making · doi:10.1177/0272989x08323620 · Cited by 34 · cited 1×
“They are statistical analysis [8], acute physiologic and chronic health evaluation (APACHE) score and sequential organ failure assessment (SOFA) [2,9–12], machine learning [13–15] and Bayesian decision [16–18].”
MethodLee, C., & Tsai, T.-L. (2018) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2018.07.013 · Cited by 34 · cited 1×
“Thus we apply three methods rather than one and suggest (1) total frequency (TF) of the selected variables by three techniques [23]; (2) 100 times sampling cross-validation for the robustness to identify the important variables.”
MethodSelf-citationAn Overview of the Predictor Standard Tools for Patient Weaning from Mechanical Ventilation
Dehghani, A., Abdeyazdan, G., & Davaridolatabadi, E. (2016) · Electronic physician · doi:10.19082/1955 · Cited by 30 · cited 1×
“They are statistical analysis [8], acute physiologic and chronic health evaluation (APACHE) score and sequential organ failure assessment (SOFA) [2,9–12], machine learning [13–15] and Bayesian decision [16–18].”
MethodEffects of APACHE II score on mechanical ventilation; prediction and outcome.
Matic, I., Titlić, M., Dikanović, M., Jurjević, M., Jukic, I., & Tonkić, A. (2007) · PubMed · Cited by 29
Aggregate demand forecast with small data and robust capacity decision in TFT-LCD manufacturing
Lee, C., & Chiang, M.-C. (2016) · Computers & Industrial Engineering · doi:10.1016/j.cie.2016.02.013 · Cited by 27 · cited 2×
“…analytics to prescriptive analytics [29]; that is, data science not only provides a model for prediction but also enhances the decision-making process in practice by investigating the value of information and decision risk (i.e., days of stay in the ICU) [30]. patient staying in the ICU).”
BackgroundSelf-citationOrtega, R., Connor, C. W., Rodriguez, G., & Spencer, C. (2014) · New England Journal of Medicine · doi:10.1056/nejmvcm1300964 · Cited by 16
Lombardi, F. S., Cotoia, A., Petta, R., Schultz, M. J., Cinnella, G., & Horn, J. (2019) · Minerva Anestesiologica · doi:10.23736/s0375-9393.18.12627-7 · Cited by 16 · cited 1×
“The extubation failure is defined as inability to sustain spontaneous breathing after removal of the artificial device such as an endothracheal or tracheostomy tube, and need for reintubation within a prespecified time window ranging from 24 h to one week [3].”
BackgroundCollinearity detection in linear regression models
Galmacci, G. (1996) · Computational Economics · doi:10.1007/bf00121635 · Cited by 9 · cited 2×
“Finally, we use the variance inflation factor (VIF) to address the collinearity problem potentially resulting in wrong identification of relevant predictors in statistical models [20–22].”
MethodHenriquez, R. R., & Korpi-Steiner, N. L. (2016) · Clinical Chemistry · doi:10.1373/clinchem.2016.260935 · Cited by 8 · cited 1×
“They are statistical analysis [8], acute physiologic and chronic health evaluation (APACHE) score and sequential organ failure assessment (SOFA) [2,9–12], machine learning [13–15] and Bayesian decision [16–18].”
MethodRoyster, R. L., Locke, A. Q., & Weller, R. S. (2014) · New England Journal of Medicine · doi:10.1056/nejmc1401725 · Cited by 4 · cited 2×
“Comparing with successfully extubated patients, the patients who need reintubation are more likely to spend more time in the ICU and the intubated patients should spend one more day to recheck the status before extubation [5].”
BackgroundPitfalls and Protocols in Practice of Manufacturing Data SciencePreprint
Lee, C.-Y., & Chien, C.-F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04025 · Cited by 1 · cited 1×
“…in our data science framework and thus it provides a robust prediction based on comprehensive information. provide a connection from predictive analytics to prescriptive analytics [29]; that is, data science not Finally, the predictive results of BPN are used for Bayesian decision analysis.”
MethodSelf-citation
Cited by
Zhao, Q.-Y., Wang, H., Luo, J.-C., Luo, M.-H., Liu, L.-P., Yu, S.-J., Liu, K., Zhang, Y.-J., Sun, P., Tu, G.-W., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.676343 · Cited by 107
“Although SAPS-II, APACHE-II, and other risk scores showed great importance for prediction in previous studies (16, 17) as well as in our study, we excluded these features for two main reasons.”
BackgroundA Machine Learning decision-making tool for extubation in Intensive Care Unit patients
Fabregat, A., Magret, M., Ferré, J. A., Vernet, A., Guasch, N., Rodríguez, A. H., Gómez, J., & Bodí, M. A. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105869 · Cited by 74
Liu, C., Hung, C.-M., Ko, S.-C., Cheng, K.-C., Chao, C., Sung, M., Hsing, S., Wang, J., Chen, C., Lai, C., et al. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.935366 · Cited by 66
“Therefore, after the recovery of the critical illness, clinicians should immediately prepare to liberate the patients from MV. Evaluation of an ICU patient’s fitness for weaning and subsequent extubation is objectively referred to the airway, respiratory, neurological parameters, etc. (5).”
BackgroundPitfalls and protocols of data science in manufacturing practice
Lee, C., & Chien, C.-F. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01711-w · Cited by 65
“Voting is a common method like ensemble technique because it ranks the variables by the sum of their selected times, using different feature selection techniques (Lee and Tsai 2019).”
MethodSelf-citationPredictors for extubation failure in COVID-19 patients using a machine learning approach
Fleuren, L. M., Dam, T. A., Tonutti, M., de Bruin, D. P., Lalisang, R. C. A., Gommers, D. A. M. P. J., Cremer, O. L., Bosman, R. J., Rigter, S., Wils, E., et al. (2021) · Critical Care · doi:10.1186/s13054-021-03864-3 · Cited by 46
Metadata
- Authors
- Tsai, T.-L., Huang, M.-H., Lee, C.-Y., & Lai, W.-W.
- Affiliations
- National Cheng Kung University (TW)
- National Cheng Kung University Hospital (TW)
- Corresponding author
- Lee, Chia-Yen
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2019-10-17
- Volume
- 8
- Issue
- 10
- Pages
- 1709
- ISSN
- 2077-0383 (ISSN-L)
- PMC
- PMC6833107
- OpenAlex
- W2980625886
- Cited by
- 24
- References
- 31
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 4 · 2022: 2 · 2021: 4 · 2020: 3 · 2019: 2
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Journal of Clinical Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Keywords
- extubation prediction, surgical intensive care unit, value of information, APACHE II score, rapid shallow breathing index, BP neural network, feature selection, Bayesian decision analysis, leukocytes, ICU length of stay, clinical decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


