Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Background: Extubation failure (EF) can lead to an increased chance of ventilator-associated pneumonia, longer hospital stays, and a higher mortality rate. This study aimed to develop and validate an accurate machine-learning model to predict EF in intensive care units (ICUs). Methods: Patients who underwent extubation in the Medical Information Mart for Intensive Care (MIMIC)-IV database were included. EF was defined as the need for ventilatory support (non-invasive ventilation or reintubation) or death within 48 h following extubation. A machine-learning model called Categorical Boosting (CatBoost) was developed based on 89 clinical and laboratory variables. SHapley Additive exPlanations (SHAP) values were calculated to evaluate feature importance and the recursive feature elimination (RFE) algorithm was used to select key features. Hyperparameter optimization was conducted using an automated machine-learning toolkit (Neural Network Intelligence). The final model was trained based on key features and compared with 10 other models. The model was then prospectively validated in patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. In addition, a web-based tool was developed to help clinicians use our model. Results: Of 16,189 patients included in the MIMIC-IV cohort, 2,756 (17.0%) had EF. Nineteen key features were selected using the RFE algorithm, including age, body mass index, stroke, heart rate, respiratory rate, mean arterial pressure, peripheral oxygen saturation, temperature, pH, central venous pressure, tidal volume, positive end-expiratory pressure, mean airway pressure, pressure support ventilation (PSV) level, mechanical ventilation (MV) durations, spontaneous breathing trial success times, urine output, crystalloid amount, and antibiotic types. After hyperparameter optimization, our model had the greatest area under the receiver operating characteristic (AUROC: 0.835) in internal validation. Significant differences in mortality, reintubation rates, and NIV rates were shown between patients with a high predicted risk and those with a low predicted risk. In the prospective validation, the superiority of our model was also observed (AUROC: 0.803). According to the SHAP values, MV duration and PSV level were the most important features for prediction. Conclusions: In conclusion, this study developed and prospectively validated a CatBoost model, which better predicted EF in ICUs than other models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · cited 1×
“The effects of remaining features on prediction scores were then measured using the functions of the SHAP Python package (version 0.32.1), which assessed the importance of each feature using a game-theoretic approach (24).”
MethodInfluentialCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927
Peñuelas, O., Frutos-Vivar, F., Fernández, C., Anzueto, A., Epstein, S. K., Apezteguía, C., González, M., Nin, N., Raymondos, K., Tomicic, V., et al. (2011) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201011-1887oc · Cited by 350 · cited 2×
“10–29% of patients who have met these criteria still experience reintubation (1, 3).”
BackgroundVidotto, M. C., Sogame, L. C. M., Calciolari, C. C., Nascimento, O. A., & Jardim, J. R. (2008) · Neurocritical Care · doi:10.1007/s12028-008-9059-x · Cited by 47
Data Science for Extubation Prediction and Value of Information in Surgical Intensive Care Unit
Tsai, T.-L., Huang, M.-H., Lee, C.-Y., & Lai, W.-W. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8101709 · Cited by 24 · cited 2×
“Although SAPS-II, APACHE-II, and other risk scores showed great importance for prediction in previous studies (16, 17) as well as in our study, we excluded these features for two main reasons.”
Background
Cited by
Moazemi, S., Vahdati, S., Li, J., Kalkhoff, S., Castano, L. J. V., Dewitz, B., Bibo, R., Sabouniaghdam, P., Tootooni, M. S., Bundschuh, R. A., et al. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1109411 · Cited by 97
Wang, H., Zhao, Q.-Y., Luo, J.-C., Liu, K., Yu, S.-J., Ma, J.-F., Luo, M.-H., Hao, G.-W., Su, Y., Zhang, Y.-J., et al. (2022) · BMC Pulmonary Medicine · doi:10.1186/s12890-022-02096-7 · Cited by 32
Self-citationLiu, W., Tao, G., Zhang, Y., Xiao, W., Zhang, J., Liu, Y., Lu, Z., Hua, T., & Yang, M. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.814566 · Cited by 25
“Previous studies have shown that the duration of IMV plays an important role in weaning (19–21).”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Zhao, Q.-Y., Wang, H., Luo, J.-C., Luo, M.-H., Liu, L.-P., Yu, S.-J., Liu, K., Zhang, Y.-J., Sun, P., Tu, G.-W., & Luo, Z.
- Venue
- Frontiers in Medicine
- Publisher
- Frontiers Media SA
- Published
- 2021-05-17
- Volume
- 8
- Pages
- 676343-676343
- ISSN
- 2296-858X (ISSN-L)
- OpenAlex
- W3163248728
- Cited by
- 107
- References
- 7
- FWCI
- 10.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units. https://app.cochat.ai/papers/10.3389/fmed.2021.676343
- The paper
- Zhao, Q.-Y., Wang, H., Luo, J.-C., Luo, M.-H., Liu, L.-P., Yu, S.-J., Liu, K., Zhang, Y.-J., Sun, P., Tu, G.-W., & Luo, Z. (2021). Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units. Frontiers in Medicine. https://doi.org/10.3389/fmed.2021.676343
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.