The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Utilizing Machine Learning Methods for Preoperative Prediction of Postsurgical Mortality and Intensive Care Unit Admission
Open accessAbstract
Objective: To compare the performance of machine learning models against the traditionally derived Combined Assessment of Risk Encountered in Surgery (CARES) model and the American Society of Anaesthesiologists-Physical Status (ASA-PS) in the prediction of 30-day postsurgical mortality and need for intensive care unit (ICU) stay >24 hours. Background: Prediction of surgical risk preoperatively is important for clinical shared decision-making and planning of health resources such as ICU beds. The current growth of electronic medical records coupled with machine learning presents an opportunity to improve the performance of established risk models. Methods: All patients aged 18 years and above who underwent noncardiac and nonneurological surgery at Singapore General Hospital (SGH) between 1 January 2012 and 31 October 2016 were included. Patient demographics, comorbidities, preoperative laboratory results, and surgery details were obtained from their electronic medical records. Seventy percent of the observations were randomly selected for training, leaving 30% for testing. Baseline models were CARES and ASA-PS. Candidate models were trained using random forest, adaptive boosting, gradient boosting, and support vector machine. Models were evaluated on area under the receiver operating characteristic curve (AUROC) and area under the precision-recall curve (AUPRC). Results: A total of 90,785 patients were included, of whom 539 (0.6%) died within 30 days and 1264 (1.4%) required ICU admission >24 hours postoperatively. Baseline models achieved high AUROCs despite poor sensitivities by predicting all negative in a predominantly negative dataset. Gradient boosting was the best performing model with AUPRCs of 0.23 and 0.38 for mortality and ICU admission outcomes respectively. Conclusions: Machine learning can be used to improve surgical risk prediction compared to traditional risk calculators. AUPRC should be used to evaluate model predictive performance instead of AUROC when the dataset is imbalanced.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Furthermore, current ML models only predict the need for ICU admission-corresponding to Level 3 in our methodology [4].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [4]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Using ten preoperative parameters, Chiew et al. trained multiple ML models that demonstrated superior sensitivity and, to a lesser extent, specificity compared to the physician-based predictions reported in the present study [4].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, sensitivity for identifying patients requiring postoperative intensive care was markedly lower than reported for ML models in the literature, with the largest discrepancies observed in patients ultimately admitted to the ICU (surgery: 38.05%; anesthesiology: 56.84%; ML: 70%).”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For preoperative ICU prediction, the authors identified the study by Chiew et al. as particularly impactful, as it demonstrated a procedure-independent approach relying solely on preoperatively available information [4].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nevertheless, clinical judgment demonstrated a superior F 1 -score, indicating a more balanced performance between sensitivity and precision (surgery: 0.527; anesthesiology: 0.551; ML: 0.28).”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [4]
Experimental — accuracy not yet measured
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 1×
“6 (Python Software Foundation, Wilmington, DE) using the scikit-learn library.(19)”
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309 · cited 1×
“We also used F1 score and AUPRC as our main evaluation 18 binary classifiers, they can be misleading and deceptive with respect to conclusions about classifier performance in the context of imbalanced datasets, as evidenced by our results.”
MethodLee, T. H., Marcantonio, E. R., Mangione, C. M., Thomas, E. J., Polanczyk, C. A., Cook, E. F., Sugarbaker, D. J., Donaldson, M. C., Poss, R., Ho, K. K. L., et al. (1999) · Circulation · doi:10.1161/01.cir.100.10.1043 · Cited by 3,771 · cited 1×
“Comorbidities were as per the Revised Cardiac Risk Index ( ), 14 which consists cerebrovascular accident, ischemic heart disease, congestive failure, diabetes mellitus (DM) on insulin and chronic kidney (CKD), as well as the ASA-PS class.”
MethodMacLeod, A. M. (2009) · Kidney International · Cited by 2,218
POSSUM: A scoring system for surgical audit
Copeland, G. P., Jones, D., & Walters, M. (1991) · Journal of British Surgery · doi:10.1002/bjs.1800780327 · Cited by 1,709 · cited 1×
“…of Mortality and Morbidity (POSSUM), Surgical Outcome Risk Tool (SORT), and American College of Surgeons National Surgical Quality Improvement Program , 6 (POSSUM), 7,8 lack of validation outside the derived population’s region ( , ACS-NSQIP) and complexity of the model itself (ACS-NSQIP).”
Background(2014) · European Heart Journal · doi:10.1093/eurheartj/ehu282 · Cited by 1,656
Mortality after surgery in Europe: a 7 day cohort study
Pearse, R. M., Moreno, R. P., Bauer, P., Pelosi, P., Metnitz, P., Spies, C., Vallet, B., Vincent, J.-L., Hoeft, A., & Rhodes, A. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61148-9 · Cited by 1,355
Eckardt, K.-U., & Kasiske, B. L. (2009) · Kidney International · doi:10.1038/ki.2009.188 · Cited by 1,167
Estimate of the global volume of surgery in 2012: an assessment supporting improved health outcomes
Weiser, T. G., Haynes, A. B., Molina, G., Lipsitz, S. R., Esquivel, M. M., Uribe-Leitz, T., Fu, R., Azad, T., Chao, T. E., Berry, W. R., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60806-6 · Cited by 956 · cited 1×
“Annals of Surgery Volume 272, Number 6, December 2020 A bout 250 million surgeries are performed worldwide each year, and this number is increasing rapidly.(1) As access to surgery improves, the number of patients with postoperative complications will also increase.”
BackgroundComplications, Failure to Rescue, and Mortality With Major Inpatient Surgery in Medicare Patients
Ghaferi, A. A., Birkmeyer, J. D., & Dimick, J. B. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e3181bef697 · Cited by 807 · cited 1×
“This could improve patient outcomes by reducing failure to rescue events 22 and efficiency in allocation of valuable ICU resources .”
Background
Cited by
Artificial intelligence in surgery
Varghese, C., Harrison, E. M., O’Grady, G., & Topol, E. J. (2024) · Nature Medicine · doi:10.1038/s41591-024-02970-3 · Cited by 287
“Numerous other machine learning risk scores exist for preoperative prediction of postoperative morbidity and mortality 45,47–51 .”
Artificial intelligence surgery: how do we get to autonomous actions in surgery?
Gumbs, A. A., Frigerio, I., Spolverato, G., Croner, R., Illanes, A., Chouillard, E., & Elyan, E. (2021) · Sensors · doi:10.3390/s21165526 · Cited by 161
“The following studies built different ML models predicting postoperative outcomes that proved to perform better than traditional risk calculators [11,12].”
ResultYang, C. B., Fridgeirsson, E. A., Kors, J. A., Reps, J., & Rijnbeek, P. R. (2024) · Journal Of Big Data · doi:10.1186/s40537-023-00857-7 · Cited by 145
“For example, several recently published papers on clinical prediction modelling applied random sampling to balance the data used for model development without assessing calibration [23–25].”
BackgroundMachine learning in perioperative medicine: a systematic review
Bellini, V., Valente, M., Bertorelli, G., Pifferi, B., Craca, M., Mordonini, M., Lombardo, G., Bottani, E., Delrio, P., & Bignami, E. (2022) · Journal of Anesthesia Analgesia and Critical Care · doi:10.1186/s44158-022-00033-y · Cited by 102
“Chiew CJ, 2020 [40] Retrospective/ observational single center Compare the performance of ML models against the traditionally (CARES) model and (ASA-PS) in the prediction of 30-day postsurgical mortality and ICU admission 90,785 Mortality, postoperative ICU admission RF, GB, adaptive boosting, SVM Best GB AUC 0.”
MethodArtificial Intelligence–enabled Decision Support in Surgery: State-of-the-art and Future Directions
Loftus, T. J., Altieri, M. S., Balch, J. A., Abbott, K. L., Choi, J., Marwaha, J. S., Hashimoto, D. A., Brat, G. A., Raftopoulos, Y., Evans, H. L., et al. (2023) · Annals of Surgery · doi:10.1097/sla.0000000000005853 · Cited by 105
Metadata
- Authors
- Chiew, C. J., Liu, N., Wong, T. H., Sim, Y. E., & Abdullah, H. R.
- Affiliations
- Singapore General Hospital (SG)
- SingHealth (SG)
- Corresponding author
- Chiew, Calvin J.
- Wong, Ting Hway
- Venue
- Annals of Surgery
- Published
- 2019-04-08
- Volume
- 272
- Issue
- 6
- Pages
- 1133-1139
- ISSN
- 0003-4932 (ISSN-L)
- 1528-1140
- PMC
- PMC7668340
- OpenAlex
- W2938932803
- Cited by
- 151
- References
- 27
- Citations by year
- 2026: 14 · 2025: 23 · 2024: 28 · 2023: 26 · 2022: 25 · 2021: 20 · 2020: 11 · 2019: 4
- FWCI
- 10.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Annals of Surgery (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- surgical risk prediction, intensive care unit admission, machine learning, gradient boosting, random forest, support vector machine, adaptive boosting, class imbalance, precision-recall curve, non-cardiac surgery, preoperative risk assessment
- MeSH terms
- Machine Learning, Adult, Aged, Female, Hospitalization, Humans, Intensive Care Units, Male, Middle Aged, Postoperative Complications, Prognosis, Retrospective Studies, Time Factors, Risk Assessment, Preoperative Period
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Utilizing Machine Learning Methods for Preoperative Prediction of Postsurgical Mortality and Intensive Care Unit Admission. https://app.cochat.ai/papers/10.1097/sla.0000000000003297
- The paper
- Chiew, C. J., Liu, N., Wong, T. H., Sim, Y. E., & Abdullah, H. R. (2020). Utilizing Machine Learning Methods for Preoperative Prediction of Postsurgical Mortality and Intensive Care Unit Admission. Annals of Surgery. https://doi.org/10.1097/sla.0000000000003297
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.