Prediction of Complications and Prognostication in Perioperative Medicine: A Systematic Review and PROBAST Assessment of Machine Learning Tools
Open accessThe DOI matches its Crossref record; 147 of the 148 references it cites were found in a registry or an index.
Abstract
Background: The utilization of artificial intelligence and machine learning as diagnostic and predictive tools in perioperative medicine holds great promise. Indeed, many studies have been performed in recent years to explore the potential. The purpose of this systematic review is to assess the current state of machine learning in perioperative medicine, its utility in prediction of complications and prognostication, and limitations related to bias and validation. Methods: A multidisciplinary team of clinicians and engineers conducted a systematic review using the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) protocol. Multiple databases were searched, including Scopus, Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane Library, PubMed, Medline, Embase, and Web of Science. The systematic review focused on study design, type of machine learning model used, validation techniques applied, and reported model performance on prediction of complications and prognostication. This review further classified outcomes and machine learning applications using an ad hoc classification system. The Prediction model Risk Of Bias Assessment Tool (PROBAST) was used to assess risk of bias and applicability of the studies. Results: A total of 103 studies were identified. The models reported in the literature were primarily based on single-center validations (75%), with only 13% being externally validated across multiple centers. Most of the mortality models demonstrated a limited ability to discriminate and classify effectively. The PROBAST assessment indicated a high risk of systematic errors in predicted outcomes and artificial intelligence or machine learning applications. Conclusions: The findings indicate that the development of this field is still in its early stages. This systematic review indicates that application of machine learning in perioperative medicine is still at an early stage. While many studies suggest potential utility, several key challenges must be first overcome before their introduction into clinical practice. Editor’s Perspective: What We Already Know about This Topic: What This Article Tells Us That Is New:
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“This observation is consistent with the findings of the meta-analysis by Arina et al. and underscores the importance of establishing a benchmark against clinical expertise [32].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [32]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In their systematic review and meta-analysis, Arina et al. summarized relevant AI models, highlighting three major limitations: the overall modest performance of existing approaches, the challenges of imbalanced datasets, and the lack of a pragmatic clinical benchmark [32].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In their systematic review and meta-analysis, Arina et al. summarized relevant AI models, highlighting three major limitations: the overall modest performance of existing approaches, the challenges of imbalanced datasets, and the lack of a pragmatic clinical benchmark [32].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The absence of widespread adoption of promising data-driven and ML-based approaches can also be attributed to the lack of direct performance comparisons with subjective clinical decision-making [4,[31][32][33][34][35].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In their systematic review and meta-analysis, Arina et al. summarized relevant AI models, highlighting three major limitations: the overall modest performance of existing approaches, the challenges of imbalanced datasets, and the lack of a pragmatic clinical benchmark [32].”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [32]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Ren, W., Li, D., Wang, J., Zhang, J., Fu, Z., & Yao, Y. (2022) · Computational and Mathematical Methods in Medicine · doi:10.1155/2022/8661324 · Cited by 16 · cited 1×
“• Development of postoperative complications: Most studies focused on the prediction of postoperative acute complications 26–28, 44– 49 Three studies developed models to predict the risk of perioperative transfusion in general surgery 80,81 and cardiac surgery.”
RetractedThe PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 3×
“The United States and China, the leading countries in artificial intelligence development, contributed the highest number of publications, followed by South Korea.”
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697 · cited 1×
“138,139 Whereas the use of machine learning in these specialties are primarily used as diagnostic aids, its use in perioperative medicine encompasses a broad range of applications including prognostication, analyzing vital signs for clinical decision support, and predicting complications.”
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 1×
“138,139 Whereas the use of machine learning in these specialties are primarily used as diagnostic aids, its use in perioperative medicine encompasses a broad range of applications including prognostication, analyzing vital signs for clinical decision support, and predicting complications.”
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984 · cited 2×
“Bias was evaluated using the Prediction model Risk Of Bias Assessment Tool (PROBAST), 18 and an ad hoc classification was developed to determine the readiness level of the machine learning algorithms reported.”
Explainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967 · cited 1×
“100 in the surgical intensive care unit 35 or in the hospital.”
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Statistics versus machine learning
Bzdok, D., Altman, N., & Krzywinski, M. (2018) · Nature Methods · doi:10.1038/nmeth.4642 · Cited by 1,508 · cited 1×
“17 We herein report a systematic review that focuses on prognostic artificial intelligence and machine learning models in perioperative medicine, aiming to carefully appraise the literature and identify knowledge gaps.”
Research works printed but not linked: 2
- Tjeertes, 2016, Perioperative complications are associated with adverse long-term prognosis and affect the cause of death after general surgery., World J Surg, 40, 2581, 10.1007/s00268-016-3600-4 · DOI
- Fawcett, 2004, ROC graphs: Notes and practical considerations for researchers., Pattern Recognit Lett, 31, 1
Cited by
Mehta, D., Gonzalez, X. T., Huang, G. T.-W., & Abraham, J. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.08.007 · Cited by 44
“A recent systematic review by Arina and colleagues 15 spe-cifically examined the state of ML tools in predicting complications and prognostication within perioperative medicine.”
InfluentialComprehensive overview of artificial intelligence in surgery: a systematic review and perspectives
Chevalier, O., Dubey, G., Benkabbou, A., Majbar, M. A., & Souadka, A. (2025) · Pflügers Archiv - European Journal of Physiology · doi:10.1007/s00424-025-03076-6 · Cited by 41
Ferrari, D., Arina, P., Edgeworth, J. D., Ćurčin, V., Guidetti, V., Mandreoli, F., & Wang, Y. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000641 · Cited by 25
Self-citationCritelli, B., Hassan, A., Lahooti, I., Noh, L., Park, J. S., Tong, K., Lahooti, A., Matzko, N. E., Adams, J. N., Liß, L., et al. (2025) · PLoS Medicine · doi:10.1371/journal.pmed.1004432 · Cited by 29
“Unfortunately, these shortcomings are like those identified in other fields such as oncology [28] and anesthesiology [73].”
Machine learning and preoperative risk prediction: the machines are coming
Shelley, B., & Shaw, M. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.07.015 · Cited by 23
Metadata
- Authors
- Arina, P., Kaczorek, M. R., Hofmaenner, D. A., Pisciotta, W., Refinetti, P., Singer, M., Mazomenos, E. B., & Whittle, J.
- Affiliations
- University College London (GB)
- Wellcome / EPSRC Centre for Interventional and Surgical Sciences (GB)
- University Hospital Zurich (CH)
- Corresponding author
- Arina, Pietro
- ORCID
- Venue
- Anesthesiology
- Published
- 2023-11-09
- Volume
- 140
- Issue
- 1
- Pages
- 85-101
- ISSN
- 0003-3022 (ISSN-L)
- 1528-1175
- PMC
- PMC11146190
- OpenAlex
- W4388517949
- Cited by
- 81
- References
- 148
- Citations by year
- 2026: 38 · 2025: 28 · 2024: 15
- FWCI
- 4.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Anesthesiology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Wellcome Trust (203145, 223793)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- machine learning, artificial intelligence, perioperative medicine, surgical complications, outcome prediction, mortality prediction, risk of bias, external validation, PROBAST, model discrimination, clinical implementation
- MeSH terms
- Machine Learning, Perioperative Medicine, Artificial Intelligence, Bias, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prediction of Complications and Prognostication in Perioperative Medicine: A Systematic Review and PROBAST Assessment of Machine Learning Tools. https://app.cochat.ai/papers/10.1097/aln.0000000000004764
- The paper
- Arina, P., Kaczorek, M. R., Hofmaenner, D. A., Pisciotta, W., Refinetti, P., Singer, M., Mazomenos, E. B., & Whittle, J. (2024). Prediction of Complications and Prognostication in Perioperative Medicine: A Systematic Review and PROBAST Assessment of Machine Learning Tools. Anesthesiology. https://doi.org/10.1097/aln.0000000000004764
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.