MySurgeryRisk: development and validation of a machine-learning risk algorithm for major complications and death after surgery.
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Abstract
Objective: To accurately calculate the risk for postoperative complications and death after surgery in the preoperative period using machine-learning modeling of clinical data. Background: Postoperative complications cause a 2-fold increase in the 30-day mortality and cost, and are associated with long-term consequences. The ability to precisely forecast the risk for major complications before surgery is limited. Methods: In a single-center cohort of 51,457 surgical patients undergoing major inpatient surgery, we have developed and validated an automated analytics framework for a preoperative risk algorithm (MySurgeryRisk) that uses existing clinical data in electronic health records to forecast patient-level probabilistic risk scores for 8 major postoperative complications (acute kidney injury, sepsis, venous thromboembolism, intensive care unit admission >48 hours, mechanical ventilation >48 hours, wound, neurologic, and cardiovascular complications) and death up to 24 months after surgery. We used the area under the receiver characteristic curve (AUC) and predictiveness curves to evaluate model performance. Results: MySurgeryRisk calculates probabilistic risk scores for 8 postoperative complications with AUC values ranging between 0.82 and 0.94 [99% confidence intervals (CIs) 0.81–0.94]. The model predicts the risk for death at 1, 3, 6, 12, and 24 months with AUC values ranging between 0.77 and 0.83 (99% CI 0.76–0.85). Conclusions: We constructed an automated predictive analytics framework for machine-learning algorithm with high discriminatory ability for assessing the risk of surgical complications and death using readily available preoperative electronic health records data. The feasibility of this novel algorithm implemented in real time clinical workflow requires further testing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The My Surgery Risk platform uses EHR data for 285 variables to predict 8 postoperative complications with an area under the curve (AUC) of 0.82–0.94 and to predict mortality at 1, 3, 6, 12, and 24 months with an AUC of 0.77–0.83.15”
From Artificial Intelligence and Surgical Decision-making. (2020) · cites this paper as [15]
In the citing paper
“In the perioperative domain, only isolated evaluations of predictive models exist [38], yet none have conducted a direct Head-to-Head comparison with real-world physician judgment.”
From Prediction of Postoperative ICU Requirements: Closing the Translational Gap with a Real-World Clinical Benchmark for Artificial Intelligence Approaches (2025) · cites this paper as [38]
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
Lee, T. H., Marcantonio, E. R., Mangione, C. M., Thomas, E. J., Polanczyk, C. A., Cook, E. F., Sugarbaker, D. J., Donaldson, M. C., Poss, R., Ho, K. K. L., et al. (1999) · Circulation · doi:10.1161/01.cir.100.10.1043 · Cited by 3,771 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
Estimation of the Youden Index and its Associated Cutoff Point
Fluss, R., Faraggi, D., & Reiser, B. (2005) · Biometrical Journal · doi:10.1002/bimj.200410135 · Cited by 2,608
An estimation of the global volume of surgery: a modelling strategy based on available data
Weiser, T. G., Regenbogen, S. E., Thompson, K. D., Haynes, A. B., Lipsitz, S. R., Berry, W. R., & Gawande, A. A. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60878-8 · Cited by 2,511 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
Bilimoria, K. Y., Liu, Y., Paruch, J. L., Zhou, L., Kmiecik, T. E., Ko, C. Y., & Cohen, M. E. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.07.385 · Cited by 1,905 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
POSSUM: A scoring system for surgical audit
Copeland, G. P., Jones, D., & Walters, M. (1991) · Journal of British Surgery · doi:10.1002/bjs.1800780327 · Cited by 1,709 · cited 1×
“All surgeries (N 1⁄4 51,457) 1786 (3) 3422 (7) 4798 (9) 6589 (13) 8759 (17) Cardiothoracic surgery (n 1⁄4 6890) 358 (5) 658 (10) 894 (13) 1143 (17) 1449 (21) Noncardiac general surgery (n 1⁄4 20,756) 703 (3) 1361 (7) 1884 (9) 2652 (13) 3570 (17) General gastrointestinal surgery (n 1⁄4 4151) 108 (3) 233 (6) 343 (8) 503…”
Futier, E., Lefrant, J.-Y., Guinot, P.-G., Godet, T., Lorne, E., Cuvillon, P., Bertran, S., Leone, M., Pastene, B., Piriou, V., et al. (2017) · JAMA · doi:10.1001/jama.2017.14172 · Cited by 917
Cited by
A clinically applicable approach to continuous prediction of future acute kidney injury
Tomašev, N., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Mottram, A., Meyer, C., Ravuri, S., Protsyuk, I., et al. (2019) · Nature · doi:10.1038/s41586-019-1390-1 · Cited by 1,086
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
Artificial Intelligence and Surgical Decision-making.
Loftus, T. J., Tighe, P. J., Filiberto, A. C., Efron, P. A., Brakenridge, S. C., Mohr, A. M., Rashidi, P., Upchurch, G. R., & Bihorac, A. (2020) · JAMA Surgery · doi:10.1001/jamasurg.2019.4917 · Cited by 650
“15 However, this requires technology infrastructure that is not currently available in all clinical settings.”
BackgroundSelf-citationOstermann, M., Bellomo, R., Burdmann, E. A., Doi, K., Endre, Z. H., Goldstein, S. L., Kane-Gill, S. L., Liu, K. D., Prowle, J. R., Shaw, A. D., et al. (2020) · Kidney International · doi:10.1016/j.kint.2020.04.020 · Cited by 564
Self-citationArtificial intelligence in surgery
Varghese, C., Harrison, E. M., O’Grady, G., & Topol, E. J. (2024) · Nature Medicine · doi:10.1038/s41591-024-02970-3 · Cited by 287
“MySurgeryRisk represents one of the few advances in complication prediction, using a machine learning algorithm 50 .”
Metadata
- Authors
- Bihorac, A., Ozrazgat-Baslanti, T., Ebadi, A., Motaei, A., Madkour, M., Pardalos, P. M., Lipori, G., Hogan, W. R., Efron, P. A., Moore, F., Moldawer, L. L., Wang, D. Z., Hobson, C. E., Rashidi, P., Li, X., & Momcilovic, P.
- Affiliations
- University of Florida (US)
- Department of Medicine, College of Medicine, University of Florida, Gainesville, FL
- University of Florida Health (US)
- Department of Industrial and Systems Engineering, College of Engineering, UF
- Corresponding author
- Bihorac, Azra
- Ebadi, Ashkan
- Motaei, Amir
- Madkour, Mohcine
- Hobson, Charles E.
- ORCID
- Venue
- Annals of Surgery
- Published
- 2019-04
- Volume
- 269
- Issue
- 4
- Pages
- 652-662
- ISSN
- 0003-4932 (ISSN-L)
- 1528-1140
- PMC
- PMC6110979
- OpenAlex
- W2793121975
- Cited by
- 377
- References
- 52
- Citations by year
- 2026: 64 · 2025: 54 · 2024: 59 · 2023: 43 · 2022: 54 · 2021: 44 · 2020: 30 · 2019: 21
- FWCI
- 19.48
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Annals of Surgery (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR001427, UL1TR000064)
- National Institute on Aging (P30AG028740)
- National Institute of General Medical Sciences (P50GM111152, R01GM110240)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- preoperative risk prediction, postoperative complications, postoperative mortality, electronic health records, acute kidney injury, sepsis, venous thromboembolism, intensive care unit admission, mechanical ventilation, wound complications, neurological complications, cardiovascular complications
- MeSH terms
- Machine Learning, Algorithms, Humans, Postoperative Complications, Risk Assessment, Preoperative Period
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MySurgeryRisk: development and validation of a machine-learning risk algorithm for major complications and death after surgery. https://app.cochat.ai/papers/10.1097/sla.0000000000002706
- The paper
- Bihorac, A., Ozrazgat-Baslanti, T., Ebadi, A., Motaei, A., Madkour, M., Pardalos, P. M., Lipori, G., Hogan, W. R., Efron, P. A., Moore, F., Moldawer, L. L., Wang, D. Z., Hobson, C. E., Rashidi, P., Li, X., & Momcilovic, P. (2019). MySurgeryRisk: development and validation of a machine-learning risk algorithm for major complications and death after surgery. Annals of Surgery. https://doi.org/10.1097/sla.0000000000002706
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.