Perioperative risk prediction in the era of enhanced recovery: a comparison of POSSUM, ACPGBI, and E-PASS scoring systems in major surgical procedures of the colorectal surgeon.
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
PURPOSE: This study aims to determine whether traditional risk models can accurately predict morbidity and mortality in patients undergoing major surgery by colorectal surgeons within an enhanced recovery program. METHODS: One thousand three hundred eighty patients undergoing surgery performed by colorectal surgeons in a single UK hospital (2008-2013) were included. Six risk models were evaluated: (1) Physiology and Operative Severity Score for the enumeration of Mortality and Morbidity (POSSUM), (2) Portsmouth POSSUM (P-POSSUM), (3) ColoRectal (CR-POSSUM), (4) Elderly POSSUM (E-POSSUM), (5) the Association of Great Britain and Ireland (ACPGBI) score, and (6) modified Estimation of Physiologic Ability and Surgical Stress Score (E-PASS). Model accuracy was assessed by observed to expected (O:E) ratios and area under Receiver Operating Characteristic curve (AUC). RESULTS: Eleven patients (0.8%) died and 143 patients (10.4%) had a major complication within 30 days of surgery. All models overpredicted mortality and had poor discrimination: POSSUM 8.5% (O:E 0.09, AUC 0.56), P-POSSUM 2.2% (O:E 0.37, AUC 0.56), CR-POSSUM 7.1% (O:E 0.11, AUC 0.61), and E-PASS 3.0% (O:E 0.27, AUC 0.46). ACPGBI overestimated mortality in patients undergoing surgery for cancer 4.4% (O:E = 0.28, AUC = 0.41). Predicted morbidity was also overestimated by POSSUM 32.7% (O:E = 0.32, AUC = 0.51). E-POSSUM overestimated mortality (3.25%, O:E 0.57 AUC = 0.54) and morbidity (37.4%, O:E 0.30 AUC = 0.53) in patients aged ≥ 70 years and over. CONCLUSION: All models overestimated mortality and morbidity. New models are required to accurately predict the risk of adverse outcome in patients undergoing major abdominal surgery taking into account the reduced physiological and operative insult of laparoscopic surgery and enhanced recovery care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When the relationships are nonlinear, the scoring system is similar to a coin toss.11”
From Artificial Intelligence and Surgical Decision-making. (2020) · cites this paper as [11]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dindo, D., Demartines, N., & Clavien, P.-A. (2004) · Annals of Surgery · doi:10.1097/01.sla.0000133083.54934.ae · Cited by 31,378
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Nygren, J., Thacker, J., Carli, F., Fearon, K. C. H., Norderval, S., Lobo, D. N., Ljungqvist, O., Soop, M., & Ramirez, J. (2013) · World Journal of Surgery · doi:10.1007/s00268-012-1787-6 · Cited by 2,171
Peduzzi, P., Concato, J., Feinstein, A. R., & Holford, T. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00048-8 · Cited by 2,154 · cited 1×
“Due to the low mortality associated with ERAS, we estimate a minimum dataset of approximately 10,000 patients with 100 deaths (10 deaths per model independent variables) would be required in order to maintain model integrity [22, 23].”
BackgroundPOSSUM: A scoring system for surgical audit
Copeland, G. P., Jones, D., & Walters, M. (1991) · Journal of British Surgery · doi:10.1002/bjs.1800780327 · Cited by 1,709
The Risk of Determining Risk with Multivariable Models
Concato, J., Feinstein, A. R., & Holford, T. R. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-3-199302010-00009 · Cited by 1,115
Gustafsson, U. O., Scott, M. J., Schwenk, W., Demartines, N., Roulin, D., Francis, N., McNaught, C. E., MacFie, J., Liberman, A. S., Soop, M., et al. (2012) · Clinical Nutrition · doi:10.1016/j.clnu.2012.08.013 · Cited by 839
Self-citationLieffers, J. R., Bathe, O. F., Fassbender, K., Winget, M., & Baracos, V. E. (2012) · British Journal of Cancer · doi:10.1038/bjc.2012.350 · Cited by 811
POSSUM and Portsmouth POSSUM for predicting mortality
Prytherch, D. R., Whiteley, M. S., Higgins, B., Weaver, P. C., Prout, W. G., & Powell, S. J. (1998) · Journal of British Surgery · doi:10.1046/j.1365-2168.1998.00840.x · Cited by 792
Surgery for colorectal cancer in elderly patients: a systematic review
Simmonds, P., Best, L., George, S., Baughan, C., Buchanan, R., Davis, C., Fentiman, I., Gosney, M., Northover, J., & Williams, C. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02713-6 · Cited by 600
Cited by
Artificial Intelligence and Surgical Decision-making.
Loftus, T. J., Tighe, P. J., Filiberto, A. C., Efron, P. A., Brakenridge, S. C., Mohr, A. M., Rashidi, P., Upchurch, G. R., & Bihorac, A. (2020) · JAMA Surgery · doi:10.1001/jamasurg.2019.4917 · Cited by 650
“11 To facilitate clinical adoption, prognostic scoring systems have been implemented as online risk calculators.”
MethodIdeal algorithms in healthcare: Explainable, dynamic, precise, autonomous, fair, and reproducible
Loftus, T. J., Tighe, P. J., Ozrazgat-Baslanti, T., Davis, J. P., Ruppert, M. M., Ren, Y., Shickel, B., Kamaleswaran, R., Hogan, W. R., Moorman, J. R., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000006 · Cited by 57
“To perform a complex task, such as differentiating between an anastomotic leak and other pro-inflammatory postoperative complications, it is potentially advantageous to incorporate high-resolution, multimodal patient data and machine learning modeling [35–39].”
Intelligent, Autonomous Machines in Surgery
Loftus, T. J., Filiberto, A. C., Balch, J. A., Ayzengart, A., Tighe, P. J., Rashidi, P., Bihorac, A., & Upchurch, G. R. (2020) · Journal of Surgical Research · doi:10.1016/j.jss.2020.03.046 · Cited by 51
The automaton as a surgeon: the future of artificial intelligence in emergency and general surgery
Rimmer, L. J., Howard, C., Picca, L., & Bashir, M. (2020) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-020-01444-8 · Cited by 36
“In an era of personalisation, precise risks for each individual patient are sought after but difficult to accurately predict [21].”
BackgroundSouwer, E. T. D., Bastiaannet, E., Steyerberg, E. W., Dekker, J. W. T., Steup, W. H., Hamaker, M. E., Sonneveld, D. J. A., Burghgraef, T. A., van den Bos, F., & Portielje, J. E. A. (2021) · Cancers · doi:10.3390/cancers13133110 · Cited by 24
de Nes, L. C. F., Hannink, G., Lam-Boer, J. ‘., Hugen, N., Verhoeven, R. H. A., de Wilt, J. H. W., & Dutch Colorectal Audit Group (2022) · BJS Open · doi:10.1093/bjsopen/zrac014 · Cited by 23
Hu, Z.-W., Xin, R.-Q., Xia, Y., Jia, G.-P., Xiao-xu, C., & Shi, W. (2020) · Clinical Interventions in Aging · doi:10.2147/cia.s258659 · Cited by 16
Mysteries, Epistemological Modesty, and Artificial Intelligence in Surgery
Loftus, T. J., Upchurch, G. R., Delitto, D., Rashidi, P., & Bihorac, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2019.00032 · Cited by 15
“For example, in applying six different regression-based prediction models to 1,380 patients undergoing colorectal surgery, Bagnall et al. (2018) found that all six models performed poorly with area under the receiver operating characteristic curve (AUROC) 0.46–0.61 (Bagnall et al., 2018).”
MethodInfluentialImpact of age on feasibility and short-term outcomes of ERAS after laparoscopic colorectal resection
Pedrazzani, C., Conti, C., Turri, G., Lazzarini, E., Tripepi, M., Scotton, G., Rivelli, M., & Guglielmi, A. (2019) · World Journal of Gastrointestinal Surgery · doi:10.4240/wjgs.v11.i10.395 · Cited by 15
ERAS failure and major complications in elective colon surgery: Common risk factors
Rasilainen, S. K., Tiainen, T., Pakarinen, M., Bumblyte, V., Scheinin, T. M., & Schramko, A. A. (2022) · Surgery in Practice and Science · doi:10.1016/j.sipas.2022.100080 · Cited by 13
Sánchez‐Guillén, L., Frasson, M., Pellino, G., Fornés, V., Ramos, J. L., Lorente, B. F., García‐Granero, Á., Sierra, I. B., Jiménez, L. M., Moya-Martínez, A., et al. (2020) · International Journal of Colorectal Disease · doi:10.1007/s00384-020-03692-x · Cited by 10
“Derived from historical data, the existing perioperative risk prediction scores are not accurate to modern surgical technique and perioperative care and they are being used inappropriately in clinical practice [17].”
BackgroundInfluentialLow value of second-look endoscopy for detecting residual colorectal cancer after endoscopic removal
Gijsbers, K. M., Post, Z., Schrauwen, R. W. M., Tang, T. J., Bisseling, T. M., Bac, D. J., Veenstra, R. P., Schreuder, R.-M., Epping, L. S. M., Cappel, W. H. D. V. T. N., et al. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2020.01.056 · Cited by 8
Bedford, J., Martin, P., Crowe, S., Wagstaff, D., dos Santos, C. R., Singleton, G. F., Baumber, R., Vindrola‐Padros, C., Vohra, R. S., Swart, M., et al. (2022) · Anaesthesia · doi:10.1111/anae.15858 · Cited by 7
“The morbidity risk estimate for POSSUM has not been updated since its first publication in 1991, and now overestimates morbidity in contemporary practice [10, 11].”
BackgroundBlair, W., Ellis, M. A., Fada, M., Wiggins, A. A., Wolfe, R. C., Patel, G. P., Brockhaus, K. K., Droege, M. E., Ebbitt, L. M., Kramer, B. J., et al. (2023) · Healthcare · doi:10.3390/healthcare11233060 · Cited by 11
“…(SSI) with appropriate antibiotics [10–13], venous thromboembolism (VTE) with anticoagulants [14–17], and postoperative nausea and vomiting (PONV) using multi-modal approaches [18–23], among others, coupled with preoperative risk assessments [24–34], has become more prevalent in surgical practice.”
BackgroundMore than 30 Years of POSSUM: Are Scoring Systems Still Relevant Today for Colorectal Surgery?
Bürtin, F., Ludwig, T., Leuchter, M., Hendricks, A., Schafmayer, C., & Philipp, M. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm13010173 · Cited by 10
“A more recent evaluation of the reliability of POSSUM, P-POSSUM, and CR-POSSUM for the prediction of mortality in patients undergoing colorectal surgery in a single UK hospital found an overestimation of mortality by all three scoring systems [34].”
MethodMagouliotis, D. E., Walker, D. A., Baloyiannis, I., Fergadi, M. P., Mamaloudis, I., Chasiotis, G., & Tzovaras, G. (2021) · World Journal of Surgery · doi:10.1007/s00268-021-06006-6 · Cited by 6
“The same study concluded that new models are required based on prospectively collected data [13].”
BackgroundResultВитальевна, Т. Д., Медведев, Д. С., Zaripova, Z. A., & Евгеньевич, Ч. А. (2021) · Russian Medical Inquiry · doi:10.32364/2587-6821-2021-5-3-150-155 · Cited by 6
A Multivariable Prediction Model to Select Colorectal Surgical Patients for Co-Management
Horta, A. B., Geraldes, C., Salgado, C. M., Vieira, S. M., Xavier, M., & Papoila, A. L. (2020) · Acta Médica Portuguesa · doi:10.20344/amp.12996 · Cited by 6
Mathis, G., Lapergola, A., Alexandre, F., Philouze, G., Mutter, D., & D’Urso, A. (2023) · International Journal of Colorectal Disease · doi:10.1007/s00384-023-04565-9 · Cited by 4
“This finding suggests the possibility that the POSSUM score might not be adapted for the population of elderly patients [24], and it might overestimate the mortality risk in emergency settings [25 ].”
BackgroundBeecham, J., Hart, A. R., Alexandre, L., Hernon, J. M., Kumar, B., & Lam, S. (2019) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-019-04300-2 · Cited by 2
Spence, R. T., Guidolin, K., Quereshy, F. A., Chadi, S. A., Chang, D. C., & Hutter, M. M. (2023) · Colorectal Disease · doi:10.1111/codi.16547 · Cited by 3
Pellisé, F., Haddad, S., Núñez-Pereira, S., Yılgör, Ç., Pupak, A., Ramírez, M., Pizones, J., Alanay, A., Obeid, I., Kleinstück, F. S., et al. (2025) · The Spine Journal · doi:10.1016/j.spinee.2025.10.011 · Cited by 3
Inoue, K., Ueno, T., Akishige, N., Soeta, T., Tsuchiya, T., Nakayama, S., Shima, K., Goto, S., Takahashi, M., Naitoh, T., et al. (2019) · International Journal of Surgery Open · doi:10.1016/j.ijso.2019.11.007 · Cited by 1
Paganini, A. M., & Balla, A. (2020) · International Journal of Surgery · doi:10.1016/j.ijsu.2020.04.020
Impact of Artificial Intelligence Integration on Surgical Outcome
Umar, M. (2021) · Journal of the Dow University of Health Sciences · doi:10.36570/jduhs.2021.2.983 · Cited by 1
Transforming surgical decisions: the rise of predictive and personalized digital tools
Eitah, H. E., Kamel, M. S., Alharbi, A. A., Almagharbeh, W. T., Altayar, M. A., & El-Shiekh, R. A. (2026) · Expert Review of Medical Devices · doi:10.1080/17434440.2026.2678899
Metadata
- Authors
- Bagnall, N. M., Pring, E. T., Malietzis, G., Athanasiou, T., Faiz, O. D., Kennedy, R. H., & Jenkins, J. T.
- Affiliations
- Imperial College London (GB)
- St Mark's Hospital (GB)
- Corresponding author
- Pring, Edward T.
- ORCID
- Venue
- International Journal of Colorectal Disease
- Published
- 2018-08-04
- Volume
- 33
- Issue
- 11
- Pages
- 1627-1634
- ISSN
- 0179-1958 (ISSN-L)
- 1432-1262
- PMC
- PMC6208691
- OpenAlex
- W2886045313
- Cited by
- 27
- References
- 29
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 5 · 2022: 4 · 2021: 4 · 2020: 8 · 2019: 4
- FWCI
- 3.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- International Journal of Colorectal Disease (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Imperial College London
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Health Sciences › Medicine › Surgery › Enhanced Recovery After Surgery
- Health Sciences › Medicine › Surgery › Hemodynamic Monitoring and Therapy
- Keywords
- perioperative risk prediction, possums, E-PASS, colorectal surgery, enhanced recovery after surgery, postoperative mortality, postoperative morbidity, risk prediction model, elderly patients, colorectal cancer surgery, CR-POSSUM, observed-to-expected ratio, discrimination (statistics)
- MeSH terms
- Calibration, Colorectal Surgery, Humans, Morbidity, Postoperative Complications, Risk Factors, ROC Curve, Risk Assessment, Perioperative Care, Surgeons
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

