Development of an American College of Surgeons National Surgery Quality Improvement Program: Morbidity and Mortality Risk Calculator for Colorectal Surgery
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Surgical decision-making and informed patient consent both benefit from having accurate information about risk. But currently available risk estimating systems have one or more limitations associated with lack of specificity to operation type, size of sample (reliability), range of outcomes predicted, and appreciation of hospital effects. STUDY DESIGN: Data from the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) patients who underwent colorectal surgery in 2006 to 2007 were used to generate logistic prediction models for 30-day morbidity, serious morbidity, and mortality. Results for these three models were then used to construct a universal multivariable model to predict risk for all three outcomes. Model performance was externally validated against 2005 data. RESULTS: For 2006 to 2007, 28,863 patients were identified who underwent major colorectal operations at 182 hospitals. A single 15-variable predictor model exhibited discrimination (c-statistic) close to that observed for the separate models on all three outcomes. Similar discrimination was found when the 2006 to 2007 universal model was applied to 3,037 operations conducted in 2005 at 37 hospitals. CONCLUSIONS: The ACS NSQIP colorectal risk calculator allows surgeons to preoperatively provide patients with detailed information about their personal risks of overall morbidity, serious morbidity, and mortality. Because ACS NSQIP can also categorize hospitals as performing better or worse than expected (or as expected), surgeons have the opportunity to adjust risk probabilities for patients at their institutions accordingly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Tufte, E. R., Cohen, J., & Cohen, P. (1979) · Journal of the American Statistical Association · doi:10.2307/2286442 · Cited by 5,180
Kramer, A. A., & Zimmerman, J. E. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000275267.64078.b0 · Cited by 886
The NSQIP: A new frontier in surgery
Khuri, S. F. (2005) · Surgery · doi:10.1016/j.surg.2005.08.016 · Cited by 584
Khuri, S. F., Henderson, W. G., Daley, J., Jonasson, O., Jones, R. S., Campbell, D. A., Fink, A. S., Mentzer, R. M., Neumayer, L., Hammermeister, K., et al. (2008) · Annals of Surgery · doi:10.1097/sla.0b013e3181823485 · Cited by 557
Development of a dedicated risk-adjustment scoring system for colorectal surgery (colorectal POSSUM)
Tekkis, P. P., Prytherch, D. R., Kocher, H. M., Senapati, A., Poloniecki, J. D., Stamatakis, J. D., & Windsor, A. C. J. (2004) · British Journal of Surgery · doi:10.1002/bjs.4430 · Cited by 346
Prioritizing Quality Improvement in General Surgery
Schilling, P. L., Dimick, J. B., & Birkmeyer, J. D. (2008) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2008.06.138 · Cited by 268
Patient-Centered Informed Consent in Surgical Practice
Bernat, J. L. (2006) · Archives of Surgery · doi:10.1001/archsurg.141.1.86 · Cited by 189
Fazio, V. W., Tekkis, P. P., Remzi, F. H., & Lavery, I. C. (2004) · Diseases of the Colon & Rectum · doi:10.1007/s10350-004-0704-y · Cited by 145
Cited by
International guidelines for groin hernia management
The HerniaSurge Group (2018) · Hernia · doi:10.1007/s10029-017-1668-x · Cited by 2,296
Bilimoria, K. Y., Liu, Y., Paruch, J. L., Zhou, L., Kmiecik, T. E., Ko, C. Y., & Cohen, M. E. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.07.385 · Cited by 1,905
Self-citationThe prevalence and outcomes of frailty in older cancer patients: a systematic review
Handforth, C., Clegg, A., Young, C., Simpkins, S., Seymour, M. T., Selby, P. J., & Young, J. (2015) · Annals of Oncology · doi:10.1093/annonc/mdu540 · Cited by 1,048
Development and Validation of a Risk Calculator for Prediction of Cardiac Risk After Surgery
Gupta, P. K., Gupta, H., Sundaram, A., Kaushik, M., Fang, X., Miller, W. J., Esterbrooks, D. J., Hunter, C. B., Pipinos, I. I., Johanning, J. M., et al. (2011) · Circulation · doi:10.1161/circulationaha.110.015701 · Cited by 757
Feldheiser, A., Aziz, O., Baldini, G., Cox, B. P. B. W., Fearon, K. C. H., Feldman, L. S., Gan, T. J., Kennedy, R. H., Ljungqvist, O., Lobo, D. N., et al. (2016) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12651 · Cited by 714
Cohen, M. E., Ko, C. Y., Bilimoria, K. Y., Zhou, L., Huffman, K., Wang, X., Liu, Y., Kraemer, K., Meng, X., Merkow, R., et al. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.02.027 · Cited by 583
Self-citationPractice Parameters for the Management of Rectal Cancer (Revised)
Monson, J. R. T., Weiser, M. R., Buie, W. D., Chang, G. J., Rafferty, J. F., Buie, W. D., Rafferty, J., Guillem, J., Boushey, R., Chang, G., et al. (2013) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0b013e31828cb66c · Cited by 563
Ingraham, A. M., Richards, K. E., Hall, B. L., & Ko, C. Y. (2010) · Advances in Surgery · doi:10.1016/j.yasu.2010.05.003 · Cited by 534
Self-citationGustafsson, U. O., Rockall, T. A., Wexner, S., How, K. Y., Emile, S., Marchuk, A., Fawcett, W. J., Sioson, M., Riedel, B., Chahal, R., et al. (2025) · Surgery · doi:10.1016/j.surg.2025.109397 · Cited by 487
De Hert, S., Staender, S., Fritsch, G., Hinkelbein, J., Afshari, A., Bettelli, G., Bock, M., Chew, M. S., Coburn, M., De Robertis, E., et al. (2018) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000000817 · Cited by 389
You, Y. N., Hardiman, K. M., Bafford, A., Poylin, V., Francone, T. D., Davis, K., Paquette, I. M., Steele, S. R., & Feingold, D. L. (2020) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000001762 · Cited by 354
Promoting perioperative metabolic and nutritional care
Gillis, C., & Carli, F. (2015) · Anesthesiology · doi:10.1097/aln.0000000000000795 · Cited by 350
Preoperative Assessment of the Older Patient: A Narrative Review
Oresanya, L. B., Lyons, W. L., & Finlayson, E. (2014) · JAMA · doi:10.1001/jama.2014.4573 · Cited by 344
Moonesinghe, S. R., Mythen, M. G., Das, P., Rowan, K. M., & Grocott, M. P. W. (2013) · Anesthesiology · doi:10.1097/aln.0b013e3182a4e94d · Cited by 334
Prehabilitation, enhanced recovery after surgery, or both? A narrative review
Gillis, C., Ljungqvist, O., & Carli, F. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.12.007 · Cited by 308
Development and Validation of a Risk Calculator Predicting Postoperative Respiratory Failure
Gupta, H., Gupta, P. K., Fang, X., Miller, W. J., Cemaj, S., Forse, R. A., & Morrow, L. E. (2011) · Chest · doi:10.1378/chest.11-0466 · Cited by 260
Raymond, B. L., Wanderer, J. P., Hawkins, A. T., Geiger, T. M., Ehrenfeld, J. M., Stokes, J. W., & McEvoy, M. D. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003718 · Cited by 60
Merkow, R. P., Hall, B. L., Cohen, M. E., Wang, X., Adams, J. L., Chow, W. B., Lawson, E. H., Bilimoria, K. Y., Richards, K., & Ko, C. Y. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e318273bf17 · Cited by 53
Self-citationLubitz, A. L., Chan, E., Zarif, D., Ross, H., Philp, M., Goldberg, A. J., & Pitt, H. A. (2017) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2017.07.1069 · Cited by 55
Eye of the beholder: risk calculators and barriers to adoption in surgical trainees.
Leeds, I. L., Rosenblum, A. J., Wise, P. E., Watkins, A. C., Goldblatt, M. I., Haut, E. R., Efron, J. E., & Johnston, F. M. (2018) · Surgery · doi:10.1016/j.surg.2018.07.002 · Cited by 42
Hyde, L. Z., Valizadeh, N., Al-Mazrou, A. M., & Kiran, R. P. (2019) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2018.11.017 · Cited by 37
Metadata
- Authors
- Cohen, M. E., Bilimoria, K. Y., Ko, C. Y., & Lee Hall, B.
- Venue
- Journal of the American College of Surgeons
- Published
- 2009-06
- Volume
- 208
- Issue
- 6
- Pages
- 1009-1016
- ISSN
- 1072-7515 (ISSN-L)
- OpenAlex
- W2027221490
- Cited by
- 364
- References
- 17
- FWCI
- 9.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.