Reliability of a Complication Classification System for Orthopaedic Surgery
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Quality of health care and safety have been emphasized by various professional and governmental groups. However, no standardized method exists for grading and reporting complications in orthopaedic surgery. Conclusions regarding outcomes are incomplete without a standardized, objective complication grading scheme applied concurrently. The general surgery literature has the Clavien-Dindo classification that meets the above criteria. QUESTIONS/PURPOSES: We asked whether a previously reported classification would show high intraobserver and interobserver reliabilities when modified for orthopaedic surgery specifically looking at hip preservation surgery. We therefore determined the interreader and intrareader reliabilities of the adapted classification scheme as applied to hip preservation surgery. METHODS: We adapted the validated Clavien-Dindo complication classification system and tested its reliability for orthopaedic surgery, specifically hip preservation surgery. There are five grades based on the treatment required to manage the complication and the potential for long-term morbidity. Forty-four complication scenarios were created from a prospective multicenter database of hip preservation procedures and from the literature. Ten readers who perform hip surgery at eight centers in three countries graded the scenarios at two different times. Fleiss' and Cohen's κ statistics were performed for interobserver and intraobserver reliabilities, respectively. RESULTS: The overall Fleiss' κ value for interobserver reliability was 0.887 (95% CI, 0.855-0.891). The weighted κ was 0.925 (95% CI, 0.894-0.956) for Grade I, 0.838 (95% CI, 0.807-0.869) for Grade II, 0.87 (95% CI, 0.835-0.866) for Grade III, and 0.898 (95% CI, 0.866-0.929) for Grade IV. The Cohen's κ value for intraobserver reliability was 0.891 (95% CI, 0.857-0.925). CONCLUSIONS: The adapted classification system shows high interobserver and intraobserver reliabilities for grading of complications when applied to orthopaedic surgery looking at complications of hip preservation surgery. This grading scheme may facilitate standardization of complication reporting and make outcome studies more comparable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Dindo, D., Demartines, N., & Clavien, P.-A. (2004) · Annals of Surgery · doi:10.1097/01.sla.0000133083.54934.ae · Cited by 31,378 · cited 8×
“[12], a complication is different from a sequela, which is inherent to the procedure and inevitable (such as scar tissue), or failure to cure, which occurs when the original goal of the surgery has not been met (ie, continued hip pain after arthroscopy).”
BackgroundMethodInfluentialThe Clavien-Dindo Classification of Surgical Complications: Five-Year Experience
Clavien, P. A., Barkun, J., de Oliveira, M. L., Vauthey, J. N., Dindo, D., Schulick, R. D., de Santibañes, E., Pekolj, J., Slankamenac, K., Bassi, C., et al. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e3181b13ca2 · Cited by 11,482
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Proposed classification of complications of surgery with examples of utility in cholecystectomy.
Clavien, P., Sanabria, J. R., & Strasberg, S. M. (1992) · PubMed · Cited by 1,951
Philippon, M. J., Briggs, K. K., Yen, Y.-M., & Kuppersmith, D. A. (2009) · The Journal of Bone and Joint Surgery. British volume · doi:10.1302/0301-620x.91b1.21329 · Cited by 860
Anterior Femoroacetabular Impingement: Part II. Midterm Results of Surgical Treatment
Beck, M., Leunig, M., Parvizi, J., Boutier, V., Wyss, D., & Ganz, R. (2004) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-200401000-00012 · Cited by 849
Self-citationDeOliveira, M. L., Winter, J. M., Schafer, M., Cunningham, S. C., Cameron, J. L., Yeo, C. J., & Clavien, P.-A. (2006) · Annals of Surgery · doi:10.1097/01.sla.0000246856.03918.9a · Cited by 804
Ribero, D., Abdalla, E. K., Madoff, D. C., Donadon, M., Loyer, E. M., & Vauthey, J.-N. (2007) · British Journal of Surgery · doi:10.1002/bjs.5836 · Cited by 510
Treatment of Femoro-Acetabular Impingement: Preliminary Results of Labral Refixation
Espinosa, N., Rothenfluh, D. A., Beck, M., Ganz, R., & Leunig, M. (2006) · The Journal of Bone & Joint Surgery · doi:10.2106/jbjs.e.00290 · Cited by 499
Self-citationThe Concept of Femoroacetabular Impingement: Current Status and Future Perspectives
Leunig, M., Beaulé, P. E., & Ganz, R. (2009) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-008-0646-0 · Cited by 444
Self-citationReddy, S. K., Pawlik, T. M., Zorzi, D., Gleisner, A. L., Ribero, D., Assumpcao, L., Barbas, A. S., Abdalla, E. K., Choti, M. A., Vauthey, J.-N., et al. (2007) · Annals of Surgical Oncology · doi:10.1245/s10434-007-9522-5 · Cited by 423
Anterior femoroacetabular impingement
Laude, F., Boyer, T., & Nogier, A. (2007) · Joint Bone Spine · doi:10.1016/j.jbspin.2007.01.001 · Cited by 380
Espinosa, N., Beck, M., Rothenfluh, D. A., Ganz, R., & Leunig, M. (2007) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.f.01123 · Cited by 300
Self-citationSurgical Treatment of Femoroacetabular Impingement: A Systematic Review of the Literature
Clohisy, J. C., St John, L. C., & Schutz, A. L. (2010) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-009-1138-6 · Cited by 288
Self-citationComplications of 2,775 Urological Laparoscopic Procedures: 1993 to 2005
Permpongkosol, S., Link, R. E., Su, L.-M., Romero, F. R., Bagga, H. S., Pavlovich, C. P., Jarrett, T. W., & Kavoussi, L. R. (2007) · Journal of Urology · doi:10.1016/j.juro.2006.09.031 · Cited by 246
Reddy, S. K., Morse, M. A., Hurwitz, H. I., Bendell, J. C., Gan, T. J., Hill, S. E., & Clary, B. M. (2008) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2007.06.290 · Cited by 172
Chun, Y. S., Vauthey, J., Ribero, D., Donadon, M., Mullen, J. T., Eng, C., Madoff, D. C., Chang, D. Z., Ho, L., Kopetz, S., et al. (2007) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-007-0272-2 · Cited by 160
Peters, C. L., Schabel, K., Anderson, L. A., & Erickson, J. A. (2009) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-009-1152-8 · Cited by 114
Patel, S. A., Cassuto, J. R., Orloff, M. S., Tsoulfas, G., Zand, M. S., Kashyap, R., Jain, A., Bozorgzadeh, A., & Abt, P. L. (2008) · Transplantation · doi:10.1097/tp.0b013e3181643ce8 · Cited by 83
Liver Transplantation: The Last Measure in the Treatment of Bile Duct Injuries
de Santibáñes, E., Ardiles, V., Gadano, A. C., Palavecino, M. E., Pekolj, J., & Ciardullo, M. A. (2008) · World Journal of Surgery · doi:10.1007/s00268-008-9650-5 · Cited by 81
Complication Reporting in Orthopaedic Trials: A Systematic Review of Randomized Controlled Trials
Goldhahn, S., Sawaguchi, T., Audigé, L., Mundi, R., Hanson, B., Bhandari, M., & Goldhahn, J. (2009) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.h.01455 · Cited by 76
Sundaram, C. P., Martin, G. L., Guise, A. I., Bernie, J. E., Bargman, V., Milgrom, M. L., Shalhav, A. L., Govani, M. V., & Goggins, W. C. (2007) · Surgical Endoscopy · doi:10.1007/s00464-006-9176-6 · Cited by 66
Systematic grading of surgical complications in live liver donors according to Clavien's system
Tamura, S., Sugawara, Y., Kaneko, J., Yamashiki, N., Kishi, Y., Matsui, Y., Kokudo, N., & Makuuchi, M. (2006) · Transplant International · doi:10.1111/j.1432-2277.2006.00375.x · Cited by 63
Morbidity and Mortality Following Multivisceral Resections in Complex Hepatic and Pancreatic Surgery
McKay, A. M., Sutherland, F. R., Bathe, O. F., & Dixon, E. (2007) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-007-0273-1 · Cited by 49
Neto, J. S., de Godoy, A. L., Carone, E., Pugliese, V., da Fonseca, E. A., Porta, G., Pugliese, R. P. S., Miura, I. K., Danesi, V. L. B., Kondo, M., et al. (2008) · Transplantation · doi:10.1097/tp.0b013e318183ed22 · Cited by 33
Cited by
The Comprehensive Complication Index: A Novel Continuous Scale to Measure Surgical Morbidity
Slankamenac, K., Graf, R., Barkun, J., Puhan, M. A., & Clavien, P.-A. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e318296c732 · Cited by 1,773
Mitropoulos, D., Artibani, W., Biyani, C. S., Bjerggaard Jensen, J., Rouprêt, M., & Truss, M. (2018) · European Urology Focus · doi:10.1016/j.euf.2017.02.014 · Cited by 349
Rozell, J. C., Courtney, P. M., Dattilo, J. R., Wu, C. H., & Lee, G.-C. (2017) · The Journal of Arthroplasty · doi:10.1016/j.arth.2017.04.002 · Cited by 172
Metadata
- Authors
- Sink, E. L., Leunig, M., Zaltz, I., Gilbert, J. C., & Clohisy, J.
- Venue
- Clinical Orthopaedics & Related Research
- Published
- 2012-08
- Volume
- 470
- Issue
- 8
- Pages
- 2220-2226
- ISSN
- 0009-921X (ISSN-L)
- OpenAlex
- W2001904103
- Cited by
- 362
- References
- 26
- FWCI
- 15.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.