The Quality of Reporting of Orthopaedic Randomized Trials with Use of a Checklist for Nonpharmacological Therapies
The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The Consolidated Standards of Reporting Trials statement for the reporting of randomized controlled trials has been limited by its applicability to surgical trials. In response, a Checklist to Evaluate a Report of a Nonpharmacological Trial was recently developed by the Consolidated Standards of Reporting Trials group to address reporting issues in surgical trials. We aimed (1) to apply the checklist for nonpharmacological therapies to orthopaedic randomized controlled trials across multiple journals from 2004 through 2005, and (2) to survey authors when methodological safeguards itemized in the checklist were not reported to determine whether they actually had been performed. We hypothesized that lack of reporting of a methodological safeguard did not necessarily mean it had not been conducted. METHODS: We searched for relevant orthopaedic randomized controlled trials across eight journals in the period from January 2004 through December 2005. We applied the Checklist to Evaluate a Report of a Nonpharmacological Trial to all eligible studies. We contacted authors to determine what methodological safeguards were actually used, especially when details remained unclear from the publication. RESULTS: We included eighty-seven randomized controlled trials from eighty-five scientific reports. In assessing the randomized controlled trials with the checklist for nonpharmacological therapies, seventy-three studies (84%) had unclear reporting of treatment allocation concealment. Only seventeen studies (20%) mentioned surgeon skill or experience. The blinding of patients, ward staff, rehabilitation staff, clinical outcome assessors, and nonclinical outcome assessors was unclear in forty-eight (55%), sixty-three (72%), sixty-four (74%), forty (46%), and thirty-three studies (38%), respectively. Authors from forty-three randomized controlled trials responded to our survey. The results of the survey showed that 41% (95% confidence interval, 25% to 58%) of the trials had adequate allocation concealment when this had been unclear from the report. Although the surgical experience of the investigators was rarely reported, most authors (70%) acknowledged that they had defined "surgical expertise criteria" such as minimum case criteria, specialized training, and clinical performance. The survey also showed that 28% to 40% of the trials had blinding of relevant groups despite the fact that the reporting of such blinding had been unclear in the publications. CONCLUSIONS: The quality of reporting in the orthopaedic literature was highly variable. Readers should not assume that bias-reducing safeguards that were not reported in a randomized controlled trial did not occur. Our study reinforces the need for the consistent use of a tool like the Checklist to Evaluate a Report of a Nonpharmacological Trial to assess the methodology of surgical trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inadequate reporting is pervasive to almost every area of health research [4-6].”
From Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. (2008) · cites this paper as [5]
Citations
Cites
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027 · cited 2×
“Was the follow-up schedule the same in each group? 1/1 100 (3-100)”
BackgroundPlint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
BOUTRON, I., MOHER, D., TUGWELL, P., GIRAUDEAU, B., POIRAUDEAU, S., NIZARD, R., & RAVAUD, P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.05.004 · Cited by 308
Boutron, I., Tubach, F., Giraudeau, B., & Ravaud, P. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.010 · Cited by 300 · cited 1×
“Was the follow-up schedule the same in each group? 1/1 100 (3-100)”
BackgroundDevereaux, P. J. (2001) · JAMA · doi:10.1001/jama.285.15.2000 · Cited by 258 · cited 1×
“Was the follow-up schedule the same in each group? 1/1 100 (3-100)”
BackgroundBHANDARI, M., RICHARDS, R. R., SPRAGUE, S., & SCHEMITSCH, E. H. (2002) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200203000-00009 · Cited by 243
Self-citationFoley, N. C., Bhogal, S. K., Teasell, R. W., Bureau, Y., & Speechley, M. R. (2006) · Physical Therapy · doi:10.1093/ptj/86.6.817 · Cited by 231
Cited by
CEC’s Standards for Classifying the Evidence Base of Practices in Special Education
Cook, B. G., Buysse, V., Klingner, J., Landrum, T. J., McWilliam, R. A., Tankersley, M., & Test, D. W. (2015) · Remedial and Special Education · doi:10.1177/0741932514557271 · Cited by 361
“In addition, although evidencebased reviewers must evaluate the methodological quality of studies based on the information reported in research reports, researchers often do not fully report all aspects of studies (Chan & Bhandari, 2007; Soares et al., 2004).”
BackgroundThe challenges faced in the design, conduct and analysis of surgical randomised controlled trials
Cook, J. A. (2009) · Trials · doi:10.1186/1745-6215-10-9 · Cited by 351
“However, blinding is not commonly undertaken in surgical trials [59].”
BackgroundMeredick, R. B., Vance, K. J., Appleby, D., & Lubowitz, J. H. (2008) · The American Journal of Sports Medicine · doi:10.1177/0363546508317964 · Cited by 348
“Based on our findings and study limitations, we offer the following recommendations, which could result in the potential for higher quality meta-analyses comparing single-bundle versus double-bundle reconstruction of the ACL in the future: (1) Investigators should become familiar with the Consolidated Standards of Rep…”
MethodStevens, A., Shamseer, L., Weinstein, E., Yazdi, F., Turner, L., Thielman, J., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., et al. (2014) · BMJ · doi:10.1136/bmj.g3804 · Cited by 242
Moher, D., Simera, I., Schulz, K. F., Hoey, J., & Altman, D. G. (2008) · BMC Medicine · doi:10.1186/1741-7015-6-13 · Cited by 153
“Inadequate reporting is pervasive to almost every area of health research [4-6].”
BackgroundAdvances and future directions for management of trauma patients with musculoskeletal injuries
Balogh, Z. J., Reumann, M. K., Gruen, R. L., Mayer‐Kuckuk, P., Schuetz, M., Harris, I. A., Gabbe, B. J., & Bhandari, M. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60991-x · Cited by 164
Self-citationChahal, J., Mall, N. A., MacDonald, P. B., Thiel, G. V., Cole, B. J., Romeo, A. A., & Verma, N. N. (2012) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2011.11.022 · Cited by 127
Kuzyk, P. R. T., Saccone, M., Sprague, S., Simunovic, N., Bhandari, M., & Schemitsch, E. H. (2011) · Journal of Bone and Joint Surgery - British Volume · doi:10.1302/0301-620x.93b5.25908 · Cited by 128
Self-citationAleem, I. S., Aleem, I., Evaniew, N., Busse, J. W., Yaszemski, M., Agarwal, A., Einhorn, T., & Bhandari, M. (2016) · Scientific Reports · doi:10.1038/srep31724 · Cited by 107
Self-citationEsposito, J. G., Schemitsch, E. H., Saccone, M., Sternheim, A., & Kuzyk, P. R. T. (2013) · Injury · doi:10.1016/j.injury.2012.12.003 · Cited by 104
Risk of bias of randomized controlled trials published in orthopaedic journals
Chess, L. E., & Gagnier, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-76 · Cited by 83
“Beyond methodological deficits in these trials some evidence suggests, similar to our findings, that RCTs in orthopaedic surgery fail to report much important information [16,18].”
BackgroundResultStrange, S., Whitehouse, M. R., Beswick, A. D., Tim Board, Burston, A., Burston, B. J., Carroll, F. E., Dieppe, P. A., Garfield, K., Gooberman‐Hill, R., et al. (2016) · Trials · doi:10.1186/s13063-016-1213-8 · Cited by 78
“These include the lack of an a priori sample size calculation, poorly defined inclusion and exclusion criteria, the use of unvalidated outcome measures and lack of detail of the statistical analysis employed [27–30].”
MethodHerman, A., Botser, I. B., Tenenbaum, S., & Chechick, A. (2009) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.h.01481 · Cited by 74
Chahal, J., Marks, P., MacDonald, P. B., Shah, P. S., Theodoropoulos, J. S., Ravi, B., & Whelan, D. B. (2012) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2011.11.012 · Cited by 76
Management of hip fracture: Fig. 1
Fernandez, M. A., Griffin, X. L., & Costa, M. L. (2015) · British Medical Bulletin · doi:10.1093/bmb/ldv036 · Cited by 71
CONSORT Compliance in Surgical Randomized Trials: Are We There Yet? A Systematic Review
Adie, S., Harris, I. A., Naylor, J., & Mittal, R. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e31829664b9 · Cited by 73
Ajrawat, P., Dwyer, T., Whelan, D. B., Theodoropoulos, J. S., Murnaghan, M. L., Bhargava, M., Ogilvie‐Harris, D. J., & Chahal, J. (2019) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0000000000000765 · Cited by 75
Checketts, J. X., Sims, M. T., Detweiler, B., Middlemist, K., Jones, J. M., & Vassar, M. B. (2018) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.17.00529 · Cited by 64
Loss to follow-up in orthopaedic clinical trials: a systematic review
Somerson, J. S., Bartush, K. C., Shroff, J. B., Bhandari, M., & Zelle, B. A. (2016) · International Orthopaedics · doi:10.1007/s00264-016-3212-5 · Cited by 61
“The reporting of loss to follow-up in our systematic review was higher (80 %) than prior studies exploring the methodological quality of orthopaedic RCTs [4, 6].”
BackgroundResultSelf-citationBhandari, M., Sprague, S., & Schemitsch, E. H. (2009) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0b013e3181a772e3 · Cited by 60
“Sample sizes of randomized controlled trials evaluating a surgical procedure have ranged from 18 to 552 participants and the average sample size was 113 participants.(9) In addition, only 32% of trials performed a priori sample size calculation,(9) indicating that these trials are unfortunately likely to be underpower…”
BackgroundSelf-citationA systematic survey of the quality of research reporting in general orthopaedic journals
Parsons, N. R., Hiskens, R., Price, C. L., Achten, J., & Costa, M. L. (2011) · The Journal of Bone and Joint Surgery. British volume · doi:10.1302/0301-620x.93b9.27193 · Cited by 55
Overcoming the Funding Challenge: The Cost of Randomized Controlled Trials in the Next Decade
Shore, B. J., Nasreddine, A. Y., & Kocher, M. S. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.l.00193 · Cited by 49
Wright, J. G., Katz, J. N., & Losina, E. (2011) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.j.00229 · Cited by 44
Outcomes Assessment in Fracture Healing Trials: A Primer
Dr. Bauke Kooistra, O. S., Sprague, S., Bhandari, M., & Schemitsch, E. H. (2010) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0b013e3181ca3fbd · Cited by 49
Self-citationTepass, A., Rolauffs, B., Weise, K., Bahrs, S. D., Dietz, K., & Bahrs, C. (2013) · Patient Safety in Surgery · doi:10.1186/1754-9493-7-34 · Cited by 43
“Regarding study quality, a problem is undoubtedly the low number of cases which were presented in surgical RCT’s as well as indistinct presentations of the used methods [89-91].”
MethodPreliminary Checklist for Reporting Observational Studies in Sports Areas: Content Validity
Moscoso, S. C., Sanduvete‐Chaves, S., Anguera, M. T., Losada, J. L., Portell, M., & Lozano-Lozano, J. A. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00291 · Cited by 49
“…checklists available with the same objective as our proposal, that is, to measure the quality of reporting, although to be applied in other contexts (e.g., in orthopedics, Mundi et al., 2008) and other kinds of designs (e.g., in orthopedics and randomized control trials, Chan and Bhandari, 2007).”
BackgroundChallenges of Randomized Controlled Surgical Trials
Campbell, A. J., Bagley, A. M., Heest, A. E. V., & James, M. A. (2010) · Orthopedic Clinics of North America · doi:10.1016/j.ocl.2009.11.001 · Cited by 41
Quality of reporting in surgical randomized clinical trials
Yu, J., Li, X., Li, Y., & Sun, X. (2016) · British journal of surgery · doi:10.1002/bjs.10331 · Cited by 39
How good is the orthopaedic literature?
Chaudhry, H., Mundi, R., Singh, I., Einhorn, T. A., & Bhandari, M. (2008) · Indian Journal of Orthopaedics · doi:10.4103/0019-5413.40250 · Cited by 33
Self-citationShamseer, L., Stevens, A., Skidmore, B., Turner, L., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., Simera, I., Schulz, K. F., et al. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-24 · Cited by 34
“Reporting of health research is, in general, inadequate [1-6].”
BackgroundPrimary outcome measures used in interventional trials for ankle fractures: a systematic review
McKeown, R., Rabiu, A.-R., Ellard, D. R., & Kearney, R. S. (2019) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-019-2770-2 · Cited by 34
“Chan S, Bhandari M.”
BackgroundWylde, V., Gooberman‐Hill, R., Horwood, J. P., Beswick, A. D., Noble, S., BROOKES, S. T., Smith, A. J., Pyke, M., Dieppe, P. A., & Blom, A. W. (2011) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-12-53 · Cited by 28
“Common problems with the design and reporting of orthopaedic-based RCTs include patients and outcome assessors not being blinded to treatment allocation, use of unvalidated or modified validated outcome measures, no sample size calculation being performed prior to the trial, unclear inclusion and exclusion criteria, a…”
MethodSmith, C., Mollon, B., Vannabouathong, C., Fu, J. M., Sales, B., Bhandari, M., & Whelan, D. B. (2020) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.18.00653 · Cited by 26
Self-citationEvaniew, N., Nuttall, J., Farrokhyar, F., Bhandari, M., & Ghert, M. A. (2013) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-013-3311-1 · Cited by 27
“[1] demonstrated that only 20% of systematic reviews included a quality assessment for included observational studies [2–4, 7, 24].”
BackgroundSelf-citationThe PARITY Investigators (2015) · Bone and Joint Research · doi:10.1302/2046-3758.49.2000482 · Cited by 26
Reporting quality and risk of bias in randomised trials in health professions education
Horsley, T., Galipeau, J., Petkovic, J., Zeiter, J., Hamstra, S. J., & Cook, D. A. (2016) · Medical Education · doi:10.1111/medu.13130 · Cited by 24
When observational studies are as helpful as randomized trials: Examples from orthopedic trauma
Beks, R. B., Bhashyam, A. R., Houwert, R. M., van der Velde, D., van Heijl, M., Smeeing, D. P. J., Hietbrink, F., Leenen, L. P. H., & Groenwold, R. H. H. (2019) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000002347 · Cited by 23
Principles of Evidence-Based Medicine
Panesar, S. S., Philippon, M. J., & Bhandari, M. (2010) · Orthopedic Clinics of North America · doi:10.1016/j.ocl.2009.12.001 · Cited by 23
“Complete reporting of allocation concealment, details of blinding in follow-up, and surgical expertise in trial reports have been uncommon.(11) Although many orthopedic journals (eg, Journal of Bone and Joint Surgery, Clinical Orthopaedics and Related Research, Acta Orthopaedica, Journal of Orthopaedic Trauma, and Ort…”
BackgroundSelf-citationThe Quality of Randomized Controlled Trials in Pediatric Orthopaedics: Are We Improving?
Dodwell, E. R., Dua, S., Dulai, S. K., Astone, K., & Mulpuri, K. (2014) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0000000000000324 · Cited by 23
“Region of body Upper limb 9 (23) 2 (22) Lower limb 12 (30) 5 (42) Spine 13 (33) 4 (31) Other 6 (15) 5 (83) Type of surgery Elective 21 (53) 11 (52)”
Fernandez, M. A., Griffin, X. L., & Costa, M. L. (2015) · The Bone & Joint Journal · doi:10.1302/0301-620x.97b7.35996 · Cited by 22
Diallo, S., Cour, F., Josephson, A., Vidart, A., Botto, H., Lebrét, T., & Bonan, B. (2012) · Urology · doi:10.1016/j.urology.2012.06.021 · Cited by 24
Anderson, J. M., Stafford, A. L., Jellison, S., & Vassar, M. B. (2021) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2020.09.019 · Cited by 26
Randomized Trials in Surgery: How Far Have We Come?
Bederman, S. S., & Wright, J. G. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.k.01627 · Cited by 20
Strategies to improve the credibility of meta-analyses in spine surgery: a systematic survey
Evaniew, N., van der Watt, L., Bhandari, M., Ghert, M. A., Aleem, I. S., Drew, B. M., & Guyatt, G. H. (2015) · The Spine Journal · doi:10.1016/j.spinee.2015.05.018 · Cited by 19
“[80] surveyed the authors of 43 orthopedic surgery RCTs and identified that 28% to 40% of the trials had blinding of relevant groups despite unclear reporting.”
BackgroundSelf-citationClinical Research in Surgery: Threats and Opportunities
Ceelen, W. P. (2014) · European Surgical Research · doi:10.1159/000367606 · Cited by 16
van Oldenrijk, J., van Berkel, Y., Kerkhoffs, G. M. M. J., Bhandari, M., & Poolman, R. W. (2012) · Spine · doi:10.1097/brs.0b013e31827ecb1c · Cited by 16
Self-citationControversial role of arthroscopic meniscectomy of the knee: A review
Ha, A. Y., Shalvoy, R. M., Voisinet, A., Racine, J., & Aaron, R. K. (2016) · World Journal of Orthopedics · doi:10.5312/wjo.v7.i5.287 · Cited by 15
Design considerations for randomised trials in orthopaedic fracture surgery
Simunovic, N., Devereaux, P. J., & Bhandari, M. (2008) · Injury · doi:10.1016/j.injury.2008.02.012 · Cited by 14
“Yet few studies in the orthopaedic literature give any details about surgical expertise.(4) The inherent variability of surgical procedures and surgeon skill requires that the intervention is precisely defined, standardised, and made explicit in the protocol to ensure that it is administered in a consistent and reprod…”
BackgroundSelf-citationAre Large Fracture Trials Possible?
Jeray, K. J., Tanner, S. L., Schemitsch, E. H., & Bhandari, M. (2010) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0b013e3181cec62a · Cited by 12
“The Writing Committee should use this checklist to prepare the manuscript because it will improve the quality and ensure all the pertinent information is reported.(23) Additionally, using this checklist during the study development will help ensure that the methodology used is sound and will yield valid results.”
MethodSelf-citationFixation versus primary replacement of displaced femoral neck fractures in the elderly
Khan, M., Aleem, I. S., & Poolman, R. W. (2010) · Indian Journal of Orthopaedics · doi:10.4103/0019-5413.73658 · Cited by 12
The Methodology of Clinical Studies Used by the FDA for Approval of High-Risk Orthopaedic Devices
Barker, J. P., Simon, S. D., & Dubin, J. R. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.00403 · Cited by 11
A Historical Analysis of Randomized Controlled Trials in Anterior Cruciate Ligament Surgery
Kay, J., Memon, M., de SA, D. L., Simunovic, N., Musahl, V., Fu, F. H., Karlsson, J., & Ayeni, O. R. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.01408 · Cited by 11
Pilot Randomized Trials: Is There a Need?
Jeray, K. J., & Tanner, S. L. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.l.00180 · Cited by 13
Pilot randomized controlled trials in the orthopaedic surgery literature: a systematic review
Desai, B., Desai, V., Shah, S. P., Srinath, A., Saleh, A., Simunovic, N., Duong, A., Sprague, S., & Bhandari, M. (2018) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-018-2337-7 · Cited by 11
Self-citationGandhi, R., Smith, H. N., Mahomed, N. N., Rizek, R., & Bhandari, M. (2010) · The Journal of Arthroplasty · doi:10.1016/j.arth.2010.06.007 · Cited by 9
Self-citationA Preliminary Investigation of the Empirical Validity of Study Quality Appraisal
Cook, B. G., Dupuis, D., & Jitendra, A. K. (2015) · Journal of Learning Disabilities · doi:10.1177/0022219415581178 · Cited by 10
Patient safety in orthopaedics
Panesar, S. S., Shaerf, D. A., Mann, B., & Malik, A. K. (2012) · Journal of Bone and Joint Surgery - British Volume · doi:10.1302/0301-620x.94b12.30217 · Cited by 8
Use and Interpretation of Composite End Points in Orthopaedic Trials
Busse, J. W., Bhandari, M., González, I. F., Montori, V. M., & Guyatt, G. H. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.k.01287 · Cited by 6
Self-citationRevisiting Sample Size: Are Big Trials the Answer?
Buse, G. L., Botto, F. O., & Devereaux, P. J. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.k.01270 · Cited by 6
Cowan, J. B., Mlynarek, R. A., Nelissen, R. G. H. H., Pijls, B. G. C. W., & Gagnier, J. J. (2015) · The Journal of Arthroplasty · doi:10.1016/j.arth.2015.03.020 · Cited by 6
The Risk of Bias in Randomized Trials in General Dentistry Journals
Hinton, S., Beyari, M. M., Madden, K., & Lamfon, H. A. (2015) · Journal of Long-Term Effects of Medical Implants · doi:10.1615/jlongtermeffmedimplants.2015011621 · Cited by 5
Arévalo-Rodríguez, I., Muñoz, É., Buitrago‐García, D., Núñez-González, S., Montero‐Oleas, N., Garzón, J. V., Hernandez, H. P., & Bonfill, X. (2018) · SAGE Open Medicine · doi:10.1177/2050312118801710 · Cited by 6
The importance of the new CONSORT Statement for clinicians
Vaarbakken, K., Ljunggren, A. E., & Hendriks, E. (2008) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(08)70020-5 · Cited by 6
“The standard was developed in response to evidence that RCTs have been reported inadequately over the last three decades (Chan and Bhandari 2007, Dickinson et al 2000, Poolman et al 2006), in spite of educational efforts.”
BackgroundDoes complementary and alternative medicine represent only placebo therapies?
Bland, J. K. S. (2008) · PubMed · Cited by 6
Reporting quality of systematic reviews with moxibustion
Tian, R., Zhang, X., Li, S.-Y., Aixinjueluo, Q.-Y., Lam, W. C., & Bian, Z. (2020) · Chinese Medicine · doi:10.1186/s13020-020-00385-z · Cited by 5
“But inadequate reporting occurs in some eld, such as surgery and traditional medicine etc.[3-5].”
BackgroundCochrane in CORR ®: Surgery for Rotator Cuff Disease (Review)
Khan, M., Simunovic, N., & Provencher, M. T. (2014) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-014-3869-2 · Cited by 5
“The Consolidated Standards of Reporting Trials statement was developed to guide the reporting of randomized controlled trials [12], and modified as the Checklist to Evaluate a Report of a Nonpharmacological Trial to address the unique methodological issues inherent to surgical trials [3] Low-quality reporting has been…”
BackgroundMethodKane, R. L., & Chung, K. C. (2020) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-20-00102 · Cited by 5
Randomized controlled trials in testicular cancer: A demographic and quality assessment
Nayan, M., Jayalath, V. H., Jewett, M. A. S., Bedard, P. L., & Hamilton, R. J. (2015) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2015.09.007 · Cited by 5
Brand, R. A. (2009) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-009-1002-8 · Cited by 4
“The nine commissioners (including Joseph-Ignace Guillotin, who had developed a ‘‘humane’’ method of execution, and Antoine Lavoisier) engaged Benjamin Franklin, who was living at the time as an ambassador of the United States to France, and one of the world’s most famous scientists [ 3 ].”
BackgroundMembers of the damage control study group, Steinhausen, E. S., Bouillon, B., & Rixen, D. (2017) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-017-0891-6 · Cited by 4
Marc, I., Pelland‐Marcotte, M., & Ernst, E. (2010) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207144.2011.522896 · Cited by 4
“The checklist has successfully evaluated reports of surgery and rehabilitation trials (Chan & Bhandari, 2007; Jacquier, Boutron, Moher, Roy, & Ravaud, 2006).”
MethodHashmi, S. Z., Noureldin, M. E., & Khan, S. N. (2014) · Current Reviews in Musculoskeletal Medicine · doi:10.1007/s12178-014-9223-1 · Cited by 3
Getting Published and Having an Impact: Turning Rehabilitation Research Results Into Gold
Brown, M., & Gordon, W. A. (2008) · Cited by 2
Meyer, C. L., Bowers, A., Jaiswal, D. D., Checketts, J. X., Engheta, M., Severns, C., Cook, S., Walters, C. G., & Vassar, M. B. (2019) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2019.03.038 · Cited by 3
“Recent studies have challenged the value of RCTs due to potential flaws in design, implementation, and reporting [13-15].”
BackgroundNetwork meta-analysis: What is its purpose in Orthopaedic literature?
Reddy, A. K., Checketts, J. X., Scott, J., Norris, G. R., & Norris, B. L. (2022) · Injury · doi:10.1016/j.injury.2022.06.025 · Cited by 1
Hollywood's guidance for improving the quality of plastic surgery articles
Freshwater, M. F. (2015) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2014.12.044 · Cited by 1
Introduction to Evidence-Based Medicine
Foote, C. J., Phillips, M., & Bhandari, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-73392-0_1 · Cited by 1
Self-citationDiallo, S., Josephson, A., Cour, F., Vidart, A., Botto, H., Lebrét, T., & Bonan, B. (2013) · European Journal of Hospital Pharmacy · doi:10.1136/ejhpharm-2013-000276.409
Introduction to Evidence-Based Medicine
Foote, C. J., & Bhandari, M. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3511-2_1
Self-citationExperimental design and statistics in orthopaedic research
Hardwick, T., Vaughan, A., Gaskin, J. S. H., & Bendall, S. P. (2017) · Orthopaedics and Trauma · doi:10.1016/j.mporth.2017.07.006
Service médical rendu, évaluation et qualité de vie
Molinier, F., Laffosse, J., Paumier, F., Bensafi, H., & Chaminade, B. (2010) · Elsevier eBooks · doi:10.1016/b978-2-84299-938-4.00034-7
Dunford, B., Bacani, R. C., Anderson, J. M., Checketts, J. X., Scott, J., Torgerson, T., Hartwell, M. L., & Vassar, M. B. (2022) · Journal of the American Osteopathic Academy of Orthopedics · doi:10.70709/3a3zmf8mdd · Cited by 1
Additional file 1 of Reporting quality of systematic reviews with moxibustion
Tian, R., Zhang, X., Li, S.-Y., Aixinjueluo, Q.-Y., Lam, W. C., & Bian, Z.-X. (2020) · Figshare · doi:10.6084/m9.figshare.13023668
Carpenter, L. S., Barakat, N., Temple, J. R., Novicoff, W. M., & Browne, J. A. (2026) · The Journal of Arthroplasty · doi:10.1016/j.arth.2026.01.083
Metadata
- Authors
- Chan, S., & Bhandari, M.
- Affiliations
- Hamilton General Hospital (CA)
- Venue
- The Journal of Bone & Joint Surgery
- Published
- 2007-09
- Volume
- 89
- Issue
- 9
- Pages
- 1970-1978
- ISSN
- 0021-9355 (ISSN-L)
- OpenAlex
- W1973873228
- Cited by
- 85
- References
- 19
- Citations by year
- 2026: 1 · 2022: 2 · 2021: 1 · 2020: 4 · 2019: 4 · 2018: 5 · 2017: 4 · 2016: 6 · 2015: 9 · 2014: 6 · 2013: 6 · 2012: 13
- FWCI
- 7.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Bone and Joint Surgery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- CONSORT statement, non-pharmacological treatment, orthopedic surgery, allocation concealment, blinding, reporting bias, author survey, surgical trials
- MeSH terms
- Authorship, Clinical Competence, Cross-Sectional Studies, Double-Blind Method, Humans, Medical Staff, Patients, Research Design, General Surgery, Bias, Randomized Controlled Trials as Topic, Single-Blind Method, Treatment Outcome, Orthopedic Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.