CoChat

Risk of bias of randomized controlled trials published in orthopaedic journals

Open access
Chess, Laura E, Gagnier, Joel · 2013 · BMC Medical Research Methodology

The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index.

Abstract

BACKGROUND: The purpose of this study was to assess the quality of methodology in orthopaedics-related randomized controlled trials (RCTs) published from January 2006 to December 2010 in the top orthopaedic journals based on impact scores from the Thompson ISI citation reports (2010). METHODS: Journals included American Journal of Sports Medicine; Journal of Orthopaedic Research; Journal of Bone and Joint Surgery, American; Spine Journal; and Osteoarthritis and Cartilage. Each RCT was assessed on ten criteria (randomization method, allocation sequence concealment, participant blinding, outcome assessor blinding, outcome measurement, interventionist training, withdrawals, intent to treat analyses, clustering, and baseline characteristics) as having empirical evidence for biasing treatment effect estimates when not performed properly. RESULTS: A total of 232 RCTs met our inclusion criteria. The proportion of RCTs in published journals fell from 6% in 2006 to 4% in 2010. Forty-nine percent of the criteria were fulfilled across these journals, with 42% of the criteria not being amendable to assessment due to inadequate reporting. The results of our regression revealed that a more recent publication year was significantly associated with more fulfilled criteria (β = 0.171; CI = -0.00 to 0.342; p = 0.051). CONCLUSION: In summary, very few studies met all ten criteria. Thus, many of these studies likely have biased estimates of treatment effects. In addition, these journals had poor reporting of important methodological aspects.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-2288-13-76

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Trial flow diagram.
Figure 1 Trial flow diagram.CC BY · PubMed Central
Figure 2 Percentage of RCTs Meeting Criteria by Publication Year.
Figure 2 Percentage of RCTs Meeting Criteria by Publication Year.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 46 references

Research works printed but not linked: 1

  1. Juni P, Tallon D, Egger M: Proceedings of the 3rd symposium on systematic reviews: beyond the basics. St. Catherine’s College. “Garbage in – garbage out?” Assessment of the quality of controlled trials in meta-analyses published in leading journals. 2000, Oxford: Centre for Statistics in Medicine, 19-

Cited by

See all 84

Metadata

Authors
Chess, L. E., & Gagnier, J.
Affiliations
  • Wayne State University (US)
  • University of Michigan (US)
Corresponding author
Chess, Laura E
Venue
BMC Medical Research Methodology
Published
2013-06-09
Volume
13
Issue
1
Pages
76-76
ISSN
1471-2288 (ISSN-L)
OpenAlex
W2009249600
Cited by
83
References
48
Citations by year
2026: 2 · 2024: 3 · 2023: 4 · 2022: 8 · 2021: 6 · 2020: 5 · 2019: 12 · 2018: 9 · 2017: 13 · 2016: 6 · 2015: 12 · 2014: 3
FWCI
7.72
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/2.0 (tdm)
Locations
  • BMC Medical Research Methodology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
risk of bias, randomized controlled trials, orthopaedic research, methodological quality, reporting quality, blinding, randomization methods, intention-to-treat analysis, publication year trends, orthopaedic journals
MeSH terms
Female, Humans, Male, Orthopedics, Publishing, Research Design, Bias, Randomized Controlled Trials as Topic, Journal Impact Factor

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Risk of bias of randomized controlled trials published in orthopaedic journals. https://app.cochat.ai/papers/10.1186/1471-2288-13-76
The paper
Chess, L. E., & Gagnier, J. (2013). Risk of bias of randomized controlled trials published in orthopaedic journals. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-13-76

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.