CoChat

Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic Literature

Gagnier, Joel J., Kellam, Patrick J. · 2013 · Journal of Bone and Joint Surgery
Cited by 112

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Properly designed and conducted systematic reviews can reliably produce valid pooled treatment-effect estimates and are an important resource for clinical decision-making. The purpose of this report was to assess the reporting and methodological quality of systematic reviews in orthopaedic journals. METHODS: With use of the 2010 Institute for Scientific Information (ISI) Thomson Reuters Journal Citation Reports, the five orthopaedic surgery journals with the highest impact factors were searched by one individual over a five-year period (from 2006 to 2010) for systematic reviews and meta-analyses. The two authors separately and independently assessed the included studies. The reporting quality was assessed with use of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, and the methodological quality was assessed with use of the Assessment of Multiple Systematic Reviews (AMSTAR) guidelines, both of which are accepted instruments. We calculated the proportions of each item reported within and across journals. RESULTS: Seventy-six systematic reviews and meta-analyses were included. Of the five journals that were examined, articles from The Journal of Bone and Joint Surgery (American Volume) had the best reporting. Articles from The American Journal of Sports Medicine fulfilled the most methodological quality items. The papers from all of the journals reported an average of only 68% of the PRISMA items and only 54% of the AMSTAR quality items. CONCLUSIONS: Both reporting and methodological quality in the top five orthopaedic journals were poor; the reporting quality was slightly superior to the methodological quality. Although there was a wide range of reporting quality and methodological quality scores across the journals, the included articles demonstrated inadequate adherence to accepted standards of quality. The use of PRISMA and AMSTAR guidelines in designing, implementing, and writing systematic reviews is recommended to improve the quality of systematic reviews and meta-analyses in orthopaedic journals. CLINICAL RELEVANCE: The validity of published systematic reviews in orthopaedics is questionable, and their contribution to clinical decision-making is suboptimal. Clinicians should be careful when interpreting and applying findings of current orthopaedic systematic reviews.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2106/jbjs.l.00597

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Cited by

See all 112

Metadata

Authors
Gagnier, J. J., & Kellam, P. J.
Venue
Journal of Bone and Joint Surgery
Published
2013-06-05
Volume
95
Issue
11
Pages
e77
ISSN
  • 0021-9355 (ISSN-L)
  • 1535-1386
OpenAlex
W2056125428
Cited by
112
References
8
FWCI
2.63
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic Literature. https://app.cochat.ai/papers/10.2106/jbjs.l.00597
The paper
Gagnier, J. J., & Kellam, P. J. (2013). Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic Literature. Journal of Bone and Joint Surgery. https://doi.org/10.2106/jbjs.l.00597

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.