The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS
Abstract
BACKGROUND: The American edition of The Journal of Bone and Joint Surgery (JBJS-A) has included a level-of-evidence rating for each of its clinical scientific papers published since January 2003. The purpose of this study was to assess the type and level of evidence found in nine different orthopaedic journals by applying this level-of-evidence rating system. METHODS: We reviewed all clinical articles published from January through June 2003 in nine orthopaedic journals. Studies of animals, studies of cadavera, basic-science articles, review articles, case reports, and expert opinions were excluded. The remaining 382 clinical articles were randomly assigned to three experienced reviewers and two inexperienced reviewers, who rated them with the JBJS-A grading system. Each reviewer determined whether the studies were therapeutic, prognostic, diagnostic, or economic, and each rated the level of evidence as I, II, III, or IV. Reviewers were blinded to the grades assigned by the other reviewers. RESULTS: According to the reviewers' ratings, 70.7% of the articles were therapeutic, 19.9% were prognostic, 8.9% were diagnostic, and 0.5% were economic. The reviewers graded 11.3% as Level I, 20.7% as Level II, 9.9% as Level III, and 58.1% as Level IV. The kappa values for the interobserver agreement between the experienced reviewers and the inexperienced reviewers were 0.62 for the level of evidence and 0.76 for the study type. The kappa values for the interobserver agreement between the experienced reviewers were 0.75 for the level of evidence and 0.85 for the study type. The kappa values for the agreement between the reviewers' grades and the JBJS-A grades were 0.84 for the level of evidence and 1.00 for the study type. All kappa values were significantly different from zero (p < 0.0001 for all). The percentage of articles that were rated Level I or II increased in accordance with the 2003 journal impact factors for the individual journals (p = 0.0061). CONCLUSIONS: Orthopaedic journals with a higher impact factor are more likely to publish Level-I or II articles. The type and level of information in orthopaedic journals can be reliably classified, and clinical investigators should pursue studies with a higher level of evidence whenever feasible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Cited by
Complications and re-operations after Bristow-Latarjet shoulder stabilization: a systematic review
Griesser, M. J., Harris, J. D., McCoy, B. W., Hussain, W. M., Jones, M. H., Bishop, J. Y., & Miniaci, A. (2013) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2012.09.009 · Cited by 631
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Harris, J. D., McCormick, F. M., Abrams, G. D., Gupta, A. K., Ellis, T. J., Bach, B. R., Bush-Joseph, C. A., & Nho, S. J. (2013) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2012.11.003 · Cited by 424
Impact factor: outdated artefact or stepping-stone to journal certification?
Vanclay, J. K. (2012) · Scientometrics · doi:10.1007/s11192-011-0561-0 · Cited by 370
Harris, J. D., Siston, R. A., Brophy, R. H., Lattermann, C., Carey, J. L., & Flanigan, D. C. (2011) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2011.02.010 · Cited by 284
Metadata
- Authors
- OBREMSKEY, W. T., PAPPAS, N., ATTALLAH-WASIF, E., TORNETTA, P., & BHANDARI, M.
- Venue
- The Journal of Bone and Joint Surgery-American Volume
- Published
- 2005-12
- Volume
- 87
- Issue
- 12
- Pages
- 2632-2638
- ISSN
- 0021-9355 (ISSN-L)
- OpenAlex
- W2112801688
- Cited by
- 359
- References
- 1
- FWCI
- 7.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS. https://app.cochat.ai/papers/10.2106/00004623-200512000-00006
- The paper
- OBREMSKEY, W. T., PAPPAS, N., ATTALLAH-WASIF, E., TORNETTA, P., & BHANDARI, M. (2005). LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS. The Journal of Bone and Joint Surgery-American Volume. https://doi.org/10.2106/00004623-200512000-00006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.