The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS
Abstract
BACKGROUND: The American edition of The Journal of Bone and Joint Surgery (JBJS-A) has included a level-of-evidence rating for each of its clinical scientific papers published since January 2003. The purpose of this study was to assess the type and level of evidence found in nine different orthopaedic journals by applying this level-of-evidence rating system. METHODS: We reviewed all clinical articles published from January through June 2003 in nine orthopaedic journals. Studies of animals, studies of cadavera, basic-science articles, review articles, case reports, and expert opinions were excluded. The remaining 382 clinical articles were randomly assigned to three experienced reviewers and two inexperienced reviewers, who rated them with the JBJS-A grading system. Each reviewer determined whether the studies were therapeutic, prognostic, diagnostic, or economic, and each rated the level of evidence as I, II, III, or IV. Reviewers were blinded to the grades assigned by the other reviewers. RESULTS: According to the reviewers' ratings, 70.7% of the articles were therapeutic, 19.9% were prognostic, 8.9% were diagnostic, and 0.5% were economic. The reviewers graded 11.3% as Level I, 20.7% as Level II, 9.9% as Level III, and 58.1% as Level IV. The kappa values for the interobserver agreement between the experienced reviewers and the inexperienced reviewers were 0.62 for the level of evidence and 0.76 for the study type. The kappa values for the interobserver agreement between the experienced reviewers were 0.75 for the level of evidence and 0.85 for the study type. The kappa values for the agreement between the reviewers' grades and the JBJS-A grades were 0.84 for the level of evidence and 1.00 for the study type. All kappa values were significantly different from zero (p < 0.0001 for all). The percentage of articles that were rated Level I or II increased in accordance with the 2003 journal impact factors for the individual journals (p = 0.0061). CONCLUSIONS: Orthopaedic journals with a higher impact factor are more likely to publish Level-I or II articles. The type and level of information in orthopaedic journals can be reliably classified, and clinical investigators should pursue studies with a higher level of evidence whenever feasible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Rules of Evidence and Clinical Recommendations on the Use of Antithrombotic Agents
Sackett, D. L. (1989) · Chest · doi:10.1378/chest.95.2_supplement.2s · Cited by 1,368
Journal impact factor: a brief review.
Garfield, E. (1999) · Europe PMC (PubMed Central) · Cited by 755
UNDERSTANDING THE LIMITATIONS OF THE JOURNAL IMPACT FACTOR
KURMIS, A. P. (2003) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200312000-00028 · Cited by 298
THE NATIONAL JOINT REGISTRY FOR ENGLAND AND WALES
Horan, F. (2003) · The Journal of Bone and Joint Surgery. British volume · doi:10.1302/0301-620x.85b1.14063 · Cited by 259
Hecht, F., Hecht, B. K., & Sandberg, A. A. (1998) · Cancer Genetics and Cytogenetics · doi:10.1016/s0165-4608(97)00459-7 · Cited by 206
Impact factor as a misleading tool in evaluation of medical journals
Hansson, S. (1995) · The Lancet · doi:10.1016/s0140-6736(95)92749-2 · Cited by 120
Bhandari, M., Swiontkowski, M. F., Einhorn, T. A., Tornetta, P., Schemitsch, E. H., Leece, P., Sprague, S., & Wright, J. G. (2004) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200408000-00016 · Cited by 100
Self-citationEvidence of Methodologic Bias in the Derivation of the Science Citation Index Impact Factor
Gallagher, E. J., & Barnaby, D. P. (1998) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(98)70286-0 · Cited by 56
Jacsó, P. (2001) · Cortex · doi:10.1016/s0010-9452(08)70602-6 · Cited by 55
Cited by
Complications and re-operations after Bristow-Latarjet shoulder stabilization: a systematic review
Griesser, M. J., Harris, J. D., McCoy, B. W., Hussain, W. M., Jones, M. H., Bishop, J. Y., & Miniaci, A. (2013) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2012.09.009 · Cited by 631
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Harris, J. D., McCormick, F. M., Abrams, G. D., Gupta, A. K., Ellis, T. J., Bach, B. R., Bush-Joseph, C. A., & Nho, S. J. (2013) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2012.11.003 · Cited by 424
Autologous Chondrocyte Implantation: A Systematic Review
Harris, J. D., Siston, R. A., Pan, X., & Flanigan, D. C. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.j.00049 · Cited by 409
Impact factor: outdated artefact or stepping-stone to journal certification?
Vanclay, J. K. (2012) · Scientometrics · doi:10.1007/s11192-011-0561-0 · Cited by 370
Metadata
- Authors
- OBREMSKEY, W. T., PAPPAS, N., ATTALLAH-WASIF, E., TORNETTA, P., & BHANDARI, M.
- Venue
- The Journal of Bone and Joint Surgery-American Volume
- Published
- 2005-12
- Volume
- 87
- Issue
- 12
- Pages
- 2632-2638
- ISSN
- 0021-9355 (ISSN-L)
- OpenAlex
- W2112801688
- Cited by
- 359
- References
- 17
- FWCI
- 7.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS. https://app.cochat.ai/papers/10.2106/00004623-200512000-00006
- The paper
- OBREMSKEY, W. T., PAPPAS, N., ATTALLAH-WASIF, E., TORNETTA, P., & BHANDARI, M. (2005). LEVEL OF EVIDENCE IN ORTHOPAEDIC JOURNALS. The Journal of Bone and Joint Surgery-American Volume. https://doi.org/10.2106/00004623-200512000-00006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.