A systematic survey of the quality of research reporting in general orthopaedic journals
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The poor reporting and use of statistical methods in orthopaedic papers has been widely discussed by both clinicians and statisticians. A detailed review of research published in general orthopaedic journals was undertaken to assess the quality of experimental design, statistical analysis and reporting. A representative sample of 100 papers was assessed for compliance to CONSORT and STROBE guidelines and the quality of the statistical reporting was assessed using a validated questionnaire. Overall compliance with CONSORT and STROBE guidelines in our study was 59% and 58% respectively, with very few papers fulfilling all criteria. In 37% of papers patient numbers were inadequately reported; 20% of papers introduced new statistical methods in the ‘results’ section not previously reported in the ‘methods’ section, and 23% of papers reported no measurement of error with the main outcome measure. Taken together, these issues indicate a general lack of statistical rigour and are consistent with similar reviews undertaken in a number of other scientific and clinical research disciplines. It is imperative that the orthopaedic research community strives to improve the quality of reporting; a failure to do so could seriously limit the development of future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Kilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860
Self-citationAls-Nielsen, B., Chen, W., Gluud, C., & Kjaergard, L. L. (2003) · JAMA · doi:10.1001/jama.290.7.921 · Cited by 746
Epidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474
Quality of reporting of observational longitudinal research.
Tooth, L. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi042 · Cited by 363
Good Laboratory Practice: Preventing Introduction of Bias at the Bench
Macleod, M. R., Fisher, M., O'Collins, V., Sena, E. S., Dirnagl, U., Bath, P. M. W., Buchan, A., van der Worp, H. B., Traystman, R., Minematsu, K., et al. (2009) · Stroke · doi:10.1161/strokeaha.108.525386 · Cited by 331
Chan, S., & Bhandari, M. (2007) · The Journal of Bone & Joint Surgery · doi:10.2106/jbjs.f.01591 · Cited by 85
Cited by
Stevens, A., Shamseer, L., Weinstein, E., Yazdi, F., Turner, L., Thielman, J., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., et al. (2014) · BMJ · doi:10.1136/bmj.g3804 · Cited by 242
Scoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134
Risk of bias of randomized controlled trials published in orthopaedic journals
Chess, L. E., & Gagnier, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-76 · Cited by 83
Sorensen, A. A., Wojahn, R. D., Manske, M. C., & Calfee, R. P. (2013) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2013.05.008 · Cited by 55
“Parson reviewed the quality of general orthopedic research reporting with STROBE guidelines in 2011 and found a 58% overall compliance rate, which was replicated in our review of hand literature (4).”
Metadata
- Authors
- Parsons, N. R., Hiskens, R., Price, C. L., Achten, J., & Costa, M. L.
- Venue
- The Journal of Bone and Joint Surgery. British volume
- Published
- 2011-09
- Volume
- 93-B
- Issue
- 9
- Pages
- 1154-1159
- ISSN
- 0301-620X (ISSN-L)
- 2044-5377
- OpenAlex
- W2142948053
- Cited by
- 55
- References
- 8
- FWCI
- 8.10
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic survey of the quality of research reporting in general orthopaedic journals. https://app.cochat.ai/papers/10.1302/0301-620x.93b9.27193
- The paper
- Parsons, N. R., Hiskens, R., Price, C. L., Achten, J., & Costa, M. L. (2011). A systematic survey of the quality of research reporting in general orthopaedic journals. The Journal of Bone and Joint Surgery. British volume. https://doi.org/10.1302/0301-620x.93b9.27193
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.