Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index; 4 of the 23 sources its claims cite were checked for support.

The devil is in the details: Reporting and transparent research practices in sports medicine and orthopedic clinical trials

Open access

Preprint — published as 10.1136/bmjopen-2021-059347 · Paper page

Abstract

Introduction: While transparent reporting of clinical trials is essential to assess the risk of bias and translate research findings into clinical practice, earlier studies have shown that deficiencies are common. This study examined current clinical trial reporting and transparent research practices in sports medicine and orthopedics. Methods: The sample included clinical trials published in the top 25% of sports medicine and orthopedics journals over nine months. Two independent reviewers assessed pre-registration, open data and criteria related to scientific rigor, the study sample, and data analysis. Results: The sample included 163 clinical trials from 27 journals. While the majority of trials mentioned rigor criteria, essential details were often missing. Sixty percent (confidence interval [CI] 53-68%) of trials reported sample size calculations, but only 32% (CI 25-39%) justified the expected effect size. Few trials indicated the blinding status of all main stakeholders (4%; CI 1-7%). Only 18% (CI 12-24%) included information on randomization type, method, and concealed allocation. Most trials reported participants’ sex/gender (95%; CI 92-98%) and information on inclusion and exclusion criteria (78%; CI 72-84%). Only 20% (CI 14-26%) of trials were pre-registered. No trials deposited data in open repositories. Conclusions: These results will aid the sports medicine and orthopedics community in developing tailored interventions to improve reporting. While authors typically mention blinding, randomization and other factors, essential details are often missing. Greater acceptance of open science practices, like pre-registration and open data, is needed. These practices have been widely encouraged, we discuss systemic interventions that may improve clinical trial reporting. Registration: https://doi.org/10.17605/OSF.IO/9648H

Overview

CoChat Summary

TL;DR

This meta-research study assessed reporting and transparent research practices in 163 clinical trials published in the top 25% of sports medicine and orthopedics journals, finding that while most trials mention rigor criteria like blinding and randomization, essential details needed to assess risk of bias are frequently missing. Only 20% of trials were pre-registered and no trial deposited data in an open repository.

Key findings

  • Sixty percent (CI 53–68%) of trials reported sample size calculations, but only 32% (CI 25–39%) justified the expected effect size; among trials reporting a calculation (n=98), 53% (CI 43–63%) included a justification, 39% presented none, and 14% used arbitrary thresholds.
  • Few trials indicated the blinding status of all main stakeholders (4%; CI 1–7%), and only 18% (CI 12–24%) included information on randomization type, method, and concealed allocation; 8% (CI 4–12%) provided complete allocation concealment information.
  • Most trials reported participants' sex/gender (95%; CI 92–98%) and inclusion/exclusion criteria (78%; CI 72–84%); 75% reported the number of participants included in the final analysis.
  • Only 20% (CI 14–26%) of trials were pre-registered (58% of registered trials were retrospective), and no trials deposited data in open repositories; 74% of trials with data availability statements said data were available upon request.

Methods

  • Systematic examination of clinical trials published in the top 25% of orthopedics and sports medicine journals (Scimago Journal Rank) over nine months (2019/12–2020/08); 175 articles from 27 journals were screened, and 163 met the ICMJE clinical trial definition and were analyzed.
  • Two independent reviewers (RS, GL, RP) performed full-text screening and data abstraction using preformatted Excel spreadsheets against CONSORT-based rigor, sample, data analysis, and transparency criteria; disagreements resolved by consensus.
  • Exploratory analysis presenting prevalence as percentages with 95% confidence intervals; odds ratios with 95% CIs examined relationships between reporting completeness and pre-registration, flow charts, or sample size calculations (these analyses were not pre-registered).

Limitations

  • Stated: CONSORT-based evaluation criteria for intervention reporting were not optimized for non-exercise or wait-and-see control interventions; odds ratios were exploratory post-hoc calculations requiring larger confirmatory studies; findings from the top 25% of journals may not generalize to journals not indexed by PubMed, lower tier journals, or non-English journals.
  • Evident from the text: the study is exploratory and does not use formal sample size calculation (a precision-based estimate of 124–203 trials was used), and the preprint version was not certified by peer review.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1101/2021.07.20.21260565

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Reporting prevalence for rigour and sample criteria. This plot displays the percentage of trials that addressed each criteria. For information on the actual randomisation or blinding status, please refer to the text. The different coloured data points are for better visual differentiation of each subcategory. Created by the authors.
Figure 1 Reporting prevalence for rigour and sample criteria. This plot displays the percentage of trials that addressed each criteria. For information on the actual randomisation or blinding status, please refer to the text. The different coloured data points are for better visual differentiation of each subcategory. Created by the authors.CC BY-NC · PubMed Central
Figure 2 The blinding status across the main different stakeholder groups across all clinical trials (n=163). Created by the authors.
Figure 2 The blinding status across the main different stakeholder groups across all clinical trials (n=163). Created by the authors.CC BY-NC · PubMed Central
Figure 3 Reporting prevalence for data analysis and transparency criteria. This plot displays the percentage of trials that addressed each criteria. Created by the authors. ES, effect size; NHST, null hypothesis statistical testing.
Figure 3 Reporting prevalence for data analysis and transparency criteria. This plot displays the percentage of trials that addressed each criteria. Created by the authors. ES, effect size; NHST, null hypothesis statistical testing.CC BY-NC · PubMed Central
Figure 4 A priori sample size calculations are essential for generating meaningful results with clinical trials. Created by the authors. This infographic focuses on key elements a priori sample size calculations that should be reported in clinical trial publication. However, it is important to note that each element should be justified individually including the thresholds for type 1 and type 2 errors, and the expected effect size. Lakens free article on sample size justification provides an excellent overview of aspects to consider when planning empirical research studies.96
Figure 4 A priori sample size calculations are essential for generating meaningful results with clinical trials. Created by the authors. This infographic focuses on key elements a priori sample size calculations that should be reported in clinical trial publication. However, it is important to note that each element should be justified individually including the thresholds for type 1 and type 2 errors, and the expected effect size. Lakens free article on sample size justification provides an excellent overview of aspects to consider when planning empirical research studies.96CC BY-NC · PubMed Central

Verification

Claims the paper makes

4 Valid · 4 Not valid · 14 Not checked · 70 Own results and interpretations

42 more claims

Create a free account to see all 92 claims and to verify the 17 references still open.

See all claims — free account
  • Probably not a substantial claim. 17
  • It may state two separate claims as one. 32

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 78 references

Research works printed but not linked: 5

  1. ICMJE. Recommendations | Preparing a Manuscript for Submission to a Medical Journal: Methods - statistics [Internet]. 2021 [updated 2021 Apr 14
  2. SCImago (nd). SJR — SCImago Journal & Country Rank [Portal] [Internet]. 2020 [cited 2021 Feb 22]. Available from: https://.scimagojr.com/journalrank.php?category=2732
  3. BMC. Advancing peer review at BMC [Internet]. 2021 [updated 2021 Apr 8
  4. cited 2021 Apr 8]. Available from: https://www.biomedcentral.com/about/advancing-peer-review
  5. EU Trials Tracker. EU Trials Tracker — Who’s not sharing clinical trial results? [Internet]: Evidence-Based Medicine Data Lab; University of Oxford. 2021 [updated 2021 Apr 12; cited 2021 Apr 12]. Available from: https://eu.trialstracker.net/

Cited by

See all 23

Metadata

Authors
Schulz, R., Langen, G., Prill, R., Cassel, M., & Weissgerber, T.
Affiliations
  • University of Potsdam (DE)
  • Medizinische Hochschule Brandenburg Theodor Fontane (DE)
  • Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
Corresponding author
Weissgerber, Tracey
Venue
BMJ Open
Publisher
openRxiv
Published
2021-07-23
Volume
12
Issue
8
Pages
e059347-e059347
ISSN
2044-6055 (ISSN-L)
OpenAlex
W4290673869
Cited by
23
References
78
Citations by year
2026: 3 · 2025: 7 · 2024: 2 · 2023: 5 · 2022: 6
FWCI
3.02
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • medRxiv (acceptedVersion, cc-by-nd)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by-nc)
  • Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
Keywords
trial reporting quality, preregistration, open data, sample size justification, blinding, randomization, open science, research transparency, risk of bias
MeSH terms
Humans, Orthopedics, Sports Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The devil is in the details: Reporting and transparent research practices in sports medicine and orthopedic clinical trials. https://app.cochat.ai/papers/10.1101/2021.07.20.21260565
The paper
Schulz, R., Langen, G., Prill, R., Cassel, M., & Weissgerber, T. (2021). The devil is in the details: Reporting and transparent research practices in sports medicine and orthopedic clinical trials. BMJ Open. https://doi.org/10.1101/2021.07.20.21260565

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.