CoChat

Discordant Information on Blinding in Trial Registries and Published Research: A Systematic Review

Zhang, Fengying, Zhu, Yi, Zhao, Shengmin, Zhang, Qian, Tao, Huan, Wu, Yunhong, Jia, Pengli · 2024 · JAMA Network Open
Cited by 8

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

Importance: Blinding of individuals involved in randomized clinical trials (RCTs) can be used to protect against performance and biases, but discrepancies in the reporting of methodological features between registered protocols and subsequent trial publications may lead to inconsistencies, thereby reintroducing bias. Objective: To investigate inconsistency in blinding as reported in trial registries and publications. Data Sources: An exploratory dataset and a validation dataset were created. The exploratory dataset consisted of RCTs included in systematic reviews of adverse events from the SMART Safety database published between January 1, 2015, to January 1, 2020. The validation dataset was based on a literature search on PubMed for all registered RCTs published within the same time frame. Study Selection: Eligible RCTs for the exploratory dataset included were those that specified drug safety as the exclusive outcome and included at least 1 pairwise meta-analysis involving 5 or more RCTs of health care interventions. The validation dataset included a random selection of RCTs without restriction on outcome. Data Extraction and Synthesis: Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines were followed during data extraction. RCTs were matched to their registries and information on blinding was extracted from both the journal publication and trial registry. Extraction was performed by 1 author and cross-checked by 2 additional authors, with discrepancies resolved via consensus. The data analysis was conducted between July 2023 and January 2024. Main Outcomes and Measures: The primary outcome was inconsistency in blinding reports in the publication and the associated trial registry. Factors associated with the inconsistency were further investigated using multivariable logistic regression. The results were then compared with the validation dataset. Results: A total of 1340 RCTs were included, with a median (IQR) sample size of 338 (152-772) participants. Of these, 749 (55.90%) were multiregional, 1220 (91.04%) were multicenter, and 835 (62.31%) were prospectively registered. The most frequently studied condition was cancer, representing 472 trials (35.22%). In the exploratory dataset, 1080 trials (80.60%) had inconsistent reporting of blinding in their published trial registry. Higher odds of inconsistency were associated with trials conducted as single-center (OR, 2.84; 95% CI, 1.24-7.74; P = .02) or those focused on cancer (OR, 3.26; 95% CI, 2.04-5.38; P < .001). Evaluation of the 98 RCTs in the validation dataset revealed that 70 (71.43%) had inconsistencies between the published trial and its registries. The occurrence of inconsistencies was significantly higher in the exploratory dataset than the validation dataset (P = .03). Conclusions and Relevance: In this systematic review of RCTs, there were significant inconsistencies in the reporting of blinding between trial publications and their corresponding registries. These findings underscore the importance of maintaining consistency between registered protocols and published trial reports to ensure methodological transparency and minimize bias.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamanetworkopen.2024.52274

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 19

  1. Viera, 2007, Eliminating bias in randomized controlled trials: importance of allocation concealment and masking., Fam Med, 39, 132
  2. Probst, 2016, Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study., Syst Rev, 5, 48, 10.1186/s13643-016-0226-4 · DOI · Paper page
  3. Schulz, 2010, CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials., BMJ, 340, c332, 10.1136/bmj.c332 · DOI · Paper page
  4. Chan, 2013, SPIRIT 2013 statement: defining standard protocol items for clinical trials., Ann Intern Med, 158, 200, 10.7326/0003-4819-158-3-201302050-00583 · DOI · Paper page
  5. Viergever, 2015, Trends in global clinical trial registration: an analysis of numbers of registered clinical trials in different parts of the world from 2004 to 2013., BMJ Open, 5, 10.1136/bmjopen-2015-008932 · DOI · Paper page
  6. Aslam, 2013, Registration of clinical trials: is it really needed?, N Am J Med Sci, 5, 713, 10.4103/1947-2714.123266 · DOI
  7. Zarin, 2007, Registering a clinical trial in ClinicalTrials.gov., Chest, 131, 909, 10.1378/chest.06-2450 · DOI
  8. Zarin, 2008, Moving toward transparency of clinical trials., Science, 319, 1340, 10.1126/science.1153632 · DOI · Paper page
  9. Zarin, 2019, 10-Year update on study results submitted to ClinicalTrials.gov., N Engl J Med, 381, 1966, 10.1056/NEJMsr1907644 · DOI · Paper page
  10. Kendall, 2003, Designing a research project: randomised controlled trials and their principles., Emerg Med J, 20, 164, 10.1136/emj.20.2.164 · DOI · Paper page
  11. Hartung, 2014, Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications., Ann Intern Med, 160, 477, 10.7326/M13-0480 · DOI · Paper page
  12. Becker, 2014, Reporting of results in ClinicalTrials.gov and high-impact journals., JAMA, 311, 1063, 10.1001/jama.2013.285634 · DOI · Paper page
  13. Zorzela, 2014, Quality of reporting in systematic reviews of adverse events: systematic review., BMJ, 348, f7668, 10.1136/bmj.f7668 · DOI · Paper page
  14. Moher, 2012, CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials., Int J Surg, 10, 28, 10.1016/j.ijsu.2011.10.001 · DOI · Paper page
  15. Maercker, 2021, Development of the new CPTSD diagnosis for ICD-11., Borderline Personal Disord Emot Dysregul, 8, 7, 10.1186/s40479-021-00148-8 · DOI · Paper page
  16. Hróbjartsson, 2011, Blinding in randomized clinical trials: imposed impartiality., Clin Pharmacol Ther, 90, 732, 10.1038/clpt.2011.207 · DOI · Paper page
  17. Tang, 2015, Comparison of serious adverse events posted at ClinicalTrials.gov and published in corresponding journal articles., BMC Med, 13, 189, 10.1186/s12916-015-0430-4 · DOI · Paper page
  18. Talebi, 2020, Consistency of trial reporting between ClinicalTrials.gov and corresponding publications: one decade after FDAAA., Trials, 21, 675, 10.1186/s13063-020-04603-9 · DOI
  19. Clarivate. Journal citation reports. Accessed November 13, 2024. https://jcr.clarivate.com/jcr/home

Cited by

See all 8

Metadata

Authors
Zhang, F., Zhu, Y., Zhao, S., Zhang, Q., Tao, H., Wu, Y., & Jia, P.
Affiliations
  • Tibet Autonomous Region Clinical Research Center for High-Altitude Stress, Endocrinology and Metabolism Disease, Hospital of Chengdu Office of People’s Government of Tibetan Autonomous Region (Hospital.C.T.), Chengdu, China
  • Proof of Concept Center, Eastern Hepatobiliary Surgery Hospital, Third Affiliated Hospital, Second Military Medical University, Naval Medical University, Shanghai, China
  • Clinical Epidemiology and Evidence-based Medicine Research Center, West China Hospital, Sichuan University, Chengdu, Sichuan, China
  • Department of Environmental and Occupational Health, Sichuan University West China School of Public Health, West China Fourth Hospital, Chengdu, Sichuan, China
  • Department of Hematology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
  • School of Management, Shanxi Medical University, Taiyuan, China
Venue
JAMA Network Open
Published
2024-12-26
Volume
7
Issue
12
Pages
e2452274
ISSN
2574-3805
Cited by
8
References
10
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Discordant Information on Blinding in Trial Registries and Published Research: A Systematic Review. https://app.cochat.ai/papers/10.1001/jamanetworkopen.2024.52274
The paper
Zhang, F., Zhu, Y., Zhao, S., Zhang, Q., Tao, H., Wu, Y., & Jia, P. (2024). Discordant Information on Blinding in Trial Registries and Published Research: A Systematic Review. JAMA Network Open. https://doi.org/10.1001/jamanetworkopen.2024.52274

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.