Discrepancies between registration and publication of randomised controlled trials: an observational study
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Summary Objectives: To determine the consistency between information contained in the registration and publication of randomised controlled trials (RCTs). Design: An observational study of RCTs published between May 2011 and May 2012 in the British Medical Journal ( BMJ) and the Journal of the American Medical Association ( JAMA) comparing registry data with publication data. Participants and Settings: Data extracted from published RCTs in BMJ and JAMA. Main outcome measures: Timing of trial registration in relation to completion of trial data collection and publication. Registered versus published primary and secondary outcomes, sample size. Results: We identified 40 RCTs in BMJ and 36 in JAMA. All 36 JAMA trials and 39 (98%) BMJ trials were registered. All registered trials were registered prior to publication. Thirty-two (82%) BMJ trials recorded the date of data completion; of these, in two trials the date of trial registration postdated the registered date of data completion. There were discrepancies between primary outcomes declared in the trial registry information and in the published paper in 18 (47%) BMJ papers and seven (19%) JAMA papers. The original sample size stated in the trial registration was achieved in 24 (60%) BMJ papers and 21 (58%) JAMA papers. Conclusions: Compulsory registration of RCTs is meaningless if the content of registry information is not complete or if discrepancies between registration and publication are not reported. This study demonstrates that discrepancies in primary and secondary outcomes and sample size between trial registration and publication remain commonplace, giving further strength to the World Health Organisation’s argument for mandatory completion of a minimum number of compulsory fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [27]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Clinical trial registration: a statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17034-7 · Cited by 408
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 2×
“Ross et al.(10) scrutinised the completeness of trial registry information in ClinicalTrials.”
BackgroundComparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243 · cited 2×
“A Cochrane Review in 2011 found that discrepancies between trial registration and publication were common and often not declared in the publication.(2) The 2010 CONSORT checklist, a guide to what to include when reporting clinical trials, includes ‘Any changes to trial outcomes after the trial commenced, with reasons’…”
BackgroundSystematic reviews to support evidence-based medicine, 2nd edition
Khan, K., Kunz, R., Kleijnen, J., & Antes, G. (2011) · CRC Press eBooks · doi:10.1201/b13411 · Cited by 168
Dickersin, K., & Chalmers, I. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.11k042 · Cited by 165
Systematic Reviews to Support Evidence-Based Medicine: How to appraise, conduct and publish reviews
Khan, K. S., & Zamora, J. (2022) · doi:10.1201/9781003220039 · Cited by 151
Huić, M., Marušić, M., & Marušić, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025258 · Cited by 114
Hannink, G., Gooszen, H. G., & Rovers, M. M. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e3182864fa3 · Cited by 102
Research works printed but not linked: 1
- Dwan K, 2011, Cochrane Database Syst Rev, 19, MR000031
Cited by
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
Registration of published randomized trials: a systematic review and meta-analysis
Trinquart, L., Dunn, A. G., & Bourgeois, F. T. (2018) · BMC Medicine · doi:10.1186/s12916-018-1168-6 · Cited by 106
Scott, A., Rucklidge, J. J., & Mulder, R. T. (2015) · PLOS ONE · doi:10.1371/journal.pone.0133718 · Cited by 99
Bradley, H. A., Rucklidge, J. J., & Mulder, R. T. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12647 · Cited by 92
Metadata
- Authors
- Walker, K. F., Stevenson, G., & Thornton, J. G.
- Affiliations
- University of Nottingham (GB)
- Nottingham University Hospitals NHS Trust (GB)
- Academic Division of Obstetrics and Gynaecology, Maternity Department, University of Nottingham, Nottingham City Hospital, Hucknall Road, Nottingham NG5 1PB, UK
- Corresponding author
- Walker, Kate F
- ORCID
- Walker, Kate F
- Venue
- JRSM Open
- Publisher
- SAGE Publications
- Published
- 2014-05-01
- Volume
- 5
- Issue
- 5
- Pages
- 2042533313517688-2042533313517688
- ISSN
- 2054-2704 (ISSN-L)
- PMC
- PMC4012655
- OpenAlex
- W2032959055
- Cited by
- 45
- References
- 13
- Citations by year
- 2026: 3 · 2025: 1 · 2023: 6 · 2022: 2 · 2021: 8 · 2019: 5 · 2018: 5 · 2017: 5 · 2016: 5 · 2015: 5
- FWCI
- 4.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- JRSM Open (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Nottingham ePrints (University of Nottingham) (submittedVersion, cc-by-nc)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- clinical trial registration, publication bias, randomized controlled trials, clinical trial registries, mandatory registration, primary and secondary outcomes, British Medical Journal, Journal of the American Medical Association
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Discrepancies between registration and publication of randomised controlled trials: an observational study. https://app.cochat.ai/papers/10.1177/2042533313517688
- The paper
- Walker, K. F., Stevenson, G., & Thornton, J. G. (2014). Discrepancies between registration and publication of randomised controlled trials: an observational study. JRSM Open. https://doi.org/10.1177/2042533313517688
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.