Primary endpoint discrepancies were found in one in ten clinical drug trials. Results of an inception cohort study
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To identify the occurrence and determinants of protocol-publication discrepancies in clinical drug trials. STUDY DESIGN AND SETTING: All published clinical drug trials reviewed by the Dutch institutional review boards in 2007 were analyzed. Discrepancies between trial protocols and publications were measured among key reporting aspects. We evaluated the association of trial characteristics with discrepancies in primary endpoints by calculating the risk ratio (RR) and 95% confidence interval (CI). RESULTS: Of the 334 published trials, 32 (9.6%) had a protocol/publication discrepancy in the primary endpoints. Among the subgroup of randomized controlled trials (RCTs; N = 204), 12 (5.9%) had a discrepancy in the primary endpoint. Investigator-initiated trials with and without industry (co-) funding were associated with having discrepancies in the primary endpoints compared with industry-sponsored trials (RR 3.7; 95% CI 1.4-9.9 and RR 4.4; 95% CI 2.0-9.5, respectively). Furthermore, other than phase 1-4 trials (vs. phase 1; RR 4.6; 95% CI 1.1-19.3), multicenter trials were also conducted outside the European Union (vs. single center; RR 0.2; 95% CI 0.1-0.6), not prospectively registered trials (RR 3.3; 95% CI 1.5-7.5), non-RCTs (vs. superiority RCT; RR 2.4; 95% CI 1.2-4.8) and, among the RCTs, crossover compared with a parallel group design (RR 3.7; 95% CI 1.1-12.3) were significantly associated with having discrepancies in the primary endpoints. CONCLUSIONS: Improvement in completeness of reporting is still needed, especially among investigator-initiated trials and non-RCTs. To eliminate undisclosed discrepancies, trial protocols should be available in the public domain at the same time when the trial is published.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“Discrepancies in the sample size can bias the interpretation of results, as the likelihood of erroneous chance findings is high if the sample size is too small [35].”
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 6×
“The first empirical study investigating the problem of selective publication found that 62% of the trials had at least one primary endpoint that was discrepant between the trial protocol and the trial publication [9].”
InfluentialSuñé, P., Suñé, J. M., & Montoro, J. B. (2013) · PLoS ONE · doi:10.1371/journal.pone.0054583 · Cited by 1,687 · cited 1×
“The third previous cohort study [10] had only a follow-up from IRB approval until publication of 5 years, which is likely too short to identify all relevant (additional) publications [30].”
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
SPIRIT 2013: new guidance for content of clinical trial protocols
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Dickersin, K., & Moher, D. (2013) · The Lancet · doi:10.1016/s0140-6736(12)62160-6 · Cited by 298
Chan, A.-W., Hrobjartsson, A., Jorgensen, K. J., Gotzsche, P. C., & Altman, D. G. (2008) · BMJ · doi:10.1136/bmj.a2299 · Cited by 202 · cited 3×
“Another reason for the difference with two of the previous cohorts is that we included all available publications in the assessment, whereas these studies only included one publication for each trial protocol [9,11,23].”
Bias, Spin, and Misreporting: Time for Full Access to Trial Protocols and Results
Chan, A.-W. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050230 · Cited by 144 · cited 1×
“Nevertheless, the identified discrepancies could still have introduced spin and bias in the trial publications [38].”
Cited by
SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials
Hróbjartsson, A., Boutron, I., Hopewell, S., Moher, D., Schulz, K. F., Collins, G. S., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081660 · Cited by 171
Promoting public access to clinical trial protocols: challenges and recommendations
Chan, A.-W., & Hróbjartsson, A. (2018) · Trials · doi:10.1186/s13063-018-2510-1 · Cited by 84
Spence, O., Hong, K., Onwuchekwa Uba, R., & Doshi, P. (2020) · Clinical Trials · doi:10.1177/1740774519868310 · Cited by 37
Selective outcome reporting in randomized clinical trials of dental implants
Sendyk, D. I., Rovai, E. S., Souza, N. V., Deboni, M. C. Z., & Pannuti, C. M. (2019) · Journal of Clinical Periodontology · doi:10.1111/jcpe.13128 · Cited by 35
EVIDENCE-BASED IMPLANT DENTISTRY: METHODOLOGICAL FOUNDATIONS, PROGRESS, AND FUTURE PERSPECTIVES.
YAN, Q., WANG, Y., WU, X., ZHAO, Y., & ZHANG, Y. (2026) · Journal of Evidence-Based Dental Practice · doi:10.1016/j.jebdp.2026.102269
Metadata
- Authors
- van den Bogert, C. A., Souverein, P. C., Brekelmans, C. T. M., Janssen, S. W. J., Koëter, G. H., Leufkens, H. G. M., & Bouter, L. M.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 89
- Pages
- 199-208
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2614285154
- Cited by
- 19
- References
- 12
- FWCI
- 1.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Primary endpoint discrepancies were found in one in ten clinical drug trials. Results of an inception cohort study. https://app.cochat.ai/papers/10.1016/j.jclinepi.2017.05.012
- The paper
- van den Bogert, C. A., Souverein, P. C., Brekelmans, C. T. M., Janssen, S. W. J., Koëter, G. H., Leufkens, H. G. M., & Bouter, L. M. (2017). Primary endpoint discrepancies were found in one in ten clinical drug trials. Results of an inception cohort study. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2017.05.012
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.