How Frequently Do the Results from Completed US Clinical Trials Enter the Public Domain? - A Statistical Analysis of the ClinicalTrials.gov Database
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Achieving transparency in clinical trials, through either publishing results in a journal or posting results to the ClinicalTrials.gov (CTG) web site, is an essential public health good. However, it remains unknown what proportion of completed studies achieve public disclosure of results (PDOR), or what factors explain these differences. METHODS: We analyzed data from 400 randomly selected studies within the CTG database that had been listed as 'completed' and had at least four years in which to disclose results. Using Kaplan-Meier curves, we calculated times from completion to PDOR (defined as publishing the primary outcomes in a journal and/or posting results to CTG), and identified explanatory variables predicting these outcomes using Cox proportional hazards models. FINDINGS: Among the 400 clinical trials, 118 (29.5%) failed to achieve PDOR within four years of completion. The median day from study completion to PDOR among 282 studies (70.5%) that achieved PDOR was 602 days (mean 647 days, SD 454 days). Studies were less likely to achieve PDOR if at earlier stages (phase 2 vs. phase 3/4, adjusted HR 0.60, 95% CI 0.47-0.78), if they only included adult subjects (adjusted HR 0.61, 95% CI 0.45-0.83), involved randomization (adjusted HR 0.62, 95% CI 0.46-0.83), or had smaller sample sizes (≤50 subjects vs. >50, adjusted HR 0.60, 95% CI 0.44-0.83). Industry-funded studies were significantly less likely to be published than non-industry or blended studies (adjusted HR 0.49, 95% CI 0.36-0.66). CONCLUSIONS: A significant proportion of completed studies did not achieve PDOR within the four years of follow-up, particularly smaller studies at earlier stages of development with industry funding. This constitutes reporting bias and threatens the validity of the clinical research literature in the US.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“Many studies were focused on publication bias, a type of reporting bias defined narrowly as over-representation of positive studies in the scientific literature [18–20].”
BackgroundSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 1×
“Many studies were focused on publication bias, a type of reporting bias defined narrowly as over-representation of positive studies in the scientific literature [18–20].”
BackgroundPublication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747 · cited 1×
“Many studies were focused on publication bias, a type of reporting bias defined narrowly as over-representation of positive studies in the scientific literature [18–20].”
BackgroundIndustry sponsorship and research outcome
Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A., & Bero, L. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub2 · Cited by 605
Ahmed, I., Sutton, A. J., & Riley, R. D. (2012) · BMJ · doi:10.1136/bmj.d7762 · Cited by 404 · cited 1×
“transparency due to undisclosed results has been a problem [6– 10].”
BackgroundTrial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 1×
“While other investigators have challenged the quality of information entered on CTG [21], this too falls into the category of limitations for which there is no current solution since we are blind to information that may have been hidden.”
BackgroundPublication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371 · cited 2×
“Similarly, among National Institutes of Health (NIH) funded trials, 32% remained unpublished after the median follow-up of 51 months from completion [12].”
Background
Cited by
Pedicle screw loosening: a clinically relevant complication?
Galbusera, F., Volkheimer, D., Reitmaier, S., Berger-Roscher, N., Kienle, A., & Wilke, H.-J. (2015) · European Spine Journal · doi:10.1007/s00586-015-3768-6 · Cited by 402
Compliance with Results Reporting at ClinicalTrials.gov
Anderson, M. L., Chiswell, K., Peterson, E. D., Tasneem, A., Topping, J., & Califf, R. M. (2015) · New England Journal of Medicine · doi:10.1056/nejmsa1409364 · Cited by 380
Anti-corruption, transparency and accountability in health: concepts, frameworks, and approaches
Vian, T. (2020) · Global Health Action · doi:10.1080/16549716.2019.1694744 · Cited by 249
Chen, R., Desai, N. R., Ross, J. S., Zhang, W., Chau, K. H., Wayda, B., Murugiah, K., Lu, D. Y., Mittal, A., & Krumholz, H. M. (2016) · BMJ · doi:10.1136/bmj.i637 · Cited by 227
Moorthy, V. S., Karam, G., Vannice, K. S., & Kieny, M.-P. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001819 · Cited by 155
“In another study, among 400 randomly selected clinical trials, nearly 30% did not publish the primary outcomes in a journal or post results to a clinical trial registry within four years of completion [5].”
BackgroundBashir, R., Bourgeois, F. T., & Dunn, A. G. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0518-3 · Cited by 47
The significance of the trial outcome was associated with publication rate and time to publication
Song, S. Y., Koo, D.-H., Jung, S.-Y., Kang, W., & Kim, E. Y. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.009 · Cited by 36
Abbas, M., Pires, D., Peters, A., Morel, C. M., Hurst, S., Holmes, A., Saito, H., Allegranzi, B., Lucet, J.-C., Zingg, W., et al. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5361-z · Cited by 17
Self-citation
Metadata
- Authors
- Saito, H., & Gill, C. J.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-15
- Volume
- 9
- Issue
- 7
- Pages
- e101826
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2011730055
- Cited by
- 74
- References
- 9
- FWCI
- 14.37
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.