Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
BACKGROUND: ClinicalTrials.gov is a publicly accessible, Internet-based registry of clinical trials managed by the US National Library of Medicine that has the potential to address selective trial publication. Our objectives were to examine completeness of registration within ClinicalTrials.gov and to determine the extent and correlates of selective publication. METHODS AND FINDINGS: We examined reporting of registration information among a cross-section of trials that had been registered at ClinicalTrials.gov after December 31, 1999 and updated as having been completed by June 8, 2007, excluding phase I trials. We then determined publication status among a random 10% subsample by searching MEDLINE using a systematic protocol, after excluding trials completed after December 31, 2005 to allow at least 2 y for publication following completion. Among the full sample of completed trials (n = 7,515), nearly 100% reported all data elements mandated by ClinicalTrials.gov, such as intervention and sponsorship. Optional data element reporting varied, with 53% reporting trial end date, 66% reporting primary outcome, and 87% reporting trial start date. Among the 10% subsample, less than half (311 of 677, 46%) of trials were published, among which 96 (31%) provided a citation within ClinicalTrials.gov of a publication describing trial results. Trials primarily sponsored by industry (40%, 144 of 357) were less likely to be published when compared with nonindustry/nongovernment sponsored trials (56%, 110 of 198; p<0.001), but there was no significant difference when compared with government sponsored trials (47%, 57 of 122; p = 0.22). Among trials that reported an end date, 75 of 123 (61%) completed prior to 2004, 50 of 96 (52%) completed during 2004, and 62 of 149 (42%) completed during 2005 were published (p = 0.006). CONCLUSIONS: Reporting of optional data elements varied and publication rates among completed trials registered within ClinicalTrials.gov were low. Without greater attention to reporting of all data elements, the potential for ClinicalTrials.gov to address selective publication of clinical trials will be limited. Please see later in the article for the Editors' Summary.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of Rosiglitazone on the Risk of Myocardial Infarction and Death from Cardiovascular Causes
Nissen, S. E., & Wolski, K. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa072761 · Cited by 4,675 · cited 2×
“Similarly unpublished clinical trials of rosiglitazone [3] identified from a company-maintained website and of erythropoiesis-stimulating agents [4] and antidepressants [5] found among data submitted to the FDA revealed important efficacy and safety information to be missing from the medical literature.”
BackgroundSelf-citationSilverstein, F. E., Faich, G., Goldstein, J. L., Simon, L. S., Pincus, T., Whelton, A., Makuch, R., Eisen, G., Agrawal, N. M., Stenson, W. F., et al. (2000) · JAMA · doi:10.1001/jama.284.10.1247 · Cited by 3,154
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 3×
“Similarly unpublished clinical trials of rosiglitazone [3] identified from a company-maintained website and of erythropoiesis-stimulating agents [4] and antidepressants [5] found among data submitted to the FDA revealed important efficacy and safety information to be missing from the medical literature.”
BackgroundResultPharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 1×
“However, we also found significantly different publication rates among study types and primary sponsors, consistent with prior research [11].”
ResultChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 1×
“Given the documented presence of outcome reporting bias among trials studied in other settings [5,12,13], the potential impact of ClinicalTrials.”
ResultRisk of Cardiovascular Events Associated with Selective COX-2 Inhibitors
Mukherjee, D. (2001) · JAMA · doi:10.1001/jama.286.8.954 · Cited by 1,741 · cited 1×
“Other evidence concerning selective publication is anecdotal, such as the absence of 6 mo of trial data from a key publication describing the efficacy of celecoxib [25,26], the delay of publication for two early trials of rofecoxib until after the medication was withdrawn from the market [27–29], and the aforementione…”
BackgroundSystematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 1×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundClinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818
Bennett, C. L. (2008) · JAMA · doi:10.1001/jama.299.8.914 · Cited by 731 · cited 2×
“Similarly unpublished clinical trials of rosiglitazone [3] identified from a company-maintained website and of erythropoiesis-stimulating agents [4] and antidepressants [5] found among data submitted to the FDA revealed important efficacy and safety information to be missing from the medical literature.”
BackgroundIoannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
Clinical Trial Registration: A Statement From the International Committee of Medical Journal Editors
DeAngelis, C. D., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · JAMA · doi:10.1001/jama.292.11.1363 · Cited by 579
Withholding Research Results in Academic Life Science: Evidence From a National Survey of Faculty
Blumenthal, D. (1997) · JAMA · doi:10.1001/jama.1997.03540390054035 · Cited by 576
Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444 · cited 1×
“Given the documented presence of outcome reporting bias among trials studied in other settings [5,12,13], the potential impact of ClinicalTrials.”
ResultPublication Bias: The Problem That Won't Go Away
DICKERSIN, K., & MIN, Y. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26343.x · Cited by 427 · cited 1×
“Finally, researchers, reviewers, and editors have historically been more enthusiastic about positive or equivalence trials and less excited about negative trials [6]; accordingly, these latter trials are submitted and accepted for publication less often [14–16,21,31].”
BackgroundJüni, P., Rutjes, A. W., & Dieppe, P. A. (2002) · BMJ · doi:10.1136/bmj.324.7349.1287 · Cited by 396
Rising, K., Bacchetti, P., & Bero, L. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050217 · Cited by 328 · cited 2×
“gov, particularly with regards to condition studied and study location, with the exception of two recent studies focused on the publication of trials submitted to the FDA [1,2].”
BackgroundFactors Associated With Failure to Publish Large Randomized Trials Presented at an Oncology Meeting
Krzyzanowska, M. K. (2003) · JAMA · doi:10.1001/jama.290.4.495 · Cited by 314 · cited 1×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundNIH clinical trials and publication bias.
Dickersin, K., & Min, Y. (1993) · PubMed · Cited by 300
Trial Registration at ClinicalTrials.gov between May and October 2005
Zarin, D. A., Tse, T., & Ide, N. C. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa053234 · Cited by 291
Issues in the Registration of Clinical Trials
Zarin, D. A., Ide, N. C., Tse, T., Harlan, W. R., West, J. C., & Lindberg, D. A. B. (2007) · JAMA · doi:10.1001/jama.297.19.2112 · Cited by 222 · cited 1×
“gov [32], progress can be made by mandating the registration of all information that is necessary for the public and profession to access and interpret trial results, including primary and secondary outcomes, study location, and enrollment, with clear field requirements to prevent vague reporting and improve data qual…”
BackgroundPublication of Clinical Trials Supporting Successful New Drug Applications: A Literature Analysis
Lee, K., Bacchetti, P., & Sim, I. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050191 · Cited by 215 · cited 2×
“gov, particularly with regards to condition studied and study location, with the exception of two recent studies focused on the publication of trials submitted to the FDA [1,2].”
BackgroundFate of biomedical research protocols and publication bias in France: retrospective cohort study
Decullier, E., Lhéritier, V., & Chapuis, F. (2005) · BMJ · doi:10.1136/bmj.38488.385995.8f · Cited by 154 · cited 2×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundPublication Bias and Research on Passive Smoking: Comparison of Published and Unpublished Studies
Misakian, A. L., & Bero, L. A. (1998) · JAMA · doi:10.1001/jama.280.3.250 · Cited by 127 · cited 1×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundBlümle, A., Huwiler, K., & Witschi, M. (2008) · Swiss Medical Weekly · doi:10.4414/smw.2008.12027 · Cited by 115
Bias in reporting clinical trials
Bardy, A. H. (1998) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.1998.00759.x · Cited by 70 · cited 1×
“Many studies have attempted to evaluate the extent of selective publication in the biomedical literature and found similarly low rates of publication [5,12–24], although none have used, to our knowledge, as large and as broadly representative a registry as ClinicalTrials.”
BackgroundKivitz, A., Greenwald, M., Cohen, S. B., Polis, A. B., Najarian, D. K., Dixon, M. E., Moidel, R. A., Green, J. A., Baraf, H. S. B., Petruschke, R. A., et al. (2004) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2004.52201.x · Cited by 33 · cited 1×
“Other evidence concerning selective publication is anecdotal, such as the absence of 6 mo of trial data from a key publication describing the efficacy of celecoxib [25,26], the delay of publication for two early trials of rofecoxib until after the medication was withdrawn from the market [27–29], and the aforementione…”
BackgroundTreatment of Patients With Osteoarthritis With Rofecoxib Compared With Nabumetone
Weaver, A. L., Messner, R. P., Storms, W. W., Polis, A. B., Najarian, D. K., Petruschke, R. A., Geba, G. P., & Tershakovec, A. M. (2006) · JCR Journal of Clinical Rheumatology · doi:10.1097/01.rhu.0000200384.79405.33 · Cited by 21 · cited 1×
“Other evidence concerning selective publication is anecdotal, such as the absence of 6 mo of trial data from a key publication describing the efficacy of celecoxib [25,26], the delay of publication for two early trials of rofecoxib until after the medication was withdrawn from the market [27–29], and the aforementione…”
BackgroundSingh, J. (2006) · Indian Journal of Pharmacology · doi:10.4103/0253-7613.19865 · Cited by 14
Cited by
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Self-citationThe ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
ResearchMatch: A National Registry to Recruit Volunteers for Clinical Research
Harris, P. A., Scott, K. W., Lebo, L., Hassan, N., Lightner, C., & Pulley, J. (2012) · Academic Medicine · doi:10.1097/acm.0b013e31823ab7d2 · Cited by 387
Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371
Self-citation
Metadata
- Authors
- Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M.
- Affiliations
- Health Services Research & Development (US)
- Yale New Haven Hospital (US)
- Amherst College (US)
- Cleveland Clinic (US)
- Corresponding author
- Ross, Joseph S.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2009-09-08
- Volume
- 6
- Issue
- 9
- Pages
- e1000144
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC2728480
- OpenAlex
- W1970223153
- Cited by
- 401
- References
- 31
- Citations by year
- 2026: 17 · 2025: 10 · 2024: 15 · 2023: 10 · 2022: 16 · 2021: 20 · 2020: 18 · 2019: 14 · 2018: 23 · 2017: 27 · 2016: 38 · 2015: 39 · 2014: 36 · 2013: 35 · 2012: 32
- FWCI
- 24.36
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- U.S. Department of Veterans Affairs (K08 AG032886)
- Hartford Foundation for Public Giving
- Amgen
- Eli Lilly and Company
- Pfizer
- Sanofi
- Health Services Research and Development
- Cleveland Clinic
- Massachusetts Medical Society
- Daiichi-Sankyo
- Novo Nordisk
- National Institute on Aging (K08AG032886)
- U.S. National Library of Medicine
- Topics
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- ClinicalTrials.gov, clinical trial registration, selective publication, publication bias, registration completeness, industry funding, publication rates, clinical trial registries, primary outcome reporting
- MeSH terms
- Clinical Trials as Topic, Cross-Sectional Studies, Drug Industry, Financing, Government, Humans, National Library of Medicine (U.S.), Periodicals as Topic, Publishing, Registries, United States, Bibliometrics, Databases, Factual, Treatment Outcome, Internet, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
