Linking ClinicalTrials.gov and PubMed to Track Results of Interventional Human Clinical Trials
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: In an effort to understand how results of human clinical trials are made public, we analyze a large set of clinical trials registered at ClinicalTrials.gov, the world's largest clinical trial registry. MATERIALS AND METHODS: We considered two trial result artifacts: (1) existence of a trial result journal article that is formally linked to a registered trial or (2) the deposition of a trial's basic summary results within the registry. RESULTS: The study sample consisted of 8907 completed, interventional, phase 2-or-higher clinical trials that were completed in 2006-2009. The majority of trials (72.2%) had no structured trial-article link present. A total of 2367 trials (26.6%) deposited basic summary results within the registry. Of those, 969 trials (10.9%) were classified as trials with extended results and 1398 trials (15.7%) were classified as trials with only required basic results. The majority of the trials (54.8%) had no evidence of results, based on either linked result articles or basic summary results (silent trials), while a minimal number (9.2%) report results through both registry deposition and publication. DISCUSSION: Our study analyzes the body of linked knowledge around clinical trials (which we refer to as the "trialome"). Our results show that most trials do not report results and, for those that do, there is minimal overlap in the types of reporting. We identify several mechanisms by which the linkages between trials and their published results can be increased. CONCLUSION: Our study shows that even when combining publications and registry results, and despite availability of several information channels, trial sponsors do not sufficiently meet the mandate to inform the public either via a linked result publication or basic results submission.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One study considered links from both cohorts of registry entries and published articles [15, 26], for a total of 82 analyses.”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous studies that examined the availability of automatic links provided a broad analysis of automatic links made available through ClinicalTrials.gov and PubMed but did not systematically evaluate the proportion of links that could additionally be resolved using manual processes [15, 16, 63].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These links can be established in an automatic fashion if the publication abstract or metadata includes the registry identifier [15, 16].”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [15]
In the citing paper
“A proportion of those links can be accessed automatically,28 29 but the remainder must be determined by inference or inquiry.”
From Systematic review protocol assessing the processes for linking clinical trial registries and their published results (2016) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747 · cited 1×
“Ideally, every trial should have at least one result article, even trials with non-significant or negative findings, although these may be harder to publish due to publication bias [12].”
BackgroundTrial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 4×
“04 years and that 81% of studies that eventually publish and link a result article do so within 3 years after completion date [3,4,6,18].”
BackgroundResultInfluentialPublication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371 · cited 4×
“04 years and that 81% of studies that eventually publish and link a result article do so within 3 years after completion date [3,4,6,18].”
BackgroundResultInfluentialPrayle, A. P., Hurley, M. N., & Smyth, A. R. (2012) · BMJ · doi:10.1136/bmj.d7373 · Cited by 290
The Quality of Registration of Clinical Trials
Viergever, R. F., & Ghersi, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0014701 · Cited by 150
Reporting “Basic Results” in ClinicalTrials.gov
Tse, T., Williams, R. J., & Zarin, D. A. (2009) · CHEST Journal · doi:10.1378/chest.08-3022 · Cited by 140
Huić, M., Marušić, M., & Marušić, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025258 · Cited by 114
Vedula, S. S., Li, T., & Dickersin, K. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001378 · Cited by 87
Huser, V., & Cimino, J. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001501 · Cited by 85 · cited 2×
“Our study analyzes the body of linked knowledge around clinical trials (which we refer to as the “trialome” [16]) in terms of existence of linked result article or presence of basic summary results using data from the world’s largest biomedical literature citation database and the world’s largest clinical trial regist…”
BackgroundMethodSelf-citationClinical Research Involving Children: Registration, Completeness, and Publication
Shamliyan, T., & Kane, R. L. (2012) · Pediatrics · doi:10.1542/peds.2010-2847 · Cited by 59
Publication bias in clinical trials of electronic health records
Vawdrey, D. K., & Hripcsak, G. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.08.007 · Cited by 38
Do urology journals enforce trial registration? A cross-sectional study of published trials
Kunath, F., Grobe, H. R., Keck, B., Rücker, G., Wullich, B., Antes, G., & Meerpohl, J. J. (2011) · BMJ Open · doi:10.1136/bmjopen-2011-000430 · Cited by 32
Precision and negative predictive value of links between ClinicalTrials.gov and PubMed.
Huser, V., & Cimino, J. J. (2012) · PubMed Central · Cited by 27
Self-citationMarušić, A., & Huić, M. (2008) · Croatian Medical Journal · doi:10.3325/cmj.2008.5.582 · Cited by 16
Results and Outcome Reporting In ClinicalTrials.gov, What Makes it Happen?
Kirillova, O. (2012) · PLoS ONE · doi:10.1371/journal.pone.0037847 · Cited by 16
Result Publication of Chinese Trials in World Health Organization Primary Registries
Xuemei, L., Youping, L., Senlin, Y., & Shangqi, S. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012676 · Cited by 7
Overview of the FDA Amendments Act of 2007: Its Effect on the Drug Development Landscape
Kishore, R., & Tabor, E. (2010) · Drug Information Journal · doi:10.1177/009286151004400411 · Cited by 5
Translational Science on Trialome: Retrolective Study of Publishing Results of Clinical Trials.
Huser, V., & Cimino, J. J. (2012) · AMIA · Cited by 2
Self-citation
Research works printed but not linked: 1
- Huser V, Cimino JJ (2013) Evaluating adherence to ICMJE’s policy of mandatory, timely clinical trial registration. J Am Med Inform Assoc (2013). PubMed: 23396544 PMC3715364 23396544
Cited by
DeVito, N. J., Bacon, S., & Goldacre, B. (2020) · The Lancet · doi:10.1016/s0140-6736(19)33220-9 · Cited by 336
Schmucker, C., Schell, L. K., Portalupi, S., Oeller, P., Cabrera, L., Bassler, D., Schwarzer, G., Scherer, R. W., Antes, G., von Elm, E., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114023 · Cited by 269
Viergever, R. F., & Li, K. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008932 · Cited by 228
Discontinuation and non-publication of surgical randomised controlled trials: observational study
Chapman, S. J., Shelton, B., Mahmood, H., Fitzgerald, J. E., Harrison, E. M., & Bhangu, A. (2014) · BMJ · doi:10.1136/bmj.g6870 · Cited by 221
The clinical trials landscape for glioblastoma: is it adequate to develop new treatments?
Vanderbeek, A. M., Rahman, R. M., Fell, G. G., Ventz, S., Chen, T., Redd, R. A., Parmigiani, G., Cloughesy, T. F., Wen, P. Y., Trippa, L., et al. (2018) · Neuro-Oncology · doi:10.1093/neuonc/noy027 · Cited by 150
Metadata
- Authors
- Huser, V., & Cimino, J. J.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Huser, Vojtech
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-07-09
- Volume
- 8
- Issue
- 7
- Pages
- e68409
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3706420
- OpenAlex
- W2070430141
- Cited by
- 90
- References
- 19
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 8 · 2023: 4 · 2022: 9 · 2021: 7 · 2020: 5 · 2019: 6 · 2018: 10 · 2017: 6 · 2016: 9 · 2015: 6 · 2014: 8 · 2013: 2
- FWCI
- 18.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health
- U.S. National Library of Medicine
- NIH Clinical Center
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- clinical trial registries, ClinicalTrials.gov, PubMed, trial sponsors
- MeSH terms
- Clinical Trials as Topic, Humans, Publications, Registries, Databases, Factual, PubMed, Public Health Informatics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.