Measuring clinical trial transparency: an empirical analysis of newly approved drugs and large pharmaceutical companies
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Objectives: To define a series of clinical trial transparency measures and apply them to large pharmaceutical and biotechnology companies and their 2014 FDA-approved drugs. Design: Cross-sectional descriptive analysis of all clinical trials supporting 2014 Food and Drugs Administration (FDA)-approved new drug applications (NDAs) for novel drugs sponsored by large companies. Data sources: Data from over 45 sources, including Drugs@FDA.gov, ClinicalTrials.gov, corporate and international registries; PubMed, Google Scholar, EMBASE, corporate press releases, Securities and Exchange Commission (SEC) filings and personal communications with drug manufacturers. Outcome measures: Trial registration, results reporting, clinical study report (CSR) synopsis sharing, biomedical journal publication, and FDA Amendments Acts (FDAAA) compliance, analysed on the drug level. Results: The FDA approved 19 novel new drugs, sponsored by 11 large companies, involving 553 trials, in 2014. We analysed 505 relevant trials. Per drug, a median of 100% (IQR 86%–100%) of trials in patients were registered, 71% (IQR 57%–100%) reported results or shared a CSR synopsis, 80% (70%–100%) were published and 96% (80%–100%) were publicly available in some form by 13 months after FDA approval. Disclosure rates were lower at FDA approval (65%) and improved significantly by 6 months post FDA approval. Per drug, a median of 100% (IQR 75%–100%) of FDAAA-applicable trials were compliant. Half of reviewed drugs had publicly disclosed results for all trials in patients in our sample. One trial was uniquely registered in a corporate registry, and not ClinicalTrials.gov; 0 trials were uniquely registered in international registries. Conclusions: Among large pharmaceutical companies and new drugs, clinical trial transparency is high based on several standards, although opportunities for improvement remain. Transparency is markedly higher for trials in patients than among all trials supporting drug approval, including trials in healthy volunteers. Ongoing efforts to publicly track companies’ transparency records and recognise exemplary companies may encourage further progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Available, N. (2000) · JAMA · doi:10.1001/jama.284.23.3043 · Cited by 2,344
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 4×
“For pharmaceutical companies with only one drug approved by the FDA in 2014, we averaged their scores on (1) the trials-in-patients analysis, excluding trials in healthy volunteers, and (2) a FDAAA compliance standard that counted a trial as compliant if it satisfied either interpretation of the reporting requirements.”
BackgroundMethodInfluentialSelf-citationCompliance with Results Reporting at ClinicalTrials.gov
Anderson, M. L., Chiswell, K., Peterson, E. D., Tasneem, A., Topping, J., & Califf, R. M. (2015) · New England Journal of Medicine · doi:10.1056/nejmsa1409364 · Cited by 380
Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371
Self-citationNon-publication of large randomized clinical trials: cross sectional analysis
Jones, C. W., Handler, L., Crowell, K. E., Keil, L. G., Weaver, M. A., & Platts-Mills, T. F. (2013) · BMJ · doi:10.1136/bmj.f6104 · Cited by 350 · cited 1×
“Finally, the trial must meet one of the following conditions: (1) at least one US site, (2) conducted under an FDA investigational new drug application, or (3) involve a drug, biologic or device manufactured in USA or its territories, and exported for research.”
MethodTrial Reporting in ClinicalTrials.gov — The Final Rule
Zarin, D. A., Tse, T., Williams, R. J., & Carr, S. (2016) · New England Journal of Medicine · doi:10.1056/nejmsr1611785 · Cited by 332
Chen, R., Desai, N. R., Ross, J. S., Zhang, W., Chau, K. H., Wayda, B., Murugiah, K., Lu, D. Y., Mittal, A., & Krumholz, H. M. (2016) · BMJ · doi:10.1136/bmj.i637 · Cited by 227
Self-citationPublication of Clinical Trials Supporting Successful New Drug Applications: A Literature Analysis
Lee, K., Bacchetti, P., & Sim, I. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050191 · Cited by 215
Cited by
Alzheimer's disease drug development pipeline: 2019
Cummings, J., Lee, G., Ritter, A., Sabbagh, M., & Zhong, K. (2019) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1016/j.trci.2019.05.008 · Cited by 762
Alzheimer's disease drug development pipeline: 2018
Cummings, J., Lee, G., Ritter, A., & Zhong, K. (2018) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1016/j.trci.2018.03.009 · Cited by 697
Alzheimer’s disease drug development pipeline: 2020
Cummings, J., Lee, G., Ritter, A., Sabbagh, M., & Zhong, K. (2020) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1002/trc2.12050 · Cited by 557
Mazzucato, M., & Li, H. L. (2021) · Journal of Law, Medicine & Ethics · doi:10.1017/jme.2021.8 · Cited by 60
A call for clinical trial globalization in Alzheimer's disease and related dementia
Llibre‐Guerra, J. J., Heavener, A., Brucki, S. M. D., Marante, J. P. D., Pintado‐Caipa, M., Chen, Y., Behrens, M. I., Hardi, A., Admirall‐Sanchez, A., Akinyemi, R., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.12995 · Cited by 37
Metadata
- Authors
- Miller, J. E., Wilenzick, M., Ritcey, N., Ross, J. S., & Mello, M. M.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-12
- Volume
- 7
- Issue
- 12
- Pages
- e017917
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2773184184
- Cited by
- 62
- References
- 12
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.