The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Failure of Investigational Drugs in Late-Stage Clinical Development and Publication of Trial Results
Abstract
IMPORTANCE: Many investigational drugs fail in late-stage clinical development. A better understanding of why investigational drugs fail can inform clinical practice, regulatory decisions, and future research. OBJECTIVE: To assess factors associated with regulatory approval or reasons for failure of investigational therapeutics in phase 3 or pivotal trials and rates of publication of trial results. DESIGN, SETTING, AND PARTICIPANTS: Using public sources and commercial databases, we identified investigational therapeutics that entered pivotal trials between 1998 and 2008, with follow-up through 2015. Agents were classified by therapeutic area, orphan designation status, fast track designation, novelty of biological pathway, company size, and as a pharmacologic or biologic product. MAIN OUTCOMES AND MEASURES: For each product, we identified reasons for failure (efficacy, safety, commercial) and assessed the rates of publication of trial results. We used multivariable logistic regression models to evaluate factors associated with regulatory approval. RESULTS: Among 640 novel therapeutics, 344 (54%) failed in clinical development, 230 (36%) were approved by the US Food and Drug Administration (FDA), and 66 (10%) were approved in other countries but not by the FDA. Most products failed due to inadequate efficacy (n = 195; 57%), while 59 (17%) failed because of safety concerns and 74 (22%) failed due to commercial reasons. The pivotal trial results were published in peer-reviewed journals for 138 of the 344 (40%) failed agents. Of 74 trials for agents that failed for commercial reasons, only 6 (8.1%) were published. In analyses adjusted for therapeutic area, agent type, firm size, orphan designation, fast-track status, trial year, and novelty of biological pathway, orphan-designated drugs were significantly more likely than nonorphan drugs to be approved (46% vs 34%; adjusted odds ratio [aOR], 2.3; 95% CI, 1.4-3.7). Cancer drugs (27% vs 39%; aOR, 0.5; 95% CI, 0.3-0.9) and agents sponsored by small and medium-size companies (28% vs 42%; aOR, 0.4; 95% CI, 0.3-0.7) were significantly less likely to be approved. CONCLUSIONS AND RELEVANCE: Roughly half of investigational drugs entering late-stage clinical development fail during or after pivotal clinical trials, primarily because of concerns about safety, efficacy, or both. Results for the majority of studies of investigational drugs that fail are not published in peer-reviewed journals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Effects of torcetrapib in patients at high risk for coronary events
Barter, P. J., Caulfield, M., Eriksson, M., Grundy, S. M., Kastelein, J. J. P., Komajda, M., Lopez-Sendon, J., Mosca, L., Tardif, J.-C., Waters, D. D., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa0706628 · Cited by 3,139
Antitumor Activity of Thalidomide in Refractory Multiple Myeloma
Singhal, S., Mehta, J., Desikan, R., Ayers, D., Roberson, P., Eddlemon, P., Munshi, N., Anaissie, E., Wilson, C., Dhodapkar, M., et al. (1999) · New England Journal of Medicine · doi:10.1056/nejm199911183412102 · Cited by 2,575
Clinical development success rates for investigational drugs
Hay, M., Thomas, D. W., Craighead, J. L., Economides, C., & Rosenthal, J. (2014) · Nature Biotechnology · doi:10.1038/nbt.2786 · Cited by 2,536
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
1,026 Experimental treatments in acute stroke
O'Collins, V. E., Macleod, M. R., Donnan, G. A., Horky, L. L., van der Worp, B. H., & Howells, D. W. (2006) · Annals of Neurology · doi:10.1002/ana.20741 · Cited by 1,460
An analysis of the attrition of drug candidates from four major pharmaceutical companies
Waring, M. J., Arrowsmith, J., Leach, A. R., Leeson, P. D., Mandrell, S., Owen, R. M., Pairaudeau, G., Pennie, W. D., Pickett, S. D., Wang, J., et al. (2015) · Nature Reviews Drug Discovery · doi:10.1038/nrd4609 · Cited by 1,450
Can Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354
A Phase 3 Trial of Semagacestat for Treatment of Alzheimer's Disease
Doody, R. S., Raman, R., Farlow, M., Iwatsubo, T., Vellas, B., Joffe, S., Kieburtz, K., He, F., Sun, X., Thomas, R. G., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1210951 · Cited by 1,224
Estimating The Cost Of New Drug Development: Is It Really $802 Million?
Adams, C. P., & Brantner, V. V. (2006) · Health Affairs · doi:10.1377/hlthaff.25.2.420 · Cited by 907
Phase II and Phase III attrition rates 2011–2012
Arrowsmith, J., & Miller, P. (2013) · Nature Reviews Drug Discovery · doi:10.1038/nrd4090 · Cited by 697
Underreporting Research Is Scientific Misconduct
Chalmers, L. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100121018 · Cited by 551
The discovery of first-in-class drugs: origins and evolution
Eder, J., Sedrani, R., & Wiesmann, C. (2014) · Nature Reviews Drug Discovery · doi:10.1038/nrd4336 · Cited by 514
O'Day, S. J., Eggermont, A. M. M., Chiarion-Sileni, V., Kefford, R., Grob, J. J., Mortier, L., Robert, C., Schachter, J., Testori, A., Mackiewicz, J., et al. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2012.44.5585 · Cited by 373
Rising, K., Bacchetti, P., & Bero, L. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050217 · Cited by 328
Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses
Hart, B., Lundh, A., & Bero, L. (2012) · BMJ · doi:10.1136/bmj.d7202 · Cited by 255
Characteristics of Clinical Trials to Support Approval of Orphan vs Nonorphan Drugs for Cancer
Kesselheim, A. S. (2011) · JAMA · doi:10.1001/jama.2011.769 · Cited by 230
Self-citationPublication of Clinical Trials Supporting Successful New Drug Applications: A Literature Analysis
Lee, K., Bacchetti, P., & Sim, I. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050191 · Cited by 215
Sacks, L. V., Shamsuddin, H. H., Yasinskaya, Y. I., Bouri, K., Lanthier, M. L., & Sherman, R. E. (2014) · JAMA · doi:10.1001/jama.2013.282542 · Cited by 214
O'Day, S., Gonzalez, R., Lawson, D., Weber, R., Hutchins, L., Anderson, C., Haddad, J., Kong, S., Williams, A., & Jacobson, E. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.17.1579 · Cited by 208
Kesselheim, A. S., Wang, B., Franklin, J. M., & Darrow, J. J. (2015) · BMJ · doi:10.1136/bmj.h4633 · Cited by 189
Self-citationDrug-Review Deadlines and Safety Problems
Carpenter, D., Zucker, E. J., & Avorn, J. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0706341 · Cited by 175
Self-citationTwo decades of new drug development for central nervous system disorders
Kesselheim, A. S., Hwang, T. J., & Franklin, J. M. (2015) · Nature Reviews Drug Discovery · doi:10.1038/nrd4793 · Cited by 160
Self-citationSelective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy
THIERS, B. H. (2009) · Yearbook of Dermatology and Dermatologic Surgery · doi:10.1016/s0093-3619(08)79042-7 · Cited by 157
Lanthier, M. L., Miller, K. L., Nardinelli, C., & Woodcock, J. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.0541 · Cited by 139
Sharing and Reporting the Results of Clinical Trials
Hudson, K., & Collins, F. S. (2014) · JAMA · doi:10.1001/jama.2014.10716 · Cited by 130
Under-reporting of harm in clinical trials
Šeruga, B., Templeton, A. J., Badillo, F. E. V., Ocaña, A., Amir, E., & Tannock, I. F. (2016) · The Lancet Oncology · doi:10.1016/s1470-2045(16)00152-2 · Cited by 119
The Use of Superlatives in Cancer Research
Abola, M. V., & Prasad, V. K. (2015) · JAMA Oncology · doi:10.1001/jamaoncol.2015.3931 · Cited by 91
New treatments compared to established treatments in randomized trials
Djulbegović, B., Kumar, A., Glasziou, P., Perera, R., Reljic, T., Stanton, L., Raftery, J. P., Johansen, M., Tanna, G. L. D., Miladinović, B., et al. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000024.pub3 · Cited by 77
Pivotal studies of orphan drugs approved for neurological diseases
Mitsumoto, J., Dorsey, E. R., Beck, C. A., Kieburtz, K. D., & Griggs, R. C. (2009) · Annals of Neurology · doi:10.1002/ana.21676 · Cited by 71
Lost in Translation: Neuropsychiatric Drug Development
Becker, R. E., & Greig, N. H. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3000446 · Cited by 59
Why Do Phase III Clinical Trials in Oncology Fail so Often?
Amiri‐Kordestani, L., & Fojo, T. (2012) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djs180 · Cited by 58
Temporal Trends and Factors Associated With Cardiovascular Drug Development, 1990 to 2012
Hwang, T. J., Lauffenburger, J. C., Franklin, J. M., & Kesselheim, A. S. (2016) · JACC Basic to Translational Science · doi:10.1016/j.jacbts.2016.03.012 · Cited by 38
Self-citationHakala, A., Kimmelman, J., Carlisle, B. G., Freeman, G., & Fergusson, D. A. (2015) · BMJ · doi:10.1136/bmj.h1116 · Cited by 29
Ross, J. S., Dzara, K., & Downing, N. S. (2015) · Health Affairs · doi:10.1377/hlthaff.2014.1160 · Cited by 24
Publication of Pivotal Efficacy Trials for Novel Therapeutic Agents Approved Between 2005 and 2011
Smithy, J. W., Downing, N. S., & Ross, J. S. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.3438 · Cited by 21
New treatments compared to established treatments in randomized trials
Soares, H., Kumar, A., Vist, G., Johansen, M., Paulsen, E., Oxman, A. D., Chalmers, I., & Djulbegović, B. (2006) · doi:10.1002/14651858.mr000024 · Cited by 11
21st Century Cures Act and similar policy efforts: at what cost?:
Zuckerman, D. M., Jury, N. J., & Silcox, C. (2015) · BMJ · doi:10.1136/bmj.h6122 · Cited by 10
Cited by
Fogel, D. B. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.08.001 · Cited by 1,035
Drug discovery and development: Role of basic biological research
Mohs, R. C., & Greig, N. H. (2017) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1016/j.trci.2017.10.005 · Cited by 673
Searching for and selecting studies
Lefebvre, C., Glanville, J., Briscoe, S., Littlewood, A., Marshall, C., Metzendorf, M., Noel‐Storr, A., Rader, T., Shokraneh, F., Thomas, J., et al. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch4 · Cited by 647
Dealing with the positive publication bias: Why you should really publish your negative results
Mlinarić, A., Horvat, M., & Šupak Smolčić, V. (2017) · Biochemia Medica · doi:10.11613/bm.2017.030201 · Cited by 514
Pound, P., & Ritskes-Hoitinga, M. (2018) · Journal of Translational Medicine · doi:10.1186/s12967-018-1678-1 · Cited by 419
Metadata
- Authors
- Hwang, T. J., Carpenter, D., Lauffenburger, J. C., Wang, B., Franklin, J. M., & Kesselheim, A. S.
- Venue
- JAMA Internal Medicine
- Publisher
- American Medical Association (AMA)
- Published
- 2016-12-01
- Volume
- 176
- Issue
- 12
- Pages
- 1826
- ISSN
- 2168-6106 (ISSN-L)
- OpenAlex
- W2531470489
- Cited by
- 442
- References
- 38
- FWCI
- 29.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.