Increasing disparities between resource inputs and outcomes, as measured by certain health deliverables, in biomedical research
Open accessAbstract
Significance: The general public funds the vast majority of biomedical research and is also the major intended beneficiary of biomedical breakthroughs. We show that increasing research investments, resulting in an increasing knowledge base, have not yielded comparative gains in certain health outcomes over the last five decades. We demonstrate that monitoring scientific inputs, outputs, and outcomes can be used to estimate the productivity of the biomedical research enterprise and may be useful in assessing future reforms and policy changes. A wide variety of negative pressures on the scientific enterprise may be contributing to a relative slowing of biomedical therapeutic innovation. Slowed biomedical research outcomes have the potential to undermine confidence in science, with widespread implications for research funding and public health.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The clinical translation of promising fundamental discoveries and preclinical approaches in nanomedicine and cell therapy has been challenging and inefficient.
“The clinical translation of promising products, technologies and interventions from the disciplines of nanomedicine and cell therapy has been slow and inefficient.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Continuous cultures of fused cells secreting antibody of predefined specificity
Köhler, G., & Milstein, C. (1975) · Nature · doi:10.1038/256495a0 · Cited by 17,200 · see citing works
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · see citing works
Iwai, Y., Ishida, M., Tanaka, Y., Okazaki, T., Honjo, T., & Minato, N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.192461099 · Cited by 3,204 · see citing works
Genomic responses in mouse models poorly mimic human inflammatory diseases
Seok, J., Warren, H. S., Cuenca, A. G., Mindrinos, M. N., Baker, H. V., Xu, W., Richards, D. R., McDonald-Smith, G. P., Gao, H., Hennessy, L., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1222878110 · Cited by 3,005 · see citing works
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1× · see citing works
“One such study found that only 11% of findings could be confirmed in 53 “landmark” hematology and oncology publications (6).”
BackgroundA STUDY OF THE ADRENOTROPIC RECEPTORS
Ahlquist, R. P. (1948) · American Journal of Physiology-Legacy Content · doi:10.1152/ajplegacy.1948.153.3.586 · Cited by 2,908 · see citing works
Chemotherapy and the war on cancer
Chabner, B. A., & Roberts, T. G. (2005) · Nature reviews. Cancer · doi:10.1038/nrc1529 · Cited by 2,152 · see citing works
Diagnosing the decline in pharmaceutical R&D efficiency
Scannell, J. W., Blanckley, A., Boldon, H., & Warrington, B. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3681 · Cited by 1,981 · see citing works
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · see citing works
Evaluating cell lines as tumour models by comparison of genomic profiles
Domcke, S., Sinha, R., Levine, D. A., Sander, C., & Schultz, N. D. (2013) · Nature Communications · doi:10.1038/ncomms3126 · Cited by 1,426 · see citing works
PD-1 and PD-1 ligands: from discovery to clinical application
Okazaki, T., & Honjo, T. (2007) · International Immunology · doi:10.1093/intimm/dxm057 · Cited by 1,310 · see citing works
Changing patterns of mortality across Europe in patients infected with HIV-1
Mocroft, A., Vella, S., Benfield, T., Chiesi, A., Miller, V., Gargalianos, P., Monforte, A. D., Yust, I., Bruun, J., Phillips, A. N., et al. (1998) · The Lancet · doi:10.1016/s0140-6736(98)03201-2 · Cited by 1,269 · see citing works
Policy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247 · see citing works
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · see citing works
Self-citationThe economics of reproducibility in preclinical research
Freedman, L. P., Cockburn, I. M., & Simcoe, T. S. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002165 · Cited by 1,055 · see citing works
Wilkinson, E. (2002) · Nature Cell Biology · doi:10.1016/s1470-2045(02)00737-4 · Cited by 951 · see citing works
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887 · see citing works
Lovastatin and beyond: the history of the HMG-CoA reductase inhibitors
Tobert, J. A. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1112 · Cited by 878 · see citing works
Reproducibility crisis: Blame it on the antibodies
Baker, M. (2015) · Nature · doi:10.1038/521274a · Cited by 830 · see citing works
Jackson, D. A., Symons, R. H., & Berg, P. (1972) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.69.10.2904 · Cited by 783 · see citing works
Relativity in the Global Positioning System
Ashby, N. (2003) · Living Reviews in Relativity · doi:10.12942/lrr-2003-1 · Cited by 691 · see citing works
Encoded evidence: DNA in forensic analysis
Jobling, M. A., & Gill, P. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1455 · Cited by 632 · see citing works
Fleming, A. (1980) · Clinical Infectious Diseases · doi:10.1093/clinids/2.1.129 · Cited by 614 · see citing works
A universal pattern of mortality decline in the G7 countries
Tuljapurkar, S. D., Li, N., & Boe, C. (2000) · Nature · doi:10.1038/35015561 · Cited by 541 · see citing works
The Decline in Ischemic Heart Disease Mortality Rates
Goldman, L., & COOK, E. F. (1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-101-6-825 · Cited by 541 · see citing works
Increasing value and reducing waste in biomedical research regulation and management
Salman, R. A., Beller, E., Kagan, J., Hemminki, E., Phillips, R. S., Savulescu, J., Macleod, M. R., Wisely, J., & Chalmers, I. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62297-7 · Cited by 532 · see citing works
Guidelines for the use of cell lines in biomedical research
Geraghty, R. J., Capes‐Davis, A., Davis, J. M., Downward, J., Freshney, R. I., Knežević, I., Lovell-Badge, R. H., Masters, J. R., Meredith, J., Stacey, G. N., et al. (2014) · British Journal of Cancer · doi:10.1038/bjc.2014.166 · Cited by 526 · see citing works
Why Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al‐Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 504 · see citing works
(U.S.), N. L. O. M. (2008) · Journal of Pain & Palliative Care Pharmacotherapy · doi:10.1080/15360280801989377 · Cited by 474 · see citing works
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441 · see citing works
Why has the number of scientific retractions increased?
Steen, R. G., Casadevall, A., & Fang, F. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068397 · Cited by 415 · see citing works
Self-citationMedical Virology of Hepatitis B: how it began and where we are now
Gerlich, W. H. (2013) · Virology Journal · doi:10.1186/1743-422x-10-239 · Cited by 349 · see citing works
Translation of highly promising basic science research into clinical applications
Contopoulos-Ioannidis, D. G., Ntzani, E. E., & Ioannidis, J. P. A. (2003) · The American Journal of Medicine · doi:10.1016/s0002-9343(03)00013-5 · Cited by 323 · see citing works
Measuring the societal impact of research
Bornmann, L. (2012) · EMBO Reports · doi:10.1038/embor.2012.99 · Cited by 257 · see citing works
STEM crisis or STEM surplus? Yes and yes
Xue, Y., & Larson, R. C. (2015) · Monthly labor review · doi:10.21916/mlr.2015.14 · Cited by 250 · see citing works
Life cycle of translational research for medical interventions
Contopoulos-Ioannidis, D. G., Alexiou, G. A., Gouvias, T. C., & Ioannidis, J. P. A. (2008) · Science · doi:10.1126/science.1160622 · Cited by 207 · see citing works
Causes for the Persistence of Impact Factor Mania
Casadevall, A., & Fang, F. C. (2014) · mBio · doi:10.1128/mbio.00064-14 · Cited by 197 · see citing works
Self-citationIoannidis, J. P. A. (2014) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2014.11.008 · Cited by 169 · see citing works
U.S. Patent and Trademark Office
Hjerpe, L. S. (2003) · Legal Reference Services Quarterly · doi:10.1300/j113v22n01_06 · Cited by 166 · see citing works
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156 · see citing works
Self-citationSmith, C. G., & Vane, J. R. (2003) · The FASEB Journal · doi:10.1096/fj.03-0093life · Cited by 153 · see citing works
Ten years of Orthoclone OKT3 (muromonab-CD3): a review
Smith, S. L. (1996) · Progress in Transplantation · doi:10.7182/prtr.1.6.3.8145l3u185493182 · Cited by 147 · see citing works
Asia's Ascent — Global Trends in Biomedical R&D Expenditures
Chakma, J., Sun, G. H., Steinberg, J. D., Sammut, S. M., & Jagsi, R. (2014) · New England Journal of Medicine · doi:10.1056/nejmp1311068 · Cited by 130 · see citing works
Inflated numbers of authors over time have not been just due to increasing research complexity
Papatheodorou, S., Trikalinos, T. A., & Ioannidis, J. P. A. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.017 · Cited by 113 · see citing works
RELATION OF AUSTRALIA AND SH ANTIGENS
Prince, A. M. (1968) · The Lancet · doi:10.1016/s0140-6736(68)90512-6 · Cited by 109 · see citing works
Casadevall, A., & Fang, F. C. (2014) · Infection and Immunity · doi:10.1128/iai.01530-13 · Cited by 100 · see citing works
Self-citationSources of error in the retracted scientific literature
Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · The FASEB Journal · doi:10.1096/fj.14-256735 · Cited by 89 · see citing works
Self-citationQuirke, V. M. (2006) · Medical History · doi:10.1017/s0025727300009455 · Cited by 69 · see citing works
Reforming Science: Structural Reforms
Fang, F. C., & Casadevall, A. (2012) · Infection and Immunity · doi:10.1128/iai.06184-11 · Cited by 60 · see citing works
Self-citationHow Do Incentives Affect Creativity?Preprint
Eckartz, K., Kirchkamp, O., & Schunk, D. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2198760 · Cited by 54 · see citing works
Discovery and development of penicillin.
Abraham, E. P. (1946) · PubMed · Cited by 54 · see citing works
The ACE and I: how ACE inhibitors came to be
Erdös, E. G. (2006) · The FASEB Journal · doi:10.1096/fj.06-0602ufm · Cited by 52 · see citing works
Barham, B. L., Foltz, J. D., & Prager, D. (2013) · Research Policy · doi:10.1016/j.respol.2013.08.007 · Cited by 42 · see citing works
Science denial: a guide for scientists
Rosenau, J. (2012) · Trends in Microbiology · doi:10.1016/j.tim.2012.10.002 · Cited by 41 · see citing works
Witzel, M. L. (2002) · London Business School Review · doi:10.1111/1467-8616.00232 · Cited by 37 · see citing works
The Evolution of Medical Imaging: From Geiger Counters to MRI--A Personal Saga
Mallard, J. R. (2003) · Perspectives in biology and medicine · doi:10.1353/pbm.2003.0040 · Cited by 21 · see citing works
Crow, M. M. (2011) · Nature · doi:10.1038/471569a · Cited by 21 · see citing works
Important Science—It's All about the SPIN
Casadevall, A., & Fang, F. C. (2009) · Infection and Immunity · doi:10.1128/iai.00757-09 · Cited by 20 · see citing works
Self-citation(2012) · Nature Biotechnology · doi:10.1038/nbt.2335 · Cited by 19 · see citing works
Free Precession Techniques in Nuclear Magnetic Resonance.
Carr, H. Y. (1953) · PhDT · Cited by 16 · see citing works
Cowper, S. G. (1968) · The Lancet · doi:10.1016/s0140-6736(68)92658-5 · Cited by 8 · see citing works
Congress seeks to quash patent trolls
Ledford, H. K. (2015) · Nature · doi:10.1038/521270a · Cited by 2 · see citing works
The levothyroxine spectrum: Bioequivalence and cost considerations
Santella, T. M., & Wertheimer, A. I. (2005) · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287 · see citing works
“comes, such as the discovery of new pharmacological agents (13).”
BackgroundSelf-citationIoannidis, J. P. A., Kim, B. Y. S., & Trounson, A. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0314-y · Cited by 175 · see citing works
Biomedical text mining for research rigor and integrity: tasks, challenges, directions
Kilicoglu, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx057 · Cited by 61 · see citing works
Byrne, J. A., & Labbé, C. (2017) · Scientometrics · doi:10.1007/s11192-016-2209-6 · Cited by 50 · see citing works
- Authors
- Bowen, A., & Casadevall, A.
- Affiliations
- Albert Einstein College of Medicine (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2015-08-17
- Volume
- 112
- Issue
- 36
- Pages
- 11335-11340
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC4568675
- OpenAlex
- W2130727984
- Cited by
- 104
- References
- 65
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 6 · 2023: 5 · 2022: 11 · 2021: 10 · 2020: 4 · 2019: 20 · 2018: 12 · 2017: 8 · 2016: 18 · 2015: 4
- FWCI
- 14.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- HHS | National Institutes of Health (T32 GM007288, R37 AI033142)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Decision Sciences › Information Systems and Management › Research, Science, and Academia
- Keywords
- research efficiency, life expectancy, new chemical entities, FDA drug approval, NIH funding, publication productivity, citation counts, research quality, reductionism, scientific specialization
- MeSH terms
- Efficiency, Forecasting, Health Resources, Humans, National Institutes of Health (U.S.), Public Health, Publications, United States, Biomedical Research, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
