Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 101–200 of 1,001
Lazic, S. E., & Essioux, L. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-37 · Cited by 237
“Given the above concerns, it is not surprising that the pharmaceutical industry has difficulty reproducing many published results [36-39].”
ResultAn open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
“Reproducing prior results is challenging because of insufficient, incomplete, or inaccurate reporting of methodologies ( Hess, 2011 ; Prinz et al., 2011 ; Steward et al., 2012 ; Hackam and Redelmeier, 2006 ; Landis et al., 2011 ).”
Model Uncertainty and Robustness: A Computational Framework for Multimodel Analysis
Young, C., & Holsteen, K. (2017) · Sociological Methods & Research · doi:10.1177/0049124115610347 · Cited by 239
“The company recently reported that in its efforts at replication, two-thirds of the published findings it studied could not be supported (Prinz et al. 2011).”
BackgroundWhat makes a good drug target?
Gashaw, I., Ellinghaus, P., Sommer, A., & Asadullah, K. (2011) · Drug Discovery Today · doi:10.1016/j.drudis.2011.09.007 · Cited by 240
Self-citationTakebe, T., Imai, R., & Ono, S. (2018) · Clinical and Translational Science · doi:10.1111/cts.12577 · Cited by 238
Hall, W., Carter, A., & Forlini, C. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)00126-6 · Cited by 231
Microbiota and reproducibility of rodent models
Franklin, C. L., & Ericsson, A. C. (2017) · Lab Animal · doi:10.1038/laban.1222 · Cited by 232
Hutton, C., Wagener, T., Freer, J., Han, D., Duffy, C., & Arheimer, B. (2016) · Water Resources Research · doi:10.1002/2016wr019285 · Cited by 233
Improving target assessment in biomedical research: the GOT-IT recommendations
Emmerich, C. H., Gamboa, L. M., Hofmann, M. C. J., Bonin-Andresen, M., Arbach, O., Schendel, P., Gerlach, B., Hempel, K., Bespalov, A., Dirnagl, U., et al. (2021) · Nature Reviews Drug Discovery · doi:10.1038/s41573-020-0087-3 · Cited by 226
Artificial Intelligence for Drug Discovery: Are We There Yet?
Hasselgren, C., & Oprea, T. I. (2024) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-040323-040828 · Cited by 236
“Bayer (171) and Amgen (172) have reported low reproducibility rates (33% and 11%, respectively) of high-impact publications, and many biomedical publications are false (173).”
BackgroundSix red flags for suspect work
Begley, C. G. (2013) · Nature · doi:10.1038/497433a · Cited by 230
Larsson, P., Engqvist, H., Biermann, J., Werner Rönnerman, E., Forssell-Aronsson, E., Kovács, A., Karlsson, P., Helou, K., & Parris, T. Z. (2020) · Scientific Reports · doi:10.1038/s41598-020-62848-5 · Cited by 229
In silico methods to address polypharmacology: current status, applications and future perspectives
Lavecchia, A., & Cerchia, C. (2016) · Drug Discovery Today · doi:10.1016/j.drudis.2015.12.007 · Cited by 225
Responsible Conduct of Research
Shamoo, A. E., & Resnik, D. B. (2022) · doi:10.1093/oso/9780197547090.001.0001 · Cited by 224
Mechanistic enzymology in drug discovery: a fresh perspective
Holdgate, G. A., Meek, T. D., & Grimley, R. L. (2018) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.219 · Cited by 220
Garner, J. P. (2014) · ILAR Journal · doi:10.1093/ilar/ilu047 · Cited by 221
Genomic evolution of cancer models: perils and opportunities
Ben-David, U., Beroukhim, R., & Golub, T. R. (2019) · Nature Reviews Cancer · doi:10.1038/s41568-018-0095-3 · Cited by 222
Regulation of the Cerebral Circulation by Arterial Carbon Dioxide
Hoiland, R. L., Fisher, J. A., & Ainslie, P. N. (2019) · Comprehensive Physiology · doi:10.1002/cphy.c180021 · Cited by 221
On determining sample size in experiments involving laboratory animals
Festing, M. F. (2018) · Laboratory Animals · doi:10.1177/0023677217738268 · Cited by 213
Prestigious Science Journals Struggle to Reach Even Average Reliability
Brembs, B. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00037 · Cited by 213
Amur, S., LaVange, L., Zineh, I., Buckman‐Garner, S., & Woodcock, J. (2015) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.136 · Cited by 211
Publication bias in meta‐analyses from the Cochrane Database of Systematic Reviews
Kicinski, M., Springate, D. A., & Kontopantelis, E. (2015) · Statistics in Medicine · doi:10.1002/sim.6525 · Cited by 210
Fochler, M., Felt, U., & Müller, R. (2016) · Minerva · doi:10.1007/s11024-016-9292-y · Cited by 208
“This shift has arguably created problems for the knowledge base of science, casting doubt on the reliability of published results (Fanelli 2012; Prinz et al. 2011; Schatz 2014).”
ResultPreclinical research in Rett syndrome: setting the foundation for translational success
Katz, D. M., Berger-Sweeney, J. E., Eubanks, J. H., Justice, M. J., Neul, J. L., Pozzo-Miller, L., Blue, M. E., Christian, D., Crawley, J. N., Giustetto, M., et al. (2012) · Disease Models & Mechanisms · doi:10.1242/dmm.011007 · Cited by 206
“…of potential drug targets in animal models of amyotrophic lateral sclerosis (ALS) (Scott et al., 2008), women’s health and cardiovascular disease (Prinz et al., 2011), cancer (Begley and Ellis, 2012; Prinz et al., 2011) or spinal cord injury (Steward et al., 2012), the authors of follow-up…”
BackgroundImproving and Accelerating Drug Development for Nervous System Disorders
Pankevich, D. E., Altevogt, B. M., Dunlop, J., Gage, F. H., & Hyman, S. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.007 · Cited by 206
Choose and Use Your Chemical Probe Wisely to Explore Cancer Biology
Blagg, J., & Workman, P. (2017) · Cancer Cell · doi:10.1016/j.ccell.2017.06.005 · Cited by 203
Developing predictive assays: The phenotypic screening “rule of 3”
Vincent, F., Loria, P., Pregel, M., Stanton, R., Kitching, L., Nocka, K., Doyonnas, R., Steppan, C., Gilbert, A., Schroeter, T., et al. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab1201 · Cited by 199
Look back in anger – what clinical studies tell us about preclinical work
Hartung, T. (2013) · ALTEX · doi:10.14573/altex.2013.3.275 · Cited by 200
“Prinz et al. (2011) from Bayer HealthCare stated in Nature Reviews in Drug Discovery “Believe it or not: how much can we rely on published data on potential drug targets?”
Reliability of the chronic mild stress model of depression: A user survey
Willner, P. (2017) · Neurobiology of Stress · doi:10.1016/j.ynstr.2016.08.001 · Cited by 198
“For example, failure rates of 75e90% were found for attempts within the pharmaceutical industry to replicate preclinical studies (Prinz et al., 2011; Begley and Ellis, 2012); similarly, a failure rate of around two thirds was reported for attempts to replicate experiments published in high ranking…”
BackgroundResultIs everything we eat associated with cancer? A systematic cookbook review
Schoenfeld, J. D., & Ioannidis, J. P. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.047142 · Cited by 198
Gene annotation bias impedes biomedical research
Haynes, W. A., Tomczak, A., & Khatri, P. (2018) · Scientific Reports · doi:10.1038/s41598-018-19333-x · Cited by 192
Curation of chemogenomics data
Fourches, D., Muratov, E., & Tropsha, A. (2015) · Nature Chemical Biology · doi:10.1038/nchembio.1881 · Cited by 192
Dirnagl, U., & Endres, M. (2014) · Stroke · doi:10.1161/strokeaha.113.004075 · Cited by 192
Emerging trends in peer review—a survey
Walker, R., & Rocha da Silva, P. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00169 · Cited by 190
“When review takes place • No review • Pre-publication review, • Post-publication review, • Mixed processes (review takes place in several phases before and after publication) 2.”
BackgroundModern Phenotypic Drug Discovery Is a Viable, Neoclassic Pharma Strategy
Lee, J. A., Uhlik, M. T., Moxham, C. M., Tomandl, D., & Sall, D. J. (2012) · Journal of Medicinal Chemistry · doi:10.1021/jm201649s · Cited by 192
“Omics”-Informed Drug and Biomarker Discovery: Opportunities, Challenges and Future Perspectives
Matthews, H., Hanison, J., & Nirmalan, N. (2016) · Proteomes · doi:10.3390/proteomes4030028 · Cited by 191
“The expected increase in the chemical and biological spaces that could potentially be interrogated for therapeutic conjunctions failed to materialise [5] and reproducibility remains a critical issue hampering the successful translation of discovery research [6,7].”
Backgroundde Groot, A. D. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.02.001 · Cited by 188
Mapping brain asymmetry in health and disease through the ENIGMA consortium
Kong, X., Postema, M. C., Guadalupe, T., de Kovel, C., Boedhoe, P. S. W., Hoogman, M., Mathias, S. R., van Rooij, D., Schijven, D., Glahn, D. C., et al. (2022) · Human Brain Mapping · doi:10.1002/hbm.25033 · Cited by 186
Mitigating risk in academic preclinical drug discovery
Dahlin, J. L., Inglese, J., & Walters, M. A. (2015) · Nature Reviews Drug Discovery · doi:10.1038/nrd4578 · Cited by 187
The mdx mouse model as a surrogate forDuchenne muscular dystrophy
Partridge, T. A. (2013) · The FEBS Journal · doi:10.1111/febs.12267 · Cited by 187
Docking techniques in pharmacology: How much promising?
Gupta, M., Sharma, R., & Kumar, A. (2018) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2018.06.005 · Cited by 186
Development of a Gut-on-a-Chip Model for High Throughput Disease Modeling and Drug Discovery
Beaurivage, C., Naumovska, E., Chang, Y., Elstak, E., Nicolas, A., Wouters, H., van Moolenbroek, G., Lanz, H., Trietsch, S., Joore, J., et al. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20225661 · Cited by 185
“However, manipulation of individual IBD parameters, such as barrier function of the epithelium and cell-type specific activation, are difficult to achieve in these complex models, which proves to complicate matters and in turn leads to poor prognosis of drug candidates [15].”
BackgroundComputational Multitarget Drug Design
Zhang, W., Pei, J., & Lai, L. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00491 · Cited by 180
Ahmad, R., Riaz, M., Khan, A., Aljamea, A., Algheryafi, M., Sewaket, D., & Alqathama, A. (2021) · Phytotherapy Research · doi:10.1002/ptr.7215 · Cited by 181
Wu, Y., & Xie, L. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.12.030 · Cited by 178
Lazic, S. E., & Essioux, L. (2016) · Cited by 182
Gil, Y., David, C. H., Demir, I., Essawy, B. T., Fulweiler, R. W., Goodall, J. L., Karlstrom, L., Lee, H., Mills, H. J., Oh, J., et al. (2016) · Earth and Space Science · doi:10.1002/2015ea000136 · Cited by 180
“An internal survey at Bayer pharmaceuticals found that about two-thirds of their projects are canceled because of inconsistencies during attempts to reproduce published research [Prinz et al 2011].”
BackgroundCommon pitfalls in preclinical cancer target validation
Kaelin, W. G. (2017) · Nature Reviews Cancer · doi:10.1038/nrc.2017.32 · Cited by 175
Erratum: Mechanistic enzymology in drug discovery: a fresh perspective
Holdgate, G. A., Meek, T. D., & Grimley, R. L. (2018) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.257 · Cited by 180
Imiquimod has strain-dependent effects in mice and does not uniquely model human psoriasis
Swindell, W. R., Michaels, K. A., Sutter, A. J., Diaconu, D., Fritz, Y., Xing, X., Sarkar, M. K., Liang, Y., Tsoi, A., Gudjonsson, J. E., et al. (2017) · Genome Medicine · doi:10.1186/s13073-017-0415-3 · Cited by 178
“refine the IMQ model by clarifying its strengths and limitations relative to human psoriasis, which should improve the chance that new findings are successfully translated to clinical studies with patients [12].”
BackgroundScientific Utopia III: Crowdsourcing Science
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., McCarthy, R. J., Riegelman, A., Silberzahn, R., & Nosek, B. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619850561 · Cited by 174
“…(Pan et al., 2016)—and evidence that many published findings are less robust than initially thought (Begley & Ellis, 2012; Errington et al., 2014; Open Science Collaboration, 2015; Prinz, Schlange, & Asadullah, 2011), researchers must determine how best to distribute limited replication resources.”
BackgroundIoannidis, J. P. A., Kim, B. Y. S., & Trounson, A. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0314-y · Cited by 175
Use and Abuse of RNAi to Study Mammalian Gene Function
Kaelin, W. G. (2012) · Science · doi:10.1126/science.1225787 · Cited by 169
Mobley, A., Linder, S. K., Braeuer, R., Ellis, L. M., & Zwelling, L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063221 · Cited by 166
“Several recent publications suggested that the seminal findings from academic laboratories could only be reproduced 11–50% of the time [1,2].”
BackgroundNext-Generation Treatments for Mental Disorders
Insel, T. R. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3004873 · Cited by 164
“Recent reports suggest that many of the results from academic laboratories cannot be replicated by industry scientists (79, 80).”
ResultPolymer therapeutics: Top 10 selling pharmaceuticals — What next?
Duncan, R. (2014) · Journal of Controlled Release · doi:10.1016/j.jconrel.2014.05.001 · Cited by 161
In Vitro research Reproducibility: Keeping up High Standards
Hirsch, C., & Schildknecht, S. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.01484 · Cited by 161
Rational Cell Culture Optimization Enhances Experimental Reproducibility in Cancer Cells
Wright Muelas, M., Ortega, F., Breitling, R., Bendtsen, C., & Westerhoff, H. V. (2018) · Scientific Reports · doi:10.1038/s41598-018-21050-4 · Cited by 160
“We conclude that, in order to ensure that (1) cells are in exponential growth from 24 hours after seeding, (2) confluence is reached as late as possible, and (3) changes in glucose, glutamine and pH are kept to a minimum, the volume of culture media should be increased up to 3 mL and seeding density reduced according…”
BackgroundA review on blockchain technology and blockchain projects fostering open science
Leible, S., Schlager, S., Schubotz, M., & Gipp, B. (2019) · Frontiers in Blockchain · doi:10.3389/fbloc.2019.00016 · Cited by 134
“Besides reproducibility of experiments (Prinz et al., 2011; Collins and Tabak, 2014; Gilbert et al., 2016; Furlanello et al., 2017), BT can also get used to address several other scientific problems (Gipp et al.”
BackgroundMethodRobust research: Institutions must do their part for reproducibility
Begley, C. G., Buchan, A. M., & Dirnagl, U. (2015) · Nature · doi:10.1038/525025a · Cited by 162
Molecular property prediction: recent trends in the era of artificial intelligence
Shen, J., & Nicolaou, C. A. (2019) · Drug Discovery Today: Technologies · doi:10.1016/j.ddtec.2020.05.001 · Cited by 157
Replicability and Reproducibility in Comparative Psychology
Stevens, J. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00862 · Cited by 191
More than 3Rs: The importance of scientific validity for harm-benefit analysis of animal research
Würbel, H. (2017) · Lab Animal · doi:10.1038/laban.1220 · Cited by 152
Oxygenation in Cell Culture: Critical Parameters for Reproducibility Are Routinely Not Reported
Al-Ani, A., Toms, D., Kondro, D., Thundathil, J., Yu, Y., & Ungrin, M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204269 · Cited by 152
Reproducibility in Scientific Computing
Ivie, P., & Thain, D. (2018) · ACM Computing Surveys · doi:10.1145/3186266 · Cited by 198
“In pharmaceuticals, Bayer [137] had slightly better results and were able to verify 21% of 67 different projects.”
ResultGuidelines for in vivo mouse models of myocardial infarction
Lindsey, M. L., Brunt, K. R., Kirk, J. A., Kleinbongard, P., Calvert, J. W., Brás, L. E. D. C., DeLeon‐Pennell, K. Y., Re, D. P. D., Frangogiannis, N. G., Frantz, S., et al. (2021) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00459.2021 · Cited by 166
On the Reproducibility of Psychological Science
Johnson, V. E., Payne, R. D., Wang, T., Asher, A., & Mandal, S. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1240079 · Cited by 149
“Reproducibility of experimental research is essential to the progress of science, but there is growing concern over the failure of scientific studies to replicate (e.g., Ioannidis 2005; Prinz et al. 2011; Begley and Ellis 2012; Pashler and Wagenmakers 2012;McNutt 2014).”
BackgroundLöscher, W. (2016) · Epilepsy Research · doi:10.1016/j.eplepsyres.2016.05.016 · Cited by 164
Nobel Turing Challenge: creating the engine for scientific discovery
Kitano, H. (2021) · npj Systems Biology and Applications · doi:10.1038/s41540-021-00189-3 · Cited by 149
Replication in Criminology and the Social Sciences
Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2017) · Annual Review of Criminology · doi:10.1146/annurev-criminol-032317-091849 · Cited by 169
Learning from our mistakes: The ‘unknown knowns’ in fragment screening
Davis, B. J., & Erlanson, D. A. (2013) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/j.bmcl.2013.03.028 · Cited by 146
Kitano, H. (2016) · AI Magazine · doi:10.1609/aimag.v37i1.2642 · Cited by 145
“It may be extremely difficult to reproduce the published experimental results, and some may prove impossible to re-create (Prinz, Schlange, and Asadullah 2011).”
BackgroundPhilosophy of science and the replicability crisis
Romero, F. (2019) · Philosophy Compass · doi:10.1111/phc3.12633 · Cited by 184
“• Amgen and Bayer Healthcare reports.”
BackgroundMethods to increase reproducibility in differential gene expression via meta-analysis
Sweeney, T. E., Haynes, W. A., Vallania, F., Ioannidis, J. P. A., & Khatri, P. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw797 · Cited by 146
“Non-reproducibility of results is a major problem in biomedical research (1,2), with rates as high as 65–89% in pharmacological studies (3,4) and 64% in psychological studies (5).”
BackgroundProvencher, S., Archer, S. L., Ramirez, F. D., Hibbert, B., Paulin, R., Boucherat, O., Lacasse, Y., & Bonnet, S. (2018) · Circulation Research · doi:10.1161/circresaha.117.312579 · Cited by 141
“Nonetheless, despite widespread recognition of the importance of these experimental design elements, confirmatory preclinical PH studies rarely report having implemented stringent methodologies, and their study designs have not improved during the past decade (Figure 3).(29,96,99) Furthermore, citation counts suggest…”
BackgroundEditorial: preclinical data reproducibility for R&D - the challenge for neuroscience
Steckler, T. (2015) · SpringerPlus · doi:10.1186/2193-1801-4-1 · Cited by 140
von Kortzfleisch, V. T., Karp, N. A., Palme, R., Kaiser, S., Sachser, N., & Richter, S. H. (2020) · Scientific Reports · doi:10.1038/s41598-020-73503-4 · Cited by 154
Assessment of transparency indicators across the biomedical literature: How open is open?
Serghiou, S., Contopoulos-Ioannidis, D. G., Boyack, K. W., Riedel, N., Wallach, J. D., & Ioannidis, J. P. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001107 · Cited by 139
Nonhuman Primates and Translational Research: Progress, Opportunities, and Challenges
Harding, J. D. (2017) · ILAR Journal · doi:10.1093/ilar/ilx033 · Cited by 150
“As reported by company scientists, estimates of failure rate range from 89% (Begley and Ellis 2012) to 75–80% (Prinz et al. 2011).”
BackgroundIs Target-Based Drug Discovery Efficient? Discovery and “Off-Target” Mechanisms of All Drugs
Sadri, A. (2023) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.2c01737 · Cited by 163
Ramirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138
“portending a waning confidence in animal model data to identify promising therapeutic targets.(5,7,11,12,22,23) Cardiovascular research and development, in particular, has fared poorly in recent years relative to other disease categories, exhibiting the greatest decline as a percentage of total projects(4) and among t…”
Rethinking Reproducibility as a Criterion for Research Quality
Leonelli, S. (2018) · Research in the history of economic thought and methodology · doi:10.1108/s0743-41542018000036b009 · Cited by 188
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Manipulating the Gut Microbiota: Methods and Challenges: Figure 1
Ericsson, A. C., & Franklin, C. L. (2015) · ILAR Journal · doi:10.1093/ilar/ilv021 · Cited by 153
“Several editorials (Begley and Ellis 2012; Hutchinson and Kirk 2011; Prinz et al. 2011) have lamented the costs associated with the inability to reproduce preclinical studies, including high attrition rates of candidate drugs, and a wide range of contributing factors has been identified.”
BackgroundA Multi-center Study on the Reproducibility of Drug-Response Assays in Mammalian Cell Lines
Niepel, M., Hafner, M., Mills, C. E., Subramanian, K., Williams, E. H., Chung, M., Gaudio, B., Barrette, A. M., Stern, A. D., Hu, B., et al. (2019) · Cell Systems · doi:10.1016/j.cels.2019.06.005 · Cited by 133
“Adoption of FAIR approaches also responds to concerns from industrial and academic groups about the reproducibility and utility of biomedical research (Arrowsmith, 2011; Baker, 2016; Begley and Ellis, 2012; Prinz et al., 2011) and the adequacy of data-reporting standards (Errington et al.”
BackgroundObjective assessment of cancer genes for drug discovery
Patel, M. N., Halling‐Brown, M., Tym, J. E., Workman, P., & Al‐Lazikani, B. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3913 · Cited by 149
“In conclusion, recent surveys 26,27 have emphasized the importance of very careful and thorough target validation to reduce the risk of failure later in the drug development pipeline.”
BackgroundAn αv‐RGD Integrin Inhibitor Toolbox: Drug Discovery Insight, Challenges and Opportunities
Hatley, R. J. D., Macdonald, S. J. F., Slack, R. J., Le, J., Ludbrook, S. B., & Lukey, P. T. (2018) · Angewandte Chemie International Edition · doi:10.1002/anie.201707948 · Cited by 130
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
Anderson, S. F., & Maxwell, S. E. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1289361 · Cited by 131
Millan, M. J., Goodwin, G. M., Meyer-Lindenberg, A., & Ove Ögren, S. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.01.016 · Cited by 132
“First, in common with many fields of R&D, there is a need for more rigorous confirmation of novel preclinical observations, especially concerning putative new drug targets and pathophysiological mechanisms underpinning psychiatric disorders (Ioannidis, 2005, 2014; Prinz et al., 2011; Ségalat, 2010; Steckler, 2015).”
BackgroundCOVID-19 research: pandemic versus “paperdemic”, integrity, values and risks of the “speed science”
Dinis‐Oliveira, R. J. (2020) · Forensic Sciences Research · doi:10.1080/20961790.2020.1767754 · Cited by 165
Schweinsberg, M., Feldman, M., Staub, N., van den Akker, O. R., van Aert, R. C. M., van Assen, M. A. L. M., Liu, Y., Althoff, T., Heer, J., Kale, A. M., et al. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.02.003 · Cited by 173
Achieving human and machine accessibility of cited data in scholarly publications
Starr, J., Castro, E., Crosas, M., Dumontier, M., Downs, R. R., Duerr, R., Haak, L. L., Haendel, M., Herman, I., Hodson, S., et al. (2015) · PeerJ Computer Science · doi:10.7717/peerj-cs.1 · Cited by 128
Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps
Jarvis, M. F., & Williams, M. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2015.12.001 · Cited by 129
“, Begley and Ellis, and Ioannidis [15,16,30].”
BackgroundResultInfluentialClark, T., Ciccarese, P. N., & Goble, C. A. (2014) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-5-28 · Cited by 127
“For users of scientific publications, these are mostly centered on failures of evidence and reproduciblity [8,55,59,60]; and on intractable volumes of information presented to the scientist [61].”
Pamies, D. (2018) · ALTEX · doi:10.14573/altex.1710081 · Cited by 127
Protein–protein interactions as druggable targets: recent technological advances
Higueruelo, A. P., Jubb, H. C., & Blundell, T. L. (2013) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2013.05.009 · Cited by 142
Neoclassic Drug Discovery: The Case for Lead Generation Using Phenotypic and Functional Approaches
Lee, J. A., & Berg, E. L. (2013) · SLAS Discovery · doi:10.1177/1087057113506118 · Cited by 126
Williams, A. J., Ekins, S., & Tkachenko, V. (2012) · Drug Discovery Today · doi:10.1016/j.drudis.2012.02.013 · Cited by 126
The changing landscape in translocator protein (TSPO) function
Selvaraj, V., & Stocco, D. M. (2015) · Trends in Endocrinology & Metabolism · doi:10.1016/j.tem.2015.02.007 · Cited by 126
“A majority of these cases have resulted from the irreproducibility of published results that describe key findings [67].”
Result
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.