Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 401–500 of 1,001
Common misconceptions about data analysis and statistics
Motulsky, H. J. (2014) · British Journal of Pharmacology · doi:10.1111/bph.12884 · Cited by 68
“…replicates, until you get the result you want; 2) overemphasis on P values rather than on the actual size of the observed effect; 3) overuse of statistical hypothesis testing, and being seduced by the word “significant”; and 4) over-reliance on standard errors, which are often misunderstood.”
Harnessing QbD, Programming Languages, and Automation for Reproducible Biology
Sadowski, M. I., Grant, C., & Fell, T. S. (2015) · Trends in biotechnology · doi:10.1016/j.tibtech.2015.11.006 · Cited by 61
“There may be other signs of impending problems: several recent studies have reported low rates of reproducibility across several areas of science including drug discovery [14], psychology [15], synthetic biology [16], medicine [17,18], and cancer research [19].”
BackgroundFrom big data to important information
Bar-Yam, Y. (2016) · Complexity · doi:10.1002/cplx.21785 · Cited by 64
Accelerating Biomedical Discoveries through Rigor and Transparency
Hewitt, J., Brown, L. L., Murphy, S. J., Grieder, F. B., & Silberberg, S. D. (2017) · ILAR Journal · doi:10.1093/ilar/ilx011 · Cited by 55
First results from psychology’s largest reproducibility test
Baker, M. (2015) · Nature · doi:10.1038/nature.2015.17433 · Cited by 54
George, C. H., Stanford, S. C., Alexander, S., Cirino, G., Docherty, J. R., Giembycz, M. A., Hoyer, D., Insel, P. A., Izzo, A. A., Ji, Y. H., et al. (2017) · British Journal of Pharmacology · doi:10.1111/bph.13925 · Cited by 52
“This has added further fuel to the fire that was first stoked up by the findings from Bayer (Prinz et al., 2011) and Amgen (Begley and Ellis, 2012) and supported by many others (for e.g. see McGrath and Lilley, 2015; Liu et al., 2016; Ortuno et al., 2016; Wang et al., 2016).”
BackgroundAn industry perspective on the role and utility of animal models of pain in drug discovery
Whiteside, G. T., Pomonis, J. D., & Kennedy, J. D. (2013) · Neuroscience Letters · doi:10.1016/j.neulet.2013.08.033 · Cited by 59
Morrell, W. C., Birkel, G. W., Forrer, M., López, T. D.-F., Backman, T. W. H., Dussault, M., Petzold, C. J., Baidoo, E. E. K., Costello, Z., Ando, D., et al. (2017) · ACS Synthetic Biology · doi:10.1021/acssynbio.7b00204 · Cited by 57
Molecular Diagnostics in Pathology: Time for a Next-Generation Pathologist?
Fassan, M. (2018) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2017-0269-ra · Cited by 57
Robert, P., Frenzel, T., Factor, C., Jošt, G., Rasschaert, M., Schuetz, G., Fretellier, N., Boyken, J., Idée, J., & Pietsch, H. (2018) · Investigative Radiology · doi:10.1097/rli.0000000000000467 · Cited by 56
Can the behavioral sciences self-correct? A social epistemic study
Romero, F. (2016) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2016.10.002 · Cited by 57
A creative destruction approach to replication: Implicit work and sex morality across cultures
Tierney, W., Hardy, J., Ebersole, C. R., Viganola, D., Clemente, E. G., Gordon, M., Hoogeveen, S., Haaf, J., Dreber, A., Johannesson, M., et al. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2020.104060 · Cited by 51
“…published findings suggests replication rates of 36% in psychology (Open Science Collaboration, 2015), 11–25% in biomedicine (Begley & Ellis, 2012; Prinz, Schlange, & Asadullah, 2011), 61% in experimental economics (Camerer et al., 2016), 70% in experimental philosophy (Cova et al., 2018), and…”
Critical Appraisal of Studies Using Laboratory Animal Models
O'Connor, A. M. C., & Sargeant, J. M. (2014) · ILAR Journal · doi:10.1093/ilar/ilu038 · Cited by 59
“There is substantial evidence that reporting of preclinical studies is less than comprehensive or has low reproducibility (Kilkenny et al. 2009; Prinz et al. 2011; Steward et al. 2012).”
BackgroundManaging risks in drug discovery: reproducibility of published findings
Kannt, A., & Wieland, T. (2016) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-016-1216-8 · Cited by 57
“Prinz et al. (2011) investigated 57 drug discovery projects in the fields of cardiovascular disease, women’s health, or oncology and concluded that in more than two thirds of them there were major discrepancies to published data leading to project termination.”
BackgroundIncorrect results in software engineering experiments: How to improve research practices
Jørgensen, M., Dybå, T., Liestøl, K., & Sjøberg, D. I. K. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2015.03.065 · Cited by 70
Parrish, M. C., Tan, Y. J., Grimes, K., & Mochly‐Rosen, D. (2018) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010818-021625 · Cited by 69
ASTM international workshop on standards and measurements for tissue engineering scaffolds
Simon, C. G., Yaszemski, M. J., Ratcliffe, A., Tomlins, P., Luginbuehl, R., & Tesk, J. A. (2015) · Journal of Biomedical Materials Research Part B: Applied Biomaterials · doi:10.1002/jbm.b.33286 · Cited by 50
Use of Humanized Mice to Study the Pathogenesis of Autoimmune and Inflammatory Diseases
Koboziev, I., Jones‐Hall, Y., Valentine, J. F., Webb, C. R., Furr, K. L., & Grisham, M. B. (2015) · Inflammatory Bowel Diseases · doi:10.1097/mib.0000000000000446 · Cited by 57
The Design and Statistical Analysis of Animal Experiments: Introduction to this Issue
Festing, M. F. W., & Nevalainen, T. O. (2014) · ILAR Journal · doi:10.1093/ilar/ilu046 · Cited by 53
“First, a few high-profile papers have suggested that the results of much animal research is unreproducible (Scott et al. 2008; Begley and Ellis 2012; Prinz et al. 2011).”
BackgroundSubbotin, V. M. (2016) · Drug Discovery Today · doi:10.1016/j.drudis.2016.05.017 · Cited by 59
A Replication by Any Other Name: A Systematic Review of Replicative Intervention Studies
Cook, B. G., Collins, L. W., Cook, S. C., & Cook, L. (2016) · Remedial and Special Education · doi:10.1177/0741932516637198 · Cited by 56
A Guide to Reproducibility in Preclinical Research
Samsa, G., & Samsa, L. A. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002351 · Cited by 50
Kirouac, D. C., Cicali, B., & Schmidt, S. (2019) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12390 · Cited by 46
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.(2) Depressingly, Amgen scientists reported that only 6/53 (11%) “landmark” cancer studies could be reproduced in- house.”
BackgroundWaltemath, D., & Wolkenhauer, O. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2555481 · Cited by 49
The Brazilian Reproducibility Initiative
Amaral, O. B., Neves, K., Wasilewska-Sampaio, A. P., & Carneiro, C. F. (2019) · eLife · doi:10.7554/elife.41602 · Cited by 49
“Many analysts criticize the country’s research as largely composed of "salami science", growing in absolute numbers but lacking in impact, originality and influence (Righetti, 2013).”
BackgroundAbou-Gharbia, M. A., & Childers, W. E. (2014) · Journal of Medicinal Chemistry · doi:10.1021/jm401564r · Cited by 58
Evaluating the credibility of histopathology data in environmental endocrine toxicity studies
Wolf, J. C., & Maack, G. (2016) · Environmental Toxicology and Chemistry · doi:10.1002/etc.3695 · Cited by 49
CETSA: A Target Engagement Assay with Potential to Transform Drug Discovery
Jensen, A. J., Molina, D. M., & Lundbäck, T. (2015) · Future Medicinal Chemistry · doi:10.4155/fmc.15.50 · Cited by 49
Open Science: What, Why, and HowPreprint
Spellman, B., Gilbert, E. A., & Corker, K. S. (2017) · doi:10.31234/osf.io/ak6jr · Cited by 50
Scudamore, C. L., Soilleux, E. J., Karp, N. A., Smith, K. C., Poulsom, R., Herrington, C. S., Day, M. J., Brayton, C. F., Bolon, B. N., Whitelaw, B., et al. (2015) · The Journal of Pathology · doi:10.1002/path.4642 · Cited by 53
“However, the lack of reproducibility of preclinical animal studies has become an increasing cause for concern [4,5] due to an inability to replicate drug target discovery studies [6,7] and the divergent results obtained with widely accepted animal models of human disease [8,9].”
BackgroundChen, J., Ceholski, D. K., Liang, L., Fish, K. M., & Hajjar, R. J. (2017) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00127.2017 · Cited by 49
“The predictivity of animal models of human disease is a crucial issue to address if reproducibility rates in laboratory experiments and clinical trials are to be improved (24).”
Donner, D. G., Kiriazis, H., Du, X., Marwick, T. H., & McMullen, J. R. (2018) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00157.2018 · Cited by 50
Chhin, C. S., Taylor, K. A., & Wei, W. S. (2018) · Educational Researcher · doi:10.3102/0013189x18788047 · Cited by 54
The Importance of Biobanking in Cancer Research
Castillo-Pelayo, T., Babinszky, S., LeBlanc, J., & Watson, P. H. (2015) · Biopreservation and Biobanking · doi:10.1089/bio.2014.0061 · Cited by 48
Improving data and knowledge management to better integrate health care and research
Cases, M., Furlong, L. I., Albanell, J., Altman, R. B., Bellazzi, R., Boyer, S. K., Brand, A. M., Brookes, A. J., Brunak, S., Clark, T., et al. (2013) · Journal of Internal Medicine · doi:10.1111/joim.12105 · Cited by 49
“Important studies of statistical and experimental design problems in contemporary scientific publications were recently reported [14, 15].”
BackgroundTen simple rules for good research practice
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010139 · Cited by 55
Liu, Y., Gill, E., & Huang, Y. Y. S. (2017) · Future Science OA · doi:10.4155/fsoa-2016-0084 · Cited by 51
Kosmidou, C., Efstathiou, N. E., Hoang, M. V., Notomi, S., Konstantinou, E. K., Hirano, M., Takahashi, K., Maidana, D. E., Tsoka, P., Young, L., et al. (2018) · Scientific Reports · doi:10.1038/s41598-017-17634-1 · Cited by 47
Synthetic biology: from hype to impact
Gardner, T. S. (2013) · Trends in biotechnology · doi:10.1016/j.tibtech.2013.01.018 · Cited by 46
Acquisition, Analysis, and Sharing of Data in 2015 and Beyond: A Survey of the Landscape
Antman, E. M., Benjamin, E. J., Harrington, R. A., Houser, S. R., Peterson, E. D., Bauman, M. A., Brown, N., Bufalino, V. J., Califf, R. M., Creager, M. A., et al. (2015) · Journal of the American Heart Association · doi:10.1161/jaha.115.002810 · Cited by 50
“Discouragingly, these studies demonstrated that only 11% to 22% of the preclinical studies could be replicated.(71,72) As a consequence of the concern about reproducibility, there is an NIH initiative to modify data acquisition and sharing in the preclinical arena.”
BackgroundKennedy, J. J., Yan, P., Zhao, L., Ivey, R. G., Voytovich, U. J., Moore, H. D., Lin, C., Pogosova‐Agadjanyan, E. L., Stirewalt, D. L., Reding, K. W., et al. (2015) · Molecular & Cellular Proteomics · doi:10.1074/mcp.o115.054940 · Cited by 51
“In this report, we: (1) demonstrate the feasibility of generating analytically robust, multiplex IMAC-MRM assays for quantifying cellular phospho-signaling, (2) present a semiautomated, 96-well format magnetic bead-based protocol for IMAC enrichment, (3) provide a catalogue of phosphopeptides that are highly amenable…”
InfluentialKrafczyk, M. S., Shi, A., Bhaskar, A., Marinov, D., & Stodden, V. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0069 · Cited by 61
Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis
Nelson, N. C., Ichikawa, K., Chung, J., & Malik, M. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254090 · Cited by 54
“Journalists discuss questions about the legitimacy of science and Bayer/Amgen scientists’ reports of their experiences of failures to replicate [58, 59] at greater length than scientists.”
BackgroundVollert, J., Macleod, M. R., Dirnagl, U., Kas, M. J., Michel, M. C., Potschka, H., Riedel, G., Wever, K. E., Würbel, H., Steckler, T., et al. (2022) · Nature Methods · doi:10.1038/s41592-022-01615-y · Cited by 51
Yu, J., Silva, J., & Califano, A. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv556 · Cited by 45
A Framework for Improving the Quality of Research in the Biological Sciences
Casadevall, A., Ellis, L. M., Davies, E. W., McFall-Ngai, M., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.01256-16 · Cited by 46
Irreproducibility of published bioscience research: Diagnosis, pathogenesis and therapy
Flier, J. S. (2016) · Molecular Metabolism · doi:10.1016/j.molmet.2016.11.006 · Cited by 49
“The dominant focus of this paper is on reproducibility in basic and translational research, but I will reference, where appropriate, specific issues related to clinical research reproducibility.”
BackgroundLeeners, B., Krüger, T. H. C., Geraedts, K., Tronci, E., Mancini, T., Ille, F., Egli, M., Röblitz, S., Saleh, L., Spanaus, K. S., et al. (2017) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2017.00120 · Cited by 57
“…sizes are common and, third, that the reproducibility of results is generally low in psychological and biomedical research (e.g., Kriegeskorte et al., 2009; Prinz et al., 2011; Ritchie et al., 2012; Button et al., 2013; Macleod et al., 2014; Open Science Collaboration, 2015; Muller et al., 2017).”
BackgroundBest Practices for Making Reproducible Biochemical Models
Porubsky, V. L., Goldberg, A. P., Rampadarath, A. K., Nickerson, D. P., Karr, J. R., & Sauro, H. M. (2020) · Cell Systems · doi:10.1016/j.cels.2020.06.012 · Cited by 45
“…obstacles in scientific research has led to calls for improved practices that ensure that published results can be reproduced by independent investigators (Mobley et al., 2013; Prinz et al., 2011; Golub et al., 1999; De Schutter, 2010; Woelfle et al., 2011; Casade-vall and Fang, 2010).”
BackgroundBarnash, K. D., James, L. I., & Frye, S. V. (2017) · Nature Chemical Biology · doi:10.1038/nchembio.2473 · Cited by 51
The importance of non-academic coauthors in bridging the conservation genetics gap
Britt, M., Haworth, S. E., Johnson, J. B., Martchenko, D., & Shafer, A. B. A. (2017) · Biological Conservation · doi:10.1016/j.biocon.2017.12.019 · Cited by 50
Knowledge in the dark: scientific challenges and ways forward
Jeschke, J. M., Lokatis, S., Bartram, I., & Tockner, K. (2019) · FACETS · doi:10.1139/facets-2019-0007 · Cited by 53
Strong Inference in Mathematical Modeling: A Method for Robust Science in the Twenty-First Century
Ganusov, V. V. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.01131 · Cited by 49
“In recent years it has been noted by several groups of investigators that many of the results in biological sciences are unreproducible (Prinz et al., 2011; Begley and Ellis, 2012; Collaboration, 2015; Freedman and Gibson, 2015; Freedman et al., 2015).”
ResultPublish and Who Should Perish: You or Science?
Kun, Á. (2018) · Publications · doi:10.3390/publications6020018 · Cited by 44
Starokozhko, V., Kallio, M. J., Howell, Å. K., Salmi, A. M., Andrew-Nielsen, G., Goldammer, M., Burggraf, M., Löbker, W., Böhmer, A., Agricola, E., et al. (2020) · Drug Discovery Today · doi:10.1016/j.drudis.2020.10.017 · Cited by 45
Loss, C. M., Melleu, F. F., Domingues, K., Lino-de-Oliveira, C., & Viola, G. G. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.763428 · Cited by 44
“…performance may affect not only the economic and translational aspects of science but also implies ethical issues once it involves necessarily living subjects, mostly laboratory animals (Prinz et al., 2011; Begley and Ellis, 2012; Festing, 2014; Freedman et al., 2015; Voelkl and Wurbel, 2021).”
BackgroundModulation of the cancer cell transcriptome by culture media formulations and cell density
Kim, S. W., KIM, S.-J., Langley, R. R., & Fidler, I. J. (2015) · International Journal of Oncology · doi:10.3892/ijo.2015.2930 · Cited by 52
Lythgoe, M. P., Rhodes, C. J., Ghataorhe, P., Attard, M. I., Wharton, J., & Wilkins, M. R. (2016) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2016.04.012 · Cited by 48
Toward Precision Healthcare: Context and Mathematical Challenges
Colijn, C., Jones, N. S., Johnston, I. G., Yaliraki, S. N., & Barahona, M. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00136 · Cited by 53
“The translational impact of this trend is starkly illustrated by recent failures to reproduce landmark cancer studies and low success rates in clinical trials (Prinz et al., 2011; Begley and Ellis, 2012).”
ResultLiu, Y., Althoff, T., & Heer, J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376533 · Cited by 65
“INTRODUCTION A reproducibility crisis has stirred multiple scientific fields [3], with replication studies failing to validate prior results [5, 6, 41, 44].”
ResultWieschowski, S., Biernot, S., Deutsch, S., Glage, S., Bleich, A., Tolba, R., & Strech, D. (2019) · PLOS ONE · doi:10.1371/journal.pone.0223758 · Cited by 44
“Despite the methodological limitations of the existing assessments of publication rates, opinions regarding publication bias in animal research play an important role in current debates on, for example, the “reproducibility crisis” [8, 9] and “failure rates in clinical research” [10, 11].”
BackgroundWhy bother using non-human primate models of cognitive disorders in translational research?
Camus, S. M. J., Ko, W. K. D., Pioli, E. Y., & Bézard, E. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2015.06.012 · Cited by 45
Time to do something about reproducibility
Morrison, S. J. (2014) · eLife · doi:10.7554/elife.03981 · Cited by 44
“Several analyses of certain subsets of cancer studies have concluded that most were not reproducible (Ioannidis et al., 2009; Prinz et al., 2011; Begley and Ellis, 2012).”
BackgroundBoulbes, D. R., Costello, T., Baggerly, K., Fan, F., Wang, R., Bhattacharya, R., Ye, X., & Ellis, L. M. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-0227 · Cited by 41
Edwards, S. R., Hamlin, A. S., Marks, N., Coulson, E. J., & Smith, M. T. (2014) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/1440-1681.12277 · Cited by 48
“In addition, recent articles published in Nature highlight the importance of replication studies by independent groups of investigators to verify the validity of preclinical research findings.(11,12) To this end, our data reported herein, generated using comprehensive study designs using the MWM with”
BackgroundThe Impact of Preclinical Irreproducibility on Drug Development
Freedman, L., & Gibson, M. (2015) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.9 · Cited by 43
Reproducibility of histopathological findings in experimental pathology of the mouse: a sorry tail
Ward, J. M., Schofield, P. N., & Sundberg, J. P. (2017) · Lab Animal · doi:10.1038/laban.1214 · Cited by 46
Ndode‐Ekane, X. E., Santana‐Gomez, C., Casillas-Espinosa, P. M., Ali, I. Y., Brady, R. D., Smith, G. S., Andrade, P., Immonen, R. J., Puhakka, N., Hudson, M. R., et al. (2019) · Epilepsy Research · doi:10.1016/j.eplepsyres.2019.01.006 · Cited by 48
“Other reasons include: publication bias favoring positive studies, measures of statistical significance with questionable clinical relevance, and failure to address issues related to translation of findings to the clinical setting (Prinz et al., 2011; Galanopoulou et al., 2013; Simonato et al., 2013; Simonato et al.,…”
BackgroundEffect size and statistical power in the rodent fear conditioning literature – A systematic review
Carneiro, C. F. D., Moulin, T. C., Macleod, M. R., & Amaral, O. B. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196258 · Cited by 54
“In light of the low reproducibility of published studies in various fields of biomedical research (Scott et al., 2008; Prinz et al., 2011; Begley and Ellis, 2012) which is thought by many to be a consequence of low statistical power and excessive reliance on significance tests (Ioannidis, 2005; Higginson and Munafò, 2…”
BackgroundIndividualized therapy trials: navigating patient care, research goals and ethics
Kane, P. B., Bittlinger, M., & Kimmelman, J. (2021) · Nature Medicine · doi:10.1038/s41591-021-01519-y · Cited by 49
Aligning physiology with psychology: Translational neuroscience in neuropsychiatric drug discovery
McArthur, R. A. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.004 · Cited by 42
“Positively-interpreted data are not only drivers in the selection and promotion of experimental compounds to development (Begley and Ioannidis, 2015; Jarvis and Williams, 2016; Lindner, 2007; Prinz et al., 2011; ter Riet et al., 2012), but also a response to pressures to publish.”
MicroRNA biomarkers of type 2 diabetes: evidence synthesis from meta-analyses and pathway modelling
Zhu, H., & Leung, S.-W. (2022) · Diabetologia · doi:10.1007/s00125-022-05809-z · Cited by 44
“Recent studies indicate that seminal findings from academic laboratories can be reproduced only 11–50% of the time [47, 48].”
BackgroundBrundin, P., Barker, R. A., Conn, P. J., Dawson, T. M., Kieburtz, K. D., Lees, A. J., Schwarzschild, M. A., Tanner, C. M., Isaacs, T., Duffen, J., et al. (2013) · Journal of Parkinson s Disease · doi:10.3233/jpd-139000 · Cited by 43
“As the success rates of Phase 2 clinical trials continue to fall [32], often through limitations of disease models, as well as questions to do with target validity [33], drug repositioning offers a promising way forward.”
Data Submission and Quality in Microarray-Based MicroRNA Profiling
Witwer, K. W. (2013) · Clinical Chemistry · doi:10.1373/clinchem.2012.193813 · Cited by 43
Rice, A. S. C., Morland, R., Huang, W., Currie, G. L., Sena, E. S., & Macleod, M. R. (2013) · Scandinavian Journal of Pain · doi:10.1016/j.sjpain.2013.02.002 · Cited by 42
Evolution of toxicological science: the need for change
Härtung, T. (2017) · International Journal of Risk Assessment and Management · doi:10.1504/ijram.2017.082570 · Cited by 54
“Two recent publications by authors from major pharmaceutical companies can be seen as an epiphany: both Amgen (Begley and Ellis, 2012) and Bayer HealthCare (Prinz et al., 2011) showed that they essentially could not reproduce the key findings of many studies that had prompted drug development.”
BackgroundOpinion versus evidence for the need to move away from animal testing
Härtung, T. (2017) · ALTEX · doi:10.14573/altex.1703291 · Cited by 54
“But these exciting results are often shaky – the only 10-25% reproducibility of important scientific papers published by the pharmaceutical industry is alarming (Begley and Ellis, 2012; Prinz et al., 2011).”
BackgroundDoes Chemical Engineering Research Have a Reproducibility Problem?
Han, R., Walton, K. S., & Sholl, D. S. (2019) · Annual Review of Chemical and Biomolecular Engineering · doi:10.1146/annurev-chembioeng-060718-030323 · Cited by 47
Do multiple experimenters improve the reproducibility of animal studies?
von Kortzfleisch, V. T., Ambrée, O., Karp, N. A., Meyer, N., Novak, J., Palme, R., Rosso, M., Touma, C., Würbel, H., Kaiser, S., et al. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001564 · Cited by 50
Kat, R., Arroyo-Araujo, M., de Vries, R. B. M., Koopmans, M. A., de Boer, S. F., & Kas, M. J. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104722 · Cited by 49
“However, preclinical research has also shown a lack of transparency of reporting as well as the use of inappropriate statistical analysis and insufficient sample sizes (Kilkenny et al., 2009; Prinz et al., 2011) putting the validity, replicability and translatability of results at stake.”
BackgroundPrion Pathogenesis in the Absence of NLRP3/ASC Inflammasomes
Nuvolone, M., Sorce, S., Schwarz, P., & Aguzzi, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0117208 · Cited by 39
Guidelines for manuscript submission in the peer-reviewed pharmacological literature
Mullane, K., Enna, S. J., Piette, J. G., & Williams, M. J. (2015) · Biochemical Pharmacology · doi:10.1016/j.bcp.2015.06.023 · Cited by 44
Open Source and Open Data Should Be Standard Practices
Gezelter, J. D. (2015) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.5b00285 · Cited by 41
“The chief reason is the growing sense that science has reached a reproducibility crisis, 2,3 where a number of scientists are admitting that their own organizations have had di ffi culty reproducing the results of prior publications.”
ResultOudega, M., Hao, P., Shang, J., Haggerty, A. E., Wang, Z., Sun, J. H., Liebl, D. J., Shi, Y., Cheng, L., Duan, H., et al. (2018) · Experimental Neurology · doi:10.1016/j.expneurol.2018.11.003 · Cited by 43
“The general consensus is that basic and translational biomedical research suffers from a lack in robustness with low success rates in replication studies reported in different scientific areas (Prinz et al., 2011; Begley and Ellis, 2012), including SCI and repair (Steward et al.”
Strech, D., Weissgerber, T., Dirnagl, U., & on behalf of QUEST Group (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000576 · Cited by 41
“Important triggers for this movement included the high failure rates of the pharmaceutical industry when trying to replicate pivotal findings of academic researchers [2].”
BackgroundQuestionable research practices may have little effect on replicability
Ulrich, R., & Miller, J. O. (2020) · eLife · doi:10.7554/elife.58237 · Cited by 53
Park, Y., Heider, D., & Hauschild, A.-C. (2021) · Cancers · doi:10.3390/cancers13133148 · Cited by 51
“However, the attempt to connect in silico data-driven analysis to in vivo translational medicine highlighted several issues concerning robustness and reproducibility [28].”
BackgroundCell-Based Screening: Extracting Meaning from Complex Data
Finkbeiner, S., Frumkin, M., & Kassner, P. D. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.023 · Cited by 39
“Perrimon, 2006; Kaelin, 2012) and have led to reports whose findings are not reproducible or robust enough to pursue therapeutically (Bhinder and Djaballah, 2013; Prinz et al., 2011).”
Madsen, D. H., & Bugge, T. H. (2015) · The Journal of Cell Biology · doi:10.1083/jcb.201501034 · Cited by 41
The Role of Big Data in the Management of Sleep-Disordered Breathing
Budhiraja, R., THOMAS, R. J., Kim, M. J., & Redline, S. S. (2016) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2016.01.009 · Cited by 46
“Indeed, it has been suggested that most published studies cannot be replicated.(2) The current health care model uses data from studies conducted on hundreds or possibly thousands of people to determine the recommendations for millions of people.”
BackgroundGeeleher, P., Cox, N. J., & Huang, R. S. (2016) · Genome biology · doi:10.1186/s13059-016-1050-9 · Cited by 47
“The possibility of targeting IGFR in Ewing ’ s sarcoma has been recognized and even though clinical studies are in the early stage, a complete clinical response of Ewing ’ s sarcoma following treatment with these compounds has been observed [28, 29].”
BackgroundLi, H., Xiang, Y., Fan, L., Zhang, X., Li, J., Yu, C., Bao, L., Cao, D., Xing, W., Liao, X., et al. (2017) · Gene · doi:10.1016/j.gene.2017.03.029 · Cited by 40
Open innovation: Towards sharing of data, models and workflows
Conrado, D. J., Karlsson, M. O., Romero, K., Sarr, C., & Wilkins, J. J. (2017) · European Journal of Pharmaceutical Sciences · doi:10.1016/j.ejps.2017.06.035 · Cited by 41
“…recently demonstrated an unexpectedly high lack of reproducibility (Begley and Ellis, 2012; Ebrahim et al., 2014; Open Science Collaboration, 2015; Prinz et al., 2011; Wang et al., 2016), leading to a lack of trust in the scientific process as implemented presently and a tremendous waste of…”
BackgroundApplied Biophysical Methods in Fragment-Based Drug Discovery
Coyle, J., & Walser, R. (2020) · SLAS DISCOVERY · doi:10.1177/2472555220916168 · Cited by 50
Aquarium: open-source laboratory software for design, execution and data management
Vrana, J. D., de Lange, O., Yang, Y., Newman, G., Saleem, A., Miller, A., Cordray, C., Halabiya, S. F., Parks, M., Lopez, E., et al. (2021) · Synthetic Biology · doi:10.1093/synbio/ysab006 · Cited by 44
Acute alcohol response phenotype in heavy social drinkers is robust and reproducible
Roche, D. J. O., Palmeri, M. D., & King, A. C. (2014) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12280 · Cited by 39
“The pharmaceutical industry also has shown difficulty in reproducing previous results, with 1 company replicating only 25% of its previously published findings (Prinz et al., 2011).”
BackgroundResultYıldırım, Z., Swanson, K., Wu, X., Zou, J., & Wu, J. C. (2024) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-022724-095035 · Cited by 49
“However, the transition from preclinical research to human clinical application has a success rate below 10%, predominantly due to unforeseen toxicities and a lack of therapeutic efficacy not anticipated by traditional preclinical animal models (4–6).”
A brief review of recent Charcot-Marie-Tooth research and priorities
Ekins, S., Litterman, N. K., Arnold, R. J. G., Burgess, R. W., Freundlich, J. S., Gray, S. J., Higgins, J. J., Langley, B. C., Willis, D. E., Notterpek, L. M., et al. (2015) · F1000Research · doi:10.12688/f1000research.6160.1 · Cited by 40
Heier, C. R., Guerron, A. D., Korotcov, A. V., Lin, S., Gordish‐Dressman, H., Fricke, S. T., Sze, R. W., Hoffman, E. P., Wang, P. C., & Nagaraju, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0112477 · Cited by 46
“clinical trials [6–8].”
Miller, J. O., & Ulrich, R. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616649170 · Cited by 43
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.