Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 501–600 of 1,001
Gholaminejad, A., Tehrani, H. A., & Fesharaki, M. G. (2018) · Biomarkers · doi:10.1080/1354750x.2018.1488275 · Cited by 39
“On the other hand, a survey on data reproducibility of biomedical science concludes that the formative result from academic laboratories could only be reproduced 11–50% of the time (Begley and Ellis 2012, Prinz et al. 2011).”
BackgroundCase Reports of Pre-clinical Replication Studies in Metabolism and Diabetes
von Herrath, M., Pagni, P. P., Grove, K., Christoffersson, G., Tang-Christensen, M., Karlsen, A. E., & Petersen, J. S. (2019) · Cell Metabolism · doi:10.1016/j.cmet.2019.02.004 · Cited by 39
Controlled One-on-One Encounters between Immune Cells and Microbes Reveal Mechanisms of Phagocytosis
Heinrich, V. (2015) · Biophysical Journal · doi:10.1016/j.bpj.2015.06.042 · Cited by 44
“The risks of translating such insights into medical applications cause growing concern for clinicians, patients, and entrepreneurs (4,5).”
BackgroundBoltze, J., Nitzsche, F., Jolkkonen, J., Weise, G., Pösel, C., Nitzsche, B., & Wagner, D. (2017) · Stem Cells · doi:10.1002/stem.2595 · Cited by 43
Human-Robot Interaction in Groups: Methodological and Research Practices
Oliveira, R., Arriaga, P., & Paiva, A. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5100059 · Cited by 51
Chemical biology approaches to target validation in cancer
Blagg, J., & Workman, P. (2014) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2014.07.007 · Cited by 41
Safeguarding Structural Data Repositories against Bad Apples
Minor, W., Dauter, Z., Helliwell, J. R., Jaskólski, M., & Wlodawer, A. (2016) · Structure · doi:10.1016/j.str.2015.12.010 · Cited by 38
“Other sobering reports indicate that up to 75% of experiments performed on drug targets in a given laboratory cannot be repeated elsewhere (Prinz et al., 2011).”
BackgroundTwomey, R., Harlley, S., Medina, C. R., Murphy, J., Atkins, W. C., McCrum, C. L., Schneider, C., Warne, J. P., Yingling, V. R., & Caldwell, A. R. (2021) · Communications in Kinesiology · doi:10.51224/cik.v1i3.43 · Cited by 43
Role of Environment and Experimenter in Reproducibility of Behavioral Studies With Laboratory Mice
Nigri, M., Åhlgren, J., Wolfer, D. P., & Võikar, V. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.835444 · Cited by 48
Slide Set: Reproducible Image Analysis and Batch Processing with ImageJ
Nanes, B. A. (2015) · BioTechniques · doi:10.2144/000114351 · Cited by 38
“Given the recent concerns regarding reproducibility of scientific research (2,3), any successful image analysis strategy must address these issues.”
Hunt, C. A., Kennedy, R., Kim, S. H. J., & Ropella, G. E. P. (2013) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1222 · Cited by 40
A living document: reincarnating the research article
Shanahan, D. R. (2015) · Trials · doi:10.1186/s13063-015-0666-5 · Cited by 42
Hakkarainen, T. W., Dellinger, P. E., Evans, H. L., Farjah, F., Farrokhi, E. T., Steele, S. R., Thirlby, R. C., & Flum, D. R. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.11.018 · Cited by 44
Resazurin Live Cell Assay: Setup and Fine-Tuning for Reliable Cytotoxicity Results
Rodríguez‐Corrales, J. Á., & Josan, J. S. (2017) · Methods in molecular biology · doi:10.1007/978-1-4939-7201-2_14 · Cited by 37
Overflow in science and its implications for trust
Siebert, S., Machesky, L. M., & Insall, R. H. (2015) · eLife · doi:10.7554/elife.10825 · Cited by 34
“…Nature Biotechnology, 2012; Button et al., 2013; Fishburn, 2014; Nuffield Council on Bioethics, 2014), ineffective peer review processes (Eisen, 2011), increasing rates of retractions of papers from academic journals (Steen, 2011), and/or reluctance to publish negative results (Prinz et al., 2011).”
BackgroundLuxenhofer, R. (2015) · Nanomedicine · doi:10.2217/nnm.15.139 · Cited by 42
Four disruptive strategies for removing drug discovery bottlenecks
Ekins, S., Waller, C. L., Bradley, M. P., Clark, A. M., & Williams, A. J. (2012) · Drug Discovery Today · doi:10.1016/j.drudis.2012.10.007 · Cited by 38
THE INNOVATIVE MEDICINES INITIATIVE: A PUBLIC PRIVATE PARTNERSHIP MODEL TO FOSTER DRUG DISCOVERY
Vaudano, E. (2013) · Computational and Structural Biotechnology Journal · doi:10.5936/csbj.201303017 · Cited by 43
An Open Science Peer Review Oath
Aleksic, J., & Markie, M. (2026) · F1000Research · doi:10.12688/f1000research.5686.2 · Cited by 37
Duggan, B. M., Foley, K. P., Henriksbo, B. D., Cavallari, J. F., Tamrakar, A. K., & Schertzer, J. D. (2017) · Scientific Reports · doi:10.1038/s41598-017-01822-0 · Cited by 38
Hurdles in Basic Science Translation
Perry, C. J., & Lawrence, A. J. (2017) · Frontiers in Pharmacology · doi:10.3389/fphar.2017.00478 · Cited by 39
Kong, X., ENIGMA Laterality Working Group, & Francks, C. (2020) · Human Brain Mapping · doi:10.1002/hbm.25154 · Cited by 35
Alternative strategies in cardiac preclinical research and new clinical trial formats
Kreutzer, F. P., Meinecke, A., Schmidt, K., Fiedler, J., & Thum, T. (2022) · Cardiovascular Research · doi:10.1093/cvr/cvab075 · Cited by 36
“Kim et al. reported on the N-of-1 study of Milasen , an ASO drug specifically designed for treatment of one particular patient suffering from the ultra-rare disease neuronal ceroid lipofuscinosis 7.”
BackgroundThe fall and rise of pharmacology – (Re-)defining the discipline?
Winquist, R. J., Mullane, K., & Williams, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.09.011 · Cited by 44
“screening methodologies [30], NGS [270] as well as the resolution of issues in data replication [43,44], trends in database interro-”
MethodEmbedding data provenance into the Learning Health System to facilitate reproducible research
Ćurčin, V. (2016) · Learning Health Systems · doi:10.1002/lrh2.10019 · Cited by 44
Poste, G. H., Compton, C. C., & Barker, A. D. (2014) · Expert Review of Molecular Diagnostics · doi:10.1586/14737159.2015.974561 · Cited by 36
Can you trust your animal study data?
Peers, I. S., South, M. C., Ceuppens, P. R., Bright, J. D., & Pilling, E. A. (2014) · Nature Reviews Drug Discovery · doi:10.1038/nrd4090-c1 · Cited by 35
Schnermann, J. B. (2015) · Annual Review of Physiology · doi:10.1146/annurev-physiol-021014-071829 · Cited by 36
How measurement science can improve confidence in research results
Plant, A. L., Becker, C. A., Hanisch, R. J., Boisvert, R. F., Possolo, A. M., & Elliott, J. T. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2004299 · Cited by 35
Publishers’ Responsibilities in Promoting Data Quality and Reproducibility
Hrynaszkiewicz, I. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_290 · Cited by 43
“Pharmaceutical companies have reported that fewer than 25% of the results reported in peer-reviewed publications could be reproduced in their labs (Prinz et al. 2011).”
BackgroundAutio, J. A., Zhu, Q., Li, X., Glasser, M. F., Schwiedrzik, C. M., Fair, D. A., Zimmermann, J., Yacoub, E. S., Menon, R. S., Essen, D. C. V., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118082 · Cited by 41
“…development and application of parallel imagng have been on-going for the past two decades and have markedly mproved human functional MR image quality ( Griswold et al., 2002 ; oeller et al., 2010 ; Pruessmann et al., 1999 ; Setsompop et al., 2012 ; ğurbil et al., 2013 ; Wiggins et al., 2006 ).”
Branco, A., Cohen, K. B., Vossen, P. T. J. M., Ide, N., & Calzolari, N. (2017) · Language Resources and Evaluation · doi:10.1007/s10579-017-9380-0 · Cited by 35
“For example, it has been shown that for some published results with major impact, replication of published results is difficult or impossible (e.g. Prinz et al. 2011; Begley and Ellis 2012; Fokkens et al. 2013; Anderson et al. 2015), and that exaggerated and false claims, sometimes with fabricated…”
ResultSoufizadeh, P., Mansouri, V., & Ahmadbeigi, N. (2024) · Laboratory Animal Research · doi:10.1186/s42826-024-00195-6 · Cited by 52
Translational paradigms in pharmacology and drug discovery
Mullane, K., Winquist, R. J., & Williams, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.10.019 · Cited by 35
“replicability of many studies [35,36].”
BackgroundInfluentialLessons Learned from Radiation Oncology Clinical Trials
Liu, F., participants, F. T. W., Okunieff, P. G., Bernhard, E. J., Stone, H. B., Yoo, S. S., Coleman, C. N., Vikram, B., Brown, M., Buatti, J. M., et al. (2013) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-13-1116 · Cited by 35
“The lack of data reproducibility is a major problem for drug development, wherein two thirds of these studies have significant inconsistencies (69, 70).”
CNS Target Identification and Validation: Avoiding the Valley of Death or Naive Optimism?
Hutson, P. H., Clark, J. A., & Cross, A. J. (2016) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010716-104624 · Cited by 40
Design and Analysis of Replication Studies
Bonett, D. G. (2020) · Organizational Research Methods · doi:10.1177/1094428120911088 · Cited by 39
“This criterion, which has been used in several major replication studies (Chang & Li, 2015; Ebersol et al., 2016; Kelin et al., 2018; Prinz et al., 2011), is flawed because the sampling error of the effect size in the original study is ignored.”
MethodWieschowski, S., Silva, D. S., & Strech, D. (2016) · PLOS Biology · doi:10.1371/journal.pbio.2000391 · Cited by 32
PCMSolver: An open‐source library for solvation modeling
Remigio, R. D., Steindal, A. H., Mozgawa, K., Weijo, V., Cao, H., & Frediani, L. (2018) · International Journal of Quantum Chemistry · doi:10.1002/qua.25685 · Cited by 35
An, G. C. (2018) · Bulletin of Mathematical Biology · doi:10.1007/s11538-018-0497-0 · Cited by 40
“…terms) has been used to describe the phenomenon that a series of foundational studies across a range of disciplines have failed in what can be considered a fundamental aspect of science: that they can be reproduced (Ioannidis 2005; Baker 2016; Prinz et al. 2011; Kaiser 2017; Freedman et al. 2015).”
BackgroundMannheim, J. G., Mamach, M., Reder, S., Traxl, A., Mucha, N., Disselhorst, J. A., Mittelhäuser, M., Kuntner, C., Thackeray, J. T., Ziegler, S. I., et al. (2019) · Journal of Nuclear Medicine · doi:10.2967/jnumed.118.221994 · Cited by 41
“There is an ongoing discussion about the reliability, reproducibility, validity and translatability of preclinical data (11-15).”
BackgroundHow Academia and the Pharmaceutical Industry Can Work Together
Rosenblatt, M. (2013) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201209-075ps · Cited by 34
Identification and characterization of cancer vulnerabilities via targeted protein degradation
Mayor-Ruiz, C., & Winter, G. E. (2019) · Drug Discovery Today: Technologies · doi:10.1016/j.ddtec.2018.12.003 · Cited by 33
Assi, H. H., Paran, C., VanderVeen, N. T., Savakus, J. C., Doherty, R., Petruzzella, E., Hoeschele, J. D., Appelman, H. D., Raptis, L. H., Mikkelsen, T., et al. (2014) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.114.214619 · Cited by 35
“STAT3 becomes activated by Janus kinase (JAK)–dependent tyrosine phosphorylation on a critical tyrosine residue (Tyr(705)), dimerizing through reciprocal Src homology 2–phosphotyrosine interaction (Prinz et al., 2011).”
BackgroundInfluentialSystem-based drug discovery within the human kinome
Bamborough, P. (2012) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2012.724056 · Cited by 36
“Reports of compound activity can prove impossible to reproduce [77], and are often insufficiently characterised to be able to exclude artefactual modes of action [78].”
BackgroundData gaps limit the translational potential of preclinical research
Kleiman, R. J., & Ehlers, M. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aac9888 · Cited by 31
Williams, D. R., Carlsson, R., & Bürkner, P. (2017) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2017.08.003 · Cited by 33
“Yet, other research areas are also experiencing difficulties replicating findings including biomedical related fields (< 25 %; Prinz et al., 2011).”
BackgroundReal life outcomes vs. clinical trial results
Zarbin, M. A. (2019) · Journal of Ophthalmic and Vision Research · doi:10.4103/jovr.jovr_279_18 · Cited by 34
“[9] Unfortunately, both in clinical science[10,11] and in basic science,[12,13] poor reproducibility of experimental results is an ongoing and important problem.”
BackgroundAssessments of Research Competencies for Clinical Investigators: A Systematic Review
Ianni, P. A., Samuels, E. M., Eakin, B. L., Perorazio, T. E., & Ellingrod, V. L. (2019) · Evaluation & the Health Professions · doi:10.1177/0163278719896392 · Cited by 42
Comte, B., Baumbach, J., Benis, A., Basílio, J., Debeljak, N., Flobak, Å., Franken, C., Harel, N., HeFeng, F. Q., Kuiper, M. T. R., et al. (2020) · Network and Systems Medicine · doi:10.1089/nsm.2020.0004 · Cited by 33
A survey of research quality in core facilities
Kos‐Braun, I. C., Gerlach, B., & Pitzer, C. (2020) · eLife · doi:10.7554/elife.62212 · Cited by 40
“Concerns about reproducibility in various areas of research have been growing for more than a decade (Eisner, 2018; Ioannidis, 2005; Ioannidis et al., 2014; Prinz et al., 2011).”
BackgroundRodgers, P., & Collings, A. (2021) · eLife · doi:10.7554/elife.75830 · Cited by 34
Jaric, I., Voelkl, B., Clerc, M., Schmid, M. W., Novak, J., Rosso, M., Rufener, R., von Kortzfleisch, V. T., Richter, S. H., Buettner, M., et al. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001837 · Cited by 32
Can cancer researchers accurately judge whether preclinical reports will reproduce?
Benjamin, D., Mandel, D. R., & Kimmelman, J. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2002212 · Cited by 32
An Introduction to Replication Research in Gifted Education: Shiny and New Is Not the Same as Useful
Makel, M. C., & Plucker, J. A. (2015) · Gifted Child Quarterly · doi:10.1177/0016986215578747 · Cited by 32
Weingarten, E., Chen, Q., McAdams, M., Yi, J., Hepler, J., & Albarracín, D. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.04.015 · Cited by 38
“Psychology is not alone when it comes to replicability failures, given that reproducibility challenges trouble virtually all scientific disciplines [40], including medicine [41], behavioral genetics [42], and neuroscience [43] among others.”
BackgroundTransparent reporting for reproducible science
Weissgerber, T. L., Garovic, V. D., Winham, S. J., Milic, N. M., & Prager, E. M. (2016) · Journal of Neuroscience Research · doi:10.1002/jnr.23785 · Cited by 33
“The inability to reproduce key scientific results is a growing concern among scientists, funding agencies, academic journals and the public (Begley and Ellis 2012; Prinz et al. 2011).”
BackgroundFake facts and alternative truths in medical research
Hofmann, B. (2018) · BMC Medical Ethics · doi:10.1186/s12910-018-0243-z · Cited by 34
Issues in Reproducible Simulation Research
Fitzpatrick, B. G. (2018) · Bulletin of Mathematical Biology · doi:10.1007/s11538-018-0496-1 · Cited by 36
Exact replication: Foundation of science or game of chance?
Piper, S. K., Grittner, U., Rex, A., Riedel, N., Fischer, F. H., Nadon, R., Siegerink, B., & Dirnagl, U. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000188 · Cited by 36
Automated Home-Cage Testing as a Tool to Improve Reproducibility of Behavioral Research?
Richter, S. H. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00383 · Cited by 38
“Thereby, particular attention has been given to animal research, where irreproducibility prevalence rates have been estimated to range between 50 and 90% (Prinz et al., 2011; Collins and Tabak, 2014; Freedman et al., 2015).”
BackgroundBioethical, Reproducibility, and Translational Challenges of Animal Models
Landi, M. S., Everitt, J. I., & Berridge, B. R. (2021) · ILAR Journal · doi:10.1093/ilar/ilaa027 · Cited by 40
Risk of bias reporting in the recent animal focal cerebral ischaemia literature
Bahor, Z., Liao, J., Macleod, M., Bannach-Brown, A., McCann, S., Wever, K., Thomas, J., Ottavi, T., Howells, D., Rice, A., et al. (2017) · Clinical science · doi:10.1042/cs20160722 · Cited by 34
Finding the Path to Biobank Sustainability Through Sound Business Planning
Henderson, M. K., Simeon‐Dubach, D., & Albert, M. (2015) · Biopreservation and Biobanking · doi:10.1089/bio.2015.29039.mh · Cited by 33
“The size and the cost of irreproducibility is enormous: up to 80–90% of pre-clinical research cannot be reproduced irrespective of the impact factor of the journal in which these articles have been published.(2,3) A recent article”
Do Corresponding Authors Take Responsibility for Their Work? A Covert Survey
Teunis, T., Nota, S. P. F. T., & Schwab, J. H. (2014) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-014-3868-3 · Cited by 35
“After publication of a manuscript, authors should remain available for access to raw data and data clarification, especially because of the importance of individual participant data for meta-analyses [8, 11], the low reproducibility of basic science results [1, 7, 13], and the encountered difficulties when implementin…”
Hylander, B. L., Eng, J. W. ‐., & Repasky, E. A. (2017) · Advances in experimental medicine and biology · doi:10.1007/978-3-319-67577-0_12 · Cited by 35
“In two major studies by drug companies, Bayer [122] and Amgen [125] investigated the reproducibility of preclinical experiments and found that less than 25% and 11%, respectively, of the studies were able to be duplicated.”
BackgroundIrreproducible text-book “knowledge”: The effects of color bands on zebra finch fitness
Wang, D., Forstmeier, W., Ihle, M., Khadraoui, M., Jerónimo, S., Martin, K., & Kempenaers, B. (2018) · Evolution · doi:10.1111/evo.13459 · Cited by 35
“…only make up a considerable part of the zebra finch literature, but also spurred and influenced the development of key concepts such as differential allocation and other maternal effects (Burley 1988), which subsequently were tested in a wide range of taxa (Sheldon 2000; Ratikainen and Kokko 2010).”
BackgroundJohnson, M. E., Chen, A., Faeder, J. R., Henning, P., Moraru, I. I., Meier‐Schellersheim, M., Murphy, R. F., Prüstel, T., Theriot, J. A., & Uhrmacher, A. M. (2020) · Molecular Biology of the Cell · doi:10.1091/mbc.e20-08-0530 · Cited by 40
“…resolved models Over the past decade, there has been a humbling realization that a large fraction of published results in experimental biology, including many that have led directly to significant efforts toward drug development, cannot be reproduced (Prinz et al., 2011; Begley and Ellis, 2012).”
BackgroundFemale sex-specific considerations to improve rigor and reproducibility in cardiovascular research
Chang, D. H., Dumanski, S. M., & Ahmed, S. B. (2022) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00462.2022 · Cited by 36
Tilp, C., Kapur, V., Loging, W., & Erb, K. J. (2013) · International Journal for Parasitology · doi:10.1016/j.ijpara.2012.12.003 · Cited by 32
Decision Making from Phase II to Phase III and the Probability of Success: Reassured by “Assurance”?
Carroll, K. J. (2013) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2013.813527 · Cited by 35
Niehues, H., van Vlijmen‐Willems, I. M. J. J., Bergboer, J. G. M., Kersten, F. F. J., Narita, M., Hendriks, W. J. A. J., van den Bogaard, E. H. J., Zeeuwen, P. L. J. M., & Schalkwijk, J. (2015) · British Journal of Dermatology · doi:10.1111/bjd.14284 · Cited by 35
Krebs, A. (2020) · ALTEX · doi:10.14573/altex.1909271e · Cited by 31
Prediction of robust scientific facts from literature
Belikov, A. V., Rzhetsky, A., & Evans, J. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00474-8 · Cited by 30
Burton, H. E., Peel, S. A. F., & Eggbeer, D. (2018) · Additive manufacturing · doi:10.1016/j.addma.2018.08.027 · Cited by 29
Sánchez‐Pagés, S., Rodríguez-Ruiz, C., & Turiégano, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0112157 · Cited by 34
“of scientific results [1–6], especially in behavioural sciences [7,8].”
BackgroundQuality Assurance in Biobanking for Pre-Clinical Research
Simeon‐Dubach, D., Zeisberger, S. M., & Hoerstrup, S. P. (2016) · Transfusion Medicine and Hemotherapy · doi:10.1159/000448254 · Cited by 33
Plant studies on fluctuating asymmetry in Russia: Mythology and methodology
Kozlov, M. V. (2017) · Russian Journal of Ecology · doi:10.1134/s1067413617010106 · Cited by 30
“The recently discovered low reproducibility of the results of biomedical research (Prinz et al., 2011; Begley and Ellis, 2012) has prompted many journals, including Nature and Science, to strengthen their requirements for the methodological parts of the manuscripts, paying special attention to…”
BackgroundLalu, M. M., Montroy, J. R., Begley, C. G., Bubela, T. M., Hunniford, V. T., Ripsman, D., Wesch, N. L., Kimmelman, J., Macleod, M. R., Moher, D., et al. (2020) · F1000Research · doi:10.12688/f1000research.23663.2 · Cited by 35
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29
Kenakin, T., Bylund, D. B., Toews, M. L., Mullane, K., Winquist, R. J., & Williams, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.10.024 · Cited by 28
Kleikers, P. W., Hooijmans, C., Göb, E., Langhauser, F., Rewell, S. S., Radermacher, K., Ritskes-Hoitinga, M., Howells, D. W., Kleinschnitz, C., & HHW Schmidt, H. (2015) · Scientific Reports · doi:10.1038/srep13428 · Cited by 29
“Taking into account all these values, the pooled variance for each group was calculated according to formula (1) here with n the size of the group and CV the coefficient of variation (SD/Mean) of the group.”
MethodLanghof, H., Chin, W. W. L., Wieschowski, S., Federico, C. A., Kimmelman, J., & Strech, D. (2018) · British Journal of Pharmacology · doi:10.1111/bph.14485 · Cited by 34
“Many commentators have questioned design and reporting standards for preclinical efficacy studies (Prinz et al., 2011; Begley and Ellis, 2012; Kimmelman and Federico, 2017; Mattina et al., 2017).”
BackgroundCentralized scientific communities are less likely to generate replicable results
Danchev, V., Rzhetsky, A., & Evans, J. A. (2019) · eLife · doi:10.7554/elife.43094 · Cited by 27
Fang, H., Findley, J. M., Muraro, G., Ravikovitch, P. I., & Sholl, D. S. (2019) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.9b02986 · Cited by 29
Lv, X., Zhang, Z., & Yuan, W. (2020) · Nutrition and Cancer · doi:10.1080/01635581.2020.1817955 · Cited by 29
A reaction norm perspective on reproducibility
Voelkl, B., & Würbel, H. (2021) · Theory in Biosciences · doi:10.1007/s12064-021-00340-y · Cited by 37
“In 2011, researchers from the company Bayer reported that out of 67 in-house replication studies of published research in the areas of oncology, women’s health and cardiovascular diseases only 14 (21%) could fully replicate the original findings (Prinz et al. 2011).”
BackgroundTargeting molecular networks for drug research
Pinto, J., Machado, R. S. R., Xavier, J. M., & Futschik, M. E. (2014) · Frontiers in Genetics · doi:10.3389/fgene.2014.00160 · Cited by 33
Howard, M. O., & Garland, E. L. (2015) · Journal of the Society for Social Work and Research · doi:10.1086/681099 · Cited by 30
Knopp, K. L., Stenfors, C., Baastrup, C., Bannon, A. W., Calvo, M., Caspani, O., Currie, G. L., Finnerup, N. B., Huang, W., Kennedy, J. D., et al. (2015) · Scandinavian Journal of Pain · doi:10.1016/j.sjpain.2015.01.006 · Cited by 32
Translational semantics and infrastructure: another search for the emperor's new clothes?
Mullane, K., & Williams, M. J. (2012) · Drug Discovery Today · doi:10.1016/j.drudis.2012.01.004 · Cited by 30
Primary lysis of eosinophils in severe desquamative asthma
Persson, C. (2014) · Clinical & Experimental Allergy · doi:10.1111/cea.12255 · Cited by 33
Use of reproducible research practices in public health: A survey of public health analysts
Harris, J. K., Johnson, K. J., Carothers, B. J., Combs, T., Luke, D. A., & Wang, X. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202447 · Cited by 40
How significant are your data? The need for a culture shift
Michel, M. C. (2014) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-014-1044-7 · Cited by 29
“In the pharmaceutical industry, lack of reproducibility also leads to a waste of resources as invalid targets may be pursued, which further drives up the already escalating costs of drug discovery and development (Prinz et al. 2011).”
BackgroundDudda, L., Kormann, E., Kozula, M., DeVito, N. J., Klebel, T., Dewi, A. P. M., Spijker, R., Stegeman, I., Van den Eynden, V., Ross-Hellauer, T., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.242057 · Cited by 28
“Fields like psychology [13], biomedical research [14,15], economics [16] and broader social sciences [17] all witnessed ‘many-lab’ studies whose findings indicated levels of reproducibility ranging between 30 and 70%.”
Enhancing reproducibility: Failures from Reproducibility Initiatives underline core challenges
Mullane, K., & Williams, M. (2017) · Biochemical Pharmacology · doi:10.1016/j.bcp.2017.04.008 · Cited by 28
Inflammatory Bowel Disease: Pathophysiology, Treatment, and Disease Modeling
Jang, J., & Jeong, S. (2023) · BioChip Journal · doi:10.1007/s13206-023-00118-y · Cited by 31
“Although animal models have proven to be useful in understanding the disease, accurately replicating individual IBD parameters [15], such as the barrier function of the epithelium and specific cells activation, in these complex models is challenging due to interspecies differences [1, 7, 12, 16].”
Biobanking in Genomic Medicine
Zhou, J. H., Şahin, A. A., & Myers, J. N. (2015) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2014-0261-ra · Cited by 28
“We then excluded articles that met one or more of the following criteria: (1) studies that were published before 1998, (2) studies that did not use tissue from the same specimen for comparison, (3) studies that used assays or reagents that were developed or used only in that laboratory or institution, (4) studies that…”
Enhancing the Efficacy of Radiation Therapy: Premises, Promises, and Practicality
Coleman, C. N., Lawrence, T. S., & Kirsch, D. G. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.57.3865 · Cited by 29
“The problem of reproducibility of preclinical studies from academic laboratories has received much needed attention.(35,36) On the basis of that information and the so-called null trials workshop, the Radiation Research Program is completing a detailed study of the methodology used in preclinical radiation modifier st…”
MethodDumas-Mallet, E., Button, K. S., Boraud, T., Munafo, M. R., & Gonon, F. (2016) · PLoS ONE · doi:10.1371/journal.pone.0158064 · Cited by 31
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.