Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 601–700 of 1,001
An Information Theoretic Approach to Model Selection: A Tutorial with Monte Carlo Confirmation
Newland, M. C. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00206-1 · Cited by 29
Critical Analysis of Non-Thermal Plasma-Driven Modulation of Immune Cells from Clinical Perspective
Smolková, B., Frtús, A., Uzhytchak, M., Lunová, M., Kubinová, Š., Dejneka, A., & Lunov, O. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21176226 · Cited by 31
“Importantly, target verification requires a thorough biological understanding [163].”
BackgroundReproducibility Problems of Amyloid-β Self-Assembly and How to Deal With Them
Faller, P., & Hureau, C. (2021) · Frontiers in Chemistry · doi:10.3389/fchem.2020.611227 · Cited by 36
“Reproducibility problems have been documented several times in the field of biomedical science (Prinz et al., 2011).”
BackgroundImproving energy research practices: guidance for transparency, reproducibility and quality
Huebner, G., Fell, M., & Watson, N. (2021) · Buildings and Cities · doi:10.5334/bc.67 · Cited by 22
Karp, N. A., Pearl, E. J., Stringer, E. J., Barkus, C., Ulrichsen, J. C., & du Sert, N. P. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001873 · Cited by 36
Leithner, C., Füchtemeier, M., Jorks, D., Mueller, S. G., Dirnagl, U., & Royl, G. (2015) · Stroke · doi:10.1161/strokeaha.114.007832 · Cited by 27
Barnes, R. O., Shea, K. E., & Watson, P. H. (2016) · Biopreservation and Biobanking · doi:10.1089/bio.2016.0021 · Cited by 29
Scientific Uncertainty in the Press: How Newspapers Describe Initial Biomedical Findings
Dumas-Mallet, E., Smith, A., Boraud, T., & Gonon, F. (2018) · Science Communication · doi:10.1177/1075547017752166 · Cited by 29
“trustworthy than those reported in less prestigious peer-reviewed journals has been contradicted by observational studies (Dumas-Mallet et al., 2016; Prinz et al., 2011).”
ResultPhenotypic Screening in C. elegans as a Tool for the Discovery of New Geroprotective Drugs
Bulterijs, S., & Braeckman, B. P. (2020) · Pharmaceuticals · doi:10.3390/ph13080164 · Cited by 33
Riehm, K. E., Azar, M., & Thombs, B. D. (2015) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2015.04.010 · Cited by 28
Wyndham, J. M., Weisenberg, N., McCarty, C. A., Goldman, G. T., Brown, M., & Borenstein, J. (2022) · doi:10.1126/aaas.ade8203 · Cited by 32
Estrogen receptor alpha gene amplification in breast cancer: 25 years of debate
Holst, F. (2016) · World Journal of Clinical Oncology · doi:10.5306/wjco.v7.i2.160 · Cited by 27
Cramond, F., Irvine, C., Liao, J., Howells, D., Sena, E., Currie, G., & Macleod, M. (2016) · Scientometrics · doi:10.1007/s11192-016-1964-8 · Cited by 27
“Poor replication of in vitro molecular and cellular biology studies has also been reported (Begley and Ellis 2012; Prinz et al. 2011) and linked in part to poor descriptions of the experimental and analytical details.”
BackgroundMapping ethical and social aspects of cancer biomarkers
Blanchard, A. (2016) · New Biotechnology · doi:10.1016/j.nbt.2016.06.1458 · Cited by 30
“The problem of ‘anchoring’ reinforces this bias; it is indeed relatively difficult to publish “results that contradict data from high-impact journals or the currently established scientific opinion in a given field” [20].”
BackgroundA New Account of Replication in the Experimental Life Sciences
Guttinger, S. (2019) · Philosophy of Science · doi:10.1086/703555 · Cited by 27
“This has led to talk of a ‘reproducibility crisis’ in science (Prinz et al. 2011; Begley and Ellis 2012; Mobley et al. 2013).”
BackgroundRole of biobanking in managing large-scale epidemiological studies
Pokrovskaya, M. S., Borisova, A. L., Metelskaya, V. A., Efimova, I. A., Doludin, Y. V., Kozlova, V. A., Serebryanskaya, Z. Z., Balanova, Y. А., Meshkov, A. N., Pustelenin, А. V., et al. (2021) · CARDIOVASCULAR THERAPY AND PREVENTION · doi:10.15829/1728-8800-2021-2958 · Cited by 27
Hamilton, D. G., Page, M. J., Finch, S. J., Everitt, S., & Fidler, F. M. (2022) · BMC Medicine · doi:10.1186/s12916-022-02644-2 · Cited by 51
Peer review versus editorial review and their role in innovative science
Steinhäuser, G., Adlassnig, W., Risch, J. A., Anderlini, S., Arguriou, P., Armendariz, A. Z., Bains, W., Baker, C. V., Barnes, M., Barnett, J., et al. (2012) · Metamedicine · doi:10.1007/s11017-012-9233-1 · Cited by 40
“Recent studies by world-class pharmaceutical companies that have failed to repeat high-profile peer reviewed research suggest that an astonishing number of such studies cannot be reproduced [11, 12].”
BackgroundIssues for new antiepilepsy drug development
Simonato, M., French, J. A., Galanopoulou, A. S., & O'Brien, T. J. (2013) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32835efe29 · Cited by 27
Whiteaker, J. R., Zhao, L., Saul, R., Kaczmarczyk, J. A., Schoenherr, R. M., Moore, H. D., Jones-Weinert, C. W., Ivey, R. G., Lin, C., Hiltke, T., et al. (2018) · Radiation Research · doi:10.1667/rr14963.1 · Cited by 32
“Due to a lack of standardization, harmonization of results across laboratories is difficult using existing technologies, hindering reproducibility of results and transferability of methods (12).”
Improving Translation by Identifying Evidence for More Human-Relevant Preclinical Strategies
Ritskes-Hoitinga, M. J., Leenaars, C. H. C., Beumer, W., Roo, T. C.-D., Stafleu, F. R., & Meijboom, F. L. B. (2020) · Animals · doi:10.3390/ani10071170 · Cited by 29
“[11] study shows that two thirds of the studies could not repeat the initially published results, leading to halting further development of those substances.”
ResultIrreproducible biology research costs put at $28 billion per year
Baker, M. (2015) · Nature · doi:10.1038/nature.2015.17711 · Cited by 29
The Research Reproducibility Crisis and Economics of Science
Maniadis, Z., & Tufano, F. (2017) · The Economic Journal · doi:10.1111/ecoj.12526 · Cited by 32
“The relevant discussion has been particularly heated in academia – especially in biomedical and psychological disciplines (e.g., Ioannidis, 2005, 2012; Prinz et al., 2011; Open Science Initiative, 2015; Simmons et al., 2011) – and the popular press has followed up, with articles in outlets such as the Economist, the N…”
Secondary use of electronic medical records for clinical research: challenges and opportunities
Yim, W., Wheeler, A. J., Curtin, C. M., Wagner, T. H., & Hernandez‐Boussard, T. (2018) · Convergent Science Physical Oncology · doi:10.1088/2057-1739/aaa905 · Cited by 26
Silva, P. J., Schaibley, V. M., & Ramos, K. S. (2018) · Journal of Translational Medicine · doi:10.1186/s12967-018-1401-2 · Cited by 30
“The reproducibility of experimental findings across different laboratories, coupled with limitations extrapolating from animals to humans, have been major impediments to translation of academic research, particularly in drug development [20].”
BackgroundSun, Q., Welsh, K. J., Bruns, D. E., Sacks, D. B., & Zhao, Z. (2019) · Clinical Chemistry · doi:10.1373/clinchem.2019.309575 · Cited by 29
“We evaluated the reporting of 11 key analytical characteristics (Table 1): (1) analytical accuracy or trueness (estimates based on method-comparison or recovery studies were accepted, regardless of whether a primary reference measurement procedure or a certified reference material was used), (2) total (day-to-day) imp…”
MethodOlofsson, J., Larsson, M. U., Roa, C., Wilson, D. A., & Laukka, E. J. (2019) · Behavior Genetics · doi:10.1007/s10519-019-09980-9 · Cited by 30
Mandal, R. K., Denny, J. E., Waide, M. L., Li, Q., Bhutiani, N., Anderson, C. D., Baby, B. V., Jala, V. R., Egilmez, N. K., & Schmidt, N. W. (2020) · BMC Biology · doi:10.1186/s12915-020-00810-7 · Cited by 29
Muradchanian, J., Hoekstra, R., Kiers, H. A. L., & van Ravenzwaaij, D. (2021) · Royal Society Open Science · doi:10.1098/rsos.201697 · Cited by 38
A community-led initiative for training in reproducible research
Auer, S., Haelterman, N. A. T., Weissgerber, T. L., Erlich, J. C., Susilaradeya, D., Julkowska, M., Gazda, M. A., Schwessinger, B., Jadavji, N. M., Reproducibility for Everyone Team, et al. (2021) · eLife · doi:10.7554/elife.64719 · Cited by 28
“While the problems with experimental reproducibility have been known for decades, they have only come to the fore over the past ten years (Begley and Ellis, 2012; Munafò et al., 2017; Prinz et al., 2011).”
BackgroundScientific misconduct: the dark side of science
Carafoli, E. (2015) · RENDICONTI LINCEI · doi:10.1007/s12210-015-0415-4 · Cited by 38
“A similar study by Prinz et al. (2011) has come to the same conclusion on 67 equally acclaimed publications of preclinical cancer research.”
BackgroundToo Much Success for Recent Groundbreaking Epigenetic Experiments
Francis, G. (2014) · Genetics · doi:10.1534/genetics.114.163998 · Cited by 28
“INDEPENDENT replications of empirical findings are criticalfor the development of science (e.g., Prinz et al. 2011; Collins and Tabak 2014; McNutt 2014), but there are difficulties in interpreting replications of statistical findings.”
O'Brien, T. J., Ben-Menachem, E., Bertram, E., Collins, S., Kokaia, M., Lerche, H., Klitgaard, H., Staley, K., Vaudano, E. A., Walker, M., et al. (2013) · Epilepsia · doi:10.1111/epi.12300 · Cited by 26
“A major contributor to this reluctance is an increasing concern that results from preclinical target validation or drug testing studies are often not replicable in independent studies, including in-house testing by industry (Prinz et al., 2011; Landis et al., 2012).”
BackgroundPhenotypic screening with primary neurons to identify drug targets for regeneration and degeneration
Cooper, D. J., Zunino, G., Bixby, J. L., & Lemmon, V. (2016) · Molecular and Cellular Neuroscience · doi:10.1016/j.mcn.2016.07.001 · Cited by 26
“Poor reproducibility may be due to poor experimental design, variability in reagents or poorly controlled experimental technique, among other possibilities (Carp, 2012; Prinz et al., 2011).”
BackgroundReplication in Imaging Genetics: The Case of Threat-Related Amygdala Reactivity
Avinun, R., Nevo, A., Knodt, A. R., Elliott, M. L., & Hariri, A. R. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.11.010 · Cited by 26
Rosell, A., Moser, B., Hisada, Y., Chinthapatla, R., Lian, G., Yang, Y., Flick, M. J., & Mackman, N. (2020) · Research and Practice in Thrombosis and Haemostasis · doi:10.1002/rth2.12363 · Cited by 26
Spellman, B. A., Gilbert, E. A., & Corker, K. S. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn519 · Cited by 92
Psychology Exceptionalism and the Multiple Discovery of the Replication Crisis
Nelson, N. C., Chung, J., Ichikawa, K., & Malik, M. M. (2021) · Review of General Psychology · doi:10.1177/10892680211046508 · Cited by 27
“…biomedical scientists, 2011 and 2012 were also important years: it was in these years that two groups of scientists from the pharmaceutical companies Bayer and Amgen reported their low rates of success in replicating results from the biomedical literature (Begley Ellis, 2012; Prinz et al., 2011).”
BackgroundImproving the Drug Development Process: More Not Less Randomized Trials
Djulbegović, B., Hozo, I., & Ioannidis, J. P. A. (2014) · JAMA · doi:10.1001/jama.2013.283742 · Cited by 32
Preclinical data reproducibility for R&D—the challenge for neuroscience
Steckler, T. (2015) · Psychopharmacology · doi:10.1007/s00213-014-3836-3 · Cited by 25
“pharmaceutical companies like Bayer (Prinz et al. 2011) gained much interest in the scientific community and raised high levels of concerns.”
BackgroundKarpen, S. C. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6570 · Cited by 25
“Bayer could only replicate 25% of the 67 studies that it attempted.(9) Is there any reason to believe that pharmacy education would fare better? Even when a p value is interpreted correctly, it is silent on the magnitude and range of an effect.”
BackgroundSimon, S. M., Meldrum, H. M., Ndung’u, E., & Ledley, F. D. (2018) · CBE—Life Sciences Education · doi:10.1187/cbe.17-03-0057 · Cited by 26
Variation in diagnostic NAFLD/NASH read-outs in paired liver samples from rodent models
Jensen, V. S., Tveden‐Nyborg, P., Zacho-Rasmussen, C., Quaade, M. L., Ipsen, D. H., Hvid, H., Fledelius, C., Wulff, E. M., & Lykkesfeldt, J. (2019) · Journal of Pharmacological and Toxicological Methods · doi:10.1016/j.vascn.2019.106651 · Cited by 28
Reproducible and transparent research practices in published neurology research
Rauh, S. L., Torgerson, T., Johnson, A., Pollard, J., Tritz, D., & Vassar, M. B. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-0091-5 · Cited by 27
Marshall, L. J., Triunfol, M., & Seidle, T. (2020) · Animals · doi:10.3390/ani10101923 · Cited by 29
“[49] commented on the plummeting success rates for Phase II trials, directly related to insufficient efficacy [50], and declared that “This indicates the limitations of the predictivity of disease models and also that the validity of the targets being investigated is frequently questionable .”
BackgroundPreclinical Stroke Research and Translational Failure: A Bird’s Eye View on Preventable Variables
Singh, D., Wasan, H., & Reeta, K. H. (2021) · Cellular and Molecular Neurobiology · doi:10.1007/s10571-021-01083-6 · Cited by 30
Hylander, B. L., Repasky, E. A., & Sexton, S. (2022) · Animals · doi:10.3390/ani12030371 · Cited by 30
“Two studies which drew attention to this issue were by Bayer [2] and Amgen [10].”
BackgroundIdentification and Development of Therapeutics for COVID-19
Rando, H. M., Wellhausen, N., Ghosh, S., Lee, A. J., Dattoli, A. A., Hu, F., Byrd, J. B., Rafizadeh, D. N., Qi, Y., Sun, Y., et al. (2021) · Lund University Publications (Lund University) · Cited by 26
The Significance of Discovery Screening and Structure Optimization Studies
Osakwe, O. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-802220-7.00005-3 · Cited by 40
Academic Discovery of Anticancer Drugs: Historic and Future Perspectives
Carugo, A., & Draetta, G. F. (2018) · Annual Review of Cancer Biology · doi:10.1146/annurev-cancerbio-030518-055645 · Cited by 30
Retractions of scientific publications: responsibility and accountability
Katavić, V. (2014) · Biochemia Medica · doi:10.11613/bm.2014.024 · Cited by 31
“This group of researchers failed to confirm the results of 89% of 53 “landmark” studies published in biomedicine! This study, and others like it have led some researchers to doubt the veracity (of most) of the published research (26,27), and to organize into a “Reproducibility Initiative” (28), so they could, as it sa…”
ResultGetting personal with the “reproducibility crisis”: interviews in the animal research community
Fitzpatrick, B. G., Koustova, E., & Wang, Y. (2018) · Lab Animal · doi:10.1038/s41684-018-0088-6 · Cited by 31
Macleod, M. R., & The NPQIP Collaborative group (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/187245 · Cited by 25
Pulverer, B. (2015) · The EMBO Journal · doi:10.15252/embj.201570090 · Cited by 24
“…issue of reproducibility in the bio-sciences came into the limelight in the wake of recent commentaries from reputable researchers in the biotech and pharmaceutical industries that claimed remarkably low rates of reproducibility for notable research papers (Prinz et al , 2011; Begley & Ellis 2012).”
Mapping brain asymmetry in health and disease through the ENIGMA consortiumPreprint
Kong, X., Postema, M. C., Guadalupe, T. M., de Kovel, C. G. F., Boedhoe, P. S. W., Hoogman, M., Mathias, S. R., van Rooij, D., Schijven, D., Glahn, D. C., et al. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ufwhp · Cited by 25
Pre-Registration in Social Psychology—a Discussion and Suggested TemplatePreprint
Veer, A. V. '., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4frms · Cited by 32
Extracting physics of life at the molecular level: A review of single-molecule data analyses
Colomb, W., & Sarkar, S. K. (2015) · Physics of Life Reviews · doi:10.1016/j.plrev.2015.01.017 · Cited by 28
Barriers to advancing nanotechnology to better improve and translate nanomedicines
Wang, Y., & Grainger, D. W. (2014) · Frontiers of Chemical Science and Engineering · doi:10.1007/s11705-014-1442-x · Cited by 25
“Reasons for lack of translation consistency from bench to bedside include: 1) a general distrust on the reliability of academic research and its quality and reproducibility [67,68]; 2) difficulties translating particle dosing determined for in vitro cell culture studies to in vivo models of tumors; 3) lack of validati…”
Glial cells as drug targets: What does it take?
Möller, T., & Boddeke, H. W. G. M. (2016) · Glia · doi:10.1002/glia.22993 · Cited by 25
“The first, titled “Believe it or not: how much can we rely on published data on potential drug targets?” was authored by a team form Target Discovery at Bayer Healthcare (Prinz et al., 2011).”
BackgroundEstimating longitudinal depressive symptoms from smartphone data in a transdiagnostic cohort
Pellegrini, A. M., Huang, E. J., Staples, P. C., Hart, K. L., Lorme, J. M., Brown, H. E., Perlis, R. H., & Onnela, J.-P. “. (2022) · Brain and Behavior · doi:10.1002/brb3.2077 · Cited by 25
“Reproducibility remains a challenge in the biomedical sciences, as fewer than 10% of studies have been found fully reproducible (Prinz et al., 2011).”
BackgroundAn Unappreciated Challenge to Oncology Drug Discovery: Pitfalls in Preclinical Research
Begley, C. G. (2013) · American Society of Clinical Oncology Educational Book · doi:10.14694/edbook_am.2013.33.466 · Cited by 24
Examining the predictive validity of NIH peer review scores
Lindner, M. D., & Nakamura, R. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126938 · Cited by 24
Sato, A., Mihara, S., & Iwasawa, T. (2012) · Tetrahedron Letters · doi:10.1016/j.tetlet.2012.05.004 · Cited by 24
The Chemistry-Biology-Medicine Continuum and the Drug Discovery and Development Process in Academia
Nicolaou, K. C. (2014) · Chemistry & Biology · doi:10.1016/j.chembiol.2014.07.020 · Cited by 30
Embracing Transparency Through Data Sharing
Boué, S., Byrne, M., Hayes, A. W., Hoeng, J., & Peitsch, M. C. (2018) · International Journal of Toxicology · doi:10.1177/1091581818803880 · Cited by 30
“The reasons for low reproducibility include underpowered studies, poor experimental design, confirmation bias resulting from a lack of randomization and blinding, neglecting to account for sex-specific effects, inappropriate statistical analysis, and pressure to publish only positive results.(16) Reproducibility, howe…”
BackgroundHolden, J. K., Francisco, E., Lensch, R., Tommerdahl, A., Kirsch, B., Zai, L. J., Dennis, R. G., & Tommerdahl, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/726364 · Cited by 25
The need for fundamental reforms in the pain research field to develop innovative drugs
Nagakura, Y. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2017.1261108 · Cited by 25
“because the poor data reproducibility is associated with project attrition [23].”
BackgroundWalters, C. G., Harter, Z. J., Wayant, C., Vo, N. H., Warren, M., Chronister, J., Tritz, D., & Vassar, M. B. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-033962 · Cited by 24
Linder, C., & Farahbakhsh, S. (2020) · Business Ethics Quarterly · doi:10.1017/beq.2019.52 · Cited by 26
Velázquez‐Campoy, A., Claro, B., Abián, O., Höring, J., Bourlon, L., Claveria‐Gimeno, R., Ennifar, E., England, P., Chaires, J. B., Wu, D., et al. (2021) · European Biophysics Journal · doi:10.1007/s00249-021-01523-7 · Cited by 23
“The lack of reproducibility is a matter of severe concern among researchers from academia and industry (Baker 2016; Begley and Ellis 2012; Ioannidis 2016; Mobley et al. 2013; Prinz et al. 2011), but there is still an ongoing debate on the criteria that should be used to Special Issue: COST Action CA15126, MOBIEU: Betw…”
BackgroundA minimal metadata set (MNMS) to repurpose nonclinical in vivo data for biomedical research
Moresis, A., Restivo, L., Bromilow, S., Flik, G., Rosati, G., Scorrano, F., Tsoory, M., O’Connor, E. C., Gaburro, S., & Bannach‐Brown, A. (2024) · Lab Animal · doi:10.1038/s41684-024-01335-0 · Cited by 26
Synthetic Biology: evolution or revolution? A co-founder's perspective
Gardner, T. S., & Hawkins, K. M. (2013) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2013.09.013 · Cited by 31
Carp, J. (2013) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-013-0188-0 · Cited by 24
Evidence-based Translational Medicine
Howells, D. W., & Macleod, M. R. (2013) · Stroke · doi:10.1161/strokeaha.113.000469 · Cited by 25
Zeitoune, A. A., Luna, J. S., Salas, K. S., ERBES, L. A., Cesar, C. L., Andrade, L. A. L. A., Carvahlo, H. F., Böttcher-Luiz, F. A., Casco, V. H., & Adur, J. F. (2017) · Cancer Informatics · doi:10.1177/1176935117690162 · Cited by 23
Preclinical progenitor cell therapy in traumatic brain injury: a meta-analysis
Jackson, M. L., Srivastava, A. K., & Cox, C. S. (2017) · Journal of Surgical Research · doi:10.1016/j.jss.2017.02.078 · Cited by 24
“However, the results of our study have the benefit of already being supported by two phase I/II clinical trials, overcoming to some extent the hurdle faced by so many successful animalmodels, which fail to show the same benefit in clinical trials.(59,63-66) The main limitation of this meta-analysis is in the outcomes…”
Sahoo, S. S., Valdez, J., Kim, M. J., Rueschman, M., & Redline, S. S. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.10.009 · Cited by 27
“…a number of the spinal cord injury studies funded by the US National Institute of Neurological Disorder and Stroke (NINDS) could not be replicated [4] and an analysis of 67 drug target discovery projects found inconsistencies between published and study data in two-thirds of the projects [5].”
BackgroundWebster, J. D., Santagostino, S. F., & Foreman, O. (2019) · Cell and Tissue Research · doi:10.1007/s00441-019-03101-y · Cited by 25
Lightweight Distributed Provenance Model for Complex Real–world Environments
Wittner, R., Mascia, C., Gallo, M., Frexia, F., Müller, H., Plass, M., Geiger, J., & Holub, P. (2022) · Scientific Data · doi:10.1038/s41597-022-01537-6 · Cited by 29
Improving the reliability of peer-reviewed publications: We are all in it together
Bustin, S. A., & Nolan, T. (2016) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.11.002 · Cited by 22
Empirical evidence for low reproducibility indicates low pre-study odds
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3475-c6 · Cited by 21
Degen, P. M., & Medo, M. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011630 · Cited by 28
“…the author’s claim that “most published research findings are false” has been the subject of considerable debate [18, 19], it indeed appears to be the case that certain fields such as preclinical cancer biology are struggling with a high prevalence of research with replication problems [20,21].”
Targeting Peroxisome Proliferator-Activated Receptor-β/δ (PPARβ/δ) for Cancer Chemoprevention
Peters, J. M., Yao, P., & Gonzalez, F. J. (2015) · Current Pharmacology Reports · doi:10.1007/s40495-015-0026-x · Cited by 24
Towards standardization guidelines for in silico approaches in personalized medicine
Brunak, S., Collin, C. B., Cathaoir, K. Ó., Golebiewski, M., Kirschner, M. W., Kockum, I. S., Moser, H., & Waltemath, D. (2020) · Berichte aus der medizinischen Informatik und Bioinformatik/Journal of integrative bioinformatics · doi:10.1515/jib-2020-0006 · Cited by 25
Kopylova, O. V., Ershova, A. I., Pokrovskaya, M. S., Meshkov, A. N., Efimova, I. A., Serebryanskaya, Z. Z., Блохина, А. В., Borisova, A. L., Kondratskaya, V. A., Limonova, A. S., et al. (2022) · CARDIOVASCULAR THERAPY AND PREVENTION · doi:10.15829/1728-8800-2021-3119 · Cited by 26
Blueprints for measuring natural behavior
Puścian, A., & Knapska, E. (2022) · iScience · doi:10.1016/j.isci.2022.104635 · Cited by 25
“It has been argued that in animal research the prevalence of irreproducible data can be as high as 50 to 90% (Prinz et al., 2011; Collins and Tabak, 2014; Freedman et al., 2015).”
BackgroundEllis, R. J. (2022) · eNeuro · doi:10.1523/eneuro.0017-22.2022 · Cited by 30
“In 2011, scientists from Bayer published a replication of 67 preclinical cancer, cardiovascular, and women’s health studies (Prinz et al., 2011).”
BackgroundProteins interacting with cloning scars: a source of false positive protein-protein interactions
Banks, C. A. S., Boanca, G., Lee, Z. T., Florens, L. A., & Washburn, M. P. (2015) · Scientific Reports · doi:10.1038/srep08530 · Cited by 24
Hey, S. P., Heilig, C. M., & Weijer, C. (2013) · Trials · doi:10.1186/1745-6215-14-159 · Cited by 26
“While a single, well-designed study may be sufficient, under particular conditions, to advance an intervention, the recent failed attempts by Bayer [13] and Amgen [14] to reproduce earlier findings demonstrates the dangers with such an approach.”
ResultReproducibility Issues: Avoiding Pitfalls in Animal Inflammation Models
Laman, J. D., Kooistra, S. M., & Clausen, B. E. (2017) · Methods in molecular biology · doi:10.1007/978-1-4939-6786-5_1 · Cited by 24
Schnell, S. D. (2018) · Bulletin of Mathematical Biology · doi:10.1007/s11538-018-0500-9 · Cited by 28
“…published in influential peer-reviewed scientific journals cannot be replicated in the biomedical sciences (Hirschhorn et al. 2002, Ioannidis 2005, Prinz et al. 2011, Begley and Ellis 2012), psychology (Bakker and Wicherts 2011, John et al 2012, Pashler and Wagenmakers 2012, Van Bavel et al.…”
BackgroundThe National Biomarker Development Alliance Accelerating the Translation of Biomarkers to the Clinic
Barker, A. D., Compton, C. C., & Poste, G. H. (2014) · Biomarkers in Medicine · doi:10.2217/bmm.14.52 · Cited by 22
Genetically Defined Strains in Drug Development and Toxicity Testing
Festing, M. F. W. (2016) · Methods in molecular biology · doi:10.1007/978-1-4939-3661-8_1 · Cited by 25
Ingre, M., & Nilsonne, G. (2018) · Royal Society Open Science · doi:10.1098/rsos.181190 · Cited by 23
In vitro disease models 4.0 via automation and high-throughput processing
Eggert, S., & Hutmacher, D. W. (2019) · Biofabrication · doi:10.1088/1758-5090/ab296f · Cited by 25
“However, recent publications highlighted significant challenges for researchers to replicate experiments [16] as well as for pharmaceutical companies to replicate preclinical studies [17, 18].”
BackgroundReplicability in Brain Imaging
Kelly, R. E., & Hoptman, M. J. (2022) · Brain Sciences · doi:10.3390/brainsci12030397 · Cited by 24
“This situation applies to fields where tested hypotheses are seldom true, which could in part explain the low replication rates observed in cancer studies [11,12].”
BackgroundKing, D. R., Hardin, K. M., Hoeker, G. S., & Poelzing, S. (2022) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00164.2022 · Cited by 22
Kocak, B., Keles, A., & Akinci D’Antonoli, T. (2023) · European Radiology · doi:10.1007/s00330-023-10243-9 · Cited by 21
Silverstein, P., Pennington, C. R., Branney, P., O'Connor, D. B., Lawlor, E., O'Brien, E., & Lynott, D. (2024) · British Journal of Psychology · doi:10.1111/bjop.12700 · Cited by 27
“…across a range of disciplines, from economics (Camerer et al., 2016) and experimental philosophy (Cova et al., 2021) to cardiovascular health (Prinz et al., 2011) and cancer biology (Begley & Ellis, 2012; Errington et al., 2021), reporting wide variability in ‘successful’ replications…”
BackgroundBiomarker-Driven Therapeutic Management of Alzheimer’s Disease: Establishing the Foundations
Cummings, J. L., & Zhong, K. (2013) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2013.205 · Cited by 22
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.