Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 701–800 of 1,001
Improving the reliability and reporting of genetic association studies
Munafo, M. R., & Gage, S. H. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.03.023 · Cited by 25
Theoretical and technological building blocks for an innovation accelerator
van Harmelen, F., KAMPIS, G., Börner, K., van den Besselaar, P., Schultes, E., Goble, C., Groth, P., Mons, B., Anderson, S., Decker, S., et al. (2012) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2012-01692-1 · Cited by 22
A New Replication Norm for Psychology
LeBel, E. P. (2015) · Collabra · doi:10.1525/collabra.23 · Cited by 33
“Though there are different ways to interpret successful versus unsuccessful replication results [95], taken together, these observations strongly suggest psychology currently has a general replicability problem (as do several other areas of science including cancer cell biology and cardiovascular health literatures [8…”
ResultNIH Peer Review: Scored Review Criteria and Overall Impact
Lindner, M. D., Vancea, A., Chen, M., & Chacko, G. W. (2015) · American Journal of Evaluation · doi:10.1177/1098214015582049 · Cited by 23
Steinfath, M., Vogl, S., Violet, N., Schwarz, F., Mielke, H., Selhorst, T., Greiner, M., & Schönfelder, G. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202762 · Cited by 26
Nelissen, I., Haase, A., Anguissola, S., Rocks, L., Jacobs, A., Willems, H., Riebeling, C., Luch, A., Piret, J., Toussaint, O., et al. (2020) · Nanomaterials · doi:10.3390/nano10081430 · Cited by 23
“Conversely, reproducible results were also transferable between models [8].”
ResultEicosanoid Content in Fetal Calf Serum Accounts for Reproducibility Challenges in Cell Culture
Niederstaetter, L., Neuditschko, B., Brunmair, J., Janker, L., Bileck, A., Favero, G. D., & Gerner, C. (2021) · Biomolecules · doi:10.3390/biom11010113 · Cited by 20
“Problems with the inter-laboratory reproducibility of results obtained with in vitro cell culture models are increasingly being recognized [1,2].”
BackgroundFeger, S. S., Dallmeier-Tiessen, S., Schmidt, A., & Woźniak, P. W. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300685 · Cited by 34
“Alarming reports concerning the failure to reproduce empirical studies in a variety of scientific fields [2, 12, 45] are leading to the development of services, tools and strategies that aim to support key reproducible research practices [60].”
BackgroundMeta-Research: How problematic citing practices distort science
Horbach, S. P. J. M., Aagaard, K., & Schneider, J. W. (2021) · doi:10.31222/osf.io/aqyhg · Cited by 21
Incidence of Data Duplications in a Randomly Selected Pool of Life Science Publications
Oksvold, M. P. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9668-7 · Cited by 20
“The disappointing conclusions from previous studies (Prinz et al. 2011; Begley and Ellis 2012) and this study, should encourage scientific journals and editors to implement measures in their review and erratum/retraction processes, to improve the quality and reliability of the scientific literature: (1) Apply an autom…”
BackgroundKuessel, L., Jaeger-Lansky, A., Pateisky, P., Rossberg, N., Schulz, A., Schmitz, A. A. P., Staudigl, C., & Wenzl, R. (2014) · Gynecological Endocrinology · doi:10.3109/09513590.2013.856409 · Cited by 20
“other scientific publication in the life sciences cannot be reproduced independently [21].”
BackgroundTransparency, bias, and reproducibility across science: a meta-research view
Ioannidis, J. P. A. (2024) · Journal of Clinical Investigation · doi:10.1172/jci181923 · Cited by 26
“Failed replication in preclinical research was first documented convincingly by big pharma (30).”
Failure to Replicate: Sound the Alarm.
Ioannidis, J. P. A. (2015) · PubMed Central · Cited by 22
Enhancing reproducibility using interprofessional team best practices
Rolland, B., Burnside, E. S., Voils, C. I., Shah, M. N., & Brasier, A. R. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.512 · Cited by 24
Haselimashhadi, H., Mason, J., Mallon, A., Smedley, D. P., Meehan, T. F., & Parkinson, H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242933 · Cited by 22
“The inference made from the data is subject to reproducibility in the analysis requiring precise, transparent, comprehensive and well-documented rules to prevent unreliable, costly and even invalid results [1].”
MethodFrancis, G., & Thunell, E. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01855-z · Cited by 29
Large inherent variability in data derived from highly standardised cell culture experiments
Reddin, I. G., Fenton, T. R., Wass, M. N., & Michaelis, M. (2023) · Pharmacological Research · doi:10.1016/j.phrs.2023.106671 · Cited by 23
“A lack of predictive power by preclinical models for cancer drug development has been blamed for these low success rates, which has been suggested to be at least in part caused by the limited replicability of findings in such systems [2,4 – 9].”
Toward a common standard for data and specimen provenance in life sciences
Wittner, R., Holub, P., Mascia, C., Frexia, F., Müller, H., Plass, M., Allocca, C. M., Betsou, F., Burdett, T., Cancio, I., et al. (2023) · Learning Health Systems · doi:10.1002/lrh2.10365 · Cited by 30
“of the control mechanisms that traditionally ensured the quality of data and processes.(1-11) At the same time, the origin and history of”
BackgroundArefin, A., Mendoza, M., Dame, K., Garcia, M. I., Strauss, D. G., & Ribeiro, A. J. S. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1212092 · Cited by 21
Steckler, T., Brose, K., Haas, M., Kas, M. J., Koustova, E., & Bespalov, A. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.05.011 · Cited by 22
“…amongst industrial and academic scientists, editors, publishers and public organizations (e.g., Couzin-Frankel, 2013; Dolgin, 2014; Landis et al., 2012; Macleod et al., 2014; McNutt, 2014; Motulsky, 2014; Munafo et al., 2014; Prinz et al., 2011; Steckler, 2015; Steward and Balice-Gordon, 2014).”
Cole, G. D., Nowbar, A. N., Mielewczik, M., Shun-Shin, M. J., & Francis, D. P. (2015) · BMJ · doi:10.1136/bmj.h4708 · Cited by 19
Automated Integration of a UPLC Glycomic Profile
Agakova, A., Vučković, F., Klarić, L., Lauc, G., & Agakov, F. V. (2016) · Methods in molecular biology · doi:10.1007/978-1-4939-6493-2_17 · Cited by 22
Reliability of infarct volumetry: Its relevance and the improvement by a software-assisted approach
Friedländer, F., Bohmann, F. O., Brunkhorst, M., Chae, J., Devraj, K., Köhler, Y., Kraft, P., Kuhn, H., Lucaciu, A., Luger, S., et al. (2016) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x16681311 · Cited by 23
“In general, an alarming problem in experimental research is that reproduction of published results fails in 75–80% of cases.(3) Researchers may overestimate the (1)Department of Neurology, Hospital of the Goethe University Frankfurt,”
BackgroundIn vivo phenotypic screening: clinical proof of concept for a drug repositioning approach
Ciallella, J. R., & Reaume, A. G. (2017) · Drug Discovery Today Technologies · doi:10.1016/j.ddtec.2017.04.001 · Cited by 24
Georgescu, C., & Wren, J. D. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx811 · Cited by 20
Algebraic shortcuts for leave-one-out cross-validation in supervised network inference
Stock, M., Pahikkala, T., Airola, A., Waegeman, W., & Baets, B. D. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bby095 · Cited by 29
Shift in the paradigm towards next-generation microbiology
Stres, B., & Kronegger, L. (2019) · FEMS Microbiology Letters · doi:10.1093/femsle/fnz159 · Cited by 21
Hedges, L. V. (2019) · Methodology · doi:10.1027/1614-2241/a000173 · Cited by 24
Resolving the Tension Between Exploration and Confirmation in Preclinical Biomedical Research
Dirnagl, U. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_278 · Cited by 26
Cohen, K. B., Xia, J., Roeder, C., & Hunter, L. (2016) · PubMed · Cited by 20
Is the Political Slant of Psychology Research Related to Scientific Replicability?
Reinero, D. A., Wills, J. A., Brady, W. J., Mende‐Siedlecki, P., Crawford, J. T., & Bavel, J. J. V. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620924463 · Cited by 21
(2015) · PubMed Central · Cited by 20
Curtis, M. J., & Abernethy, D. R. (2015) · Pharmacology Research & Perspectives · doi:10.1002/prp2.106 · Cited by 23
“These calls have recently become more strident with reports of lack of reproducibility of research results that are in the published literature (Prinz et al. 2011).”
ResultDoes GLP enhance the quality of toxicological evidence for regulatory decisions?: TABLE 1.
Borgert, C. J., Becker, R. A., Carlton, B. D., Hanson, M. L., Kwiatkowski, P., Marty, M. S., McCarty, L. S., Quill, T. F., Solomon, K. R., Kraak, G. V. D., et al. (2016) · Toxicological Sciences · doi:10.1093/toxsci/kfw056 · Cited by 24
“…its effectiveness in identifying scientific fraud (eg, academic studies from Arnold et al., 1996; McLachlan, 1997; Online Universities, 2012), irreproducible data (eg, Prinz et al., 2011) and reporting of associations that fail to meet minimum statistical requirements (eg, Bosker et al., 2013).”
BackgroundWhy is publication of negative clinical trial data important?
Hayes, A. G., & Hunter, J. A. (2012) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2012.02215.x · Cited by 20
“This becomes even more important if data that has been published to validate these targets pre-clinically is not always reproducible (Prinz et al., 2011).”
BackgroundNeuroprotective therapies: Preclinical reproducibility is only part of the problem
Tymianski, M. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aac9412 · Cited by 20
Tagne, A. M., Cassina, N., Furgiuele, A., Storelli, E., Cosentino, M., & Marino, F. (2020) · Journal of Academic Ethics · doi:10.1007/s10805-020-09359-0 · Cited by 20
“…to biomedical research as they waste resources (Gammon and Franzini 2013; Freedman et al. 2015), undermine public trust in science (Arrowsmith 2011; Prinz et al. 2011; Resnik and Shamoo 2017), tarnish the reputation of researchers and the credibility of research institutions (Lu et al. 2013; Stern…”
BackgroundMouchabac, S., Adrien, V., Falala-Séchet, C., Bonnot, O., Maatoug, R., Millet, B., Peretti, C.-S., Bourla, A., & Ferreri, F. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.622506 · Cited by 21
Beyerbach, J., Stadelmaier, J., HOFFMANN, G. E., Balduzzi, S., Bröckelmann, N., & Schwingshackl, L. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab095 · Cited by 20
Translational science: a survey of US biomedical researchers’ perspectives and practices
Walker, R. L., Saylor, K. W., Waltz, M., & Fisher, J. A. (2021) · Lab Animal · doi:10.1038/s41684-021-00890-0 · Cited by 20
The Dilemma of Reproducibility of Gating Isotherms for Flexible MOFs
De, A., Maliuta, M., Senkovska, I., & Kaskel, S. (2022) · Langmuir · doi:10.1021/acs.langmuir.2c01999 · Cited by 22
Multiplicity and replicability: two sides of the same coin
Bretz, F., & Westfall, P. H. (2014) · Pharmaceutical Statistics · doi:10.1002/pst.1648 · Cited by 19
“tific findings has been reported, be it in genomic research [1,2], drug development [3,4], or medical research in general [5].”
BackgroundBest Practices and Standard Protocols as a Tool to Enhance Translation for Neuromuscular Disorders
Willmann, R., Luca, A. D., Nagaraju, K., & Rüegg, M. A. (2015) · Journal of Neuromuscular Diseases · doi:10.3233/jnd-140067 · Cited by 19
“The low predictive power of preclinical studies to translate into successful clinical trials has caused frustration in the patients’ as well as in the researchers’ communities [1–5].”
BackgroundA Chemocentric Approach to the Identification of Cancer Targets
Flachner, B., Lőrincz, Z., Carotti, A., Nicolotti, O., Kuchipudi, P., Remez, N., Sanz, F., Tóvári, J., Szabó, M. J., Bertók, B., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035582 · Cited by 21
“The DIVISS strategy presented here represents a novel chemocentric approach to the identification of cancer-relevant drug targets that complements efficiently other established bioinformatics and functional approaches [51,52] and thus may contribute to increasing our confidence on potential drug targets [53].”
Can a good tree bring forth evil fruit? The funding of medical research by industry
Capps, B. (2016) · British Medical Bulletin · doi:10.1093/bmb/ldw014 · Cited by 21
“This has usefully identified many published results that cannot be reproduced.(62) Trawling these large amounts of published data serves a valuable social purpose; including identifying potential misconduct when published results are unrepeatable.”
BackgroundIdentification of Ligands and Translation to Clinical Applications
Haberkorn, U., Mier, W., Kopka, K., Herold‐Mende, C. C., Altmann, A., & Babich, J. W. (2017) · Journal of Nuclear Medicine · doi:10.2967/jnumed.116.186791 · Cited by 19
Tyler, D. C., Hitt, B. D., Nterful, F., & Mettling, M. (2019) · College & Research Libraries · doi:10.5860/crl.80.4.525 · Cited by 24
Sato, A., Ohashi, K., Ito, K., & Iwasawa, T. (2013) · Tetrahedron Letters · doi:10.1016/j.tetlet.2013.03.107 · Cited by 19
Grüter, B. E., Croci, D. M., Schöpf, S., Nevzati, E., d’Allonzo, D., Lattmann, J., Roth, T. A., Bircher, B., Muroi, C., Dutilh, G., et al. (2020) · Translational Stroke Research · doi:10.1007/s12975-020-00801-4 · Cited by 19
Towards FAIR protocols and workflows: the OpenPREDICT use case
Çelebi, R., Moreira, J., Hassan, A., Ayyar, S., Ridder, L., Kuhn, T., & Dumontier, M. (2020) · PeerJ Computer Science · doi:10.7717/peerj-cs.281 · Cited by 26
Methodological Problems With Online Concussion Testing
Holden, J. K., Francisco, E., Tommerdahl, A., Lensch, R., Kirsch, B., Zai, L. J., Pearce, A. J., Favorov, O. V., Dennis, R. G., & Tommerdahl, M. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.509091 · Cited by 23
ISO 20387 biobanking standard. Analysis of requirements and experience of implementation
Borisova, A. L., Pokrovskaya, M. S., Meshkov, A. N., Metelskaya, V. A., Shatalova, A. M., & Drapkina, O. M. (2020) · Russian Clinical Laboratory Diagnostics · doi:10.18821/0869-2084-2020-65-9-587-592 · Cited by 19
Addressing the Right Targets in Oncology: Challenges and Alternative Approaches
Stock, J. K., Jones, N. P., Hammonds, T. R., Roffey, J., & Dillon, C. (2015) · SLAS DISCOVERY · doi:10.1177/1087057114564349 · Cited by 21
“This inability to reliably exploit findings from the primary literature is a particularly acute problem and is a major contributing factor to project attrition throughout preclinical discovery.(63) The issue of poor data reproducibility has received a considerable amount of attention in recent years within the scienti…”
BackgroundResultBone Tropism in Cancer Metastases
Wang, H., Zhang, W., Bado, I., & Zhang, X. H.-F. (2019) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a036848 · Cited by 22
(2012) · Nature Biotechnology · doi:10.1038/nbt.2335 · Cited by 21
Ostrow, K., Heffernan, N. T., & Williams, J. J. (2017) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/016146811711900308 · Cited by 23
Identification and Development of Therapeutics for COVID-19
Rando, H. M., Wellhausen, N., Ghosh, S., Lee, A. J., Dattoli, A. A., Hu, F., Byrd, J. B., Rafizadeh, D. N., Lordan, R., Qi, Y., et al. (2021) · mSystems · doi:10.1128/msystems.00233-21 · Cited by 28
“validate targets can be difficult to reproduce (281), which may pose challenges to target-based experimental screening and to in silico screens.”
The Open Science Peer Review Oath
Aleksic, J., Alexa, A., Attwood, T. K., Hong, N. C., Dahlö, M., Davey, R., Dinkel, H., Förstner, K. U., Grigorov, I., Hèriché, J.-K., et al. (2014) · F1000Research · doi:10.12688/f1000research.5686.1 · Cited by 19
“Reproducibility in science is a hot topic and a concerning one; indeed, several commentators have concluded that fallibilities in the way that research investigations are currently conducted, and how their results are disseminated via article publication have become detrimental to the scientific process (1-4).”
Cahart, M., O’Daly, O., Giampietro, V., Timmers, M., Streffer, J. R., Einstein, S. G., Zelaya, F. O., Dell’Acqua, F., & Williams, S. (2022) · Human Brain Mapping · doi:10.1002/hbm.26180 · Cited by 22
“In the last two decades, concerns regarding the reliability of biomedical research have been increasingly expressed (Ionnadis, 2005; Prinz et al., 2011) and recent research has focused on identifying best practices with a view to improving the test–retest reliability of standard rs-fMRI measures (Noble et al.”
BackgroundHylander, B. L., Qiao, G., Gomez, E. C., Singh, P. K., & Repasky, E. A. (2023) · Biochimie · doi:10.1016/j.biochi.2023.01.016 · Cited by 18
Obtaining miRNA from Saliva—Comparison of Sampling and Purification Methods
Urbizu, A., Arnaldo, L., & Beyer, K. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24032386 · Cited by 20
“For several years now, there has been an open discussion about repeated problems with the reproducibility of scientific results in almost all fields of research [24,25].”
Addgene: Making Materials Sharing “Science As Usual”
Kamens, J. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001991 · Cited by 21
“Poor explanation of experimental methods, including insufficient description of reagents in publications, is a potential cause of data irreproducibility [6–7].”
MethodAssessing Public Metabolomics Metadata, Towards Improving Quality
Ferreira, J. D., Inácio, B., Salek, R. M., & Couto, F. M. (2017) · Berichte aus der medizinischen Informatik und Bioinformatik/Journal of integrative bioinformatics · doi:10.1515/jib-2017-0054 · Cited by 19
A computational solution to improve biomarker reproducibility during long-term projects
Feng, F., Thompson, M. P., Thomas, B. E., Duffy, E. R., Kim, J., Kurosawa, S., Tashjian, J. Y., Wei, Y., Andry, C., & Stearns-Kurosawa, D. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0209060 · Cited by 19
Weeks, K. L., Henstridge, D. C., Salim, A., Shaw, J. E., Marwick, T. H., & McMullen, J. R. (2019) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00327.2019 · Cited by 18
“Over the past decade, there have been increasing concerns around the reproducibility of preclinical animal research and the lack of detail provided in publications in relation to experimental design (7, 8, 28, 47).”
BackgroundA new approach method for characterizing inter-species toxicodynamic variability
Burnett, S. D., Karmakar, M., Murphy, W. J., Chiu, W. A., & Rusyn, I. (2021) · Journal of Toxicology and Environmental Health · doi:10.1080/15287394.2021.1966861 · Cited by 18
“Reproducibility in chemical-induced effects on fibroblasts To evaluate reproducibility (Prinz, Schlange, and Asadullah 2011), in accordance with the best practices for enhancing rigor in science (Casadevall and Fang 2016), our study design included an assessment of experimental variability.”
Is preclinical research in cancer biology reproducible enough?
Kane, P. B., & Kimmelman, J. (2021) · eLife · doi:10.7554/elife.67527 · Cited by 22
Héroux, M. E., Butler, A. A., Cashin, A. G., McCaughey, E. J., Affleck, A. J., Green, M. A., Cartwright, A., Jones, M. D., Kiely, K. M., van Schooten, K. S., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060976 · Cited by 21
RegenBase: a knowledge base of spinal cord injury biology for translational research
Callahan, A., Abeyruwan, S. W., Al‐Ali, H., Sakurai, K., Ferguson, A. R., Popovich, P. G., Shah, N. H., Visser, U., Bixby, J. L., & Lemmon, V. (2016) · Database · doi:10.1093/database/baw040 · Cited by 19
“Despite these advances, experiment replicability remains a significant challenge, with recent studies reporting that less than half of major experimental results are reproducible in a second laboratory (7, 8).”
BackgroundEditorial: Do You See What I See?: Quality, Reliability, and Reproducibility in Biomedical Research
Kraus, W. L. (2014) · Molecular Endocrinology · doi:10.1210/me.2014-1036 · Cited by 18
“rate of reproducibility of landmark discoveries in biomedicine (4, 5), as well as problems with data analysis and peer review, but they fail to provide and substantiate an accurate view of the scope of the problem and its overall impact on the scientific enterprise.”
BackgroundReproducibility and cell biology
Yamada, K. M., & Hall, A. (2015) · The Journal of Cell Biology · doi:10.1083/jcb.201503036 · Cited by 19
“These companies encountered surprisingly low reproducibility (<25%) of published work (Prinz et al., 2011; Begley and Ellis, 2012).”
BackgroundBalafoutas, L., Celse, J., Karakostas, A., & Umashev, N. (2024) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2024.102327 · Cited by 24
A guideline proposal for mice preparation and care in 18F-FDG PET imaging
Ribeiro, F. M., Correia, P. M. M., SANTOS, A. C. D. S., & Veloso, J. F. C. A. (2022) · EJNMMI Research · doi:10.1186/s13550-022-00921-y · Cited by 21
“[8] as one of the reasons for the lack of reproducibility, the absence of a global standard protocol limits repeatability, reproducibility, and reliability of data.”
BackgroundUnderstanding the importance of quality control and quality assurance in preclinical PET/CT imaging
McDougald, W., & Mannheim, J. G. (2022) · EJNMMI Physics · doi:10.1186/s40658-022-00503-w · Cited by 22
Poor antibody validation is a challenge in biomedical research: a case study for detection of c-FLIP
Bucur, O., Pennarun, B., Stancu, A. L., Nadler, M. J. S., Muraru, M. S., Bertomeu, T., & Khosravi‐Far, R. (2013) · APOPTOSIS · doi:10.1007/s10495-013-0880-0 · Cited by 17
Why So Few New Cardiovascular Drugs Translate to the Clinics
Vatner, S. F. (2016) · Circulation Research · doi:10.1161/circresaha.116.309512 · Cited by 17
“The most popular explanation for this decline has been the irreproducibility of data, in that only in 20% to 25% of projects repeated in industry were the data completely in line with what was in the literature, often because published data were incorrect.(1) The current Viewpoint offers a novel reason for failure of…”
InfluentialFrom Famine to Feast: Developing Early-Phase Combination Immunotherapy Trials Wisely
Day, D., Monjazeb, A. M., Sharon, E., Ivy, S. P., Rubin, E. H., Rosner, G. L., & Butler, M. O. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-16-3064 · Cited by 17
“Currently, there are substantial limitations to nonclinical studies, including suboptimal reproducibility (74, 75), publication bias, and insufficiently characterized combination index (defined as a quantitative measure of combination drug effects; ref.”
BackgroundTumkaya, T., Ott, S., & Claridge‐Chang, A. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.07.016 · Cited by 20
“, 2017), including in the fields of cancer research (Begley and Ellis, 2012), drug target identification (Prinz et al., 2011), and human psychology (Open Science Collaboration, 2015a; Gilbert et al.”
Refinement on the Way Towards Replacement: Are We Doing What We Can?
Herrmann, K. (2019) · BRILL eBooks · doi:10.1163/9789004391192_002 · Cited by 39
Measuring the effects of publication bias in political science
Esarey, J., & Wu, A. (2016) · Research & Politics · doi:10.1177/2053168016665856 · Cited by 21
Independent labs to verify high-profile papers
Baker, M. (2012) · Nature · doi:10.1038/nature.2012.11176 · Cited by 17
Five Easy Ways To Make Your Research More Reproducible
Sholl, D. S. (2019) · Langmuir · doi:10.1021/acs.langmuir.9b02963 · Cited by 19
Reproducible Research in Vadose Zone Sciences
Skaggs, T. H., Young, M. H., & Vrugt, J. A. (2015) · Vadose Zone Journal · doi:10.2136/vzj2015.06.0088 · Cited by 17
Is There a Replication Crisis in Medical Education Research?
Hope, D., Dewar, A., & Hay, C. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004063 · Cited by 18
Testing the reproducibility and robustness of the cancer biology literature by robot
Roper, K., Abdel‐Rehim, A., Hubbard, S. A., Carpenter, M. R., Rzhetsky, A., Soldatova, L., & King, R. D. (2022) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0821 · Cited by 23
Ritskes-Hoitinga, M. J., & Pound, P. (2022) · Journal of the Royal Society of Medicine · doi:10.1177/01410768221100970 · Cited by 17
Thiele, F., Windebank, A. J., & Siddiqui, A. M. (2023) · Journal of Neuropathology & Experimental Neurology · doi:10.1093/jnen/nlad040 · Cited by 22
“(5) Image augmentation: image augmentation is the process of creating new training images by applying random transformations to existing images.”
BackgroundCare to share? Experimental evidence on code sharing behavior in the social sciences
Krähmer, D., Schächtele, L., & Schneck, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289380 · Cited by 20
Rewarding high-power replication research
Wagenmakers, E., & Forstmann, B. U. (2013) · Cortex · doi:10.1016/j.cortex.2013.09.010 · Cited by 16
Rethinking ‘academic’ drug discovery: the Manchester Institute perspective
Jordan, A. M., Waddell, I. D., & Ogilvie, D. (2014) · Drug Discovery Today · doi:10.1016/j.drudis.2014.12.011 · Cited by 17
Lost in Translation: What is Stopping Inhaled Nanomedicines From Realizing Their Potential?
Kumar, A., Dailey, L. A., & Forbes, B. (2014) · Therapeutic Delivery · doi:10.4155/tde.14.47 · Cited by 19
The academic–industrial complex: navigating the translational and cultural divide
Freedman, S. B., & Mullane, K. (2017) · Drug Discovery Today · doi:10.1016/j.drudis.2017.03.005 · Cited by 20
Palaniappan, K., & Kum, I. Y. S. (2017) · Current Psychology · doi:10.1007/s12144-017-9733-2 · Cited by 23
“For example, Prinz et al. found about 65% inconsistencies between existing and published data in the fields of oncology, cardiovascular diseases and women’s health (Prinz et al. 2011).”
The need for a formalised system of Quality Control for environmental policy-science
Larcombe, P., & Ridd, P. (2017) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2017.11.038 · Cited by 16
“Prinz et al. (2011) of the German drug company Bayer, writing in the journal ‘Nature Reviews Drug Discovery’ claimed that 75% of the literature used for potential drug discovery targets is unreliable.”
BackgroundControlling fluid flow to improve cell seeding uniformity
Reynolds, P. M., Rasmussen, C. H., Hansson, M. D., Dufva, M., Riehle, M. O., & Gadegaard, N. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207211 · Cited by 16
Statistical reproducibility for pairwise t-tests in pharmaceutical research
Simkus, A., Coolen, F. P. A., Coolen‐Maturi, T., Karp, N. A., & Bendtsen, C. (2021) · Statistical Methods in Medical Research · doi:10.1177/09622802211041765 · Cited by 23
Satyamitra, M. M., Perez-Horta, Z., DiCarlo, A. L., Cassatt, D. R., Rios, C. I., Price, P. W., & Taliaferro, L. P. (2022) · Radiation Research · doi:10.1667/rade-21-00198.1 · Cited by 16
CURRENT BEST PRACTICES AND BIOBANKING RECOMMENDATIONS
Doludin, Y. V., Borisova, A. L., Pokrovskaya, M. S., Stefanyuk, O. V., Sivakova, O. V., Botsoeva, S. A., Meshkov, A. N., Metelskaya, V. A., & Drapkina, O. M. (2019) · Russian Clinical Laboratory Diagnostics · doi:10.18821/0869-2084-2019-64-12-769-776 · Cited by 16
Fry, D. (2014) · ILAR Journal · doi:10.1093/ilar/ilu031 · Cited by 18
“…of positive outcomes (Bebarta et al. 2003), poor correspondence between animal experiments and clinical findings (Perel et al. 2006), the variation in reported effects (Scott et al. 2008), and difficulty in repeating published studies in-house (Begley and Ellis 2012; Prinz et al. 2011).”
BackgroundResultPreformulation in Drug Research and Pharmaceutical Product Development
Acharya, P. C., Shetty, S. R., Fernandes, C., Suares, D., Maheshwari, R., & Tekade, R. K. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-814423-7.00001-0 · Cited by 26
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.