Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 201–300 of 1,001
SHRINE: Enabling Nationally Scalable Multi-Site Disease Studies
McMurry, A. J., Murphy, S. N., MacFadden, D., Weber, G., Simons, W. W., Orechia, J., Bickel, J., Wattanasin, N., Gilbert, C., Trevvett, P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055811 · Cited by 125
“Results of medical research studies are often contradictory[1,2] or cannot be reproduced[3,4,5,6,7].”
BackgroundPharmacotherapy of amphetamine‐type stimulant dependence: An update
Brensilver, M., Heinzerling, K. G., & Shoptaw, S. (2013) · Drug and Alcohol Review · doi:10.1111/dar.12048 · Cited by 124
“Some researchers have highlighted the need for better validation of pharmacological target exposure, receptor binding and functional modulation [91], whereas others underscore problems even earlier in drug development, namely target identification [92,93].”
BackgroundBias in the reporting of sex and age in biomedical research on mouse models
Flórez-Vargas, O., Brass, A., Karystianis, G., Bramhall, M., Stevens, R., Cruickshank, S., & Nenadic, G. (2016) · eLife · doi:10.7554/elife.13615 · Cited by 124
Reproducibility and Research Integrity
Resnik, D. B., & Shamoo, A. E. (2016) · Accountability in Research · doi:10.1080/08989621.2016.1257387 · Cited by 151
“To test their hypothesis, they analyzed 67 in-house drug target validation projects and found that only 20–25% were reproducible (Prinz, Schlange, and Asadullah 2011).”
MethodBuscher, K., Ehinger, E., Gupta, P., Pramod, A. B., Wolf, D., Tweet, G., Pan, C., Mills, C. D., Lusis, A. J., & Ley, K. (2017) · Nature Communications · doi:10.1038/ncomms16041 · Cited by 123
“In conclusion, our population-based approach yields (1) improved gene signatures with higher predictive power; (2) a methodological framework to extract meaningful signatures of data sets from heterogeneous populations, and demonstrates (3) the usefulness of the HMDP as a valuable surrogate for human diversity in tran…”
BackgroundBiobanking 3.0: Evidence based and customer focused biobanking
Simeon‐Dubach, D., & Watson, P. H. (2014) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2013.12.018 · Cited by 133
“While this issue has been known for a long time [33] to biobankers, recent papers have highlighted this issue for the broader scientific community as it relates to the very low reproducibility of scientific data published even in high impact factor journals [34,35].”
BackgroundCorrelated Multimodal Imaging in Life Sciences: Expanding the Biomedical Horizon
Walter, A., Paul‐Gilloteaux, P., Plochberger, B., Šefc, L., Verkade, P., Mannheim, J. G., Slezak, P., Unterhuber, A., Marchetti‐Deschmann, M., Ogris, M., et al. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00047 · Cited by 142
“Multiple studies have demonstrated that a bench-to-bedside translation from preclinical results into clinical practice is not as easy as anticipated [113, 115, 117].”
BackgroundResultReplication studies in economics—How many and which papers are chosen for replication, and why?
Mueller‐Langer, F., Fecher, B., Harhoff, D., & Wagner, G. G. (2018) · Research Policy · doi:10.1016/j.respol.2018.07.019 · Cited by 145
“Recent empirical evidence suggests that false positives are a major source for concern in many social and biomedical sciences (Bettis, 2012; Begley and Ellis, 2012; Brodeur et al., 2016; Freedman et al., 2015; Gall et al., 2017; Ioannidis, 2012; Open Science Collaboration, 2015; Prinz et al., 2011).”
Leveraging preclinical models for the development of Alzheimer disease therapeutics
Scearce-Levie, K. A., Sanchez, P. E., & Lewcock, J. W. (2020) · Nature Reviews Drug Discovery · doi:10.1038/s41573-020-0065-9 · Cited by 128
The Addgene repository: an international nonprofit plasmid and data resource
Kamens, J. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku893 · Cited by 118
Quality Issues of Research Antibodies
Weller, M. G. (2016) · Analytical Chemistry Insights · doi:10.4137/aci.s31614 · Cited by 118
Replication, Communication, and the Population Dynamics of Scientific Discovery
McElreath, R., & Smaldino, P. E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136088 · Cited by 117
Never waste a good crisis: confronting reproducibility in translational research
Drucker, D. J. (2016) · Cell Metabolism · doi:10.1016/j.cmet.2016.08.006 · Cited by 117
Diabetic Complications: Current Challenges and Opportunities
Nickerson, H. D., & Dutta, S. (2012) · Journal of Cardiovascular Translational Research · doi:10.1007/s12265-012-9388-1 · Cited by 136
Experimenter gender and replicability in science
Chapman, C. D., Benedict, C., & Schiöth, H. B. (2018) · Science Advances · doi:10.1126/sciadv.1701427 · Cited by 130
McGreivy, N., & Hakim, A. H. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00897-5 · Cited by 269
Camerer, C., Dreber, A., Holzmeister, F., Ho, T. H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., et al. (2018) · doi:10.31235/osf.io/4hmb6 · Cited by 117
Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices
Martin, G. N., & Clarke, R. M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00523 · Cited by 116
“…for example, reporting the first of the Many Labs projects hosted by the Open Science Foundation, found a reasonably good rate of replication attempts: Of 13 replication attempts of classic and contemporary findings in social and cognitive psychology using 36 samples comprising 6344 participants,…”
BackgroundPredictive validity in drug discovery: what it is, why it matters and how to improve it
Scannell, J. W., Bosley, J., Hickman, J. A., Dawson, G. R., Truebel, H., Ferreira, G. S., Richards, D. B., & Treherne, J. M. (2022) · Nature Reviews Drug Discovery · doi:10.1038/s41573-022-00552-x · Cited by 142
Michel, M. C., Murphy, T. J., & Motulsky, H. J. (2020) · Molecular Pharmacology · doi:10.1124/mol.119.118927 · Cited by 127
How to make more published research true
Ioannidis, J. P. A. (2015) · Acimed · Cited by 138
The challenge and promise of anti-epileptic therapy development in animal models
Simonato, M., Brooks-Kayal, A. R., Engel, J., Galanopoulou, A. S., Jensen, F. E., Moshé, S. L., O'Brien, T. J., Pitkanen, A., Wilcox, K. S., & French, J. A. (2014) · The Lancet Neurology · doi:10.1016/s1474-4422(14)70076-6 · Cited by 114
Bustin, S., & Nolan, T. (2017) · European Journal of Clinical Investigation · doi:10.1111/eci.12801 · Cited by 113
The therapeutics of Alzheimer's disease: Where we stand and where we are heading
Selkoe, D. J. (2013) · Annals of Neurology · doi:10.1002/ana.24001 · Cited by 113
Researcher Perspectives on Publication and Peer Review of Data
Kratz, J. E., & Strasser, C. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0117619 · Cited by 138
What makes a good drug target?
Gashaw, I., Ellinghaus, P., Sommer, A., & Asadullah, K. (2011) · Drug Discovery Today · doi:10.1016/j.drudis.2011.12.008 · Cited by 122
Self-citationKabza, M., Karolak, J. A., Rydzanicz, M., Szcześniak, M. W., Nowak-Malczewska, D. M., Ginter-Matuszewska, B., Polakowski, P., Płoski, R., Szaflik, J. P., & Gajęcka, M. (2017) · European Journal of Human Genetics · doi:10.1038/ejhg.2017.4 · Cited by 122
Endometriosis: current challenges in modeling a multifactorial disease of unknown etiology
Malvezzi, H., Marengo, E. B., Podgaec, S., & Piccinato, C. D. A. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02471-0 · Cited by 134
Schweinsberg, M., Madan, N., Vianello, M., Sommer, S. A., Jordan, J., Tierney, W., Awtrey, E., Zhu, L. L., Diermeier, D., Heinze, J. E., et al. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.001 · Cited by 108
“For example, an initiative by Bayer Healthcare to replicate 67 pre-clinical studies led to a reproducibility rate of 20–25% (Prinz et al., 2011), and researchers at Amgen were only able to replicate 6 of 53 influential cancer biology studies (Begley & Ellis, 2012).”
Batich, K. A., Mitchell, D. A., Healy, P., Herndon, J. E., & Sampson, J. H. (2020) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-20-1082 · Cited by 107
“So unfortunately, especially in oncology, as many as 65%ofmedical studies appear inconsistent when retested, and only 6% can be deemed reproducible (33).”
BackgroundExpanding Chemical Probe Space: Quality Criteria for Covalent and Degrader Probes
Hartung, I. V., Rudolph, J., Mader, M. M., Mulder, M. P. C., & Workman, P. (2023) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.3c00550 · Cited by 115
Tran, K. T., Pallesen, J. S., Solbak, S. M. Ø., Narayanan, D., Baig, A., Zang, J., Aguayo‐Orozco, A., Carmona, R. M., Garcia, A. D., & Bach, A. (2019) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.9b00723 · Cited by 110
Thermoneutrality, mice, and cancer: a heated opinion
Hylander, B. L., & Repasky, E. A. (2016) · Trends in cancer · doi:10.1016/j.trecan.2016.03.005 · Cited by 107
“Concluding Remarks The outcomes of preclinical mouse studies form the basis for understanding disease biology, immune and therapeutic responses, and determining which therapies to take into clinical trials [80–83].”
Targeting tumor suppressor genes for cancer therapy
Liu, Y., Hu, X., Han, C., Wang, L., Zhang, X., He, X., & Lu, X. (2015) · BioEssays · doi:10.1002/bies.201500093 · Cited by 107
The need for robust characterization of nanomaterials for nanomedicine applications
Mahmoudi, M. (2021) · Nature Communications · doi:10.1038/s41467-021-25584-6 · Cited by 116
Do stroke models model stroke?
Mergenthaler, P., & Meisel, A. (2012) · Disease Models & Mechanisms · doi:10.1242/dmm.010033 · Cited by 127
“…research in many areas (Bath et al., 2007; Bath et al., 2012; Crossley et al., 2008; Hackam and Redelmeier, 2006; Hampton, 2002; Ioannidis, 2005; Prinz et al., 2011; Rothwell, 2005; van der Worp et al., 2010a) and have been discussed intensively for decades (Atkins, 1966; Gifford and Feinstein,…”
BackgroundQuality assessment tools for evidence from environmental science
Bilotta, G. S., Milner, A. M., & Boyd, I. L. (2014) · Environmental Evidence · doi:10.1186/2047-2382-3-14 · Cited by 107
“Background There are significant concerns about the low reproducibility of scientific studies [1,2], and the limited effectiveness of peer-review as a quality-control mechanism [3,4].”
BackgroundScientific Utopia: II. Restructuring incentives and practices to promote truth over publishabilityPreprint
Nosek, B. A., Spies, J. R., & Motyl, M. S. (2016) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/k4bgq · Cited by 115
Bowen, A., & Casadevall, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1504955112 · Cited by 104
“Steen RG, Casadevall A, Fang FC (2013) Why has the number of scientific retractions increased? PLoS One 8(7):e68397.”
BackgroundBiomarkers in Sporadic and Familial Alzheimer’s Disease
Lista, S., O’Bryant, S. E., Blennow, K., Dubois, B., Hugon, J., Zetterberg, H., & Hampel, H. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-143006 · Cited by 106
Common misconceptions about data analysis and statistics
Motulsky, H. J. (2014) · Pharmacology Research & Perspectives · doi:10.1002/prp2.93 · Cited by 106
Introducing Therioepistemology: the study of how knowledge is gained from animal research
Garner, J. P., Gaskill, B. N., Weber, E. M., Dallaire, J. A., & Pritchett‐Corning, K. R. (2017) · Lab Animal · doi:10.1038/laban.1224 · Cited by 115
Reproducibility and Rigor in Animal-Based Research
Macleod, M., & Mohan, S. (2019) · ILAR Journal · doi:10.1093/ilar/ilz015 · Cited by 104
“This has been studied in retrospective observational [2,3] and prospective [4] studies.”
BackgroundQuality of reporting of confounding remained suboptimal after the STROBE guideline
Pouwels, K. B., Widyakusuma, N. N., Groenwold, R. H. H., & Hak, E. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.009 · Cited by 112
Enhancing Reuse of Data and Biological Material in Medical Research: From FAIR to FAIR-Health
Holub, P., Kohlmayer, F., Prasser, F., Mayrhofer, M. T., Schlünder, I., Martin, G. M., Casati, S., Koumakis, L., Wutte, A., Kozera, Ł., et al. (2018) · Biopreservation and Biobanking · doi:10.1089/bio.2017.0110 · Cited by 102
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
Is There a Free Lunch in Inference?
Rouder, J. N., Morey, R. D., Verhagen, J., Province, J. M., & Wagenmakers, E. (2016) · Topics in Cognitive Science · doi:10.1111/tops.12214 · Cited by 103
Advancing AI in healthcare: A comprehensive review of best practices
Polevikov, S. (2023) · Clinica Chimica Acta · doi:10.1016/j.cca.2023.117519 · Cited by 140
Did a change in Nature journals’ editorial policy for life sciences research improve reporting?
The NPQIP Collaborative group, Study steering committee, Macleod, M., Sena, E., Howells, D., Macleod, M., Sena, E., Howells, D., Kiermer, V., Swaminathan, S., et al. (2019) · BMJ Open Science · doi:10.1136/bmjos-2017-000035 · Cited by 102
Reproducibility of research and preclinical validation: problems and solutions
Pusztai, L., Hatzis, C., & André, F. (2013) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2013.171 · Cited by 114
Medicinal chemistry in drug discovery in big pharma: past, present and future
Campbell, I. B., Macdonald, S. J. F., & Procopiou, P. A. (2017) · Drug Discovery Today · doi:10.1016/j.drudis.2017.10.007 · Cited by 112
Estimating the deep replicability of scientific findings using human and artificial intelligence
Yang, Y., Youyou, W., & Uzzi, B. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1909046117 · Cited by 101
Brommage, R., Liu, J., Hansen, G. M., Kirkpatrick, L. L., Potter, D. G., Sands, A. T., Zambrowicz, B., Powell, D. R., & Vogel, P. (2014) · Bone Research · doi:10.1038/boneres.2014.34 · Cited by 100
Target Engagement in Lead Generation
Durham, T. B., & Blanco, M.-J. (2015) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/j.bmcl.2014.12.076 · Cited by 97
Bridging Translation by Improving Preclinical Study Design in AKI
de Caestecker, M., Humphreys, B. D., Liu, K. D., Fissell, W. H., Cerda, J., Nolin, T. D., Askenazi, D., Mour, G., Harrell, F. E., Pullen, N., et al. (2015) · Journal of the American Society of Nephrology · doi:10.1681/asn.2015070832 · Cited by 99
Tipton, E., Pustejovsky, J. E., & Ahmadi, H. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1338 · Cited by 97
A Call for Examining Replication and Bias in Special Education Research
Cook, B. G. (2014) · Remedial and Special Education · doi:10.1177/0741932514528995 · Cited by 108
“The notion that researchers are commonly unable to reproduce research findings has found increasing acceptance among the research community (e.g., Munafo & Flint, 2010; Prinz et al., 2011; Yong, 2012) and has received attention in the popular press (S.”
BackgroundInitial gut microbiota structure affects sensitivity to DSS-induced colitis in a mouse model
Li, M., Wu, Y., Hu, Y., Zhao, L., & Zhang, C. (2017) · Science China Life Sciences · doi:10.1007/s11427-017-9097-0 · Cited by 112
Online rules for control of false discovery rate and false discovery exceedance
Javanmard, A., & Montanari, A. (2018) · The Annals of Statistics · doi:10.1214/17-aos1559 · Cited by 154
Appraising iniparib, the PARP inhibitor that never was—what must we learn?
Mateo, J., Ong, M., Tan, D. S. P., Gonzalez, M. A., & de Bono, J. S. (2013) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2013.177 · Cited by 96
First-in-human Phase 1 CRISPR Gene Editing Cancer Trials: Are We Ready?
Baylis, F. E., & McLeod, M. (2017) · Current Gene Therapy · doi:10.2174/1566523217666171121165935 · Cited by 120
“In our view, there should have been several pre-clinical studies with independent replication by research teams that are financially disinterested in the outcome [44-46].”
BackgroundBoth Questionable and Open Research Practices Are Prevalent in Education Research
Makel, M. C., Hodges, J., Cook, B. G., & Plucker, J. A. (2021) · Educational Researcher · doi:10.3102/0013189x211001356 · Cited by 110
Approaches to modernize the combination drug development paradigm
Day, D., & Siu, L. L. (2016) · Genome Medicine · doi:10.1186/s13073-016-0369-x · Cited by 104
“Additionally, low rates (11–25 %) of reproducibility of published laboratory data, including those from high-impact journals, have been identified, despite attempts to recreate the experimental environment, suggesting limitations in the validity of scientific findings and probable publication bias [76, 77].”
BackgroundThe Ethnopharmacologic Contribution to Bioprospecting Natural Products
Buenz, E. J., Verpoorte, R., & Bauer, B. A. (2017) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010617-052703 · Cited by 109
BBMRI-ERIC Directory: 515 Biobanks with Over 60 Million Biological Samples
Holub, P., Swertz, M. A., Reihs, R., van Enckevort, D., Müller, H., & Litton, J. (2016) · Biopreservation and Biobanking · doi:10.1089/bio.2016.0088 · Cited by 95
Reproducibility Crisis: Are We Ignoring Reaction Norms?
Voelkl, B., & Würbel, H. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2016.05.003 · Cited by 103
Z-curve 2.0: Estimating Replication Rates and Discovery Rates
Bartos̆, F., & Schimmack, U. (2022) · Meta-Psychology · doi:10.15626/mp.2021.2720 · Cited by 126
Targeting class I histone deacetylase 2 in MYC amplified group 3 medulloblastoma
Ecker, J., Oehme, I., Mazitschek, R., Korshunov, A., Kool, M., Hielscher, T., Kiss, J., Selt, F., Konrad, C., Lodrini, M., et al. (2015) · Acta Neuropathologica Communications · doi:10.1186/s40478-015-0201-7 · Cited by 92
“The root of failure to translate preclinical findings in general has been extensively discussed [59-61].”
BackgroundMichel, M. C., Murphy, T. J., & Motulsky, H. J. (2019) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.119.264143 · Cited by 97
Sources of error in the retracted scientific literature
Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · The FASEB Journal · doi:10.1096/fj.14-256735 · Cited by 89
“Several studies have documented low rates of reproducibility of published literature and an alarming failure rate for preclinical observations that progress to clinical evaluation (2, 3).”
BackgroundSystems biology in drug discovery and development
Berg, E. L. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.10.003 · Cited by 105
The Increasing Urgency for Standards in Basic Biologic Research
Freedman, L. P., & Inglese, J. (2014) · Cancer Research · doi:10.1158/0008-5472.can-14-0925 · Cited by 91
“In 2011, Prinz and colleagues (2) reported”
Andrews, N. A., Latrémolière, A., Basbaum, A. I., Mogil, J. S., Porreca, F., Rice, A. S. C., Woolf, C. J., Currie, G. L., Dworkin, R. H., Eisenach, J. C., et al. (2015) · Pain · doi:10.1097/j.pain.0000000000000458 · Cited by 99
The Fundamental Characteristics of a Translational Scientist
Gilliland, C. T., White, J., Gee, B., Kreeftmeijer-Vegter, R., Biétrix, F., Ussi, A. E., Hajdúch, M., Kočiš, P., Chiba, N., Hirasawa, R., et al. (2019) · ACS Pharmacology & Translational Science · doi:10.1021/acsptsci.9b00022 · Cited by 105
Wodarski, R., Delaney, A., Ultenius, C., Morland, R., Andrews, N., Baastrup, C., Bryden, L. A., Caspani, O., Christoph, T., Gardiner, N. J., et al. (2016) · Pain · doi:10.1097/j.pain.0000000000000657 · Cited by 103
“This likely contributes to the well-recognized poor level of experimental reproducibility.(54) Implementing the concept, ethos, and design of multicentre clinical trials into preclinical studies could significantly increase”
BackgroundLevelling the Translational Gap for Animal to Human Efficacy Data
Ferreira, G. S., Veening-Griffioen, D. H., Boon, W., Moors, E. H. M., & van Meer, P. J. K. (2020) · Animals · doi:10.3390/ani10071199 · Cited by 104
“The results of a sizeable portion of animal studies are unreliable [8,9,23].”
Failures in Phase III: Causes and Consequences
Seruga, B., Ocana, A., Amir, E., & Tannock, I. F. (2015) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-15-0124 · Cited by 88
Estimating the Reproducibility of Psychological Science
Nosek, B. A., Cohoon, J., Kidwell, M., & Spies, J. R. (2016) · doi:10.31219/osf.io/447b3 · Cited by 88
Making the collective knowledge of chemistry open and machine actionable
Jablonka, K. M., Patiny, L., & Smit, B. (2022) · Nature Chemistry · doi:10.1038/s41557-022-00910-7 · Cited by 85
“Scientists have also long been concerned about the reproducibility of results 2,3 .”
BackgroundStandard Operating Procedure to Optimize Resazurin-Based Viability Assays
Petiti, J., Revel, L., & Divieto, C. (2024) · Biosensors · doi:10.3390/bios14040156 · Cited by 99
“Unfortunately, these studies often encounter challenges related to low inter-laboratory reproducibility, which ultimately leads to unreliable data [11,33,34].”
BackgroundVariability of the Reverse Transcription Step: Practical Implications
Bustin, S., Dhillon, H. S., Kirvell, S., Greenwood, C., Parker, M., Shipley, G. L., & Nolan, T. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2014.230615 · Cited by 86
India's depleting groundwater: When science meets policy
Chindarkar, N., & Grafton, R. Q. (2019) · Asia & the Pacific Policy Studies · doi:10.1002/app5.269 · Cited by 90
Tackling reproducibility in academic preclinical drug discovery
Frye, S. V., Arkin, M. R., Arrowsmith, C. H., Conn, P. J., Glicksman, M. A., Hull-Ryde, E. A., & Slusher, B. S. (2015) · Nature Reviews Drug Discovery · doi:10.1038/nrd4737 · Cited by 84
Perspectives on In Vitro to In Vivo Extrapolations
Härtung, T. (2017) · Applied In Vitro Toxicology · doi:10.1089/aivt.2016.0026 · Cited by 100
Andrade, E., Bento, A. F., Cavalli, J., de Oliveira, S. K. F., Freitas, C. S., Marcon, R., Schwanke, R. C., Siqueira, J. M., & Calixto, J. Β. (2016) · Brazilian Journal of Medical and Biological Research · doi:10.1590/1414-431x20165644 · Cited by 99
“Studies conducted by researchers from Amgen and Bayer Healthcare showed a very low rate of reproducibility (89 and 78%, respectively) of articles published in international journals (71,72).”
BackgroundEffect of impact factor and discipline on journal data sharing policies
Resnik, D. B., Morales, M., Landrum, R., Shi, M., Minnier, J., Vasilevsky, N. A., & Champieux, R. E. (2019) · Accountability in Research · doi:10.1080/08989621.2019.1591277 · Cited by 82
Good Laboratory Practice for optimization research
Kendall, G., Bai, R., Błażewicz, J., Causmaecker, P. D., Gendreau, M., John, R. I., Li, J., McCollum, B., Pesch, E., Qu, R., et al. (2015) · Journal of the Operational Research Society · doi:10.1057/jors.2015.77 · Cited by 95
Animal models of Huntington's disease for translation to the clinic: Best practices
Menalled, L., & Brunner, D. (2014) · Movement Disorders · doi:10.1002/mds.26006 · Cited by 85
“Lack of Replicability: A Complex Problem Several publications have pointed out the serious lack of replication of preclinical studies and failure to translate to the clinic.(38-40) Two of the most important reasons behind the failure of translation of apparent positive results from preclinical trials in clinical setti…”
BackgroundIntegrating imaging and omics data: A review
Antonelli, L., Guarracino, M. R., Maddalena, L., & Sangiovanni, M. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.04.032 · Cited by 79
Experimental Errors in QSAR Modeling Sets: What We Can Do and What We Cannot Do
Zhao, L., Wang, W., Sedykh, A., & Zhu, H. (2017) · ACS Omega · doi:10.1021/acsomega.7b00274 · Cited by 78
Metascience as a Scientific Social Movement
Peterson, D., & Panofsky, A. L. (2023) · Minerva · doi:10.1007/s11024-023-09490-3 · Cited by 119
Acknowledging and Overcoming Nonreproducibility in Basic and Preclinical Research
Ioannidis, J. P. A. (2017) · JAMA · doi:10.1001/jama.2017.0549 · Cited by 78
Lemmon, V., Ferguson, A. R., Popovich, P. G., Xu, X., Snow, D. M., Igarashi, M., Beattie, C. E., & Bixby, J. L. (2014) · Journal of Neurotrauma · doi:10.1089/neu.2014.3400 · Cited by 81
“4,5 Similarly, a project funded by the National Institute of Neurological Disorders and Stroke (NINDS) resulted in a high failure rate in replicating published pre-clinical results for treatment of spinal cord injury (SCI).”
Murine Models of Inflammatory Bowel Disease (IBD): Challenges of Modeling Human Disease
DeVoss, J., & Diehl, L. J. (2013) · Toxicologic Pathology · doi:10.1177/0192623313509729 · Cited by 89
“However, recent publications have highlighted several major pharmaceutical companies’ struggles in attempting to reproduce published literature (Arrowsmith 2011; Prinz, Schlange, and Asadullah 2011; Begley and Ellis 2012).”
Festing, M. F. W. (2014) · ILAR Journal · doi:10.1093/ilar/ilu045 · Cited by 78
Reproducing Statistical Results
Stodden, V. (2015) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020127 · Cited by 77
“Group 2012, 2013; Peng 2011; Prinz et al. 2011); some reports have appeared in the popular press (Economist Staff Writer 2013a,b; Hiltzik 2013; Johnson 2014).”
BackgroundTranslating Mouse Models: Immune Variation and Efficacy Testing
Sellers, R. S. (2017) · Toxicologic Pathology · doi:10.1177/0192623316675767 · Cited by 77
Biomarkers in Amyloid-β Immunotherapy Trials in Alzheimer’s Disease
Blennow, K., Hampel, H. J., & Zetterberg, H. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.154 · Cited by 87
We Ran 9 Billion Regressions: Eliminating False Positives through Computational Model Robustness
Muñoz, J., & Young, C. (2018) · Sociological Methodology · doi:10.1177/0081175018777988 · Cited by 84
“This may explain why there appears to be an alarming overabundance of false positive, nonreplic-able results in many social science literatures (Chabris et al. 2012; Open Science Collaboration 2015; Prinz, Schlange, and Asadullah 2011; Sala-i-Martin, Doppelhofer, and Miller 2004).”
Backgroundhttps://www.altex.org/index.php/altex/article/view/1339
Krebs, A., Waldmann, T., Wilks, M. F., van Vugt-Lussenburg, B. M. A., van der Burg, B., Terron, A., Steger-Hartmann, T., Ruegg, J., Rovida, C., Pedersen, E., et al. (2019) · ALTEX · doi:10.14573/altex.1909271 · Cited by 77
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.