Believe it or not: how much can we rely on published data on potential drug targets?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“reports from the pharmaceutical industry (Begley & Ellis, 2012;Prinz et al., 2011) and systematic assessments of replicability in specific fields, such as cancer biology (Errington, Mathur, et al., 2021), spinal cord injury (Steward et al., 2012) and amyotrophic lateral sclerosis (Scott et al., 2008), have reported success rates ranging from 0 to 40%.”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“These numbers are in a similar range as previous estimates from the biomedical literature (Begley & Ellis, 2012;Errington, Mathur, et al., 2021;Prinz et al., 2011;Scott et al., 2008;Steward et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Prinz et al., 2011
In the citing paper
“This may contribute to publication bias, selective reporting, and questionable research practices that reduce the credibility of the published literature 18-25 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [19]
In the citing paper
“Scientists at Bayer have reported that only ~25% of published preclinical studies could be validated to the point at which projects could progress.2”
From Reproducibility of Quantitative Systems Pharmacology Models: Current Challenges and Future Opportunities (2019) · cites this paper as [2]
In the citing paper
“A team at Bayer HealthCare in Germany last year reported 4 that only about 25% of published preclinical studies could be validated to the point at which projects could continue.”
From Raise standards for preclinical cancer research (2012) · cites this paper as [4]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Arrowsmith, J. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439 · Cited by 622
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226
Osherovich, L. Z. (2011) · Science-Business eXchange · doi:10.1038/scibx.2011.416 · Cited by 43
Factors Affecting Reproducibility between Genome-Scale siRNA-Based Screens
Barrows, N. J., Sommer, C. L., Garcia-Blanco, M. A., & Pearson, J. L. (2010) · SLAS Discovery · doi:10.1177/1087057110374994 · Cited by 39
McDonald, R. J., Cloft, H. J., & Kallmes, D. F. (2007) · American Journal of Neuroradiology · doi:10.3174/ajnr.a0766 · Cited by 31
Nemery, B. (2001) · Occupational and Environmental Medicine · doi:10.1136/oem.58.9.604 · Cited by 23 · cited 1×
“Adding to this problem, many initially rejected papers will subsequently be published in other journals without substantial changes or improvement”
Background
Research works printed but not linked: 2
- Lehrer, J. The truth wears off: is there something wrong with the scientific method? The New Yorker [online], (2010).
- Freeman, D. H. Lies, damned lies, and medical science. The Atlantic [online], (2010).
Cited by
Items 301–400 of 1,001
Poor replication validity of biomedical association studies reported by newspapers
Dumas-Mallet, E., Smith, A., Boraud, T., & Gonon, F. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172650 · Cited by 76
“Empirical studies have actually observed that many initial findings are refuted by subsequent studies, a trend that holds true at all three levels of biomedical research: i) preclinical studies [6, 7], ii) associations between biomarkers or risk factors and diseases [8– 11], and iii) clinical trials [12–16].”
ResultIs Most Published Research Really False?
Leek, J. T., & Jager, L. R. (2016) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-060116-054104 · Cited by 90
Strech, D., & Dirnagl, U. (2019) · BMJ Open Science · doi:10.1136/bmjos-2018-000048 · Cited by 74
Life Science’s Average Publishable Unit (APU) Has Increased over the Past Two Decades
Cordero, R. J. B., Leon-Rodriguez, C. M. D., Alvarado-Torres, J. K., Rodriguez, A. R., & Casadevall, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0156983 · Cited by 74
“In recent years, the quality of the scientific literature has been questioned by an increasing number of retractions [6,7], the finding that most retractions are due to misconduct [7,53] and the realization that many published studies are not reproducible [3,4].”
BackgroundAuthorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor
Vogt, L., Reichlin, T. S., Nathues, C., & Würbel, H. (2016) · PLOS Biology · doi:10.1371/journal.pbio.2000598 · Cited by 73
Enhancing the Promise of Drug Repositioning through Genetics
Pritchard, J.-L. E., O’Mara, T. A., & Glubb, D. M. (2017) · Frontiers in Pharmacology · doi:10.3389/fphar.2017.00896 · Cited by 73
Hendriks, F., Kienhues, D., & Bromme, R. (2020) · Public Understanding of Science · doi:10.1177/0963662520902383 · Cited by 73
Boba: Authoring and Visualizing Multiverse Analyses
Liu, Y., Kale, A., Althoff, T., & Heer, J. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3028985 · Cited by 73
“The last decade saw widespread failure to replicate findings in published literature across multiple scientific fields [2, 6, 35, 41].”
BackgroundReproducibility of science: Fraud, impact factors and carelessness
Eisner, D. A. (2018) · Journal of Molecular and Cellular Cardiology · doi:10.1016/j.yjmcc.2017.10.009 · Cited by 73
Systematic heterogenization for better reproducibility in animal experimentation
Richter, S. H. (2017) · Lab Animal · doi:10.1038/laban.1330 · Cited by 78
Increasing the reproducibility of fluid biomarker studies in neurodegenerative studies
Mattsson-Carlgren, N., Palmqvist, S., Blennow, K., & Hansson, O. (2020) · Nature Communications · doi:10.1038/s41467-020-19957-6 · Cited by 72
“biomarker research 18,19 .”
Increasing the statistical power of animal experiments with historical control data
Bonapersona, V., Hoijtink, H., RELACS, Sarabdjitsingh, R. A., & Joëls, M. (2021) · Nature Neuroscience · doi:10.1038/s41593-020-00792-3 · Cited by 88
Kahnau, P., Mieske, P., Wilzopolski, J., Kalliokoski, O., Mandillo, S., Hölter, S. M., Võikar, V., Amfim, A., Badurek, S., Bartelik, A., et al. (2023) · BMC Biology · doi:10.1186/s12915-023-01751-7 · Cited by 91
“To date, the reproducibility crisis remains unresolved and various approaches are discussed and pursued to improve the reliability of scientific data [4, 7, 20–24].”
BackgroundStriving for transparent and credible research: practical guidelines for behavioral ecologists
Ihle, M., Winney, I. S., Krystalli, A., & Croucher, M. (2017) · Behavioral Ecology · doi:10.1093/beheco/arx003 · Cited by 75
“Reports of researchers being unable to reproduce results within and between labs and the disproportionate attention that the irreproducible studies receive highlight several problems with how we conduct research (Prinz et al. 2011; Begley and Ellis 2012; Open Science Collaboration 2015).”
ResultDeveloping New Immunosuppression for the Next Generation of Transplant Recipients: The Path Forward
Stegall, M. D., Morris, R. E., Alloway, R. R., & Mannon, R. B. (2016) · American Journal of Transplantation · doi:10.1111/ajt.13582 · Cited by 73
Graduate Biomedical Science Education Needs a New Philosophy
Bosch, G., & Casadevall, A. (2017) · mBio · doi:10.1128/mbio.01539-17 · Cited by 87
From intuition to AI: evolution of small molecule representations in drug discovery
McGibbon, M., Shave, S., Dong, J. N., Gao, Y., Houston, D. R., Xie, J., Yang, Y., Schwaller, P., & Blay, V. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad422 · Cited by 88
Brown, N., Cambruzzi, J., Cox, P. J., Davies, M., Dunbar, J., Plumbley, D., Sellwood, M. A., Sim, A., Williams-Jones, B. I., Zwierzyna, M., et al. (2018) · Progress in medicinal chemistry · doi:10.1016/bs.pmch.2017.12.003 · Cited by 83
Preclinical efficacy studies in investigator brochures: do they enable risk–benefit assessment?
Wieschowski, S., Chin, W. W. L., Federico, C., Sievers, S., Kimmelman, J., & Strech, D. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004879 · Cited by 70
Ferreira, G. S., Veening-Griffioen, D. H., Boon, W., Moors, E. H. M., Wied, C. C. G., Schellekens, H., & van Meer, P. J. K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218014 · Cited by 85
CMM—An enhanced platform for interactive validation of metal binding sites
Gucwa, M., Lenkiewicz, J., Zheng, H., Cymborowski, M., Cooper, D. R., Murzyn, K., & Minor, W. (2023) · Protein Science · doi:10.1002/pro.4525 · Cited by 69
“Reports indicate that academic results cannot be reproduced in a commercial environment in >50% of the cases (Prinz et al., 2011), mainly due to incomplete or inaccurate descriptions of experimental procedures and results (Errington, Denis, et al., 2021; Errington, Mathur, et al., 2021; Nosek &…”
BackgroundThe impact of CRISPR–Cas9 on target identification and validation
Moore, J. D. (2015) · Drug Discovery Today · doi:10.1016/j.drudis.2014.12.016 · Cited by 81
Optimizing sampling approaches along ecological gradients
Schweiger, A., Irl, S. D. H., Steinbauer, M. J., Dengler, J., & Beierkuhnlein, C. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12495 · Cited by 84
Ethics in cryptomarket research
Martin, J. A., & Christin, N. (2016) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2016.05.006 · Cited by 69
Rigorous Science: a How-To Guide
Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.01902-16 · Cited by 110
“Rigor has gained new prominence amid concerns about a lack of reproducibility in important studies (2, 3), an epidemic of retractions due to misconduct (4), and the discovery that the published literature is riddled with problematic images (5).”
BackgroundCommon Misconceptions about Data Analysis and Statistics
Motulsky, H. J. (2014) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.114.219170 · Cited by 68
In search of preclinical robustness
Peers, I. S., Ceuppens, P. R., & Harbron, C. G. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3849 · Cited by 68
Point estimates, Simpson’s paradox, and nonergodicity in biological sciences
Mangalam, M., & Kelty‐Stephen, D. G. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.017 · Cited by 78
Milette, K., Roseman, M., & Thombs, B. D. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.09.015 · Cited by 71
“Furthermore, robust evidence shows that the results of a significant proportion of preclinical studies cannot be replicated [31–35].”
BackgroundGholaminejad, A., Tehrani, H. A., & Fesharaki, M. G. (2018) · Journal of Nephrology · doi:10.1007/s40620-018-0511-5 · Cited by 69
Refining animal research: The Animal Study Registry
Bert, B., Heinl, C., Chmielewska, J., Schwarz, F., Grune, B., Hensel, A., Greiner, M., & Schönfelder, G. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000463 · Cited by 67
Understanding experiments and research practices for reproducibility: an exploratory study
Samuel, S., & König‐Ries, B. (2021) · PeerJ · doi:10.7717/peerj.11140 · Cited by 76
Miedema, F. F. (2021) · Springer eBooks · doi:10.1007/978-94-024-2115-6 · Cited by 136
Common misconceptions about data analysis and statistics
Motulsky, H. J. (2014) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-014-1037-6 · Cited by 71
“Investigators at Bayer Healthcare were reportedly able to reproduce only 20–25 % of 67 preclinical studies (Prinz et al. 2011), and investigators at Amgen were able to reproduce only 6 of 53 studies in basic cancer biology despite often cooperating with the original investigators (Begley and Ellis…”
A close look onto structural models and primary ligands of metallo-β-lactamases
Raczynska, J. E., Shabalin, I. G., Minor, W., Wlodawer, A., & Jaskólski, M. (2018) · Drug Resistance Updates · doi:10.1016/j.drup.2018.08.001 · Cited by 67
“A number of recent reports have brought to the attention of the scientific community the uncomfortable fact that a noticeable fraction of biomedical research cannot be reproduced (Minor et al., 2016; Prinz et al., 2011).”
BackgroundCreative destruction in science
Tierney, W., Hardy, J. H., Ebersole, C. R., Leavitt, K., Viganola, D., Clemente, E. G., Gordon, M., Dreber, A., Johannesson, M., Pfeiffer, T., et al. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.07.002 · Cited by 66
A Proposal Regarding Reporting of In Vitro Testing Results
Smith, M. A., & Houghton, P. J. (2013) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-13-0043 · Cited by 69
“On the one hand, translational research conducted by academic researchers and evaluated by pharmaceutical companies has been found to often lack reproducibility, and claimed conclusions have not been supported by further independent testing (1, 2).”
BackgroundThe challenges with the validation of research antibodies
Voskuil, J. L. A. (2017) · F1000Research · doi:10.12688/f1000research.10851.1 · Cited by 74
Scientists Still Behaving Badly? A Survey Within Industry and Universities
Godecharle, S., Fieuws, S., Nemery, B., & Dierickx, K. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9957-4 · Cited by 68
Reproducibility of Fluorescent Expression from Engineered Biological Constructs in E. coli
Beal, J., Haddock-Angelli, T., Gershater, M., de Mora, K., Lizarazo, M., Hollenhorst, J., Rettberg, R., & Contributors, I. I. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150182 · Cited by 65
Maric‐Bilkan, C., Arnold, A. P., Taylor, D. A., Dwinell, M. R., Howlett, S. E., WENGER, N. K., Reckelhoff, J. F., Sandberg, K. L., Churchill, G. A., Levin, E. R., et al. (2016) · Hypertension · doi:10.1161/hypertensionaha.115.06967 · Cited by 70
“It is estimated that only 20% to 28% of published articles related to CVD report the sex of the cells used,(4) which may, in part, contribute to the growing concern over reduced reproducibility of research findings in preclinical studies.(12) Most importantly, however, differences in responses of cells derived from fe…”
BackgroundDistinct roles of theta and alpha oscillations in the involuntary capture of goal-directed attention
Harris, A. M., Dux, P. E., Jones, C. N., & Mattingley, J. B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.008 · Cited by 73
“Furthermore, inducing alpha oscillations, either with TMS (Romei et al. 2010), entrainment by flickering stimuli (de Graaf et al. 2013; Mathewson et al. 2010, 2012), or through real-time neurofeedback training (Okazaki et al. 2015), has been shown to modulate stimulus detection.”
Mogil, J. S. (2017) · Lab Animal · doi:10.1038/laban.1223 · Cited by 78
Identification of Pim Kinases as Novel Targets for PJ34 with Confounding Effects in PARP Biology
Antolín, A. A., Jalencas, X., Yélamos, J., & Mestres, J. (2012) · ACS Chemical Biology · doi:10.1021/cb300317y · Cited by 64
The development of high-content screening (HCS) technology and its importance to drug discovery
Fraietta, I., & Gasparri, F. (2016) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2016.1165203 · Cited by 76
Animal Models in Translational Research: Rosetta Stone or Stumbling Block?
Bolker, J. A. (2017) · BioEssays · doi:10.1002/bies.201700089 · Cited by 75
Crisis or self-correction: Rethinking media narratives about the well-being of science
Jamieson, K. H. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708276114 · Cited by 78
“In 2011, scientists at Bayer HealthCare reported that of the findings of 67 projects (most from oncology), only ∼20–25% were “completely in line with our in-house findings” (43).”
BackgroundWhy (and how) we should publish negative data
Nimpf, S., & Keays, D. A. (2019) · EMBO Reports · doi:10.15252/embr.201949775 · Cited by 72
Established and Emerging Trends in Computational Drug Discovery in the Structural Genomics Era
Taboureau, O., Baell, J. B., Fernández‐Recio, J., & Villoutreix, B. O. (2012) · Chemistry & Biology · doi:10.1016/j.chembiol.2011.12.007 · Cited by 69
Hsieh, J., Sedykh, A., Huang, R., Xia, M., & Tice, R. R. (2015) · SLAS DISCOVERY · doi:10.1177/1087057115581317 · Cited by 64
O'Bryant, S. E., Lista, S., Rissman, R. A., Edwards, M., Zhang, F., Hall, J., Zetterberg, H., Lovestone, S., Gupta, V., Graff‐Radford, N., et al. (2016) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2015.12.003 · Cited by 63
“Despite tremendous scientific advancements, there remains a significant concern regarding the lack of reproducibility of research findings [1–4] with most believing that “at least 50%” of academic findings will not be replicable within industry laboratories [4].”
BackgroundChallenges in Building Usable Knowledge in Education
Hedges, L. V. (2018) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2017.1375583 · Cited by 63
Expert curation in UniProtKB: a case study on dealing with conflicting and erroneous data
Poux, S., Magrane, M., Arighi, C. N., Bridge, A., O'Donovan, C., Laiho, K., & The UniProt Consortium (2014) · Database · doi:10.1093/database/bau016 · Cited by 62
“Another publication, from researchers at Bayer HealthCare, reported that they could successfully reproduce results in only 25% of the cases (8).”
BackgroundEvrard, Y. A., Srivastava, A., Randjelovic, J., Doroshow, J. H., Dean, D. A., Morris, J. S., & Chuang, J. H. (2020) · Cancer Research · doi:10.1158/0008-5472.can-19-3101 · Cited by 62
Rate and success of study replication in ecology and evolution
Kelly, C. D. (2019) · PeerJ · doi:10.7717/peerj.7654 · Cited by 71
Imagining the “open” university: Sharing scholarship to improve research and education
McKiernan, E. C. (2017) · PLoS Biology · doi:10.1371/journal.pbio.1002614 · Cited by 78
“In recent years, large-scale projects in the fields of psychology [78] and cancer biology [79, 80] have 273 a empted to reproduce key findings and found a low rate of reproducibility.”
BackgroundFlow Cytometry: Impact on Early Drug Discovery
Edwards, B. S., & Sklar, L. A. (2015) · SLAS DISCOVERY · doi:10.1177/1087057115578273 · Cited by 66
Thomenius, M. J., Totman, J., Harvey, D. M., Mitchell, L. H., Riera, T. V., Cosmopoulos, K., Grassian, A. R., Klaus, C. R., Foley, M., Admirand, E. A., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197372 · Cited by 64
“Although estimates have been attempted [44, 45], it is unknown how much of the literature in cancer biology will ultimately be effected by undiscovered artifacts associated with RNAi technology.”
Biomedical text mining for research rigor and integrity: tasks, challenges, directions
Kilicoglu, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx057 · Cited by 61
Effects of weaning age and housing conditions on phenotypic differences in mice
Bailoo, J. D., Voelkl, B., Varholick, J. A., Novak, J., Murphy, E., Rosso, M., Palme, R., & Würbel, H. (2020) · Scientific Reports · doi:10.1038/s41598-020-68549-3 · Cited by 73
The Emergence of Statistical Objectivity: Changing Ideas of Epistemic Vice and Virtue in Science
Freese, J., & Peterson, D. (2018) · Sociological Theory · doi:10.1177/0735275118794987 · Cited by 69
Zhang, H., Liu, X., Warden, C. D., Huang, Y., Loera, S., Xue, L., Zhang, S., Chu, P., Zheng, S., & Yen, Y. (2014) · BMC Cancer · doi:10.1186/1471-2407-14-664 · Cited by 60
“A similar result was also seen in another report [53].”
ResultIoannidis, J. P. A. (2014) · Biostatistics · doi:10.1093/biostatistics/kxt036 · Cited by 60
Centenary of the death of Elie Metchnikoff: a visionary and an outstanding team leader
Cavaillon, J., & Legout, S. (2016) · Microbes and Infection · doi:10.1016/j.micinf.2016.05.008 · Cited by 69
Dijkstra, J. R., van Kempen, L. C., Nagtegaal, I. D., & Bustin, S. A. (2014) · Molecular Oncology · doi:10.1016/j.molonc.2013.12.016 · Cited by 59
“This conclusion agrees with a recent observation that literature data on potential drug targets should be viewed with caution, sincemost experiments published in the peer-reviewed literature are not reproducible (Prinz et al., 2011).”
BackgroundThe researchers’ view of scientific rigor—survey on the conduct and reporting of in vivo research
Reichlin, T. S., Vogt, L., & Würbel, H. (2016) · PLOS ONE · doi:10.1371/journal.pone.0165999 · Cited by 72
“[1,2]) and translational failure of preclinical animal research [3–5] has therefore raised serious concerns about the scientific validity [6,7] and ethical justification [8,9] of in vivo research.”
BackgroundBe positive about negatives–recommendations for the publication of negative (or null) results
Bespalov, A., Steckler, T., & Skolnick, P. (2019) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2019.10.007 · Cited by 59
Rigor or Mortis: Best Practices for Preclinical Research in Neuroscience
Steward, O., & Balice‐Gordon, R. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.042 · Cited by 63
“Against this background of accomplishment, however, is the increasing documentation that many published findings are not replicated when there are explicit attempts to do so (Prinz et al., 2011).”
PhenStat: A Tool Kit for Standardized Analysis of High Throughput Phenotypic Data
Kurbatova, N., Mason, J. C., Morgan, H., Meehan, T. F., & Karp, N. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0131274 · Cited by 64
Scientific productivity: An exploratory study of metrics and incentives
Lindner, M. D., Torralba, K. D., & Khan, N. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195321 · Cited by 68
Vollert, J., Schenker, E., Macleod, M. R., Bespalov, A., Würbel, H., Michel, M. C., Dirnagl, U., Potschka, H., Waldron, A., Wever, K. E., et al. (2020) · BMJ Open Science · doi:10.1136/bmjos-2019-100046 · Cited by 63
Buchner, D. A., & Nadeau, J. H. (2015) · Genome Research · doi:10.1101/gr.187450.114 · Cited by 66
“…types of experimental vagaries differ from the recent calls to improve upon experimental reproducibility in science as the discrepancy is not due to small numbers, experimenter bias, care-less phenotyping, statistical fluctuations, or fraud (Macleod 2011; Prinz et al. 2011; Collins and Tabak 2014).”
Irreproducible Experimental Results: Causes, (Mis)interpretations, and Consequences
Loscalzo, J. (2012) · Circulation · doi:10.1161/circulationaha.112.098244 · Cited by 59
“For example, Prinz and colleagues recently published an analysis from their experience in drug development at Bayer Healthcare in which they surveyed company investigators who were charged with experimentally validating published data on potential new drug targets (11).”
BackgroundStone, H. B., Bernhard, E. J., Coleman, C. N., Deye, J. A., Capala, J., Mitchell, J. B., & Brown, J. M. (2016) · Translational Oncology · doi:10.1016/j.tranon.2016.01.002 · Cited by 64
“[2,51–54]).”
Button, K. S., Bal, L., Clark, A., & Shipley, T. (2016) · BMC Psychology · doi:10.1186/s40359-016-0167-7 · Cited by 58
“of science, and may explain the paucity of basic findings translating into clinical applications [21, 31, 32].”
Does repeat synthesis in materials chemistry obey a power law?
Agrawal, M., Han, R., Herath, D., & Sholl, D. S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1918484117 · Cited by 58
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2021) · Royal Society Open Science · doi:10.1098/rsos.201925 · Cited by 85
“In particular, a series of attempts to reproduce the results of published research findings in different disciplines found that these replication efforts produced much weaker evidence than the original study [4, 5, 6, 7].”
ResultRIPOSTE: a framework for improving the design and analysis of laboratory-based research
Masca, N. G., Hensor, E. M., Cornelius, V. R., Buffa, F. M., Marriott, H. M., Eales, J. M., Messenger, M. P., Anderson, A. E., Boot, C., Bunce, C., et al. (2015) · eLife · doi:10.7554/elife.05519 · Cited by 56
“elifesciences.org FEATURE ARTICLE”
BackgroundLandeck, L., Kneip, C., Reischl, J., & Asadullah, K. (2016) · Experimental Dermatology · doi:10.1111/exd.12948 · Cited by 67
Self-citationWormBot, an open-source robotics platform for survival and behavior analysis in C. elegans
Pitt, J. N., Strait, N. L., Vayndorf, E. M., Blue, B. W., Tran, C., Davis, B. E. M., Huang, K., Johnson, B., Lim, J. K., Liu, S. N., et al. (2019) · GeroScience · doi:10.1007/s11357-019-00124-9 · Cited by 69
The use and misuse of statistical methodologies in pharmacology research
Marino, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.05.017 · Cited by 61
The reproducibility of biomedical research: Sleepers awake!
Bustin, S. A. (2014) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.01.002 · Cited by 56
Llovera, G., & Liesz, A. (2016) · Journal of Neurochemistry · doi:10.1111/jnc.13516 · Cited by 56
“…international consortia in response to the ‘replication crisis’, several reports have been published regarding deficiencies with respect to reproducibility among research centers and a lack of robust preclinical results in academic research (Prinz et al. 2011; Begley and Ellis 2012; Perrin 2014).”
BackgroundTen Basic Rules of Antibody Validation
Weller, M. G. (2018) · Analytical Chemistry Insights · doi:10.1177/1177390118757462 · Cited by 62
An a priori solution to the replication crisis
Trafimow, D. (2018) · Philosophical Psychology · doi:10.1080/09515089.2018.1490707 · Cited by 59
“…Asendorpf and colleagues (2013), Brandt and colleauges (2013), Earp (2016), Earp and Everett (2015), Earp et al. (2014), Earp and Trafimow (2015), Ioannidis (2005), Makel and Plucker (2014), McBee and Matthews (2014), Open Science Collaboration (2015), and Prinz, Schlange, and Asadullah (2011).”
BackgroundVenkataramani, S., Low, S. H. H., Weigle, B., Dutcher, D. L., Jerath, K., Menzenski, M., Frego, L., Truncali, K., Gupta, P., Kroe‐Barrett, R., et al. (2018) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2018.08.064 · Cited by 56
Hullman, J., Kay, M., Kim, Y.-S., & Shrestha, S. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2743898 · Cited by 55
Grillon, C., & Ernst, M. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.024 · Cited by 52
Burnett, S. D., Blanchette, A. D., Chiu, W. A., & Rusyn, I. (2021) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.1c00203 · Cited by 95
Randomization Does Not Help Much, Comparability Does
Saint-Mont, U. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132102 · Cited by 55
Everitt, J. I. (2014) · Toxicologic Pathology · doi:10.1177/0192623314555162 · Cited by 65
“Difficulty in reproducing published studies reflects some of the biases in scientific publications (Prinz, Schlange, and Asadullah 2011).”
BackgroundResultTellurium notebooks—An environment for reproducible dynamical modeling in systems biology
Medley, J. K., Choi, K., König, M., Smith, L., Gu, S., Hellerstein, J., Sealfon, S. C., & Sauro, H. M. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006220 · Cited by 55
Precision medicine review: rare driver mutations and their biophysical classification
Nussinov, R., Jang, H., Tsai, C., & Cheng, F. (2019) · Biophysical Reviews · doi:10.1007/s12551-018-0496-2 · Cited by 57
Güttinger, S. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-019-0269-1 · Cited by 84
Quality really matters: the need to improve specimen quality in biomedical research
Simeon‐Dubach, D., Burt, A. D., & Hall, P. A. (2012) · The Journal of Pathology · doi:10.1002/path.4117 · Cited by 55
“Therefore findings of low reproducibility of published scientific data as reported recently by two different groups are perhaps not surprising [6,7].”
BackgroundBias in science: natural and social
May, J. (2020) · Synthese · doi:10.1007/s11229-020-02937-0 · Cited by 66
“Although this does not by any means reflect a precise estimate of the replication rate in oncology, other attempts to confirm published findings also report low success rates (e.g. 20–25% in Prinz et al. 2011).”
ResultMekruksavanich, S., & Jitpattanakul, A. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022265 · Cited by 59
Thoma, C. R., Stroebel, S., Rösch, N., Calpe, B., Krek, W., & Kelm, J. M. (2013) · SLAS Discovery · doi:10.1177/1087057113499071 · Cited by 54
“Although many potential drug targets have been discovered with this approach, most of them did not turn out to be robust enough to withstand rigorous validation in subsequent preclinical models.(4) One difficulty that limits the robustness of such findings in subsequent validation studies relates to clear differences…”
BackgroundResultProtein purification and crystallization artifacts: The tale usually not told
Niedzialkowska, E., Gasiorowska, O., Handing, K. B., Majorek, K. A., Porebski, P. J., Shabalin, I. G., Zasadzinska, E., Cymborowski, M., & Minor, W. (2016) · Protein Science · doi:10.1002/pro.2861 · Cited by 54
Harrison, T. M. (2020) · doi:10.1007/978-3-030-46687-9 · Cited by 53
Metadata
- Authors
- Prinz, F., Schlange, T., & Asadullah, K.
- Affiliations
- Bayer (Germany) (DE)
- Corresponding author
- Asadullah, Khusru
- ORCID
- Schlange, Thomas
- Venue
- Nature Reviews Drug Discovery
- Published
- 2011-08-31
- Volume
- 10
- Issue
- 9
- Pages
- 712-712
- ISSN
- 1474-1776 (ISSN-L)
- 1474-1784
- OpenAlex
- W2067833766
- Cited by
- 1,888
- References
- 8
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 86 · 2023: 108 · 2022: 138 · 2021: 126 · 2020: 131 · 2019: 171 · 2018: 147 · 2017: 176 · 2016: 202 · 2015: 183 · 2014: 141 · 2013: 98 · 2012: 57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Reviews Drug Discovery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- therapeutic target, reproducibility, publication bias, false positives, peer review, manuscript rejection, siRNA screen, drug target validation
- MeSH terms
- Drug Industry, Humans, Drug Design, Clinical Trials, Phase II as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.