Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,101–2,200 of 2,889
Preclinical Studies to Enable First in Human Clinical Trials
Chopra, R., & Raynaud, F. I. (2020) · Springer eBooks · doi:10.1007/978-3-030-47682-3_3 · Cited by 5
The imperative to find the courage to redesign the biomedical research enterprise
Bielekova, B., & Brownlee, S. (2021) · F1000Research · doi:10.12688/f1000research.53654.1 · Cited by 3
“This example is hardly an exception: a major effort to reproduce important scientific discoveries found non-reproduced articles published in higher impact journals and were accruing more citations than reproducible articles.(3)”
BackgroundResultNovel biomedical research must not be a work of fiction
Lazar, M. A. (2021) · Journal of Clinical Investigation · doi:10.1172/jci150827 · Cited by 2
Translational medicine: the changing role of big pharma
Fishburn, C. S. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820493-1.00026-x · Cited by 2
Altan, S., Amaratunga, D., Cabrera, J., Garren, J. M., Geys, H., Kolassa, J. E., LeBlond, D. J., Li, D., Liao, J. J. Z., Liu, J., et al. (2022) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2022.2038258 · Cited by 4
“Reproducibility of preclinical experiments has been found to be as low as 10% (Begley and Ellis 2012; Prinz, Schlange, and Asadullah 2011; Border et al. 2019).”
BackgroundCohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2018) · Springer eBooks · doi:10.1007/978-3-319-31107-4_54 · Cited by 2
AI buzzwords explained: scientific workflows
Garijo, D. (2017) · AI Matters · doi:10.1145/3067682.3067683 · Cited by 4
Krebs, A. (2019) · ALTEX · doi:10.14573/altex.1909271s · Cited by 19
“This lack of test method transparency may contribute significantly to reproducibility issues often reported for biomedical research (Ioannidis, 2012; Begley and Ellis, 2012; Prinz et al., 2011; Hartung et al., 2019).”
BackgroundFinding common ground in cancer research
(2014) · Nature Medicine · doi:10.1038/nm.3456 · Cited by 2
Rouphael, A. B. (2022) · Journal for Nature Conservation · doi:10.1016/j.jnc.2022.126236 · Cited by 4
Ruhela, V., Gupta, A., Sriram, K., Ahuja, G., Kaur, G., & Gupta, R. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.842051 · Cited by 2
“Functionally, the paralogues behave identically (Begley and Ellis, 2012) due to the same seed in their mature miRNA sequence.”
BackgroundPublish without bias or perish without replications
Ventura, R. (2022) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2022.08.010 · Cited by 2
Passive and Active Targeting for Solid Tumors
More, M. P., Deshmukh, P. K., Patil, P. O., Nangare, S., Tade, R. S., Patil, A., Pandey, A. P., Mutalik, S., Patil, P. B., Khan, Z. G., et al. (2022) · Environmental chemistry for a sustainable world · doi:10.1007/978-3-031-14848-4_5 · Cited by 4
Novel hydrogels: are they poised to transform 3D cell-based assay systems in early drug discovery?
Treherne, J. M., & Miller, A. F. (2023) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2023.2175813 · Cited by 2
Rajčáni, J., Vargová, L., Adamkovic, M., & Kačmár, P. (2023) · Studia Psychologica · doi:10.31577/sp.2023.01.866 · Cited by 3
Lessons from shortcomings in machine learning for medical imaging
Varoquaux, G. P., & Cheplygina, V. (2023) · OECD eBooks · doi:10.1787/b885eecd-en · Cited by 4
Treat societally impactful scientific insights as open-source software artifacts
Liem, C. C. S., & Demetriou, A. M. (2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1109/icse-seis58686.2023.00020 · Cited by 4
“While researchers have been divided on which domains suffer from reproducibility crises [11], generally, many well-published works have failed to replicate in psychology [12] and cancer biology [13], and many concerns are arising about the replicability of machine learning outcomes [14], [15].”
BackgroundResearch rigor and reproducibility in research education: A CTSA institutional survey
Axfors, C., Malički, M., & Goodman, S. N. (2024) · Journal of Clinical and Translational Science · doi:10.1017/cts.2024.10 · Cited by 2
Assessment of transparency indicators in space medicine
Bellomo, R. K., Zavalis, E. A., & Ioannidis, J. P. A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300701 · Cited by 2
Crisis, Confidence, and the Limits of Replication
Brown, J. (2024) · Zygon® · doi:10.16995/zygon.11502 · Cited by 3
We Should Do More Direct Replications in Science
Buck, S. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.4eccc443 · Cited by 2
Clinical Translation in Central Nervous System Diseases: Ethical and Social Challenges
Kimmelman, J., & Hey, S. P. (2014) · Springer eBooks · doi:10.1007/978-94-007-4707-4_130 · Cited by 3
Holm, S., Hofmann, B., & Laake, P. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-799943-2.00002-1 · Cited by 2
Reiss, J. (2016) · Springer eBooks · doi:10.1007/978-3-319-45532-7_4 · Cited by 2
Translation: Relevance of Spinal Cord Injury Animal Models
Tigchelaar, S., & Kwon, B. K. (2017) · Springer eBooks · doi:10.1007/978-3-319-46293-6_25 · Cited by 2
The 3rd Antibody Validation meeting: Bath UK 20-21st September 2018
Goodman, S. L. (2018) · F1000Research · doi:10.12688/f1000research.17645.1 · Cited by 2
[Current best practices and biobanking recomedations.]
Doludin, Y. V., Borisova, A. L., Pokrovskaya, M. S., et al. (2019) · PubMed · doi:10.18821/0000-0000-0000-00-0-0-00 · Cited by 2
Artificial Neural Network enabling Clinically Meaningful Biological Image Data Generation
Ha, J., Kim, S., Baik, Y., Lee, D., Lee, W., & Suh, S. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176621 · Cited by 2
Strengthening the link between pre-clinical and clinical resuscitation research
Kochanek, P. M., Manole, M. D., & Callaway, C. W. (2020) · Resuscitation · doi:10.1016/j.resuscitation.2020.11.008 · Cited by 2
What discontinued trials teach us about trial registration?
Vellinga, A., Lambe, K. A., O'Connor, P. E., & O’Dea, A. (2021) · BMC Research Notes · doi:10.1186/s13104-020-05391-w · Cited by 3
Les manques à l’intégrité scientifique et médicale
Sculier, J. (2015) · Cahiers de psychologie clinique · doi:10.3917/cpc.044.0013 · Cited by 4
The R-Factor: A Measure of Scientific VeracityPreprint
Nicholson, J. M., & Lazebnik, Y. A. (2014) · doi:10.15200/winn.140832.20404 · Cited by 6
Storing Reproducible Results from Computational Experiments using Scientific Python Packages
Oxvig, C. S., Arildsen, T., & Larsen, T. (2016) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-629e541a-006 · Cited by 2
Replicability Analysis for Natural Language Processing: Testing Significance with Multiple DatasetsPreprint
Dror, R., Baumer, G., Bogomolov, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.09500 · Cited by 2
“…to as the cornerstone of science (Moonesinghe et al., 2007), replicability analysis is of predominant importance in many scientific fields including psychology (Collaboration, 2012), genomics (Heller et al., 2014), economics (Herndon et al., 2014) and medicine (Begley and Ellis, 2012), among others.”
BackgroundA multi-center study on factors influencing the reproducibility of in vitro drug-response studiesPreprint
Niepel, M., Hafner, M. A., Mills, C. E., Subramanian, K., Williams, E. H., Chung, M., Gaudio, B. L., Barrette, A. M., Stern, A. D., Hu, B., et al. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/213553 · Cited by 2
“…Dumontier et al. 2016)) as well as reports from industry that call into the question the reproducibility of published data (Arrowsmith 2011, Prinz, Schlange et al. 2011, Begley and Ellis 2012, Baker 2016) have increased interest in data reliability (Errington, Iorns et al. 2014, Morrison 2014).”
BackgroundCentralized "big science" communities more likely generate non-replicable resultsPreprint
Danchev, V., Rzhetsky, A., & Evans, J. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05042 · Cited by 2
[Validation of a rapid urease test for the diagnosis of Helicobacter pylori infection].
Cifuentes, P., Topor, J., Avagnina, A., Elsner, B., Moore, R., Barberis, C. M., Albarenga, K., & Antelo, P. (2002) · PubMed · Cited by 4
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Clinical applications of real-time FMRI neurofeedback training : premises, promises, and pitfalls
Mehler, D. M. A. (2018) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 4
Public Statements of Good Conduct Promote Pro-Social BehaviorPreprint
Koessler, A., Page, L., & Dulleck, U. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3184836 · Cited by 2
From one environment to many: The problem of replicability of statistical inferencesPreprint
Higgins, J. J., Higgins, M., & Lin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10036 · Cited by 2
“…scientific studies are unable to be verified in follow-up studies—was dramatically brought to the forefront when researchers at the biotech company Amgen attempted to replicate 53 well-regarded preclinical studies only to find that just 6 supported the original conclusions (Begley and Ellis 2012).”
BackgroundA reckless guide to P-values: local evidence, global errors
Lew, M. J. (2019) · arXiv · doi:10.48550/arxiv.1910.02042 · Cited by 2
“…would indeed help to minimise the number of times that pharmacologists make fools of themselves by reducing the number of false positive results in pharmacological journals and, consequently, reduce the number of faulty leads that fail to translate into a therapeutic [Begley and Ellis, 2012].”
BackgroundTowards FAIR protocols and workflows: The OpenPREDICT case studyPreprint
Çelebi, R., Moreira, J., Hassan, A., Ayyar, S., Ridder, L., Kuhn, T., & Dumontier, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09531 · Cited by 2
“…of instructions and their derived code with different steps and parameters, are factors believed to contribute to a non-reproducibility rate of 64% for pharmacological studies (Ioannidis, 2005a; Prinz et al., 2011), 89% in cancer (Begley and Ellis, 2012), and in 66% psychology (Klein et al., 2014).”
BackgroundVerigin, B. L. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20200622bv · Cited by 2
Toward Replicability With Confidence Intervals for the Exceedance Probability
Segal, B. D. (2019) · Figshare · doi:10.6084/m9.figshare.10762796.v1 · Cited by 2
Feger, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02570 · Cited by 4
“Thus, it has been argued, that the scientific culture not only lacks support for systematic reproducibility, but even impairs reproducible research practices [7, 38, 63].”
BackgroundTime to fiddle with your unpublished data
Ryan, M. J., & Touyz, R. M. (2021) · Clinical Science · doi:10.1042/cs20201298 · Cited by 2
Naturally occurring combinations of receptors from single cell transcriptomics in endothelial cellsPreprint
Domanskyi, S., Hakansson, A., Meng, M., Pham, B. K., Zivin, J. G., Piermarocchi, C., Paternostro, G., & Ferrara, N. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.04.425317 · Cited by 2
An, G. C. (2018) · Preprints.org · doi:10.20944/preprints201805.0308.v2 · Cited by 2
Target-based Drug Discovery Is Inefficient: Discovery and “Off-target” Mechanisms of All DrugsPreprint
Sadri, A. (2022) · doi:10.31219/osf.io/bxwcr · Cited by 2
Balas, E. A. (2018) · Wiley eBooks · doi:10.1002/9781119225898.ch6 · Cited by 2
(2015) · Radiology · doi:10.1148/radiol.2753201506 · Cited by 2
Aschner, M., Autrup, H. N., Berry, C. L., Boobis, A. R., Cohen, S. M., Dekant, W., Galli, C. L., Goodman, J. I., Gori, G. B., Greim, H. A., et al. (2018) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2018.07.004 · Cited by 2
Festing, M. F. W. (2016) · Methods and principles in medicinal chemistry · doi:10.1002/9783527695881.ch3 · Cited by 2
Auer, S., Haelterman, N. A. T., Weissgerber, T. L., Erlich, J. C., Susilaradeya, D., Julkowska, M., Gazda, M. A., Abitua, A., Niraulu, A., Shah, A. P., et al. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/dxw67 · Cited by 2
An, G. C. (2018) · Preprints.org · doi:10.20944/preprints201805.0308.v1 · Cited by 2
Preregistration and increased transparency will benefit science
Mellor, D. T. (2017) · European Science Editing · doi:10.31219/osf.io/xsfam · Cited by 3
Silverstein, P., Pennington, C. R., Branney, P., et al. (2023) · doi:10.31234/osf.io/b5m6q · Cited by 2
Is biomedical research self-correcting? Modeling insights on the persistence of spurious sciencePreprint
Grimes, D. R. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.17.549436 · Cited by 2
Commentary: Fifty years exploring pharmacology with Sam Enna
Williams, M. J. (2024) · Biochemical Pharmacology · doi:10.1016/j.bcp.2024.116067 · Cited by 2
Researchers‘ perspectives on preregistration in animal researchPreprint
Priboi, C., Mayer, B., Vergauwe, E., Elger, B. S., & Würbel, H. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.07.687141 · Cited by 2
Asshoff, R. (2016) · Journal of Biological Education · doi:10.1080/00219266.2016.1150872 · Cited by 1
“The results of research, especially in medical research, must have high reliability and this means high levels of replication, which for several reasons is not always assured, as recent studies have shown (e.g. Begley and Ellis 2012; Open Science Collaboration (2015).”
BackgroundResultInfluentialDesign of procedures and projects
Fry, D., Smith, A. J., Storey, J., Bate, S. T., & Ritskes-Hoitinga, M. J. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-821180-9.00002-7 · Cited by 1
Replication and Reproducibility in Primate Cognition Research
Farrar, B. G., Krupenye, C., Motes‐Rodrigo, A., Tennie, C., Fischer, J., Altschul, D., & Ostojić, L. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108955836.021 · Cited by 4
ЕПОХА ПОСТПРАВДИ У СУЧАСНОМУ СВІТІ: ВИТОКИ ТА ПРИЧИНИ
Коркос, Я. (2023) · Слобожанський науковий вісник. Серія Психологія. · doi:10.32782/psyspu/2023.1.4 · Cited by 1
Eaglstein, W. H. (2023) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2023.08.003 · Cited by 1
Clark, J. S. C., Podsiadło, K., Sobalska‐Kwapis, M., Marciniak, B., Rydzewska, K., Ciechanowicz, A., van de Wetering, T., & Strapagiel, D. (2023) · Scientific Reports · doi:10.1038/s41598-023-43323-3 · Cited by 3
Björndahl, L. (2024) · Asian Journal of Andrology · doi:10.4103/aja202380 · Cited by 3
“33,35,36 The background is a general lack of reproducibility of published results.”
BackgroundLa replicabilidad en la ciencia y el papel transformador de la metodología estadística de knockoffs
Vásquez, A. R., Escarela, G., Núñez‐Antonio, G., & Urbina, J. U. M. (2024) · SAHUARUS REVISTA ELECTRÓNICA DE MATEMÁTICAS · doi:10.36788/sah.v8i1.148 · Cited by 2
“Informes de Amgen y Bayer Healthcare revelaron dificultades para replicar hallazgos biom´edicos (Begley and Ellis, 2012; Prinz et al., 2011).”
BackgroundGlobal Regulatory Requirements Applicable for PROTACs
Pujari, R., Soni, U., & Gawade, A. R. (2024) · Springer eBooks · doi:10.1007/978-981-97-5077-1_7 · Cited by 1
Replicability in High Dimensional Statistics
Hopkins, M., Impagliazzo, R., Kane, D. M., Liu, S., & Ye, C. (2024) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs61266.2024.00103 · Cited by 15
“Recent years have seen the repeated failure of influential work in oncology [1], clinical research [2], and other high impact areas to replicate under scrutiny.”
Enhancing reproducibility in single cell research with biocytometry: An inter-laboratory study
Fikar, P., Alvarez, L., Berne, L., Cienciala, M., Kan, C., Kasl, H., Luo, M., Novackova, Z., Ordoñez, S., Šramková, Z., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314992 · Cited by 2
“Single cell research is at the forefront of the reproducibility challenge, facing significant inter-laboratory variability [2–4] and the sobering observation that a mere 11% of preclinical studies are successfully reproduced [5].”
Religion, Brain & Behavior adopts stricter transparency standards
Wildman, W. J., Ross, R. M., McKay, R., Watts, J., Hoogeveen, S., Sosis, R. H., Cristofori, I., Price, M. E., & Shaver, J. H. (2024) · Religion Brain & Behavior · doi:10.1080/2153599x.2024.2424031 · Cited by 1
“In a similar investigation, Begley and Ellis (2012) reported a meager 11% replication rate.”
Analytical Considerations: Discovery or Validation of Biomarkers
Chawla, Y., & Saraswat, M. (2024) · Springer eBooks · doi:10.1007/978-981-97-5045-0_3 · Cited by 1
DECODE enables high-throughput mapping of antibody epitopes at single amino acid resolution
Matsumoto, K., Harada, S. Y., Yoshida, S. Y., Narumi, R., Mitani, T. T., Yada, S., Sato, A., Morii, E., Shimizu, Y., & Ueda, H. R. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3002707 · Cited by 1
Meirmans, S., Luijken, K., Bruijning-Verhagen, P. C. J. L., Groenwold, R. H. H., & de Boer, A. R. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111785 · Cited by 2
Automated model refinement using perturbation-observation pairs
Park, K. H., Rozum, J. C., & Albert, R. (2025) · npj Systems Biology and Applications · doi:10.1038/s41540-025-00532-y · Cited by 1
The development and validation of the Immersion Experience Questionnaire Short Form (IEQ-SF)
Cutting, J., Aung, M., Perret, F., & Cairns, P. A. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103580 · Cited by 8
Le, P. N., Keysar, S. B., Miller, B., Morton, J. J., Chimed, T.-S., Alzofon, N., Nieto, C., Davies, K. D., Thomas, C. M., Weaver, A. N., et al. (2025) · Molecular Carcinogenesis · doi:10.1002/mc.70025 · Cited by 1
Spatial artifact detection improves the reproducibility of drug screening experiments
Ianevski, A., Nader, K. M., Potdar, S., Gorbonos, A., Ianevski, F., Tanoli, Z., Saarela, J., & Aittokallio, T. A. (2025) · iScience · doi:10.1016/j.isci.2025.113470 · Cited by 2
Ezzo, N., Nguyen, T. H., Ren, C. L., & Yim, E. K. F. (2025) · ACS Biomaterials Science & Engineering · doi:10.1021/acsbiomaterials.5c01015 · Cited by 2
Statistical power analysis in exercise science
Uehata, A., & Rein, R. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2571841 · Cited by 6
“For example, efforts to replicate promising findings in biomedical research have resulted in a replication rate of less than 25% (Begley & Ellis, 2012; Prinz et al., 2011).”
Hasso, T., Brosnan, M., Ali, S., & Chai, D. (2026) · Pacific-Basin Finance Journal · doi:10.1016/j.pacfin.2026.103166 · Cited by 1
Szabó, C. (2025) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000007775 · Cited by 2
Gelsleichter, Y. A., Banzi, R., Naudet, F., Vinatier, C., Kertész, I., & Varga, M. (2025) · F1000Research · doi:10.12688/f1000research.172013.1 · Cited by 1
A rapid method of evaluating cytotoxic drug efficacy using sub-cellular fluctuation imaging
Rehnstrom, H., Eley, A., Clayton, N. S., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-30295-9 · Cited by 1
Subspace-constrained graph unlearning for forgetting high-risk compound-protein interactions
Zhang, Y., Hu, R., Li, Y., & Kang, Z. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115193 · Cited by 1
Morris, J. J., Lee, C., Thai, T. Q., & Jones, L. M. (2026) · Journal of the American Society for Mass Spectrometry · doi:10.1021/jasms.5c00398 · Cited by 1
Goodbye P<0.05. P-value is simply one item among many to gauge scientific evidence
Slim, K., Chadli, D., & Occéan, B. (2026) · Journal of Visceral Surgery · doi:10.1016/j.jviscsurg.2026.02.005 · Cited by 1
Improving Laboratory-Based Cancer Drug Discovery Study Designs for Better Research Translations
Manoharan, S. (2026) · Methods and Protocols · doi:10.3390/mps9020038 · Cited by 2
“Begley and Ellis [60], in a comment published in Nature, pointed out that a major reason for failures in cancer-related clinical trials is the quality of preclinical data.”
Harnessing the power of artificial intelligence for clinical trials in cancer
Sönmez, G., Yazarkan, Y., Sahin, T. K., & Güven, D. C. (2026) · Expert Review of Anticancer Therapy · doi:10.1080/14737140.2026.2642221 · Cited by 1
“Preclinical models rarely capture this complexity, which contributes to the poor translation of promising laboratory findings into clinical efficacy [43,44].”
Alidina, Z., Banani, I., Abiha, U. E., Sultan, U., & Pawlik, T. M. (2026) · Cancers · doi:10.3390/cancers18060937 · Cited by 3
“Retrospective designs, modest sample sizes, and limited prospective external validation increase the risk of overfitting and performance optimism, generating concerns highlighted in the predictive modeling literature [46,48].”
Wang, X., Song, M.-Z., & Li, M. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1780034 · Cited by 1
“While the therapeutic strategies discussed above exhibit promising mechanistic rationale and encouraging preclinical evidence, their successful translation into clinical practice ultimately depends on addressing several critical methodological, translational, and implementation challenges (68–70).”
Zhang, Y., Yang, B., Yu, Y., Wang, X., Niu, C., Zhang, Y., Liu, Y., Li, J. G., Zhang, C., Yang, J., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-70582-1 · Cited by 1
“To independently con fi rm the accuracy of the IDMS-certi fi ed values of TranScale, we performed orthogonal validation using one-step reverse transcription digital PCR (RT-dPCR) (Supplementary Table 6, Supplementary Data 4, Supplementary Fig.”
InfluentialOkada, N., Maruko, A., Oshima, K., Nishi, A., & Kobayashi, Y. (2026) · International Journal of Molecular Sciences · doi:10.3390/ijms27073119 · Cited by 2
Bioactive natural products exhibiting anticancer activities
Joshi, U., Ojha, D. R., Giri, G. R., Bhattarai, S., Sharma, K. R., & Parajuli, N. (2026) · Studies in natural products chemistry · doi:10.1016/b978-0-443-49146-7.00004-2 · Cited by 1
Bennett, H., Blake, H. T., d’Unienville, N. M. A., Murray, J., & Fox, J. L. (2026) · Sports Medicine · doi:10.1007/s40279-026-02451-2 · Cited by 2
“An inability to replicate published research has been demonstrated in the field of psychology [7–10], cancer [11], economics [12], and philosophy [13].”
Wenzel, E. V., Al-Halabi-Frenzel, L., Demiral, S., Frenzel, A., Gnann, D. C., Keitel, M. C.-E., Lehmler, N., Mukherjee, T., Rauls, J., Schirrmann, T., et al. (2026) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2026.1765764 · Cited by 5
“…offered for research use are still based on polyclonal sera (Dübel, 2024), despite well-known problems with false positive or lacking reactivities (Begley and Ellis, 2012; Bradbury A. M. and Plückthun, 2015; Goodman, 2018; Bradbury A. and Plückthun, 2015) and always poorly defined contents that…”
Podlasz, P., Migocka-Patrzałek, M., Prajsnar, T. K., Sarosiak, A., & Tylżanowski, P. (2026) · Acta Biochimica Polonica · doi:10.3389/abp.2026.16545 · Cited by 3
Naveen, P., Mamidi, G., Priyadarsini, A., & Swathi, G. (2026) · Discover Nano · doi:10.1186/s11671-026-04669-5 · Cited by 1
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.