Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,201–2,300 of 2,889
Priboi, C., Mayer, B., Vergauwe, E., Elger, B. S., & Würbel, H. (2026) · PLoS Biology · doi:10.1371/journal.pbio.3003511 · Cited by 4
“The inability to replicate published results, e.g., in cancer research [18], and the low rates of translating preclinical findings to clinical studies [19,20], have led to questions about the rigor and reproducibility of animal research [18,21–23].”
Frustra laborare ? Methodological inefficiencies and epistemic limits in toxicological testing
Landsiedel, R., Kolle, S. N., & Funk-Weyer, D. (2026) · Alternatives to Laboratory Animals · doi:10.1177/02611929261472447 · Cited by 2
Cross‐tissue immune profiling of APOE ε4 reveals early dysregulation in Alzheimer's disease
Shvetcov, A., Thomson, S., Graham, M. E., Hauger, B. M., Keller, J. E., Smoyer, C. J., Tague, S. E., Cho, A., Imam, F. B., Krish, V. S., et al. (2026) · Alzheimer s & Dementia · doi:10.1002/alz.71714 · Cited by 10
Mebius, A. (2015) · PhilPapers (PhilPapers Foundation) · Cited by 1
Plágio e condutas inadequadas em pesquisa: onde chegamos e o que podemos fazer
Chamon, W. (2013) · Arquivos Brasileiros de Oftalmologia · doi:10.1590/s0004-27492013000600001 · Cited by 2
Controversies in ASSAY and Drug Development Technologies : A Focus on Assessing Irreproducibility
Glickman, J. F., Lundbäck, T., Napper, A. D., Niles, W. D., Simeonov, A. M., Weaver, C. D., Yin, H. H., Zaman, G. J. R., & Osada, H. (2014) · Assay and Drug Development Technologies · doi:10.1089/adt.2014.1501 · Cited by 1
Bains, W. (2012) · Cited by 1
Campillo-Artero, C. (2015) · Springer eBooks · doi:10.1007/978-3-319-15004-8_4 · Cited by 3
Villain of Molecular Biology: Why are we not reproducible in research?
Bhardwaj, V. (2015) · F1000Research · doi:10.12688/f1000research.6854.1 · Cited by 2
A Kinetic Model for the Integrated Assessment of Safety and Efficacy in Clinical Trials
Diamond, G. A. (2014) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2014.07.080 · Cited by 1
Volkov, V. S. (2014) · Communicative & Integrative Biology · doi:10.4161/cib.27966 · Cited by 1
“For example, recent indications for sampled 53 publications in cancer research show that up to 90% of them may be incorrect.(10) The most serious problem is that over 60% of”
BackgroundThe test of time and editorial responsibility
Begley, C. G. (2013) · Pigment Cell & Melanoma Research · doi:10.1111/pcmr.12143 · Cited by 1
“Several groups have indicated that we have a serious problem, particularly in the ‘top-tier’ journals, with between ~75 and 90% of publications unable to be reproduced (Begley and Ellis, 2012; Booth, 2011; Prinz et al., 2011).”
BackgroundSelf-citationPublishing the data behind the data (Show me yours, I'll show you mine)
Leng, G. (2014) · Physiological Reports · doi:10.14814/phy2.12186 · Cited by 1
“Most prominently, it was recently reported that the biotechnology firm Amgen tried to confirm findings published in 53 ‘landmark’ preclinical cancer studies; scientific findings were confirmed in only six cases (Begley and Ellis 2012).”
BackgroundDiscoveries and Anti-Discoveries on the Web of Argument and Data
Clark, T., Goble, C., & Ciccarese, P. (2014) · National Conference on Artificial Intelligence · Cited by 1
The Highs and Lows of Measuring Thrombopoietin in Aplastic Anemia
Corey, S. J. (2016) · Pediatric Blood & Cancer · doi:10.1002/pbc.25885 · Cited by 1
“For neoplasms, preclinical or clinical reproducibility of proposed biomarkers often result in disappointment for poorly understood reasons.[8] Confounding the use of biomarkers in making an accurate diagnosis of AA or RCC is the heterogeneity of both disorders.”
BackgroundPreclinical oncology — reporting transparency needed
Gardner, E. E., & Rudin, C. M. (2015) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2015.216 · Cited by 1
Patterns in target-directed breast cancer research
Torres, S., Simmons, C. E., Boileau, J.-F., McLeod, D., Martins, I., & Trudeau, M. (2016) · SpringerPlus · doi:10.1186/s40064-016-1736-1 · Cited by 1
“However, given that clinical research in oncology is both costly and associated with the highest rates of drug attrition and trial failure (Begley and Ellis 2012; Hutchinson and Kirk 2011) we have undertaken an analysis of ongoing BC targeted therapy trials registered to CT.gov to describe patterns…”
BackgroundJournal of Controversies in Biomedical Research - the Need of the Hour
Morais, C., & Vitetta, L. (2015) · Journal of Controversies in Biomedical Research · doi:10.15586/jcbmr.2015.5 · Cited by 1
“Astonishingly, 47 out of the 53 (89%) could not be reproduced (1).”
BackgroundPerkel, J. M. (2015) · BioTechniques · doi:10.2144/000114272 · Cited by 1
Religion Viewed From Different Sciences
VERSCHUUREN, G. M. N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-420190-3.00040-5 · Cited by 1
Cohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2016) · Springer eBooks · doi:10.1007/978-3-319-31420-4_54-1 · Cited by 1
Guindalini, C., & Oliveira, M. M. (2017) · Vigilância Sanitária em Debate · doi:10.22239/2317-269x.00875 · Cited by 2
Webb, C. R., & Grisham, M. B. (2017) · Springer eBooks · doi:10.1007/978-3-319-33703-6_15 · Cited by 1
Anglin, S. M. (2016) · doi:10.7282/t3h70j34 · Cited by 1
Replikationen, Reputation und gute wissenschaftliche Praxis
Fecher, B., Fräßdorf, M., Hebing, M., & Wagner, G. G. (2017) · Information - Wissenschaft & Praxis · doi:10.1515/iwp-2017-0025 · Cited by 2
“%) erfolgreich (Begley & Ellis, 2012).”
The State of Science and Unreliable Research
Hughes, L. D. (2014) · Cited by 1
Esteves, D., Moussallem, D., Soru, T., et al. (2017) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1145/3106426.3106530 · Cited by 1
“Further analysis have found that only 6 of 53 high-profile papers in cancer biology could be reproduced [2].”
BackgroundReproducibility of biomedical research: Quo vadis?
Dal‐Ré, R., Bernad, A., & Garesse, R. (2016) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2016.06.029 · Cited by 1
Specification of Subject Sex in Oncology-Related Animal Studies
Lee, S., Kim, W. J., Jeon, Y., Lim, C. H., & Sun, K. (2018) · Acute and Critical Care · doi:10.4266/acc.2017.00444 · Cited by 4
“This potentially results in poor reproducibility [11].”
Malin, D. H., Hetherington, S. A., Nghiem, D. M., Ward, C. P., Kelling, N., Izygon, J. J., Harrison‐Walker, L. J., Campbell, J. R., Hughes, R., & Buras, W. R. (2019) · Journal of Neuroscience Research · doi:10.1002/jnr.24440 · Cited by 1
“There have been a number of failures to replicate published peer‐reviewed articles reporting seemingly important findings in basic or preclinical research (Begley & Ellis, 2012; Open Science Collaboration, 2015; Prinz, Schlange, & Asadullah, 2011).”
BackgroundProgress in Biomedical Sciences and Raw Data: Ethical Dilemmas
Casacuberta, D., & Tassani, S. (2019) · Springer eBooks · doi:10.1007/978-3-030-28626-2_6 · Cited by 1
Moiseev, S. V., Zykova, A. S., Bulanov, N. M., Gitel, E. P., Novikov, P. I., Bulanova, M., Kronbichler, A., & Jayne, D. R. W. (2020) · The Journal of Rheumatology · doi:10.3899/jrheum.191082 · Cited by 1
Incentives, Rewards, and Recognition - What Really Motivates a Researcher?
Ghimpău, V. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-11 · Cited by 2
Reproducibility: Buy Low, Sell High
Maxion, R. A. (2020) · IEEE Security & Privacy · doi:10.1109/msec.2020.3005077 · Cited by 1
Irreproducibility –The deadly sin of preclinical research in drug development
Pillai, S., Kobayashi, K., Michael, M., & Meena, A. (2020) · Journal of Pre-Clinical and Clinical Research · doi:10.26444/jpccr/131017 · Cited by 1
Rapid Tissue Donation (RTD) for Oncology Research
Mannelli, C. (2021) · The International Library of Bioethics · doi:10.1007/978-3-030-67201-0_1 · Cited by 1
Development of Novel Radiopharmaceuticals: Problems, Decisions and More Problems
Babich, J. W., & Haberkorn, U. (2020) · SpringerBriefs in ethics · doi:10.1007/978-3-030-61412-6_6 · Cited by 1
Target Validation—Prosecuting the Target
Jones, L. H. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820472-6.00014-1 · Cited by 1
Sorjonen, K., Nilsonne, G., Melin, B., & Ingre, M. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05545-4 · Cited by 1
Meta-analyzing logistic regression slopes: A partial effect size for categorical outcomes
Anderson, N. (2021) · doi:10.7916/d8-37cs-mp34 · Cited by 1
ProvCaRe: A Large-Scale Semantic Provenance Resource for Scientific Reproducibility
Liu, C., Kim, M. J., Rueschman, M., & Sahoo, S. S. (2020) · Advanced information and knowledge processing · doi:10.1007/978-3-030-67681-0_5 · Cited by 1
Open Science and Clinical Psychology
Linthicum, K. P., Southward, M. W., & Schleider, J. L. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00165-5 · Cited by 2
Reducing sources of variance in experimental procedures in in vitro research
Fischer, I., Martinez-Dominguez, M. V., Hänggi, D., & Kahlert, U. D. (2021) · F1000Research · doi:10.12688/f1000research.73497.1 · Cited by 4
“Also, improved and increased standardization in wet lab research is suggested as a powerful strategy to increase repeatability.(3,9,5)”
BackgroundKey methodological issues in researching gifted education and advanced academics
McBee, M. T. (2021) · Routledge eBooks · doi:10.4324/9781003025443-1 · Cited by 1
Future of Regulatory Safety Assessments
Bode, G., & Starck-Lantova, P. (2020) · Springer eBooks · doi:10.1007/978-3-319-68864-0_71 · Cited by 1
Howard, J. (2018) · Springer eBooks · doi:10.1007/978-3-319-93224-8_30 · Cited by 1
Cancer therapies: Caveats, concerns, and momentum
Anisman, H., & Kusnecov, A. W. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91904-3.00001-x · Cited by 1
(2013) · Biology Open · doi:10.1242/bio.20134093 · Cited by 1
“As I have discussed before (Raff, 2012), given the extreme pressures on scientists to publish in journals with high impact factors, it is perhaps no surprise to learn that other scientists often find the data published in these journals difficult to reproduce (Begley and Ellis, 2012; Mullard, 2011).”
BackgroundPourquié, O., Brown, K. E., & Moulton, O. C. (2014) · Development · doi:10.1242/dev.115923 · Cited by 1
“…news/briefing/21588057-scientists-think-science-self-correctingalarming-degree-it-not-trouble) suggested that biotech companies no longer trust the results of published studies from academia, finding them more often than not to be irreproducible (see also Begley and Ellis, 2012).”
BackgroundNew forms of checks and balances are needed to improve research integrity
Iorns, E. J., & Chong, C. (2014) · F1000Research · doi:10.12688/f1000research.3980 · Cited by 1
Thesis plan: the effect of data science teaching for non-STEM students
Barboza, L. C. G. (2022) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3529372.3530976 · Cited by 3
“Industry and academia, especially in STEM courses, where knowledge of data science is mastered and has a solid foundation and even a reference curriculum, curriculum guidelines for graduate programs in data science are also discussed [3].”
BackgroundNeuhaus, C. P. (2022) · The Hastings Center Report · doi:10.1002/hast.1430 · Cited by 3
New data sharing requirements for AIChE Journal authors
Sholl, D. S. (2023) · AIChE Journal · doi:10.1002/aic.18017 · Cited by 1
Negative findings but positive contributions in cardiovascular research
Chen, K., & Zeng, C. (2023) · Life Sciences · doi:10.1016/j.lfs.2023.121494 · Cited by 1
Kindzierski, W., Young, S., & Dunn, J. (2023) · International Journal of Statistics and Probability · doi:10.5539/ijsp.v12n3p40 · Cited by 1
“…have increasingly recognized that far too much published research is irreproducible or false (e.g., Ioannidis, 2005; Ioannidis et al., 2011; Young & Karr, 2011; Begley & Ellis, 2012; Keown, 2012; Begley & Ioannidis, 2015; Iqbal et al., 2016; Randall & Welser, 2018; Stodden et al., 2018).”
BackgroundVõikar, V., Casarotto, P. C., Glerean, E., Laakso, K., Saurio, K. J., Karhulahti, V., & Scherer, A. (2023) · Journal for Reproducibility in Neuroscience · doi:10.36850/jrn.2023.e47 · Cited by 1
Application and progress of highcontent imaging in molecular biology
Boyang, H., Yangyanqiu, W., Wenting, R., Chenxin, Y., Chu, J., Zhanbo, Q., Yanjun, Y., Qiang, Y., & Han, S. (2023) · Biotechnology Journal · doi:10.1002/biot.202300170 · Cited by 2
Addressing the “Replication Crisis” in the Field of Parkinson’s Disease
Albanese, F., Bloem, B. R., & Kalia, L. V. (2023) · Journal of Parkinson s Disease · doi:10.3233/jpd-239002 · Cited by 1
“Similarly, a paper published by Amgen in 2012 reported that only 11% of the 53 pre-clinical cancer studies examined could be successfully reproduced [5].”
The replication crisis in science and its overlap into kinantropology: an introduction
Baloun, L., & Mališ, J. (2023) · Tělesná kultura · doi:10.5507/tk.2023.002 · Cited by 1
OmniReprodubileCellAnalysis: a comprehensive toolbox for the analysis of cellular biology data
Tortarolo, D., Pernice, S., Clapero, F., Valdembri, D., Serini, G., Riccardo, F., Tarone, L., Bena, C. E., Bosia, C., Contaldo, S. G., et al. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385438 · Cited by 1
“Similarly, in the field of cancer research, studies show that only about 20-25% [2] or 11% [3] of published studies can be validated or reproduced.”
BackgroundHochheimer, C. J., Bosma, G., Gunn-Sandell, L. B., & Sammel, M. D. (2024) · Stat · doi:10.1002/sta4.653 · Cited by 2
“The reproducibility crisis has been well-documented (Baker, 2016; Begley & Ellis, 2012; Iqbal et al., 2016; “ Making Progress Toward Open Data, ” , 2017; Prinz et al., 2011).”
BackgroundFAIR reporting of clinical trials for public health practice
Balas, E. A., Bussi, B. S., Asem, N., Amour, C., Mwanziva, C. E., Vasquez, J., Labib, N. A., Price, M., Mahande, M. J., Baskar, R., et al. (2024) · Proceedings of the European Academy of Sciences and Arts · doi:10.4081/peasa.19 · Cited by 2
“16 The high ratio of non-reproducible clinical trials also calls into question the ethical participation of large numbers of patients in essentially useless studies.”
BackgroundBeing positive about negatives: why publishing negative results is good for veterinary science
Boxer, E. (2024) · Veterinary Record · doi:10.1002/vetr.4362 · Cited by 1
Application of New Biological Entities (NBEs) as Therapeutics
Bagade, O. M., & Doke-Bagade, P. E. (2024) · Springer eBooks · doi:10.1007/978-981-97-2596-0_13 · Cited by 1
Introducing Students to Research and Reproducibility with Open Science Tools
Griego, C. D., Zhang, C., Hu, W., Ma, Z., & Ouyang, A. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--47683 · Cited by 1
Testing the usefulness of a quality system in preclinical research
Bernard, R., Gerlach, B., Haas, M., Macleod, M. R., Potschka, H., Rice, A. S. C., Steckler, T., Võikar, V., & Wever, K. E. (2024) · Neuroscience Applied · doi:10.1016/j.nsa.2024.105395 · Cited by 2
“Important factors contributing to translational failure are insufficient validity and irreproducibility of experiments (Begley and Ellis, 2012; Prinz et al., 2011).”
Elliott, C., Patterson, E. D., Tarcea, A., et al. (2024) · Injury · doi:10.1016/j.injury.2024.112067 · Cited by 1
ToxPoint: Chemical risks and children’s health—building on progress based on science, not panic
Cohen, S. M., Rietjens, I. M. C. M., Levy, L., et al. (2025) · Toxicological Sciences · doi:10.1093/toxsci/kfaf051 · Cited by 1
Steele, S., Lavrijssen, T., & Steckler, T. (2025) · Research Integrity and Peer Review · doi:10.1186/s41073-025-00176-w · Cited by 1
Current Developments in the Pharmacological Activities and Synthesis of Carbazole Derivatives
Oba, G. M. J., Sahu, R., Shah, K., et al. (2025) · Mini-Reviews in Medicinal Chemistry · doi:10.2174/0113895575407122250822095143 · Cited by 1
Transitioning Discoveries from Cancer Genomics Research Laboratories into Pathology Practice
Jamaspishvili, T., & Squire, J. A. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0727-4_12 · Cited by 1
Resilience within Ultrascale Computing System: Challenges and Opportunities from Nesus Project
Bouvry, P., Mayer, R. L., Muszyński, J., Petcu, D., Rauber, A., Tempesti, G., Trinh, T. A., & Varrette, S. (2015) · Supercomputing Frontiers and Innovations · doi:10.14529/jsfi150203 · Cited by 1
Research Integrity: Perspectives from Korea and the United States
Lee, I. J., & KALICHMAN, M. W. (2016) · Springer eBooks · doi:10.1007/978-981-287-098-8_63 · Cited by 1
Do We Need a Science of Science?
Maiväli, Ü. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-418689-7.00001-6 · Cited by 1
Lost and Found in Behavioral Informatics
Haendel, M. A., & Chesler, E. J. (2012) · International review of neurobiology · doi:10.1016/b978-0-12-388408-4.00001-0 · Cited by 1
Sinha, R., & Sudhish, P. S. (2016) · IEEE International Symposium on Ethics in Engineering, Science, and Technology (ETHICS) · doi:10.1109/ethics.2016.7560050 · Cited by 3
Reinventing the Methods Journal: Increasing Reproducibility with Video Journals
Henderson, K. M. (2013) · Against the grain · doi:10.7771/2380-176x.6605 · Cited by 1
Using Systems Pharmacology to Advance Oncology Drug Development
Kirouac, D. C. (2016) · AAPS advances in the pharmaceutical sciences series · doi:10.1007/978-3-319-44534-2_19 · Cited by 2
Applications of Non-coding RNA in the Molecular Pathology of Cancer
Krishnan, K., & Cloonan, N. (2016) · Springer eBooks · doi:10.1007/978-1-4939-6643-1_9 · Cited by 2
Application of Clinical Trial Results to Clinical Practice
Zarbin, M. A., Bhagat, N., & Mukkamala, L. K. (2017) · Developments in ophthalmology · doi:10.1159/000459707 · Cited by 2
Ecological Validity in the Critical Care Environment: Closing the Loop on Evidence Based Medicine
Maas, M. B. (2017) · Respiratory Care · doi:10.4187/respcare.06015 · Cited by 1
Tang, B. L. (2018) · Accountability in Research · doi:10.1080/08989621.2018.1479257 · Cited by 1
“In the life sciences, this problem has been widely documented (Begley and Ellis 2012; Schulz, Cookson, and Hausmann 2016).”
BackgroundLeisman, D. E. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003420 · Cited by 1
“For example, in 2012, an industry-funded project attempting to replicate 53 landmark preclinical cancer studies made headlines when it could reproduce just six (11%) (11).”
Background2017 Meeting of the National Directors of Graduate Studies in Pharmacology and Physiology
Victor, T. R., Thompson, K. K., Barnett, J. V., et al. (2018) · AJP Advances in Physiology Education · doi:10.1152/advan.00027.2018 · Cited by 1
“Ellis published a commentary in Nature (1) calling for increased rigor in preclinical cancer research.”
BackgroundSeneviratne, A. K., Rosenblum, N. D., Zahr, S. K., et al. (2019) · Clinical and investigative medicine · doi:10.25011/cim.v42i3.33088 · Cited by 1
“Incentives such as securing funds, jobs, promotions or tenure are primarily contingent upon a researcher’s high publication output in high-impact journals [3,4]; however, there is no guarantee that a publication in a higher-impact journal is more likely to lead to a health solution compared with a study published in a…”
ResultBleakley, C., & Smoliga, J. M. (2019) · Journal of Orthopaedic and Sports Physical Therapy · Cited by 1
Nanocontainers for the encapsulation and delivery of antioxidants/nutrients to food
Chen, D. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816770-0.00008-3 · Cited by 2
Berman, J. J. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-404576-7.00007-1 · Cited by 1
Reproducing Neural Ensemble Classifier for Semantic Relation Extraction inScientific Papers
Rim, K., Tu, J., Lynch, K., & Pustejovsky, J. D. (2020) · Language Resources and Evaluation · Cited by 6
Maisonneuve, H. (2020) · Les Tribunes de la santé · doi:10.3917/seve1.064.0079 · Cited by 2
Berry, C. L. (2020) · Toxicology Research and Application · doi:10.1177/2397847320951377 · Cited by 1
Begley, C. G., & Snapinn, S. M. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1782259 · Cited by 1
Self-citationConsistent Inclusion of Mesenchymal Stem Cells into In Vitro Tumor Models
Ferreira, L. P., Gaspar, V. M., & Mano, J. F. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1225-5_1 · Cited by 1
Park, Y. L., Kim, H., Lee, J. Y., Jeong, S., Kwon, E.-Y., & Joo, J. (2021) · Journal of Dental Rehabilitation and Applied Science · doi:10.14368/jdras.2021.37.2.88 · Cited by 1
“발되기 위해서는 제일 먼저 해당 조직에 존재하는 세포 에 독성을 가지는지를 평가해야 하고 그것은 주로 세포 생존율 평가를 통해 확인할 수 있다.(18,19) 본 연구에서는 NTP를 적용한 그룹과 다른 그룹간에 세포생존율의 통 계적으로 유의한 차이가 없음을 확인하므로써 NTP 장 치가 인간치은섬유모세포의 생존에 영향을 미치지 않음 을 확인할 수 있었다.”
The file drawer effect – a long-lasting issue in science
Lemaire, B., In&Sight, Lenoble, R., Zanon, M., Jacquel, T., & Vallortígara, G. (2021) · doi:10.52732/kuwg1044 · Cited by 1
Xu, X., & Hu, S. (2021) · Springer eBooks · doi:10.1007/978-981-10-8953-4_1 · Cited by 2
Ehlers, L., Kirchner, M., Mertins, P., Strehl, C., Buttgereit, F., & Gaber, T. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23095049 · Cited by 2
“Researchers found that less than a quarter of important preclinical studies were reproducible [1,2].”
BackgroundData publication consensus and controversies
Kratz, J. E., & Strasser, C. A. (2014) · F1000Research · doi:10.12688/f1000research.4518 · Cited by 1
Enhancing the Assessment of Reprogenetic Technologies: The Case of Mitochondrial Replacement
de Melo‐Martín, I. (2016) · Oxford University Press eBooks · doi:10.1093/med/9780190460204.003.0008 · Cited by 1
Hoppe, I. J., Prommegger, B., Uhl, A., Lohrig, U., Huber, C. G., & Brandstetter, H. (2022) · ChemBioChem · doi:10.1002/cbic.202200399
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.