Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,001–2,100 of 2,889
Freedman, L. P. (2017) · Science · doi:10.1126/science.aam8039 · Cited by 3
Remmers, N. A., Cox, J. L., Grunkemeyer, J. A., Aravind, S., Arkfeld, C. K., Hollingsworth, M. A., & Carlson, M. A. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/267112 · Cited by 3
“, tumor xenografting into immunosuppressed mice) to determine the 70 efficacy of various therapeutics in humans [4-6,10-14].”
BackgroundSignificance Testing in Natural and Biological Systems: A ReviewPreprint
Kak, S. C. (2021) · doi:10.36227/techrxiv.14599836.v1 · Cited by 3
Factor Investing in Sovereign Bond Markets: Deep Sample EvidencePreprint
Baltussen, G., Martens, M. P. E., & Penninga, O. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3873863 · Cited by 3
“Begley and Ellis (2012) show that out of 53 studies on pre-clinical cancer only 11% could be replicated. An open science collaboration (2015) shows that out of 97 significant psychological studies only 36 could be replicated. In behavioral economics, Camerer et al. (2016) find that out of 18 laboratory studies in econ…”
BackgroundInfluentialModel-Adaptive Interface Generation for Data-Driven DiscoveryPreprint
Tangmunarunkit, H., Shafaeibejestan, A., Chudy, J., Czajkowski, K., Schuler, R. E., & Kesselman, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.01781 · Cited by 4
“This has led to notable and high-profile concerns that question the validity [4] and reproducibility [25] of scientific results, due in part to the poor quality of data management practices [30].”
BackgroundHow failure to falsify in high-volume science contributes to the replication crisisPreprint
Rajtmajer, S. M., Errington, T. M., & Hillary, F. G. (2021) · doi:10.31234/osf.io/5fb7h · Cited by 3
NSF Science of Science Proposal: Randomized Trial of Registered ReportsPreprint
Nosek, B. A., Mellor, D. T., Errington, T. M., Soderberg, C. K., Krall, T., Grasty, F. L., Brooks, R. E., Davis, R., Kousta, S. T., Swaminathan, S., et al. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/jvxab · Cited by 3
Brough, D., Smith, A. M., II, Turley, K., et al. (2021) · doi:10.31222/osf.io/hvfpx · Cited by 3
Abstracts from the 12th Annual Meeting of ISMPP
(2016) · Current Medical Research and Opinion · doi:10.1185/03007995.2016.1152850 · Cited by 3
Antitrust and User Union in the Era of Digital Platforms and Big DataPreprint
Cong, L. W., & Mayer, S. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4140083 · Cited by 3
A Novel Humanized Immune Stroma PDX Cancer Model for Therapeutic StudiesPreprint
Yang, D., Beddows, I., Tang, H., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.03.547206 · Cited by 3
“Poor models of cancer used in drug development are proposed to play a major role in the ultimate failure of drugs in clinical trials (14).”
Investigating Issues with Reproducibility in Journal Articles Published in Psychological SciencePreprint
Homewood, C. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6d5nq · Cited by 3
Scientific reasoning driven by influential data: resuscitate dfstat !Preprint
Spiess, A., Rödiger, S., Schaks, M., Burdukiewicz, M., & Tellinghuisen, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.30.621016 · Cited by 3
Andress, B. D., Hoffman, M., & McNulty, A. L. (2022) · Journal of Orthopaedic Research® · doi:10.1002/jor.25498 · Cited by 2
Data sharing in modeling and simulation of biomechanical systems in interdisciplinary environments
Villota‐Narvaez, Y., Bleiler, C., & Röhrle, O. (2024) · GAMM-Mitteilungen · doi:10.1002/gamm.202370006 · Cited by 5
Supporting evidence in phase 2 cancer trial protocols: a content analysis
Bicer, S., Nelson, A., Carayannis, K., & Kimmelman, J. (2024) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djae281 · Cited by 4
Wood, J., & van Schalkwyk, I. (2025) · Journal of Transportation Technologies · doi:10.4236/jtts.2025.151010 · Cited by 4
Medical Progress: Science Versus Practice
Dellsén, F., Latham, A. J., Norton, J., & Varga, S. (2025) · Erkenntnis · doi:10.1007/s10670-025-00953-5 · Cited by 2
“Some argue that the replication crisis (Baker, 2016 ) presents a significant challenge to our understanding of medical phenomena and that substantial changes to our research practices are necessary (Munafò et al., 2017 ; Williams, 2015 ; Begley & Ellis, 2012 ).”
Navigating Ambiguity and Uncertainty in End-of-Life Care Research Practice
van Drimmelen, T., Slagboom, M. N., Reis, R., Bouter, L. M., & van der Steen, J. T. (2025) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646251377121 · Cited by 2
“More recently, following the discovery that the reproducibility of research leaves much to be desired (Begley & Ellis, 2012; Cobey et al., 2023; Ioannidis, 2005; Open Science Collaboration, 2015), research conduct is quickly unfolding to be a major topic in other disciplines as well (Aubert Bonn &…”
InfluentialFrom 3D culture to clinical decision-making: Systematic innovations in breast cancer organoids
Hu, M., Zhou, C., Li, M., & Zhao, J. (2025) · Biomaterials Advances · doi:10.1016/j.bioadv.2025.214528 · Cited by 3
Purpurin as a promising anticancer agent: A review of preclinical evidence
Voon, F., Lee, Y. Z., Ooi, X. Y., Tay, C. Z. E., Tan, J. W., Tham, C. L., Ho, Y., & Lee, M. T. (2025) · Fitoterapia · doi:10.1016/j.fitote.2025.107052 · Cited by 4
Sholl, D. S. (2026) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.5c08003 · Cited by 6
MIFE and MIFD: Minimum information for fermentation experiments and devices
Georgakilas, G. K., Metcalfe, B., Bize, A., Crowther, M. R. B. , Fernandez, E., Villela, S. M. A., Owen, S., Wittner, R., Corrales, D. C., von Gladiss, A., et al. (2026) · GigaScience · doi:10.1093/gigascience/giag038 · Cited by 2
“That is because good data management practices are not just a bureaucratic (or academic) exercise but are crucial for cultivating new knowledge, facilitating data sharing, and ensuring reproducibility [ 4 , 5 ].”
Pillai, R., Rashidfarrokhi, A., Hao, Y., Wu, W., Mancini, M. C. S., Karadal-Ferrena, B., Dimitriadoy, S. G., Cross, M., Yeaton, A. H., Huang, S. M., et al. (2026) · Cancer Discovery · doi:10.1158/2159-8290.cd-25-0470 · Cited by 3
“Preclinical transplant tumor models characterizing solid tumors frequently utilize cell lines arising from a single dominant clone as opposed to autochthonous tumors derived from genetically engineered mouse models (GEMM) which allow tumors to develop in a heterogenous manner (16–18).”
Bach, D., Bùi, V. G., & Nguyen, T. U. O. N. G. (2026) · Journal of Extracellular Biology · doi:10.1002/jex2.70131 · Cited by 4
Guo, C., Li, Q., Liang, W., Lu, J., Yue, W., Tian, S., & Zhang, W. (2026) · Targetome · doi:10.48130/targetome-0026-0027 · Cited by 4
Microglial Biology in Neuroinflammatory Disease: Pharmaco-industrial Approach to Target Validation
Möller, T., Wes, P. D., & Doller, D. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0974-2_9 · Cited by 2
“11 %) were successfully replicated (Begley and Ellis 2012).”
BackgroundExperimental neurology and state of preclinical research
Höke, A. (2012) · Experimental Neurology · doi:10.1016/j.expneurol.2012.12.011 · Cited by 2
Challenges in Translating Academic Research into Therapeutic Advancement
Matos, G., Tufik, S. B., & Andersen, M. L. (2013) · Frontiers in Neurology · doi:10.3389/fneur.2013.00123 · Cited by 2
Bucur, O. (2013) · Discoveries · doi:10.15190/d.2013.1 · Cited by 2
“siRNAs, and other reagents employed essential? Antibodies, other reagents, inadequate animal models or cell-based models/assays, insufficient number of experimental repeats and statistical inadequacies all contribute to the low reproducibility of preclinical and clinical data [4-8].”
BackgroundChoi, S. W., Lam, D. M., & Irwin, M. G. (2015) · Hong Kong Medical Journal · doi:10.12809/hkmj154631 · Cited by 3
Best Practices for Clinical and Translational Research and Implementation
Kroetz, D. L. (2016) · Clinical and Translational Science · doi:10.1111/cts.12411 · Cited by 2
Poline, B., Vul, E., & Tal (2016) · Cited by 2
Reproducibility of Two Innate Immune System Models
Presbitero, A., Krzhizhanovskaya, V. V., Mancini, E., Brands, R., & Sloot, P. M. A. (2016) · Communications in computer and information science · doi:10.1007/978-3-319-49700-6_50 · Cited by 2
Onward and upward with transparent research reporting
Adams, J. C. (2017) · American Journal of Physiology-Cell Physiology · doi:10.1152/ajpcell.00045.2017 · Cited by 2
Discovery and Preclinical Work
Mochly‐Rosen, D., & Grimes, K. (2013) · SpringerBriefs in pharmaceutical science & drug development · doi:10.1007/978-3-319-02201-7_2 · Cited by 2
Kelling, N., Ward, C. P., Malin, D. H., Buras, W. R., & Hetherington, S. A. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601633 · Cited by 2
“…led to some phenomenal discoveries, over the past decade we have been exposed to numerous events that have called into question the validity of a number of scientific works (Begley & Ellis, 2012; Ioannidis, Greenland, Hlatky, Khoury, Macleod, Moher, et al, 2014; Open Science Collaboration, 2015).”
BackgroundBiomedical Research in the 21st Century: Multiple Challenges in Resolving Reproducibility Issues
Mullane, K., Curtis, M. J., & Williams, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00006-9 · Cited by 4
To achieve the goals of e-Science, we must change research culture globally
Hong, N. C. (2018) · Informatik-Spektrum · doi:10.1007/s00287-018-01134-1 · Cited by 1
“A 2012 study by Begley and Ellis [4] reviewed a decade of landmark”
BackgroundInfluentialApplication of In Silico Drug Repurposing in Infectious Diseases
Kumar, P., & Ghosh, I. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816125-8.00015-8 · Cited by 2
Rigor, Reproducibility, and Responsibility: A Quantum of Solace
Turner, J. R. (2019) · Cellular and Molecular Gastroenterology and Hepatology · doi:10.1016/j.jcmgh.2019.03.006 · Cited by 2
Halim, A. B. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816121-0.00011-8 · Cited by 2
Publish and who should perish: you or science?
Kun, Á. (2019) · Science Editor and Publisher · doi:10.24069/2542-0267-2019-1-2-76-93 · Cited by 2
Clinical and Patient-Reported Outcomes After Hybrid Russe Procedure for Scaphoid Nonunion
Shapiro, L. M., Roe, A. K., & Kamal, R. N. (2020) · Hand · doi:10.1177/1558944720911214 · Cited by 2
Crosby, K., Wood, A. W., Simendinger, J., Grange, C., Carr, L., Costa-Grant, K., Roller, C. J., & Polakiewicz, R. D. (2020) · Journal of Histotechnology · doi:10.1080/01478885.2020.1847012 · Cited by 2
Hall, L. M., & Hendricks, A. E. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-03817-7 · Cited by 3
Kindness in science does matter
Jost, W. H., Altmann, C. F., & Reichmann, H. (2021) · Journal of Neural Transmission · doi:10.1007/s00702-021-02395-z · Cited by 2
Fry, D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-385103-1.00008-7 · Cited by 2
Hersh, W. (2020) · Health informatics · doi:10.1007/978-3-030-47686-1_2 · Cited by 2
Grüne‐Yanoff, T. (2022) · European Journal for Philosophy of Science · doi:10.1007/s13194-022-00452-2 · Cited by 2
Chan, E. W., Wong, J., Chan, C. S., & Cheung, F. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_18 · Cited by 4
Replication of "null results" - Absence of evidence or evidence of absence?
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2023) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.2305.04587 · Cited by 2
Replication and Reproducibility and the Self-Correction of Science: What Can JID Innovations Do?
Hall, R. P. (2023) · JID Innovations · doi:10.1016/j.xjidi.2023.100188 · Cited by 3
Hey, T. (2023) · OECD eBooks · doi:10.1787/7b7b1bce-en · Cited by 5
Clemens, R., Rao, P. G., Elouafi, I. A., Oniang'o, R. K., Chandrasekara, A., Pressman, P., & Yadav, J. K. P. S. (2023) · Journal of Food Bioactives · doi:10.31665/jfb.2023.18342 · Cited by 3
Transparent Science: A More Credible, Reproducible, and Publishable Way to Do Science
Mellor, D. T., Vazire, S., & Lindsay, D. S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108304443.020 · Cited by 2
Johnson, B. A., Addolorato, G., Lesch, O., Liu, L., & Rodd, Z. A. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1271229 · Cited by 3
“Similarly, only 11% of pre-clinical cancer studies were successfully replicated in multiple research laboratories (3).”
BackgroundTime-dependent proteomics and drug response in expanding cancer cells
Pan, Y., Xuan, Y., Hao, P., Chen, X., Yan, R., Zhang, C., Ke, X., Qu, Y., & Zhang, X. (2024) · Pharmacological Research · doi:10.1016/j.phrs.2024.107208 · Cited by 3
The 30th Annual Prostate Cancer Foundation Scientific Retreat Report
Miyahira, A. K., & Soule, H. R. (2024) · The Prostate · doi:10.1002/pros.24768 · Cited by 2
Application of preclinical juvenile animal models
Hermans, E., Toelen, J., Ventrella, D., Schaepdrijver, L. D., Turner, K. J., Croubels, S., & Devreese, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-88459-4.00009-2 · Cited by 3
East in the West: Europeans rethinking RRI with the help of Daoist Philosophy
Blanchard, A., & Strand, R. (2024) · Journal of Responsible Innovation · doi:10.1080/23299460.2024.2425106 · Cited by 2
Activity recognition in scientific experimentation using multimodal visual encoding
Gabrieli, G., Morales, I., Christofidellis, D., Graziani, M., Giovannini, A. A., Zipoli, F., Thakkar, A., Foncubierta–Rodríguez, A., Manica, M., & Ruch, P. (2024) · Digital Discovery · doi:10.1039/d4dd00287c · Cited by 7
The Reproducibility Crisis and Kinesiology: Confronting the Human & Statistical Limitations
Twietmeyer, G. (2025) · International Journal of Kinesiology in Higher Education · doi:10.1080/24711616.2025.2468469 · Cited by 2
Dombrowski, S. C. (2025) · Journal of School Psychology · doi:10.1016/j.jsp.2025.101462 · Cited by 2
ISO/GxP Industrial Facilities with In-House Biobanks to Pursue Accreditation for ISO 20387
Simeon‐Dubach, D., Glueck, L. M., Kalra, P. S., Benaouag, S., & Ansari, S. (2025) · Biopreservation and Biobanking · doi:10.1089/bio.2024.0149 · Cited by 3
Teaching experimental design: outputs from the FELASA Working Group
Fry, D., Berdoy, M., Forni, M., Sorzano, C. Ó. S., Steckler, T., & Franco, N. H. (2025) · Laboratory Animals · doi:10.1177/00236772241295308 · Cited by 2
Fragile methods, fractured trust: rethinking scientific responsibility
Bustin, S. A., & Wittwer, C. T. (2025) · Methods · doi:10.1016/j.ymeth.2025.07.003 · Cited by 3
Is time of the essence? A temporal meta-synthesis of seven media effects theories
Walter, N., Dobmeier, C. M., Rains, S. A., Feeley, T. H., & Noar, S. M. (2025) · Journal of Communication · doi:10.1093/joc/jqaf032 · Cited by 3
Lin, C., Sniezek, C. M., McGann, C. D., Karki, R., Giglio, R. M., Garcia, B. A., McFaline‐Figueroa, J. L., & Schweppe, D. K. (2026) · Communications Biology · doi:10.1038/s42003-025-09455-0 · Cited by 3
“We did this in the context of a genetically diverse panel of lung cancer cell lines with KRAS, EGFR, TP53, CDKN1A, STK11 mutations and integrated proteomic, phosphoproteomic, and transcriptomics to explore drivers of the heterogeneous HDACi responses in these cells.”
The epistemic responsibilities in medicine of beneficence and respect for patient autonomy
Schwab, A. P. (2017) · Ethics Medicine and Public Health · doi:10.1016/j.jemep.2017.04.015 · Cited by 2
Replicability, Reproducibility, and Agent-based Simulation of Interventions.
Hum, R. S., & Kleinberg, S. (2017) · PubMed · Cited by 5
Learning from Principles of Evidence-Based Medicine to Optimize Nonclinical Research Practices
Lefevre, I. A., & Balice‐Gordon, R. J. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_276 · Cited by 4
Kamran, S. C., Palma, D. A., Katz, M. S., & Zietman, A. L. (2021) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2021.03.005 · Cited by 2
The Financial Component of the Scientific Publication’s Value Original article
Kasatkin, P. I., Kovalchuk, J. A., & Stepnov, I. (2022) · Высшее образование в России · doi:10.31992/0869-3617-2022-31-12-85-102 · Cited by 2
Bridging consensus and controversy in fear conditioning research via meta-analysis
Garofalo, S. (2023) · Peer community in neuroscience. · doi:10.24072/pci.neuro.100144 · Cited by 1
Measurement in Biological Systems from the Self-organisation Point of View
Štys, D., Urban, J., Rychtáriková, R., Zhyrova, A., & Císař, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16480-9_43 · Cited by 2
“Measurement in biological systems became a subject of concern as a consequence of numerous reports on limited reproducibility of experimental results [1,2].”
BackgroundChoudhury, K. R., Keir, S. T., Ashcraft, K. A., Boss, M., & Dewhirst, M. W. (2015) · Oncotarget · doi:10.18632/oncotarget.4141 · Cited by 2
“Results from TGD studies often lack reproducibility [1].”
Backgroundvan der Sligte, N. E., Kampen, K. R., & de Bont, E. S. J. M. (2015) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-015-2019-7 · Cited by 2
“Extrapolation of this proposed in vitro model to an in vivo model increases the translational feasibility of the preclinical treatment screening, which is highly desirable since only 5 % of the identified putative anticancer compounds present sufficient clinical activity in phase III trials [49, 50].”
BackgroundNoorden, R. V. (2013) · Nature · doi:10.1038/497300a · Cited by 2
Chico, L. K., & Watterson, D. M. (2012) · Expert Opinion on Drug Discovery · doi:10.1517/17460441.2012.733692 · Cited by 2
Being a Scientist today: are you still having fun?
Anastasia, L. (2012) · Drug Discovery Today · doi:10.1016/j.drudis.2012.10.001 · Cited by 2
Open Access (OA) and the Heritage of Research Reproducibility
Zhang, Y. (2013) · Journal of Aging Science · doi:10.4172/2329-8847.1000e104 · Cited by 2
“This is compatible with new concepts, such as article of built-up from modules, or the initial hypothesis publication, being followed-up with experiments as updated, as well as tolerance of publishing “imperfect” story with gaps [3].”
MethodWalsh, G. M., & Devine, D. V. (2014) · ISBT Science Series · doi:10.1111/voxs.12076 · Cited by 2
Rockman, H. A. (2014) · Journal of Clinical Investigation · doi:10.1172/jci75011 · Cited by 2
Gold, A. K. (2013) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14505001088 · Cited by 2
“(Begley and Ellis, 2012) Constructivists suggest that no matter how well it has been documented, data will always remain an incomplete representation of decisions and choices.”
Birabaharan, J., & Ascoli, C. A. (2015) · Genetic Engineering & Biotechnology News · doi:10.1089/gen.35.14.03 · Cited by 2
Supporting More Reliable Results
Webb, S. (2015) · BioTechniques · doi:10.2144/000114314 · Cited by 3
On the road from WEIRD to STEM, psychology hits a bump.
Suedfeld, P. (2016) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000044 · Cited by 2
Interrogating the Cancer Genome to Deliver More Precise Cancer Care
Mateo, J., & Bono, J. S. D. (2016) · American Society of Clinical Oncology Educational Book · doi:10.14694/edbk_156908 · Cited by 2
From Mice to Men: Translation from Bench to Bedside
Martić-Kehl, M. I., & Schubiger, P. A. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118865064.ch13 · Cited by 2
Osterath, B. (2016) · Nachrichten aus der Chemie · doi:10.1002/nadc.20164055129 · Cited by 2
The Radiation Stress Response: Of the People, By the People and For the People
Coleman, C. N. (2017) · Radiation Research · doi:10.1667/rr0cnc.1 · Cited by 2
“The issue of the lack of reproducibility and predictability of preclinical data for clinical trials had not yet arisen (35) but has since been a focus of much attention.”
Assessing the utility of an institutional publications officer: a pilot assessment
Cobey, K. D., Galipeau, J., Shamseer, L., & Moher, D. (2017) · PeerJ · doi:10.7717/peerj.3294 · Cited by 2
“The irreproducibility of research has been highlighted as a central concern (Baker, 2016; Begley & Ioannidis, 2015; Begley & Ellis, 2012; Buck, 2015; Collins & Tabak, 2012; Freedman, Cockburn, & Simcoe, 2015).”
BackgroundLou, E. (2018) · Annals of Translational Medicine · doi:10.21037/atm.2018.03.04 · Cited by 2
Haring, R., & Bell, R. J. (2018) · Climacteric · doi:10.1080/13697137.2018.1476968 · Cited by 3
“Thus, we feel that the most effective approaches to addressing the issue of bias and lack of reproducibility will include a combination of both (1) technical solutions enabling Open Science, and (2) initiatives promoting continuing education in research methods, independent oversight and robust research governance.”
BackgroundImproving the ACGIH threshold limit value (TLV) process
Smith, C. J., & Perfetti, T. A. (2018) · Toxicology Research and Application · doi:10.1177/2397847318801758 · Cited by 3
Cancer research: quo vadis—to war?
Wheatley, D. N. (2014) · ecancermedicalscience · doi:10.3332/ecancer.2014.ed45 · Cited by 2
Impact of Inadequate Methods and Data Analysis on Reproducibility
Elliott, S. (2019) · Journal of Pharmaceutical Sciences · doi:10.1016/j.xphs.2019.07.003 · Cited by 3
Reproducible Findings in Systematic Reviews and Meta-analyses in Oncology
Unger, J. M. (2019) · JAMA Oncology · doi:10.1001/jamaoncol.2019.2664 · Cited by 2
Preclinical Strategies for Testing of Targeted Radiosensitizers
Lin, S. H., Ye, R., & Wang, Y. (2020) · Cancer drug discovery and develogment/Cancer drug discovery and development · doi:10.1007/978-3-030-49701-9_5 · Cited by 3
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.