Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,701–2,800 of 2,889
Drug Design Models for Human Diseases by Transgenic Animals
Banerjee, S., Banerjee, S., Bose, S., Das, A., Banerjee, S., & Gyawali, R. (2024) · Interdisciplinary biotechnological advances · doi:10.1007/978-981-97-1148-2_10
Kelter, R. (2024) · Statistics in Biosciences · doi:10.1007/s12561-024-09425-w
“The replication crisis in medical research has been discussed in an abundance of scientific publications [14–16] and isolated the reliance of traditional frequentist hypothesis tests on p -values and the concept of statistical significance as one problem contributing to the issue.”
Matsumoto, K., Harada, S. Y., Yoshida, S. Y., Narumi, R., Mitani, T. T., Yada, S., Sato, A., Morii, E., Shimizu, Y., & Ueda, H. R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.06.13.598778
Researcher Discretion: Navigating ambiguity and uncertainty in research practicePreprint
van Drimmelen, T., Slagboom, M. N., Bouter, L. M., Reis, R., & van der Steen, J. T. (2024) · doi:10.31222/osf.io/2vah6
Human organs-on-a-chip for cancer modeling
Hegde, M., Girisa, S., & Harsha, C. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13782-2.00005-x
Enhancing reproducibility and decentralization in single cell research with biocytometryPreprint
Fikar, P., Alvarez, L., Berne, L., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.07.01.601489
Chang, S., & Kang, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4885005
Iorio, E., Khanteymoori, A., Fond, K. A., Keller, A., Davis, L. M., Schwab, J. M., Ferguson, A. R., Espin, A. T., & Watzlawick, R. (2024) · Neurotrauma Reports · doi:10.1089/neur.2024.0038
“Prior reports suggest that most pre-clinical therapies reported in high-impact journals cannot be independently replicated, 41 leading to the perception that pre-clinical literature lacks standardization and relies on underpowered studies with questionable evidentiary basis.”
Carrier, M. (2024) · De Gruyter eBooks · doi:10.1515/9783110788341-011
Advancements in intelligent drug delivery systems and their clinical applications
Hamzy, I. A., Alqhoson, A. I., Aljarbou, A. M., & Alhajri, M. A. (2017) · International Journal of Health Sciences · doi:10.53730/ijhs.v1ns1.15092 · Cited by 3
Zhuang, H., & Acuna, D. E. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00332
Meta-Research: Assessing the Alignment of Biomedical Research and Clinical TranslationPreprint
Sun, M., Stoeger, T., & Amaral, L. A. N. (2024) · medRxiv · doi:10.1101/2024.10.07.24314705
Agudogo, S., Moody, R., Whelan, A., Wagner, S., Berghella, V., Chauhan, S. P., Ramos, S. Z., & Gupta, M. (2024) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2024.10.024
Transaction Costs Economics and Good Scientific Practice
Lipski, J. G. (2024) · Journal for General Philosophy of Science · doi:10.1007/s10838-024-09683-8
Bode, G., Starck-Lantova, P., & Kramer, P.-J. (2024) · Springer eBooks · doi:10.1007/978-3-031-35529-5_142
Arrighi, N., & Hofman, P. M. (2024) · Wiley eBooks · doi:10.1002/9781394332731.refs
Hassan, M. S., Nasrin, T., Vishwakarma, A., Hoque, M., & Ali, S. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-22326-6.00001-8
Strategic policy options to improve quality and productivity of biomedical research
Balas, E. A., Leo, G. D., & Shaw, K. B. (2024) · Politics and the Life Sciences · doi:10.1017/pls.2024.10
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch3
Yıldırım, A. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83662-080-820241011
10.1016/b978-3-437-21073-0.00047-7
(2000) · Time to knit · doi:10.1016/b978-3-437-21073-0.00047-7
Mitä toistettavuuskriisistä pitäisi ajatella? Kymmenen suomalaistutkijaa sähköpostihaastattelussa
Heino, M., Ilmarinen, V., Leikas, S., Lipsanen, J. O., Lönnqvist, J., Olkkonen, M., Palosaari, E. J., Renvik, T. A., Saurio, K. J., & Silfver-Kuhalampi, M. (2025) · Psykologia · doi:10.62443/psykologia.v54i6.143375 · Cited by 1
Measuring the quality of experimental research
Ventura, R. (2025) · Synthese · doi:10.1007/s11229-024-04905-4
“In the related field of pre-clinical cancer research, Begley and Ellis (2012) report an even lower replication rate: out of 53 attempts to replicate landmark papers, only 11% were successful.”
Meijer, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5120272
Teixeira, A. F., Pires, B. R. B., Panis, C., Monte‐Alto‐Costa, A., da Fonseca, A. D. S., & Mencalha, A. L. (2025) · Journal of Biochemical and Molecular Toxicology · doi:10.1002/jbt.70192
“However, this process is financially costly and time ‐ consuming, highlighting the benefit of drug repurposing [25, 26].”
Schmaling, K. B., & Kaplan, R. M. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009391733.006
Multiobjective optimization of biological and physical properties in drug discovery
Gleeson, M. P., & Montanari, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-29808-0.00014-5
Ten Strategies for Critical Thinking
Roediger, H. L., III, & Horne, S. N. (2025) · Springer eBooks · doi:10.1007/978-3-031-82644-3_11
Moving forward: challenges and directions for psychopathological network theory and methodologyPreprint
Fried, E. I., & Cramer, A. O. J. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mh3cf_v1
How clinically relevant and inclusive are prostate cell lines?Preprint
Ahmed, Z., Mosabbir, W., Tandon, D., Pereira, S. M. P., Cheema, U., Loizidou, M., Withington, J., Moore, C. M., Okoli, U. A., & Heavey, S. (2025) · Research Square · doi:10.21203/rs.3.rs-6355469/v1
Incorporating Quantitative Literacy into a T32 Retreat: Lessons and Considerations from Experience
Hall, A. A., & McGrath, J. R. (2025) · eNeuro · doi:10.1523/eneuro.0027-25.2025
“Emblematic of these ongoing issues, many studies have shown that >50% of biomedical science papers fail to replicate (Begley and Ellis, 2012; Baker, 2016a; Korbmacher et al., 2023), with the expected cost to taxpayers being as high as 28-billion dollars per year (Freedman et al., 2015).”
The Epistemic Aims of the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0003
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0002
Philosophy of the Humanities: What and Why?
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0001
Authority and Deference in the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0004
The Future of the Philosophy of the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0010
Perspectives, Social Constructions, Standpoints, and Truth in the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0006
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0008
Method and Interpretation in the Humanities
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0005
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0009
The Humanities and Political Aims
Grimm, S. R., Peels, R., & van Woudenberg, R. (2025) · Oxford University Press eBooks · doi:10.1093/9780197749647.003.0007
Operational Excellence - AI as Third Peer ReviewerPreprint
Alavi, M. V. (2025) · doi:10.31222/osf.io/me46h_v1
Reliable Communication on Advanced Materials—The Impact of Science Communication on Society
Nau, K., Krug, H. F., Marquardt, C., et al. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-96-4459-9_6
AI and the Subjective Crisis of Knowledge
Scherz, P., & Vera, L. (2025) · Journal of Religious Ethics · doi:10.1111/jore.70001
Anikin, A. (2025) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02740-3
“…the replication crisis in both behavioral (Camerer et al., 2018; Nosek et al., 2022; Open Science Collaboration, 2015; Soto, 2019) and clinical (Begley & Ellis, 2012; Prinz et al., 2011) research, suboptimal statistical practices (Gelman & Loken, 2014; McShane et al., 2019), theory crisis in…”
Prolog: Translationale neurologische Forschung – From Bench to Bedside
Dirnagl, U. (2022) · Elsevier eBooks · doi:10.1016/b978-3-437-21884-2.00032-5
Hamilton, D. G., McKenzie, J. E., Nguyen, P., Rethlefsen, M. L., McDonald, S. J., Brennan, S., Fidler, F. M., Higgins, J. P. T., Kanukula, R., Karunananthan, S., et al. (2025) · medRxiv · doi:10.1101/2025.07.17.25331623
Baxter, A. G., Morley, N., Cleary, W. H., Harrington, K. L., Zuurlink, J. Z., Trujillo, J. J., Tremaine, G., & Leighton, L. R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5391128
Kumar, P., Pradhan, V., Panwar, V., & Bandyopadhyay, A. (2025) · De Gruyter eBooks · doi:10.1515/9783111504667-004
Les scientifiques doivent aborder différemment la recherche sur les cancers au stade précoce
Nadon, R. (2023) · The Conversation · doi:10.64628/aap.fkkwjqf7t
Major study shows the need to improve how scientists approach early-stage cancer research
Nadon, R. (2022) · The Conversation · doi:10.64628/aam.h5yd6tmnw
Design, optimization, and inoculum development for culturing the cells
Mittal, H. N., Kushwaha, O. S., & Karri, R. R. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-31476-6.00016-6
Yüksel, A. (2025) · CABI eBooks · doi:10.1079/9781800628076.0001
The Erosion of Research Integrity: Crises, Pseudoscience, and the Illusion of Progress
Yüksel, A. (2025) · CABI eBooks · doi:10.1079/9781800628076.0003
Survey-Based Insights into the Replication Crisis and the 3R in Software Engineering
de Azevedo, I. M., Vasconcelos, A. P., Teixeira, E., & Soares, S. (2025) · Simpósio Brasileiro de Engenharia de Software (SBES) · doi:10.5753/sbes.2025.9967
Ertürk, R. A., Emül, A. A., Darendeli-Kiraz, B. N., Sarı, F. Z., Ergün, M. A., & Baysan, M. S. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013552
“Many studies show that reproducibility rates are particularly low in certain fields [2,3] such as social, behavioral [4–7], and life sciences [8– 11].”
Deng, S., Xiong, F., Jie, F., Gao, Q., Wang, J., & Li, S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-30142-1.00011-0
Publishing gold standard science
McNally, E. M., Jackson, S. M., Williams, C. L., & Eickelberg, O. (2025) · Journal of Clinical Investigation · doi:10.1172/jci201281
“A 2012 commentary by Begley and Ellis on the quality of published preclinical data drew wide attention to the problem of irreproducibility in cancer research (3).”
Lobanov, V. A., Rossomakhina, N., Kazakova, E., Zherdeva, V. V., & Makarov, V. (2025) · Chemical Biology & Drug Design · doi:10.1111/cbdd.70195
“…animal testing demonstrates substantial interspecies differences in pharmaco-kinetics, metabolism, and signaling pathways compared to humans, leading to low translational relevance and a high attrition rate of candidate compounds during clinical trials (Begley and Ellis 2012; Mak et al. 2014).”
Kaplan, D. (2025) · Springer eBooks · doi:10.1007/978-3-032-08228-2_7
Yarmush, M. L. (2025) · Innovation and Emerging Technologies · doi:10.1142/s2737599425300107
Academic Drift and The Development of Pathways for Curriculum
(2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64113-695-220251011
Pogrow, S. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64113-695-220251015
Antes, A. L. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-68123-133-420251010
Hofer, A. M., Tobler, L., Ruepp, M., & Mühlemann, O. (2025) · Scientific Reports · doi:10.1038/s41598-025-26703-9 · Cited by 1
“While most cancer-related publica9ons on PGRN report an effect of PGRN, studies observing no effect are more likely not to have been published, which overall generates a skewed picture of PGRN’s involvement in cancer 24 .”
The Use of Artificial Intelligence (AI) Technologies in Biomedicine
Udriștoiu, Ș., & Udriștoiu, Ș. (2025) · Applied Sciences · doi:10.3390/app152312604
Preregistration in Animal Experimentation – A Qualitative Study on Researchers’ Views in SwitzerlandPreprint
Priboi, C., Lalor, S., Sarra, G., Vergauwe, E., Elger, B. S., & Würbel, H. (2025) · Research Square · doi:10.21203/rs.3.rs-8194213/v1
(2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15428-7.16001-5
From Tissue to Mutations : Genetic Profiling of Colorectal Cancer
Mathot, L. (2014) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Schmaling, K. B., & Kaplan, R. M. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009391733.009
Molecular Regulators of Stem Cell Fate and Tumor Development in the Cerebellum
Brun, S. N. (2014) · DukeSpace (Duke University)
Additional file 1 of The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12650470
Lu, Y., Zhang, W., Tian, Z., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20882134
Mandal, R. K., Denny, J. E., Waide, M. L., Li, Q., Bhutiani, N., Anderson, C. D., Baby, B. V., Jala, V. R., Egilmez, N. K., & Schmidt, N. W. (2020) · Figshare · doi:10.6084/m9.figshare.12610025
Cui, W., Xue, H., Wei, L., Jin, J., Tian, X., & Wang, Q. (2021) · Figshare · doi:10.6084/m9.figshare.13663221
Sorjonen, K., Nilsonne, G., Melin, B., & Ingre, M. (2021) · Figshare · doi:10.6084/m9.figshare.14385325
Additional file 2 of Clinical trial design in the era of precision medicine
Fountzilas, E., Tsimberidou, A. M., Vo, H. H., & Kurzrock, R. (2022) · Figshare · doi:10.6084/m9.figshare.20762891
Mandal, R. K., Denny, J. E., Waide, M. L., Li, Q., Bhutiani, N., Anderson, C. D., Baby, B. V., Jala, V. R., Egilmez, N. K., & Schmidt, N. W. (2020) · Figshare · doi:10.6084/m9.figshare.12610019
Smith, A., Lambert, P. C., & Rutherford, M. J. (2022) · Figshare · doi:10.6084/m9.figshare.20154308
Additional file 4 of The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12650479
Cui, W., Xue, H., Wei, L., Jin, J., Tian, X., & Wang, Q. (2021) · Figshare · doi:10.6084/m9.figshare.13663233
Additional file 1 of Clinical trial design in the era of precision medicine
Fountzilas, E., Tsimberidou, A. M., Vo, H. H., & Kurzrock, R. (2022) · Figshare · doi:10.6084/m9.figshare.20762888
Cui, W., Xue, H., Wei, L., Jin, J., Tian, X., & Wang, Q. (2021) · Figshare · doi:10.6084/m9.figshare.13663236
Smith, A., Lambert, P. C., & Rutherford, M. J. (2022) · Figshare · doi:10.6084/m9.figshare.20154311
Sorjonen, K., Nilsonne, G., Melin, B., & Ingre, M. (2021) · Figshare · doi:10.6084/m9.figshare.14385322
Hamilton, D. G., Page, M. J., Finch, S., Everitt, S., & Fidler, F. (2022) · Figshare · doi:10.6084/m9.figshare.21532680
Sorjonen, K., Nilsonne, G., Melin, B., & Ingre, M. (2021) · Figshare · doi:10.6084/m9.figshare.14385319
Holst, M. R., Faust, A., & Strech, D. (2022) · Figshare · doi:10.6084/m9.figshare.19589373
Mandal, R. K., Denny, J. E., Waide, M. L., Li, Q., Bhutiani, N., Anderson, C. D., Baby, B. V., Jala, V. R., Egilmez, N. K., & Schmidt, N. W. (2020) · Figshare · doi:10.6084/m9.figshare.12610022
Cui, W., Xue, H., Wei, L., Jin, J., Tian, X., & Wang, Q. (2021) · Figshare · doi:10.6084/m9.figshare.13663230
Cui, W., Xue, H., Wei, L., Jin, J., Tian, X., & Wang, Q. (2021) · Figshare · doi:10.6084/m9.figshare.13663224
Additional file 2 of The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12650473
Zhao, B., Jiang, Y., Zhang, T., Shang, Z., Zhang, W., Hu, K., Chen, F., Mei, F., Gao, Q., Zhao, L., et al. (2020) · Figshare · doi:10.6084/m9.figshare.13294768
Hall, L. M., & Hendricks, A. E. (2020) · Figshare · doi:10.6084/m9.figshare.13357508
Page, M. J., Moher, D., Fidler, F. M., Higgins, J. P. T., Brennan, S. E., Haddaway, N. R., Hamilton, D. G., Kanukula, R., Karunananthan, S., Maxwell, L. J., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14442918
Scientists’ reputations are based on getting it right, not being rightPreprint
Axt, J., Nosek, B. A., & Ebersole, C. R. (2019) · OSF Preprints (OSF Preprints)
Innovation Policy in a Networked World
Sorenson, O. (n.d.) · RePEc: Research Papers in Economics
Treacy, M., Juchem, C., & Landheer, K. (2025) · Scientific Reports · doi:10.1038/s41598-025-32710-7
Primer on Reproducibility: Trends, Tools, and Some Tips and Tricks
Pejdo, D., Ursić, L., & Marušić, A. (2025) · Current Protocols · doi:10.1002/cpz1.70299
“Awareness of this crisis was raised by failures to reproduce studies in preclinical cancer research (Begley & Ellis, 2012) and psychology (Open Science Collaboration, 2015), among other fields, as well as by a Nature survey of > 1500 scientists from different disciplines in which > 70% respondents…”
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.