Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,401–2,500 of 2,889
A Continuum of Reproducible Research in Drug Development
Folkers, G., & Baier, S. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118865064.ch14 · Cited by 1
Engel, F., Walsh, P., Görzig, H., Brocks, H., Heutelbeck, D., Kelly, B., Fuchs, M., & Hemmje, M. (2016) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-319-32703-7_152
The Healthcare Ecosystem and Biomedical Research Funding
Hehenberger, M. (2015) · Nanomedicine · doi:10.1201/b18615-11
WRESTLING WITH REPRODUCIBILITY IN RESEARCH
Dove, P. M. (2014)
Maiväli, Ü. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-418689-7.00005-3
Novel Targets and Their Assessment for Cancer Treatment
Ranganath, S. H., & Nguyen, A. (2016) · Springer eBooks · doi:10.1007/978-3-319-29827-6_7
Question of Data Manipulation in Failure to Replicate Findings in Published Manuscript
Snyder, P. J., Mayes, L. C., & Smith, W. E. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-405198-0.00003-5
Why don't things happen the same way every time?
Sellke, F. W. (2016) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2016.09.010
[Value of fluorescein angiography in control of retinal thermal damage due to diode laser].
Desmettre, T. J., Devoisselle, J., Bégu, S., & Mordon, S. R. (1999) · PubMed
Unsupervised alignment of natural language with video
Naim, I., & Gildea, D. J. (n.d.) · UR Research (University of Rochester) · Cited by 1
Multiobjective Optimization of Biological and Physical Properties in Drug Discovery
Gleeson, M. P., & Montanari, D. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-409547-2.12315-7 · Cited by 1
77. Mouse models: some reflections from the lab
Blanchard, A. (2016) · Congress of the European Society for Agricultural and Food Ethics (EurSafe) · doi:10.3920/978-90-8686-834-6_77
Reproducibility and research misconduct: time for radical reform
Gandevia, S. C. (2016) · Internal Medicine Journal · doi:10.1111/imj.13206
Research Antibody Reproducibility
Polakiewicz, R. D. (2016) · Genetic Engineering & Biotechnology News · doi:10.1089/gen.36.16.03
Messin, L. J., & Meadows, J. C. (2016) · Exchanges The Interdisciplinary Research Journal · doi:10.31273/eirj.v4i1.153
“This has led to what is termed the reproducibility crisis, affecting both basic and clinical research — a 2012 review found that only six out of 53 clinical oncology papers were reproducible (Begley and Ellis, 2012).”
BackgroundExperimental study of segregation mechanisms in bedload sediment transport
Dudill, A. (2016) · cIRcle (University of British Columbia) · doi:10.14288/1.0319162
Ramsden, J. J. (2013) · Journal of Biological Physics and Chemistry · doi:10.4024/15ra13e.jbpc.13.04
Boling, C. S. (2016) · Michigan State University Libraries · doi:10.25335/m5vb08
Why Pharma Should Care About the Valley of Death
Dessain, S. K., & Fishman, S. E. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-809216-3.00006-3
Yin, J., & Shen, S. (2016) · Journal of Biometrics & Biostatistics · doi:10.4172/2155-6180.1000324
“Different from the cytotoxic agents that are often administrated in limited number of treatment cycles, MTA and immunotherapy administrations are often prolonged for many treatment cycles until disease progression [2].”
BackgroundIN THREE-DIMENSIONAL BIOMATERIAL HYDROGELS
Malinen, M. M. (2014)
Scientific Scholarly Communication: Moving Forward Through Open Discussions
Silva, P. U. K. D., & Vance, C. K. (2017) · Fascinating life sciences · doi:10.1007/978-3-319-50627-2_1
Significance: Statistical Versus Clinical
Bartolo, C. A. D., & Braun, M. K. (2017) · Springer eBooks · doi:10.1007/978-3-319-49547-7_4 · Cited by 1
Miller, S. M., Moos, W. H., Munk, B. H., & Munk, S. A. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100625-2.00001-5
The Cellular and Molecular Axis of Muscle Regeneration
Ieronimakis, N. M. (2014) · ResearchWorks at the University of Washington (University of Washington)
Validation—The Key to Translatable Cytometry in the 21st Century
Litwin, V., Green, C., & Vitaliti, A. (2017) · Series in bioengineering · doi:10.1007/978-981-10-4499-1_6
Morrison, J. S., & Hageman, M. J. (2017) · AAPS advances in the pharmaceutical sciences series · doi:10.1007/978-3-319-50042-3_14
Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E. C., et al. (2016) · Kölner Universitäts PublikationsServer (Universität zu Köln)
Agostinelli, C., Sabattini, E., Pileri, S. A., et al. (2017) · Human Pathology · doi:10.1016/j.humpath.2017.02.029
Casadevall, A., & Fang, F. C. (2014)
SIQINS : strengthening quality improvement intervention reporting in Surgery
Jones, E. L. (2017) · Figshare
Influencing consumer resistance through priming: the role of mindsets and motivational orientation
Harman, B. (2016) · Arrow@dit (Dublin Institute of Technology)
19 The Conundrum of Dosimetry: Its Applications to Pharmacology and Biophysics Are Distinct
Miller, W. (2017) · CRC Press eBooks · doi:10.1201/9781315154572-19
Smith, R. W. (2012) · eLife · doi:10.7554/elife.00351
“For example, a paper published in Nature earlier this caused much consternation by showing that of 53 early laboratory studies of promising targets for treating cancer, only six could be replicated (Begley and Ellis, 2012).”
Kwon, M.-S., Nam, S., Lee, S., Ahn, Y. Z., Chang, H. R., Kim, Y. H., & Park, T. (2017) · Oncotarget · doi:10.18632/oncotarget.19270
Book Review: Handbook of Ethics in Quantitative Methodology
O’Neill, P. (2012) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2012.7.4.87
The Economics of Reproducibility in
Freedman, L. P., Cockburn, I., & Simcoe, T. S. (2015)
Doos, L., Packer, C., Ward, D. J., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016206
Cvek, B. (2017) · Health Affairs · doi:10.1377/hlthaff.2017.0803
Lushington, G. H., & Chaguturu, R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-801814-9.00016-7
Cyclin E1 as a therapeutic target in high grade serous ovarian cancer
Au‐Yeung, G. (2017) · Minerva Access (University of Melbourne)
Buie, M. (2017) · Productivity Press eBooks · doi:10.1201/b21939-1
Cohen, N. D. (2017) · doi:10.1002/9781119063254.ch18
Sample Size Calculation for Differential Expression Analysis of RNA-Seq Data
Hoskins, S. P., Shyr, D., & Shyr, Y. (2017) · Springer eBooks · doi:10.1007/978-981-10-0126-0_22
Therapeutic targets in sickle cell disease
Sins, J. W. R. (2017) · Data Archiving and Networked Services (DANS)
Grenzen von Krankenhausrankings als Leistungsvergleiche
Dorn, C. (2017) · Springer eBooks · doi:10.1007/978-3-658-17916-8_9
Managing Project Selection Through Contract DesignPreprint
Bao, Y., Shi, M., & Kalra, A. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3077351
Expectation to academia from the industrial point of view: To bridge the Death Valley
Kikuchi, H. (2017) · Drug Delivery System · doi:10.2745/dds.32.297
Le rôle des modèles murins en immuno-oncologie
Soares, D. G., & Lotz, J. (2017) · ONCOLOGIE · doi:10.1007/s10269-017-2731-z
Preprint of Too good to be false: Nonsignificant results revisitedPreprint
Hartgerink, C. H. J., Wicherts, J. M., & van Assen, M. A. L. M. (2016) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/rkumy · Cited by 1
A survey on information sources used by academic researchers to evaluate scientific instrumentsPreprint
Bergenholtz, C., MacAulay, S. C., Kolympiris, C., & Seim, I. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/253799
Exceedance probability for parameter estimatesPreprint
Segal, B. D. (2018) · arXiv (Cornell University)
Folgueras-Flatschart, Á. V., Gomes, B. C., Leve, F., & Boldrini, L. D. C. (2018) · Vigilância Sanitária em Debate · doi:10.22239/2317-269x.01083 · Cited by 2
Four proposals for a more reliable scientific literature
Bosch, J. (2018) · South African Journal of Science · doi:10.17159/sajs.2018/a0257
Antibody-based bead arrays for high-throughput protein profiling in human plasma and serum
Drobin, K. (2018) · DiVA (Digitala Vetenskapliga Arkivet)
Lerman, D. M. (2018) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000000356
Cutaneous biometrics: guidelines and models
Li, B. S., Cary, J. H., & Maïbach, H. I. (2018) · British Journal of Dermatology · doi:10.1111/bjd.16526
Practical statistical considerations for investigating anti-tumor treatments in mice
Gold, D. L., Lang, L., & Zerba, K. E. (2018) · Journal of Applied Statistics · doi:10.1080/02664763.2018.1477925
Pluralisms, Perspectives, and Potential Problems
Hvidtfeldt, R. (2018) · Springer eBooks · doi:10.1007/978-3-319-90872-4_6
Basic Statistics and Clinical Studies in Radiation Oncology
Pilz, L. R. (2018) · Springer eBooks · doi:10.1007/978-3-319-52619-5_57-1
Three Dimensional Prostate Cancer Model Systems
Mosaad, E. M. O. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.118287
Future of Regulatory Safety Assessments
Bode, G., & Starck-Lantova, P. (2018) · Springer eBooks · doi:10.1007/978-3-319-56637-5_71-1
Seneci, P. (2018) · Elsevier eBooks · doi:10.1016/b978-0-08-099420-8.00002-x
Presenting and sharing clinical data using the eTRIKS Standards Master Tree for tranSMART
Barbosa-Silva, A., Bratfalean, D., Gu, W., et al. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty809
Expediting the Flow of Knowledge Versus Rushing into PrintPreprint
Heesen, R. (2018) · PhilSci-Archive (University of Pittsburgh)
Hollmann, S., Regierer, B., D’Elia, D., Gruden, K., Baebler, Š., Frohme, M., Pfeil, J., Sezerman, O. U., Evelo, C. T., Ehrhart, F., et al. (2018) · EasyChair preprint · doi:10.29007/4xkd
Am I Luckier Than You? Individual Differences in Precognition Performance
Zdrenka, M. (2018) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.19314362 · Cited by 1
Perspectives for Characterizing Drug Component of Theranostic Products Containing Nanomaterials
Sayes, C. M., & Hickey, A. J. (2018) · Bioanalysis · doi:10.1007/978-3-030-01775-0_13
Hall, L., & Hendricks, A. E. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/500660 · Cited by 1
“Increasing concern about the lack of reproducibility and replicability of published research (1-8) has led to numerous guidelines and recommendations including the formation of the National Academies of Sciences, Engineering, and Medicine committee (9) on Reproducibility and Replicability in Science (10-13).”
BackgroundMethodResultInfluentialDepth First Learning: Learning to Understand Machine Learning
Oliver, A., Bhupatiraji, S., Resnick, C., et al. (2018)
Mannstadt, M., & Wein, M. N. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804182-6.00006-x
Catching Up to Corporate: A Shift towards Academic Data Governance
Clark, J., Hurley, L., & Ogier, A. (2014) · VTechWorks (Virginia Tech)
A Framework To Evaluate Pipeline Reproducibility Across Operating Systems
Scaria, L. (2018) · Spectrum Research Repository (Concordia University) · Cited by 1
The Illusion of Success and the Nature of RewardPreprint
Sornette, D., & Cauwels, P. P. (2019) · arXiv (Cornell University)
The Brazilian Reproducibility Initiative: a systematic assessment of Brazilian biomedical sciencePreprint
Amaral, O. B., Neves, K., Wasilewska‐Sampaio, A. P., & Carneiro, C. F. D. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ahf7t
“…in a direct replication (Goodman et al., 2016) – in specific areas of research were initially raised by theoretical models (Ioannidis, 2005a), systematic reviews of the existing literature (Ioannidis, 2005b) and alarm calls by the pharmaceutical industry (Begley & Ellis, 2012; Prinz et al., 2011).”
BackgroundVirDB: Crowdsourced Database for Evaluation of Dynamical Viral Infection Models
Wąsik, S., Jaroszewski, M., Nowaczyk, M., Szóstak, N., Prejzendanc, T., & Błażewicz, J. (2019) · Current Bioinformatics · doi:10.2174/1574893614666190308155904
Companion Diagnostics Assay Development—Prototype, Verification, and Analytical Validation
Ellison, A. R., & Stanforth, D. A. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813539-6.00012-2 · Cited by 1
Tyurenkov, I. N., Волотова, Е. В., Куркин, Д. В., & Bakulin, D. A. (2019) · Reviews on Clinical Pharmacology and Drug Therapy · doi:10.17816/rcf17157-64
“Систематические ошибки [22], пренебрежение принципами клинических исследований при проведении доклинических [23, 26], методологические и интерпретационные проблемы при использовании генно-модифицированных животных [17, 29], пренебрежение влиянием фенотипической пластичности и факторами внешней среды на результаты эксп…”
Deep Impact: Unintended consequences of journal rank
Brembs, B., Button, K. S., & Munafo, M. R. (2013) · University of Regensburg Publication Server (University of Regensburg) · doi:10.48550/arxiv.1301.3748
“Three recent studies reported attempts to replicate published findings in preclinical medicine [69–71].”
ResultMeasurement in biological systems from the self-organisation point of viewPreprint
Štys, D., Urban, J., Rychtáriková, R., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02419
“Measurement in biological systems became a subject of concern as a consequence of numerous reports on limited reproducibility of experimental results [1,2].”
BackgroundIs the replication crisis a problem for biologists? A geometric morphometric approachPreprint
Vrdoljak, J., Sánchez, K. I., Arreola-Ramos, R., Huesa, E. G. D., Villagra, A., Ávila, L. J., & Morando, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/862052
Netskar, H. (2019) · NORA - Norwegian Open Research Archives
Status and Challenges of Reproducibility in Computational Systems and Synthetic Biology
Choi, K., Karr, J. R., & Sauro, H. M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-801238-3.11525-9 · Cited by 1
Notes on the Fringes of the Replication Crisis in Management Science
Hensel, P. G. (2019) · Problemy Zarządzania - Management Issues · doi:10.7172/1644-9584.84.4
Does the blue bird get the flu? using Twitter for flu surveillance
Grüninger, S. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-152442
Chemical Strategies for Evaluating New Drug Targets
Carter, A. J., Seupel, R., Brennan, P. E., Sundström, M., Introini, A., & Mueller‐Fahrnow, A. (2019) · Methods and principles in medicinal chemistry · doi:10.1002/9783527818242.ch1
The evolution of social dominance in house sparrows
Sánchez‐Tójar, A. (2018) · KOPS (University of Konstanz) · Cited by 1
Spatial characterization of the BT-20 triple negative breast cancer spheroidal model
Ncube, K. N. (2019) · UpSpace Institutional Repository (University of Pretoria) · Cited by 1
A Glimpse at the Future of Animal-Assisted Interventions
Turner, D. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-801292-5.00028-6 · Cited by 1
A Pathologist's View of Drug and Biomarker Development
Dunstan, R. W. (2020) · Wiley eBooks · doi:10.1002/9781119187547.ch12
Enhancing Cancer Immunotherapies Using Cell-Based or Viral Vectored Vaccines
Mould, R. C. (2020) · The Atrium (University of Guelph)
Workshop on reproducibility in research
KALICHMAN, M. W., & Mills, P. J. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.496
“The goal was to produce a program with the following features: (1) highly interactive; (2) pre- and post-testings to monitor impact; (3) independent of the particular area of research for the participants; (4) emphasis on the many different ways in which diverse stakeholders could easily improve the reproducibility of…”
BackgroundJudging Research: How Should Research and Researchers Be Evaluated and Rewarded?
Bihorac, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-8
Achievement of the Paper and Its Honor for a Researcher
Lin, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-13
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.