Raise standards for preclinical cancer research
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index; 3 of the 9 sources its claims cite were checked for support.
Overview
CoChat Summary
TL;DR
This Nature Comment argues that many landmark preclinical oncology findings are not reproducible and calls for higher standards in methods, reporting, and incentives. It reports that Amgen confirmed only 6 of 53 landmark papers (11%) and cites Bayer’s finding that about 25% of published preclinical studies could be validated.
Key findings
- In Amgen’s ten-year retrospective analysis, scientific findings were confirmed in only 6 of 53 “landmark” preclinical cancer papers (11%); non-reproduced studies often lacked blinding, relied on single experiments such as one Western blot, or presented selected data.
- Bayer HealthCare reported that only about 25% of published preclinical studies could be validated to the point at which projects could continue; published cancer research represented 70% of the studies analysed in that report, with possible overlap with Amgen’s 53 papers.
- Citation data showed non-reproduced articles in journals with impact factor >20 had a mean of 248 citations (range 3–800) versus 231 (range 82–519) for reproduced articles; for impact factor 5–19, non-reproduced articles had a mean of 169 citations (range 6–1,909) versus 13 (range 3–24) for reproduced articles.
- The authors recommend reporting negative data, blinding preclinical experiments, validating reagents, repeating critical experiments, avoiding single cell lines or models, requiring patient-selection biomarkers, and changing academic incentives.
Methods
- This is a Nature Comment/perspective, not a primary experimental study; it synthesizes Amgen’s ten-year retrospective analysis of experiments performed prospectively and cites a Bayer HealthCare report.
- Amgen selected 53 “landmark” papers describing completely new approaches or alternative clinical uses, attempted confirmation, used additional models, contacted original authors, exchanged reagents, and repeated experiments under the authors’ direction, occasionally in the original investigator’s laboratory.
- The analysis reports counts of confirmed findings and citation metrics from Google Scholar, May 2011; the recommendations are proposed changes rather than tested interventions.
Limitations
- Stated: validation attempts may have failed because of technical differences or difficulties despite efforts to ensure otherwise; additional models were used; when findings could not be reproduced, authors were contacted and experiments were repeated under their direction.
- Stated: papers were deliberately selected as “landmark” and described something completely new, so some data might not hold up; Bayer’s analysed studies may overlap with Amgen’s 53 papers.
- Evident: as a Comment, the text provides no detailed systematic protocol, inclusion criteria, statistical methods, or full dataset; the citation analysis is descriptive and limited to two impact-factor strata.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 6 Not checked · 12 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Sadly, clinical trials in oncology have the highest failure rate compared with other therapeutic areas.”
What the sources say
- Partly supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). sourceExperimental — accuracy not yet measured
The opening passage of our copy (labelled Abstract; page unavailable) says cancer-drug attrition is much higher than in other therapeutic areas, citing 5% of anticancer agents versus 20% of cardiovascular agents reaching licensure. That comparison covers development from preclinical activity through phase III, not failure rates specifically among clinical trials; it also does not explicitly establish a highest-rate ranking. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although we in the cancer field hoped that this would lead to more effective drugs, historically, our ability to translate cancer research to clinical success has been remarkably low 1 .”
What the sources say
- Supportedcites [1] Hutchinson, L. & Kirk, R. Nature Rev. Clin. Oncol. 8, 189–190 (2011). source
The opening passage (labeled Abstract in our copy; no page given) reports that only 5% of agents with preclinical anticancer activity are licensed after demonstrating sufficient efficacy in phase III testing. It also says cancer drug attrition is much higher than in other therapeutic areas, supporting the claim of historically low translation to clinical success. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In studies for which findings could be reproduced, authors had paid close attention to controls, reagents, investigator bias and describing the complete data set.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For results that could not be reproduced, however, data were not routinely analysed by investigators blinded to the experimental versus control groups.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Investigators frequently presented the results of one experiment, such as a single Western-blot analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 22 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there are other more common sources of unreliability in the literature (41)(42)(43)(44)”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [42]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“many established scientific results in the social (49, 50) and biomedical (51-53) sciences cannot readily be replicated.”
From Misinformation in and about science (2021) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A landmark study conducted by Glenn Begley and his team in 2012 concluded that most cancer research studies were not reproducible, by alarmingly reporting that 47 of 53 published findings could not be replicated [13].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cell biology, two industrial laboratories reported success replicating the original results of landmark findings in only 11% and 25% of the attempted cases ( 10, 11 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [10]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
High drug attrition rates—where are we going wrong?
Hutchinson, L., & Kirk, R. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.34 · Cited by 517
Drug development and clinical trials—the path to an approved cancer drug
Rubin, E. H., & Gilliland, D. G. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.22 · Cited by 135
Raising the bar for cancer therapy models
Francia, G., & Kerbel, R. S. (2010) · Nature Biotechnology · doi:10.1038/nbt0610-561 · Cited by 54
Cited by
Items 2,301–2,400 of 2,889
Cohort Studies, Meta-analyses, and Clinical Trials in Childhood Hypertension
Larkins, N., & Craig, J. C. (2023) · Springer eBooks · doi:10.1007/978-3-031-06231-5_54 · Cited by 1
Biopharmaceuticals as Challenges to the Regulatory System
Ebbers, H. C. (2012) · Utrecht University Repository (Utrecht University) · Cited by 1
Hutton, J. L. (2017) · Wiley eBooks · doi:10.1002/9781118445112.stat04992.pub2 · Cited by 1
Aggregating Knockoffs for Controlling the False Discovery Rate with One-Shot CommunicationPreprint
Su, W., Qian, J., & Liu, L. (2015) · arXiv (Cornell University) · Cited by 2
Oakley, B. A., & Finelli, C. (2014) · IEEE Transactions on Education · doi:10.1109/te.2014.2313036 · Cited by 1
“Another major study found that 88% of 53 “landmark” cancer studies could not be replicated, even despite assistance from those who produced the original study [12].”
Bennett, C. L., & Bian, J. (2014) · British Journal of Cancer · doi:10.1038/bjc.2014.292 · Cited by 1
“To date, none of these worrisome preclinical research findings have been replicated by scientists employed by manufacturers of ESAs—instilling controversy into whether preclinical research studies are in fact replicable (Begley and Ellis, 2012).”
BackgroundRecent Applications of Web Semantics in eLifeScience
Clark, T., & Roos, M. (2014) · Journal of Web Semantics · doi:10.1016/j.websem.2014.11.005 · Cited by 1
“The interpretations of various researchers may be mutually contradictory, while results that seem to hold up well in a laboratory may fall apart, for instance in therapeutic development, or in human trials [9-11].”
BackgroundGood science, bad science: Questioning research practices in psychological research
Bakker, M. (2014) · UvA-DARE (University of Amsterdam) · Cited by 1
Gesing, S., Connor, T. R., & Taylor, I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.02689 · Cited by 1
The Role of Modern Portfolio Management in Pharma Innovation
Greuel, J. M., & Wiest, A. (2016) · doi:10.1002/9783527693405.ch20 · Cited by 1
Dark Side of Molecular Techniques: How to Fix It ?Preprint
Bhardwaj, V. (2016) · Preprints.org · doi:10.20944/preprints201608.0016.v1
“In 2012, the biotechnology company Amgen reported that only 10% of researches published in top journals by world best labs are reproducible (1).”
BackgroundThe Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2835131 · Cited by 2
Disease‐Specific Stem Cell Models for Toxicological Screenings and Drug Development
Jung, M., Jung, J., Schiller, J., & Schroeder, I. S. (2016) · Wiley eBooks · doi:10.1002/9781119135449.ch7 · Cited by 1
In the Midst of Life—Cell Death: What Is It, What Is It Good for, and How to Study It
Silke, J., & Johnstone, R. W. (2016) · Cold Spring Harbor Protocols · doi:10.1101/pdb.top070508 · Cited by 1
Farhy, C., Hariharan, S., Ylanko, J., van Woudenberg, L., Cimadamore, F., Ugarte, F., Forsberg, E. C., Huang, C., Andrews, D. W., & Terskikh, A. V. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/348888 · Cited by 1
“However, these markers require manual and arbitrary thresholding, which could be confusing and potentially contributes to multiple challenges of reproducibility in biomedical science (38,39).”
BackgroundShort hairpin RNAs artifactually impair cell growth and suppress clustered microRNA expressionPreprint
Powers, J. T., da Rocha, E., Pearson, D., Missios, P., de Soysa, T., Barragan, J., Cahan, P., & Daley, G. Q. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/372920 · Cited by 1
Clark, T., Ciccarese, P., & Goble, C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.3506 · Cited by 1
“These ultimately all address the issue of scientific reproducibility [8,55,59,60].”
InfluentialShirtcliff, E. A., Wang, W., Moody, S. N., Smith, J. D., & Simmons, J. G. (2019) · Developmental Psychobiology · doi:10.1002/dev.21885 · Cited by 1
Economically rational sample-size choice and irreproducibility.Preprint
Braganza, O. (2019) · arXiv (Cornell University) · Cited by 1
Proxyeconomics, the inevitable corruption of proxy-based competitionPreprint
Braganza, O. (2018) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1803.00345
STAR: Statistical Tests with Auditable ResultsPreprint
Servan-Schreiber, S., Ohrimenko, O., Kraska, T., & Zgraggen, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10875 · Cited by 3
“It is therefore unsurprising that the MCP is among the leading reasons why the scientific community is plagued by false discoveries [2, 25–27].”
BackgroundValid statistical approaches for clustered data: A Monte Carlo simulation studyPreprint
McLaurin, K. A., Fairchild, A. J., Shi, D., Booze, R. M., & Mactutus, C. F. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.27.400945 · Cited by 1
Fecher, B., Frrrdorf, M., & Wagner, G. G. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2779180 · Cited by 2
Tools to enable animal to human translation: Assessing the value of disease models
Ferreira, G. S. (2020) · Utrecht University Repository (Utrecht University) · doi:10.33540/157 · Cited by 2
Data variability in standardised cell culture experimentsPreprint
Reddin, I. G., Fenton, T. R., Wass, M. N., & Michaelis, M. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.27.433153 · Cited by 1
“30 Much of the data are based on researcher views expressed in survey responses [1131 13] or provided as Comments or Correspondence without providing detailed 32 information [14,15].”
BackgroundOverview on the Null Hypothesis Significance TestPreprint
van Dongen, N. N. N., & van Grootel, L. (2021) · doi:10.31234/osf.io/hwk4n · Cited by 1
Rapid Evidence Review 1 on the Critical Appraisal of Third-Party Evidence
Thomas, S., Gregory, P., O’Brien, S. J., McCallion, C., Goodall, B., Chan, C., & Nunn, P. (2021) · doi:10.46756/sci.fsa.elm525 · Cited by 1
Machine Learning Approaches for Predicting the Onset Time of the Adverse Drug Events in OncologyPreprint
Timilsina, M., Tandan, M., & Nováček, V. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4089512 · Cited by 1
Beauchemin, C. A. A., Paradis, É., Pinilla, L. T., et al. (2021) · doi:10.32920/14638854 · Cited by 1
Replication and Reproducibility in Primate Cognition ResearchPreprint
Farrar, B. G., Krupenye, C., Motes‐Rodrigo, A., Tennie, C., Fischer, J., Altschul, D., & Ostojić, L. (2021) · doi:10.31219/osf.io/z52er · Cited by 1
(2017) · Elsevier eBooks · doi:10.1016/b978-0-12-811306-6.02002-9 · Cited by 1
Murkin, J., Amos, H. E., Brough, D., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.04.20.487864 · Cited by 1
Kramer, W. (2022) · Wiley eBooks · doi:10.1002/9783527824014.ch3 · Cited by 1
Translational Medicine – The Bridging Discipline. Role and Tools in the Drug Development Process
Hinder, M., & Hartl, D. (2022) · Wiley eBooks · doi:10.1002/9783527824014.ch7 · Cited by 2
A workcell 1.0 for programmable and controlled operation of multiple fluidic chips in parallelPreprint
Ning, C., Bunke, G., Lietar, S., van den Heuvel, L., & Shahein, A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.04.16.536594 · Cited by 1
Replication of “null results” – Absence of evidence or evidence of absence?Preprint
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2023) · eLife · doi:10.7554/elife.92311.1 · Cited by 1
Smith, A. J., & Richmond, J. (2024) · Wiley eBooks · doi:10.1002/9781119555278.ch2 · Cited by 1
Ahmed, Z., Mosabbir, W., Tandon, D., Pereira, S. M. P., Cheema, U., Loizidou, M., Withington, J., Moore, C. M., Okoli, U. A., & Heavey, S. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.20.585982 · Cited by 3
Data Valuation with Gradient SimilarityPreprint
Evans, N., Mills, G. B., Wu, G., Song, X. B., & McWeeney, S. K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.08217 · Cited by 10
“Many foundational high-throughput datasets are affected by reproducibility and data quality issues, which often limit the actionable results of these resources [1, 2, 3, 4].”
BackgroundEditorial: Common methodological issues in comparative biochemistry and physiology
Glover, C. N., Borowiec, B. G., & Joyce, W. (2024) · Comparative Biochemistry and Physiology Part A Molecular & Integrative Physiology · doi:10.1016/j.cbpa.2024.111697 · Cited by 1
A review of pre-registration in autism research journalsPreprint
Poole, D., Linden, A. H., Sedgewick, F., & Hobson, H. (2024) · doi:10.31222/osf.io/9382m · Cited by 1
Jansen, J. A. W., van den Brand, M. A., de Vegt, F., et al. (2025) · medRxiv · doi:10.1101/2025.02.18.25322469 · Cited by 1
The Intervention Fragility Quotient: An Improved Metric for Assessing Robustness in Clinical TrialsPreprint
Heston, T. F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5425334 · Cited by 1
A call to ensure reproducibility of machine learning applications in industrial ecologyPreprint
Rankin, K. H., Donati, F., Tu, Q., Ward-Bond, J., Reitz, N., Hiser, B., van Lierde, S., Suh, S., Saxe, S., Posen, I. D., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9270723/v1 · Cited by 1
The root cause: why do so many drugs fail to translate from bench to bedside?
Levchenko, A., Corrigan, M., & Wexler, B. (2026) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2026.2665217 · Cited by 2
“External-validity problems (species differences, non-representative pharmacology) combine with reproducibility challenges— underpowered experiments, bias, and selective reporting— to inflate effect sizes and propagate fragile claims down-stream [9–11].”
Reproducible Protein NMR Data Analysis
Fenwick, M. (2014) · OpenCommons - UConn (University of Connecticut)
La falta de reproducibilitat de la investigació: L'estadística com a legitimació del resultat
Goddard, S. D., & Johnson, V. E. (2014) · Mètode: Revista de difusió de la investigació de la Universitat de Valencia · doi:10.7203/metode.0.3913
“…coincidence, two pharmaceutical fi rms recently reported that they were only able to fully reproduce the peer-reviewed and published results of a small proportion of attempted studies: 20-25 % for one fi rm (Prinz, Schlange and Asadullah, 2011) and 11 % for the other (Begley and Ellis, 2012).”
BackgroundField-Testing Astronaut Assistance Robots in Australian Outback [From the Field]
Mann, G. A., Small, N., Lee, K., Clarke, J., & Sheh, R. (2015) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2015.2452200 · Cited by 1
“More precisely, and by way of example, according to Begley and Ellis [5], only 11% of 53 studies in the area of preclinical cancer drugs were reproducible, while Ioannidis et al.”
On Research Reproducibility: An interview with Gianluca Setti [Turning Point]
Guglielmelli, E. (2015) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2015.2458492
Software for Neuroimaging Data Analysis
Poline, J., & Kennedy, D. N. (2015) · Springer eBooks · doi:10.1007/978-1-4614-6675-8_538
Empirische Arbeiten als Zufallsbefunde
Horn, M. E. (2014) · PhyDid B - Didaktik der Physik - Beiträge zur DPG-Frühjahrstagung
CD83 as a drug target in GVHD and humoral immunity
Wong, K. Y. (2015) · The University of Queensland · doi:10.14264/uql.2015.793
Mass Spectrometry and Affinity Based Methods for Analysis of Proteins and Proteomes
Sundberg, M. (2015) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 1
Increasing value and reducing waste in animal models of rheumatological disease
Currie, G. L., & Macleod, M. R. (2015) · International Journal of Rheumatic Diseases · doi:10.1111/1756-185x.12703
Transparency, reproducibility, credibility: announcing a pilot
Austin, P., & Robertson, M. (2015) · BMC Biology · doi:10.1186/s12915-015-0175-8 · Cited by 1
Developing Cancer Immunotherapies as Drugs: Setting the Stage Through Methodological Progress
Hoos, A. (2014) · Springer eBooks · doi:10.1007/978-3-319-05104-8_6
Changing the attitudes of sex studies in science
Harris, A. L. (2015) · Surgery · doi:10.1016/j.surg.2014.12.018
A Network-Heuristic Approach to Improve the Impact of Genomic Data on Drug Discovery
Trister, A. D., & Huang, E. S. (2013) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.246
A new standard in reproducibility
Haas, M. J. (2014) · Science-Business eXchange · doi:10.1038/scibx.2014.76
Reconsidering phenotypic heart failure drug discovery
Toomey, J. R., & Upson, J. J. (2012) · Drug Discovery Today Therapeutic Strategies · doi:10.1016/j.ddstr.2014.01.003
Dredge, K. S. (2014) · Cancer Research · doi:10.1158/0008-5472.can-14-2313
“Freedman and Inglese (1) provided an excellent synopsis of the causes for irreproducibility in cancer research and the need for standards, complementing previous concerns on this issue (2).”
La falta de reproducibilitat de la investigació: L'estadística com a legitimació del resultat
Goddard, S. D., & Johnson, V. E. (2014) · Mètode: Revista de difusió de la investigació de la Universitat de Valencia · doi:10.7203/metode.83.3913
An interview with David H Farb, Section Editor for Basic Pharmacology
Farb, D. H. (2013) · BMC Pharmacology and Toxicology · doi:10.1186/2050-6511-14-42
Be-(a)-ware of the Red Flags: Common Flaws of Nonreproducible Preclinical Research Studies
Korpi-Steiner, N. L., & Molinaro, R. J. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2013.216986
Science, democracy and emerging threats to scientific progress
Feller, S. M. (2012) · Cell Communication and Signaling · doi:10.1186/1478-811x-10-24
“com/reproducibility) [1,2] and article retractions due to fabrication of data are on the rise in a fiercely competitive environment created by an economically difficult climate [3].”
BackgroundIntrapersonal Externalities: When Decisions Help or Hinder your Future Self
Stillwell, D. J. (2013) · Nottingham ePrints (University of Nottingham)
Data from industry funded trials are reliable enough to be published
Out, H. J. (2014) · BMJ · doi:10.1136/bmj.g1298
Chan, A., Song, F., Vickers, A. J., Erson, T. J., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & Worp, H. B. V. D. (2015)
Understanding what's "under the hood" : increasing accessibility in omics research
Patterson, J. (2015) · OHSU Digital Commons · doi:10.6083/m4k35smm
Wernerman, J., & Rooyackers, O. (2015) · Clinical Nutrition · doi:10.1016/j.clnu.2015.09.006
Algunos aspectos del artículo científico en la Revista Peruana de Biología
Romero, L. (2015) · Revista Peruana de Biología · doi:10.15381/rpb.v22i3.11431
Pitman, A. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.162370
Special Issue on Reproducible Research for Biomedical Informatics
McIntosh, L. D., Hudson‐Vitale, C., & Prior, F. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.12.011
Wagner, J. D. (2016) · uO Research (University of Ottawa) · doi:10.20381/ruor-2878
Como tornar mais confiável a pesquisa publicada
Ioannidis, J. P. A. (2015) · Acimed
Are we engaged in reproducible research?
Jadhav, M., & Jadhav, P. (2015) · Journal of Ayurveda and Integrative Medicine · doi:10.4103/0975-9476.166387
Lesher‐Pérez, S. C. (2015) · Deep Blue (University of Michigan)
System biology modeling : the insights for computational drug discovery
Huang, H. (2014) · IUScholarWorks (Indiana University) · doi:10.7912/c2/935 · Cited by 2
Gimenez, M. A., & de Llobregat, S. B. (2014)
Reproducibility in Science — Rethink, or Crisis?
Maindonald, J. H. (2015)
Masca, N. G. D., Hensor, E. M. A., Cornelius, V. R., Buffa, F. M., Marriott, H. M., Eales, J., Messenger, M. P., Anderson, A. E., Boot, C., Bunce, C., et al. (2015)
Arkas: Rapid, Reproducible RNAseq Analysis as a ServicePreprint
Colombo, A., Triche, T. J., & Ramsingh, G. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/031435
DISCOVERIES REPORTS: publishing discoveries in medicine, biology and chemistry
Bucur, O., & Liehn, E. A. (2014) · Discoveries Reports · doi:10.15190/drep.2014.4
Kremer, H.-J. (2016) · Journal of Pharmacy and Nutrition Sciences · doi:10.6000/1927-5951.2016.06.02.2
Reproducibility in the Open Access Era for Biomedical Research
Wang, S. Z. (2016) · Journal of Neurology & Neurophysiology · doi:10.4172/2155-9562.1000e117
“In 2011 and 2012, two giant pharma/biotech companies Amgen (California) and Bayer (Germany) published their findings in Nature, respectively, showing that only 10% to 30% of published scientific studies were actually reproducible [5,6].”
Background[Challenges and strategies of drug innovation].
Guo, Z., & Zhao, H. (2013) · PubMed
Bioethics of preclinical research in biomedical sciences
Navarro, D. I. M. (2015) · DOAJ (DOAJ: Directory of Open Access Journals)
Response to Linares et al. on Personalized Oxycodone Dosing
Ruan, X., Bumgarner, G. W., & Kaye, A. D. (2016) · Pain Medicine · doi:10.1093/pm/pnw112
Burotto, P. M., Rojas, G., Berkovits, C., et al. (2015) · Contacto Científico
Zarbin, M. A. (2016) · Translational Vision Science & Technology · doi:10.1167/tvst.5.3.12
“Unfortunately, even highly cited basic science research does not always produce results that are replicated.(1,2) Errors in study design seem to occur more frequently than they should, even in basic research.”
BackgroundMadhu, M. N., Aguiar, C., Hassan, A., & Brunt, K. R. (2016) · Journal of Molecular and Cellular Cardiology · doi:10.1016/j.yjmcc.2016.06.062
Improving Science for a Better Future
Khalil, M. M. (2015) · The frontiers collection · doi:10.1007/978-3-319-20717-9_11
Ruan, X., Rubin, R. E., & Kaye, A. D. (2016) · Annals of Pharmacotherapy · doi:10.1177/1060028015627311
“In 2012, researchers at the biotechnology firm Amgen in Thousand Oaks, California, reported that they could replicate only 6 out of 53 landmark studies in oncology and hematology.(5) Earlier this year, a large project that attempted to replicate 100 psychology studies managed to reproduce only slightly more than a thi…”
BackgroundIncreasing experimental reproducibility, from antibodies to protein arrays
Ferrigno, P. K. (2016) · Drug Discovery Today · doi:10.1016/j.drudis.2016.07.005 · Cited by 1
Metadata
- Authors
- Begley, C. G., & Ellis, L. M.
- Affiliations
- Amgen (United States) (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Ellis, Lee M.
- Venue
- Nature
- Published
- 2012-03-28
- Volume
- 483
- Issue
- 7391
- Pages
- 531-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1987777080
- Semantic Scholar
- 1a81d3d1e8a983e0551edf485f4ac1a8cdd7fea4
- Cited by
- 2,979
- References
- 5
- Citations by year
- 2026: 106 · 2025: 116 · 2024: 127 · 2023: 169 · 2022: 179 · 2021: 206 · 2020: 236 · 2019: 255 · 2018: 262 · 2017: 271 · 2016: 283 · 2015: 262 · 2014: 226 · 2013: 133 · 2012: 62
- FWCI
- 210.63
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-05-02)
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- preclinical cancer research, research standards, publication practices, research incentives, translational research, clinical trials
- MeSH terms
- Animals, Clinical Trials as Topic, Drug Evaluation, Preclinical, Humans, Neoplasms, Research Design, Reproducibility of Results, Survival Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.