The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic
Open accessAbstract
BACKGROUND: The pharmaceutical and biotechnology industries depend on findings from academic investigators prior to initiating programs to develop new diagnostic and therapeutic agents to benefit cancer patients. The success of these programs depends on the validity of published findings. This validity, represented by the reproducibility of published findings, has come into question recently as investigators from companies have raised the issue of poor reproducibility of published results from academic laboratories. Furthermore, retraction rates in high impact journals are climbing. METHODS AND FINDINGS: To examine a microcosm of the academic experience with data reproducibility, we surveyed the faculty and trainees at MD Anderson Cancer Center using an anonymous computerized questionnaire; we sought to ascertain the frequency and potential causes of non-reproducible data. We found that ∼50% of respondents had experienced at least one episode of the inability to reproduce published data; many who pursued this issue with the original authors were never able to identify the reason for the lack of reproducibility; some were even met with a less than "collegial" interaction. CONCLUSIONS: These results suggest that the problem of data reproducibility is real. Biomedical science needs to establish processes to decrease the problem and adjudicate discrepancies in findings when they are discovered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“Several recent publications suggested that the seminal findings from academic laboratories could only be reproduced 11–50% of the time [1,2].”
BackgroundSelf-citationBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“Several recent publications suggested that the seminal findings from academic laboratories could only be reproduced 11–50% of the time [1,2].”
BackgroundMisconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 1×
“4% of retracted articles had been retracted due to misconduct [4].”
BackgroundA call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Cited by
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
The fickle P value generates irreproducible results
Halsey, L. G., Curran-Everett, D., Vowler, S. L., & Drummond, G. B. (2015) · Nature Methods · doi:10.1038/nmeth.3288 · Cited by 765
Animal models of human disease: challenges in enabling translation
McGonigle, P., & Ruggeri, B. (2014) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.08.006 · Cited by 610
Horvath, J. C., Forte, J. D., & Carter, O. (2015) · Brain Stimulation · doi:10.1016/j.brs.2015.01.400 · Cited by 609
“[23]), to medicine (see: Ref.”
Horvath, J. C., Forte, J. D., & Carter, O. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.11.021 · Cited by 528
AI for life: Trends in artificial intelligence for biotechnology
Holzinger, A., Keiblinger, K., Holub, P., Zatloukal, K., & Müller, H. (2023) · New Biotechnology · doi:10.1016/j.nbt.2023.02.001 · Cited by 438
ITK: enabling reproducible research and open science
McCormick, M., Liu, X., Jomier, J., Marion, C., & Ibanez, L. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00013 · Cited by 376
Smith, B. J., Miller, R. A., Ericsson, A. C., Harrison, D. C., Strong, R., & Schmidt, T. M. (2019) · BMC Microbiology · doi:10.1186/s12866-019-1494-7 · Cited by 349
Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations
McKiernan, E. C., Schimanski, L. A., Muñoz Nieves, C., Matthias, L., Niles, M. T., & Alperin, J. P. (2019) · eLife · doi:10.7554/elife.47338 · Cited by 347
An open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
Zhu, H., & Leung, S. W. (2015) · Diabetologia · doi:10.1007/s00125-015-3510-2 · Cited by 271
Considering aspects of the 3Rs principles within experimental animal biology
Sneddon, L. U., Halsey, L. G., & Bury, N. R. (2017) · Journal of Experimental Biology · doi:10.1242/jeb.147058 · Cited by 254
Oxygenation in Cell Culture: Critical Parameters for Reproducibility Are Routinely Not Reported
Al-Ani, A., Toms, D., Kondro, D., Thundathil, J., Yu, Y., & Ungrin, M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204269 · Cited by 152
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps
Jarvis, M. F., & Williams, M. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2015.12.001 · Cited by 129
Improved reproducibility by assuring confidence in measurements in biomedical research
Plant, A. L., Locascio, L. E., May, W. E., & Gallagher, P. D. (2014) · Nature Methods · doi:10.1038/nmeth.3076 · Cited by 89
Retractions in cancer research: a systematic survey
Bozzo, A., Bali, K., Evaniew, N., & Ghert, M. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0031-1 · Cited by 83
“6% acknowledged feeling “pressured to publish findings of which you had doubt” [26].”
BackgroundInfluentialFaggion, C. M., Huivin, R., Aranda, L., Pandis, N., & Alarcon, M. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.02.011 · Cited by 49
Waltemath, D., & Wolkenhauer, O. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2555481 · Cited by 49
Best Practices for Making Reproducible Biochemical Models
Porubsky, V. L., Goldberg, A. P., Rampadarath, A. K., Nickerson, D. P., Karr, J. R., & Sauro, H. M. (2020) · Cell Systems · doi:10.1016/j.cels.2020.06.012 · Cited by 45
Boulbes, D. R., Costello, T., Baggerly, K., Fan, F., Wang, R., Bhattacharya, R., Ye, X., & Ellis, L. M. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-0227 · Cited by 41
Self-citationImproving the reliability of peer-reviewed publications: We are all in it together
Bustin, S. A., & Nolan, T. (2016) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.11.002 · Cited by 22
Empirical evidence for low reproducibility indicates low pre-study odds
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3475-c6 · Cited by 21
Metadata
- Authors
- Mobley, A., Linder, S. K., Braeuer, R., Ellis, L. M., & Zwelling, L.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-05-15
- Volume
- 8
- Issue
- 5
- Pages
- e63221
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2070441922
- Cited by
- 166
- References
- 4
- FWCI
- 66.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.