The DOI matches its Crossref record; 192 of the 192 references it cites were found in a registry or an index.
Challenges for assessing replicability in preclinical cancer biology
Open accessAbstract
We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication – it is hard to assess whether reported findings are credible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Selective killing of cancer cells by a small molecule targeting the stress response to ROS
Raj, L., Ide, T., Gurkar, A. U., Foley, M., Schenone, M., Li, X., Tolliday, N. J., Golub, T. R., Carr, S. A., Shamji, A. F., et al. (2011) · Nature · doi:10.1038/nature10167 · Cited by 1,030
RetractedR: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“With publication bias, negative findings are much less likely to be reported than positive findings (Greenwald, 1975; Rosenthal, 1979).”
BackgroundThe case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 3×
“…lateral sclerosis (Perrin, 2014), and systematic replication efforts in other disciplines (Camerer et al., 2016; Camerer et al., 2018; Cova et al., 2018; Ebersole et al., 2016; Ebersole et al., 2019; Klein et al., 2014; Klein et al., 2018; Open Science Collaboration, 2015; Steward et al., 2012).”
BackgroundConfirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Long non-coding RNA HOTAIR reprograms chromatin state to promote cancer metastasis
Gupta, R. A., Shah, N., Wang, K. C., Kim, J., Horlings, H. M., Wong, D. J., Tsai, M.-C., Hung, T., Argani, P., Rinn, J. L., et al. (2010) · Nature · doi:10.1038/nature08975 · Cited by 5,218
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“…can lead to intentional or unintentional manufacturing and reporting of positive outcomes that are more favorable for publication (Casadevall and Fang, 2012; Gelman and Loken, 2013; Ioannidis, 2005; John et al., 2012; Kaplan and Irvin, 2015; van der Naald et al., 2020; Simmons et al., 2011).”
BackgroundMelanoma exosomes educate bone marrow progenitor cells toward a pro-metastatic phenotype through MET
Peinado, H., Alečković, M., Lavotshkin, S., Matei, I., Costa-Silva, B., Moreno-Bueno, G., Hergueta-Redondo, M., Williams, C., García-Santos, G., Ghajar, C. M., et al. (2012) · Nature Medicine · doi:10.1038/nm.2753 · Cited by 3,715
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Xu, W., Yang, H., Liu, Y., Yang, Y., Wang, P., Kim, S.-H., Ito, S., Yang, C., Wang, P., Xiao, M.-T., et al. (2011) · Cancer Cell · doi:10.1016/j.ccr.2010.12.014 · Cited by 2,875
CCL2 recruits inflammatory monocytes to facilitate breast-tumour metastasis
Qian, B.-Z., Li, J., Zhang, H., Kitamura, T., Zhang, J., Campion, L. R., Kaiser, E. A., Snyder, L. A., & Pollard, J. W. (2011) · Nature · doi:10.1038/nature10138 · Cited by 2,874
BET Bromodomain Inhibition as a Therapeutic Strategy to Target c-Myc
Delmore, J. E., Issa, G. C., Lemieux, M. E., Rahl, P. B., Shi, J., Jacobs, H. M., Kastritis, E., Gilpatrick, T., Paranal, R. M., Qi, J., et al. (2011) · Cell · doi:10.1016/j.cell.2011.08.017 · Cited by 2,813
A Chromatin-Mediated Reversible Drug-Tolerant State in Cancer Cell Subpopulations
Sharma, S. V., Lee, D. Y., Li, B., Quinlan, M. P., Takahashi, F., Maheswaran, S., McDermott, U., Azizian, N., Zou, L., Fischbach, M. A., et al. (2010) · Cell · doi:10.1016/j.cell.2010.02.027 · Cited by 2,770
Figueroa, M. E., Abdel-Wahab, O., Lu, C., Ward, P. S., Patel, J., Shih, A., Li, Y., Bhagwat, N., Vasanthakumar, A., Fernandez, H. F., et al. (2010) · Cancer Cell · doi:10.1016/j.ccr.2010.11.015 · Cited by 2,766
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Self-citationSystematic identification of genomic markers of drug sensitivity in cancer cells
Garnett, M. J., Edelman, E. J., Heidorn, S. J., Greenman, C. D., Dastur, A., Lau, K. W., Greninger, P., Thompson, I. R., Luo, X., Soares, J., et al. (2012) · Nature · doi:10.1038/nature11005 · Cited by 2,456
A restricted cell population propagates glioblastoma growth after chemotherapy
Chen, J., Li, Y., Yu, T.-S., McKay, R. M., Burns, D. K., Kernie, S. G., & Parada, L. F. (2012) · Nature · doi:10.1038/nature11287 · Cited by 2,354
A coding-independent function of gene and pseudogene mRNAs regulates tumour biology
Poliseno, L., Salmena, L., Zhang, J., Carver, B., Haveman, W. J., & Pandolfi, P. P. (2010) · Nature · doi:10.1038/nature09144 · Cited by 2,323
Oncogene-induced Nrf2 transcription promotes ROS detoxification and tumorigenesis
DeNicola, G. M., Karreth, F. A., Humpton, T. J., Gopinathan, A., Wei, C., Frese, K., Mangal, D., Yu, K. H., Yeo, C. J., Calhoun, E. S., et al. (2011) · Nature · doi:10.1038/nature10189 · Cited by 2,277
Intestinal inflammation targets cancer-inducing activity of the microbiota
Arthur, J. C., Perez-Chanona, E., Mühlbauer, M., Tomkovich, S., Uronis, J. M., Fan, T.-J., Campbell, B. J., Abujamel, T., Dogan, B., Rogers, A. B., et al. (2012) · Science · doi:10.1126/science.1224820 · Cited by 2,263
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Melanomas acquire resistance to B-RAF(V600E) inhibition by RTK or N-RAS upregulation
Nazarian, R., Shi, H., Wang, Q., Kong, X., Koya, R. C., Lee, H., Chen, Z., Lee, M.-K., Attar, N., Sazegar, H., et al. (2010) · Nature · doi:10.1038/nature09626 · Cited by 2,192
Unresponsiveness of colon cancer to BRAF(V600E) inhibition through feedback activation of EGFR
Prahallad, A., Sun, C., Huang, S., Di Nicolantonio, F., Salazar, R., Zecchin, D., Beijersbergen, R. L., Bardelli, A., & Bernards, R. (2012) · Nature · doi:10.1038/nature10868 · Cited by 2,051
Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma
Castellarin, M., Warren, R. L., Freeman, J. D., Dreolini, L., Krzywinski, M., Strauss, J., Barnes, R., Watson, P., Allen-Vercoe, E., Moore, R. A., et al. (2012) · Genome Research · doi:10.1101/gr.126516.111 · Cited by 2,043
Ward, P. S., Patel, J., Wise, D. R., Abdel-Wahab, O., Bennett, B. D., Coller, H. A., Cross, J. R., Fantin, V. R., Hedvat, C. V., Perl, A. E., et al. (2010) · Cancer Cell · doi:10.1016/j.ccr.2010.01.020 · Cited by 2,020
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Self-citationHARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
IDH mutation impairs histone demethylation and results in a block to cell differentiation
Lu, C., Ward, P. S., Kapoor, G. S., Rohle, D., Turcan, S., Abdel-Wahab, O., Edwards, C. R., Khanin, R., Figueroa, M. E., Melnick, A., et al. (2012) · Nature · doi:10.1038/nature10860 · Cited by 1,985
An endogenous tumour-promoting ligand of the human aryl hydrocarbon receptor
Opitz, C. A., Litzenburger, U. M., Sahm, F., Ott, M., Tritschler, I., Trump, S., Schumacher, T., Jestaedt, L., Schrenk, D., Weller, M., et al. (2011) · Nature · doi:10.1038/nature10491 · Cited by 1,898
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
RNAi screen identifies Brd4 as a therapeutic target in acute myeloid leukaemia
Zuber, J., Shi, J., Wang, E., Rappaport, A. R., Herrmann, H., Sison, E. A., Magoon, D., Qi, J., Blatt, K., Wunderlich, M., et al. (2011) · Nature · doi:10.1038/nature10334 · Cited by 1,870
RAF inhibitors transactivate RAF dimers and ERK signalling in cells with wild-type BRAF
Poulikakos, P. I., Zhang, C., Bollag, G., Shokat, K. M., & Rosen, N. (2010) · Nature · doi:10.1038/nature08902 · Cited by 1,811
Wnt activity defines colon cancer stem cells and is regulated by the microenvironment
Vermeulen, L., De Sousa E Melo, F., van der Heijden, M., Cameron, K., de Jong, J. H., Borovski, T., Tuynman, J. B., Todaro, M., Merz, C., Rodermond, H., et al. (2010) · Nature Cell Biology · doi:10.1038/ncb2048 · Cited by 1,804
Reductive glutamine metabolism by IDH1 mediates lipogenesis under hypoxia
Metallo, C. M., Gameiro, P. A., Bell, E. L., Mattaini, K. R., Yang, J., Hiller, K., Jewell, C. M., Johnson, Z. R., Irvine, D. J., Guarente, L., et al. (2012) · Nature · doi:10.1038/nature10602 · Cited by 1,791
Tumour micro-environment elicits innate resistance to RAF inhibitors through HGF secretion
Straussman, R., Morikawa, T., Shee, K., Barzily-Rokni, M., Qian, Z. R., Du, J., Davis, A., Mongare, M. M., Gould, J., Frederick, D. T., et al. (2012) · Nature · doi:10.1038/nature11183 · Cited by 1,771
Functional genomics reveal that the serine synthesis pathway is essential in breast cancer
Possemato, R., Marks, K. M., Shaul, Y. D., Pacold, M. E., Kim, D., Birsoy, K., Sethumadhavan, S., Woo, H.-K., Jang, H. G., Jha, A. K., et al. (2011) · Nature · doi:10.1038/nature10350 · Cited by 1,683
Willingham, S. B., Volkmer, J.-P., Gentles, A. J., Sahoo, D., Dalerba, P., Mitra, S. S., Wang, J., Contreras-Trujillo, H., Martin, R., Cohen, J. D., et al. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1121623109 · Cited by 1,666
RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growth
Hatzivassiliou, G., Song, K., Yen, I., Brandhuber, B. J., Anderson, D. J., Alvarado, R., Ludlam, M. J. C., Stokoe, D., Gloor, S. L., Vigers, G., et al. (2010) · Nature · doi:10.1038/nature08833 · Cited by 1,622
Senescence surveillance of pre-malignant hepatocytes limits liver cancer development
Kang, T.-W., Yevsa, T., Woller, N., Hoenicke, L., Wuestefeld, T., Dauch, D., Hohmeyer, A., Gereke, M., Rudalska, R., Potapova, A., et al. (2011) · Nature · doi:10.1038/nature10599 · Cited by 1,621
Increasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0399-z · Cited by 1,521
Self-citationMorin, R. D., Johnson, N. A., Severson, T. M., Mungall, A. J., An, J., Goya, R., Paul, J. E., Boyle, M., Woolcock, B. W., Kuchenbauer, F., et al. (2010) · Nature Genetics · doi:10.1038/ng.518 · Cited by 1,521
Transcriptional Amplification in Tumor Cells with Elevated c-Myc
Lin, C. Y., Lovén, J., Rahl, P. B., Paranal, R. M., Burge, C. B., Bradner, J. E., Lee, T. I., & Young, R. A. (2012) · Cell · doi:10.1016/j.cell.2012.08.026 · Cited by 1,513
Inhibition of BET recruitment to chromatin as an effective treatment for MLL-fusion leukaemia
Dawson, M. A., Prinjha, R. K., Dittmann, A., Giotopoulos, G., Bantscheff, M., Chan, W.-I., Robson, S. C., Chung, C.-W., Hopf, C., Savitski, M. M., et al. (2011) · Nature · doi:10.1038/nature10509 · Cited by 1,503
Kinase-Dead BRAF and Oncogenic RAS Cooperate to Drive Tumor Progression through CRAF
Heidorn, S. J., Milagre, C., Whittaker, S., Nourry, A., Niculescu-Duvas, I., Dhomen, N., Hussain, J., Reis-Filho, J. S., Springer, C. J., Pritchard, C., et al. (2010) · Cell · doi:10.1016/j.cell.2009.12.040 · Cited by 1,465
COT drives resistance to RAF inhibition through MAP kinase pathway reactivation
Johannessen, C. M., Boehm, J. S., Kim, S. Y., Thomas, S. R., Wardwell, L., Johnson, L. A., Emery, C. M., Stransky, N., Cogdill, A. P., Barretina, J., et al. (2010) · Nature · doi:10.1038/nature09627 · Cited by 1,460
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
The microRNA miR-34a inhibits prostate cancer stem cells and metastasis by directly repressing CD44
Liu, C., Kelnar, K., Liu, B., Chen, X., Calhoun-Davis, T., Li, H., Patrawala, L., Yan, H., Jeter, C., Honorio, S., et al. (2011) · Nature Medicine · doi:10.1038/nm.2284 · Cited by 1,400
Tumour vascularization via endothelial differentiation of glioblastoma stem-like cells
Ricci-Vitiani, L., Pallini, R., Biffoni, M., Todaro, M., Invernici, G., Cenci, T., Maira, G., Parati, E. A., Stassi, G., Larocca, L. M., et al. (2010) · Nature · doi:10.1038/nature09557 · Cited by 1,379
Interactions between cancer stem cells and their niche govern metastatic colonization
Malanchi, I., Santamaria-Martínez, A., Susanto, E., Peng, H., Lehr, H.-A., Delaloye, J.-F., & Huelsken, J. (2012) · Nature · doi:10.1038/nature10694 · Cited by 1,339
Reducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314 · cited 2×
“, 2011), efforts by a nonprofit biotech to replicate findings of potential drugs in a mouse model of amyotrophic lateral sclerosis (Perrin, 2014), and systematic replication efforts in other disciplines (Camerer et al., 2016; Camerer et al., 2018; Cova et al., 2018; Ebersole et al., 2016; Ebersole et al., 2019; Klein…”
BackgroundNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Feeling validated versus being correct: A meta-analysis of selective exposure to information
Hart, W., Albarracín, D., Eagly, A. H., Brechan, I., Lindberg, M. J., & Merrill, L. (2009) · Psychological Bulletin · doi:10.1037/a0015701 · Cited by 1,292
The transcriptional network for mesenchymal transformation of brain tumours
Carro, M. S., Lim, W. K., Alvarez, M. J., Bollo, R. J., Zhao, X., Snyder, E. Y., Sulman, E. P., Anne, S. L., Doetsch, F., Colman, H., et al. (2010) · Nature · doi:10.1038/nature08712 · Cited by 1,259
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
DNA breaks and chromosome pulverization from errors in mitosis
Crasta, K., Ganem, N. J., Dagher, R., Lantermann, A. B., Ivanova, E. V., Pan, Y., Nezi, L., Protopopov, A., Chowdhury, D., & Pellman, D. (2012) · Nature · doi:10.1038/nature10802 · Cited by 1,227
Impaired hydroxylation of 5-methylcytosine in myeloid cancers with mutant TET2
Ko, M., Huang, Y., Jankowska, A. M., Pape, U. J., Tahiliani, M., Bandukwala, H. S., An, J., Lamperti, E. D., Koh, K. P., Ganetzky, R., et al. (2010) · Nature · doi:10.1038/nature09586 · Cited by 1,213
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Self-citationA call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Normal and neoplastic nonstem cells can spontaneously convert to a stem-like state
Chaffer, C. L., Brueckmann, I., Scheel, C., Kaestli, A. J., Wiggins, P. A., Rodrigues, L. O., Brooks, M., Reinhardt, F., Su, Y., Polyak, K., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102454108 · Cited by 1,147
Widespread potential for growth-factor-driven resistance to anticancer kinase inhibitors
Wilson, T. R., Fridlyand, J., Yan, Y., Penuel, E., Burton, L., Chan, E., Peng, J., Lin, E., Wang, Y., Sosman, J., et al. (2012) · Nature · doi:10.1038/nature11249 · Cited by 1,134
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125
Coadministration of a Tumor-Penetrating Peptide Enhances the Efficacy of Cancer Drugs
Sugahara, K. N., Teesalu, T., Karmali, P. P., Kotamraju, V. R., Agemy, L., Greenwald, D. R., & Ruoslahti, E. (2010) · Science · doi:10.1126/science.1183057 · Cited by 1,075
Lineage Tracing Reveals Lgr5 + Stem Cell Activity in Mouse Intestinal Adenomas
Schepers, A. G., Snippert, H. J., Stange, D. E., van den Born, M., van Es, J. H., van de Wetering, M., & Clevers, H. (2012) · Science · doi:10.1126/science.1224676 · Cited by 1,072
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
Diverse somatic mutation patterns and pathway alterations in human cancers
Kan, Z., Jaiswal, B. S., Stinson, J., Janakiraman, V., Bhatt, D., Stern, H. M., Yue, P., Haverty, P. M., Bourgon, R., Zheng, J., et al. (2010) · Nature · doi:10.1038/nature09208 · Cited by 1,027
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“With publication bias, negative findings are much less likely to be reported than positive findings (Greenwald, 1975; Rosenthal, 1979).”
BackgroundCoding-Independent Regulation of the Tumor Suppressor PTEN by Competing Endogenous mRNAs
Tay, Y., Kats, L., Salmena, L., Weiss, D., Tan, S. M., Ala, U., Karreth, F., Poliseno, L., Provero, P., Di Cunto, F., et al. (2011) · Cell · doi:10.1016/j.cell.2011.09.029 · Cited by 1,019
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964 · cited 1×
“For example, selectively reporting experiments or analyses, particularly reporting only those that 'worked', biases the literature by ignoring negative or null results (Fanelli, 2010; Fanelli, 2011; Ioannidis, 2005; Rosenthal, 1979; Sterling, 1959; Sterling et al., 1995).”
BackgroundMany Labs 2: Investigating variation in replicability across samples and settings
Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918810225 · Cited by 944
Self-citationReproducibility and Replicability in Science
Committee on Reproducibility and Replicability in Science, Board on Behavioral, C., Committee on National Statistics, Education, D. O. B. A. S. S. A., Nuclear and Radiation Studies Board, Studies, D. O. E. A. L., Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Sciences, D. O. E. A. P., Board on Research Data and Information, et al. (2019) · doi:10.17226/25303 · Cited by 924
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860 · cited 1×
“These lead to a biased literature with exaggerated claims and incredible evidence (Begley and Ellis, 2012; Open Science Collaboration, 2015; Prinz et al., 2011; Smaldino and McElreath, 2016).”
BackgroundKilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860
Sirota, M., Dudley, J. T., Kim, J., Chiang, A. P., Morgan, A. A., Sweet-Cordero, A., Sage, J., & Butte, A. J. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3001318 · Cited by 799
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Self-citationMelanoma genome sequencing reveals frequent PREX2 mutations
Berger, M. F., Hodis, E., Heffernan, T. P., Deribe, Y. L., Lawrence, M. S., Protopopov, A., Ivanova, E., Watson, I. R., Nickerson, E., Ghosh, P., et al. (2012) · Nature · doi:10.1038/nature11071 · Cited by 756
Replications in Psychology Research: How Often Do They Really Occur?
Makel, M. C., Plucker, J. A., & Hegarty, B. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612460688 · Cited by 750
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Goetz, J. G., Minguet, S., Navarro-Lérida, I., Lazcano, J. J., Samaniego, R., Calvo, E., Tello, M., Osteso-Ibáñez, T., Pellinen, T., Echarri, A., et al. (2011) · Cell · doi:10.1016/j.cell.2011.05.040 · Cited by 720
Defining the mode of tumour growth by clonal analysis
Driessens, G., Beck, B., Caauwe, A., Simons, B. D., & Blanpain, C. (2012) · Nature · doi:10.1038/nature11344 · Cited by 717
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
Self-citationSumazin, P., Yang, X., Chiu, H.-S., Chung, W.-J., Iyer, A., Llobet-Navas, D., Rajbhandari, P., Bansal, M., Guarnieri, P., Silva, J., et al. (2011) · Cell · doi:10.1016/j.cell.2011.09.041 · Cited by 697
Fischhoff, B., & Beyth, R. (1975) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(75)90002-1 · Cited by 685
Lee, M. J., Ye, A. S., Gardino, A. K., Heijink, A. M., Sorger, P. K., MacBeath, G., & Yaffe, M. B. (2012) · Cell · doi:10.1016/j.cell.2012.03.031 · Cited by 680
Preclinical research: Make mouse studies work
Perrin, S. (2014) · Nature · doi:10.1038/507423a · Cited by 668
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel, M. C., & Plucker, J. A. (2014) · Educational Researcher · doi:10.3102/0013189x14545513 · Cited by 609
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608
A microRNA regulon that mediates endothelial recruitment and metastasis by cancer cells
Png, K. J., Halberg, N., Yoshida, M., & Tavazoie, S. F. (2012) · Nature · doi:10.1038/nature10661 · Cited by 531
BRCA1 tumour suppression occurs via heterochromatin-mediated silencing
Zhu, Q., Pao, G. M., Huynh, A. M., Suh, H., Tonnu, N., Nederlof, P. M., Gage, F. H., & Verma, I. M. (2011) · Nature · doi:10.1038/nature10371 · Cited by 485
Many Labs 3: Evaluating participant pool quality across the academic semester via replication
Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., Baranski, E., Bernstein, M. J., Bonfiglio, D. B. V., Boucher, L., et al. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.012 · Cited by 468
Self-citationInvestigating the replicability of preclinical cancer biology
Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.71601 · Cited by 462
Self-citationSterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
The hindsight bias: A meta-analysis
Christensen-Szalanski, J. J. J., & Willham, C. F. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90010-q · Cited by 449
Nosek, B. A., & Errington, T. M. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000691 · Cited by 444
Self-citationAn Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports
Scheel, A. M., Schijen, M. R. M. J., & Lakens, D. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211007467 · Cited by 370
Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
Kaplan, R. M., & Irvin, V. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132382 · Cited by 356
Preregistration Is Hard, And Worthwhile
Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., van ’t Veer, A. E., & Vazire, S. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.009 · Cited by 319
Self-citationAn open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
Self-citationBaker, D., Lidster, K., Sottomayor, A., & Amor, S. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001756 · Cited by 305
The Open Knowledge Foundation: Open Data Means Better Science
Molloy, J. C. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1001195 · Cited by 299
Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 295
Self-citationGiner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274
Stodden, V., Guo, P., & Ma, Z. (2013) · PLoS ONE · doi:10.1371/journal.pone.0067111 · Cited by 257
Announcement: Reducing our irreproducibility
(2013) · Nature · doi:10.1038/496398a · Cited by 243
Normative Dissonance in Science: Results from a National Survey of U.S. Scientists
Anderson, M. S., Martinson, B. C., & De Vries, R. (2007) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2007.2.4.3 · Cited by 208
The Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Replication and reproducibility in spinal cord injury research
Steward, O., Popovich, P. G., Dietrich, W. D., & Kleitman, N. (2012) · Experimental Neurology · doi:10.1016/j.expneurol.2011.06.017 · Cited by 186
Estimating the Reproducibility of Experimental Philosophy
Cova, F., Strickland, B., Abatista, A., Allard, A., Andow, J., Attie, M., Beebe, J., Berniūnas, R., Boudesseul, J., Colombo, M., et al. (2021) · Review of Philosophy and Psychology · doi:10.1007/s13164-018-0400-9 · Cited by 179
Replication in Criminology and the Social Sciences
Pridemore, W. A., Makel, M. C., & Plucker, J. A. (2017) · Annual Review of Criminology · doi:10.1146/annurev-criminol-032317-091849 · Cited by 167
Replication in prevention science
Valentine, J. C., Biglan, A., Boruch, R. F., Castro, F. G., Collins, L. M., Flay, B. R., Kellam, S., Mościcki, E. K., & Schinke, S. P. (2011) · Prevention Science · doi:10.1007/s11121-011-0217-6 · Cited by 166
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156
What’s next for Registered Reports?
Chambers, C. (2019) · Nature · doi:10.1038/d41586-019-02674-6 · Cited by 154
Moher, D., Simera, I., Schulz, K. F., Hoey, J., & Altman, D. G. (2008) · BMC Medicine · doi:10.1186/1741-7015-6-13 · Cited by 153 · cited 1×
“And the combined effect of constraints related to the research paper format (including word limits, and only reporting what can be described in words), the tendency of authors to report what they perceive to be important, and rewards for exciting, innovative outcomes is an emphasis on reporting outcomes and their impl…”
BackgroundOpen Science Practices are on the Rise: The State of Social Science (3S) SurveyPreprint
Christensen, G., Wang, Z., Paluck, E. L., Swanson, N., Birke, D. J., Miguel, E. A., & Littman, R. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/5rksu · Cited by 151
Assessment of transparency indicators across the biomedical literature: How open is open?
Serghiou, S., Contopoulos-Ioannidis, D. G., Boyack, K. W., Riedel, N., Wallach, J. D., & Ioannidis, J. P. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001107 · Cited by 139
Ramirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
Never waste a good crisis: confronting reproducibility in translational research
Drucker, D. J. (2016) · Cell Metabolism · doi:10.1016/j.cmet.2016.08.006 · Cited by 117 · cited 1×
“…findings are often advanced to clinical trials before they have been verified and replicated by other laboratories (Chalmers et al., 2014; Drucker, 2016; Ramirez et al., 2017); and many papers continue to be cited even after they have been retracted (Budd et al., 1999; Lu et al.,…”
BackgroundSovacool, B. K. (2008) · Journal of Bioethical Inquiry · doi:10.1007/s11673-008-9113-6 · Cited by 116
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., et al. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920958687 · Cited by 105
Self-citationEffects of article retraction on citation and practice in medicine.
(1999) · Europe PMC (PubMed Central) · Cited by 101
Preregistration Becoming the Norm in Psychological Science
Lindsay, B. A. N. A. D. S. (2018) · APS observer · Cited by 100
The (lack of) Impact of Retraction on Citation Networks
Madlock-Brown, C. R., & Eichmann, D. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-014-9532-1 · Cited by 89
Horrigan, S. K., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.18173 · Cited by 87
Macleod, M., Collings, A. M., Graf, C., Kiermer, V., Mellor, D., Swaminathan, S., Sweet, D., & Vinson, V. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103238118 · Cited by 77
Liberating field science samples and data
Mcnutt, M. K., Lehnert, K. A., Hanson, B., Nosek, B. A., Ellison, A. M., & King, J. L. (2016) · Science · doi:10.1126/science.aad7048 · Cited by 77
Self-citationSCIENTIFIC FRAUD AND THE POWER STRUCTURE OF SCIENCE
Martin, B. G. (1992) · Prometheus · doi:10.1080/08109029208629515 · Cited by 69
Gulin, J. E. N., Rocco, D. M., & García-Bournissen, F. (2015) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0004194 · Cited by 66
Replication Study: Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma
Repass, J. F., Reproducibility Project: Cancer Biology, Iorns, E. J., Denis, A., Williams, S. R., Perfito, N., & Errington, T. M. (2018) · eLife · doi:10.7554/elife.25801 · Cited by 66
Self-citationMantis, C., Kandela, I. K., Aird, F., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.17584 · Cited by 60
Marcus, E. (2016) · Cell · doi:10.1016/j.cell.2016.08.021 · Cited by 55
van der Naald, M., Wenker, S., Doevendans, P. A., Wever, K. E., & Chamuleau, S. A. J. (2020) · BMJ Open Science · doi:10.1136/bmjos-2019-100051 · Cited by 53
Phelps, M. A., Coss, C. C., Wang, H., Cook, M. S., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.12470 · Cited by 51
Registered report: Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma
Repass, J. F., Maherali, N., Owen, K. A., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.10012 · Cited by 50
Replication Study: BET bromodomain inhibition as a therapeutic strategy to target c-Myc
Aird, F., Kandela, I. K., Mantis, C., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.21253 · Cited by 48
The best time to argue about what a replication means? Before you do it
Nosek, B. A., & Errington, T. M. (2020) · Nature · doi:10.1038/d41586-020-02142-6 · Cited by 47
Self-citationReplication Study: Transcriptional amplification in tumor cells with elevated c-Myc
Lewis, L. M., Edwards, M. C., Meyers, Z. R., Talbot, C. C., Hao, H., Blum, D., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., et al. (2018) · eLife · doi:10.7554/elife.30274 · Cited by 45
Self-citationReproducibility: Use mouse biobanks or lose them
Lloyd, K. C. K., Franklin, C. L., Lutz, C., & Magnuson, T. (2015) · Nature · doi:10.1038/522151a · Cited by 35
Yan, X., Tang, B., Chen, B., Shan, Y., Yang, H., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., et al. (2019) · eLife · doi:10.7554/elife.43511 · Cited by 35
Self-citationReplication Study: Melanoma genome sequencing reveals frequent PREX2 mutations
Horrigan, S. K., Courville, P., Sampey, D. B., zhou, F., Cai, S., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.21634 · Cited by 34
Li, J., Lam, M., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.06434 · Cited by 32
Replication Study: Systematic identification of genomic markers of drug sensitivity in cancer cells
Heuvel, J. P. V., Maddox, E., Maalouf, S. W., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., & Errington, T. M. (2018) · eLife · doi:10.7554/elife.29747 · Cited by 31
Self-citationEvaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29
Self-citationDutch agency launches first grants programme dedicated to replication
Baker, M. (2016) · Nature · doi:10.1038/nature.2016.20287 · Cited by 29
Kim, J., Afshari, A., Sengupta, R., Sebastiano, V., Gupta, A. A., Kim, Y. H., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., et al. (2018) · eLife · doi:10.7554/elife.39944 · Cited by 29
Self-citationKandela, I. K., Aird, F., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.17044 · Cited by 27
Macleod, M. R., & The NPQIP Collaborative group (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/187245 · Cited by 27
Fiehn, O., Showalter, M. R., Tooley, C. E. S., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.12626 · Cited by 25
Sheen, M. R., Fields, J. L., Northan, B., Lacoste, J., Ang, L., Fiering, S., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., et al. (2019) · eLife · doi:10.7554/elife.45120 · Cited by 25
Self-citationEssex, A., Pineda, J. J., Acharya, G., Xin, H., Evans, J., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., et al. (2019) · eLife · doi:10.7554/elife.45426 · Cited by 23
Self-citationExperiments from unfinished Registered Reports in the Reproducibility Project: Cancer Biology
Errington, T. M., Denis, A., Allison, A. B., Araiza, R., Aza-Blanc, P., Bower, L. R., Campos, J., Chu, H., Denson, S., Donham, C., et al. (2021) · eLife · doi:10.7554/elife.73430 · Cited by 22
Self-citationShowalter, M. R., Hatakeyama, J., Čajka, T., VanderVorst, K., Carraway, K. L., Fiehn, O., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.26030 · Cited by 21
Chroscinski, D., Sampey, D. B., Maherali, N., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04363 · Cited by 20
Registered report: BET bromodomain inhibition as a therapeutic strategy to target c-Myc
Kandela, I. K., Jin, H. Y., Owen, K. A., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.07072 · Cited by 20
Khan, I., Kerwin, J., Owen, K. A., Griner, E., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.08245 · Cited by 20
Blum, D., LaBarge, S. A., & Reproducibility Project: Cancer Biology (2014) · eLife · doi:10.7554/elife.04034 · Cited by 19
Registered report: COT drives resistance to RAF inhibition through MAP kinase pathway reactivation
Sharma, V., Young, L., Cavadas, M. A. S., Owen, K. A., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.11414 · Cited by 18
Shan, X., Fung, J. J., Kosaka, A. H., Danet-Desnoyers, G. A., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.25306 · Cited by 18
Raouf, S., Weston, C. R., Yucel, N. D., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04105 · Cited by 17
Kerwin, J., Khan, I., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., & Errington, T. M. (2020) · eLife · doi:10.7554/elife.51019 · Cited by 17
Self-citationEvans, J. G., Essex, A., Xin, H., Amitai, N., Brinton, L. T., Griner, E., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.07301 · Cited by 16
Registered report: A chromatin-mediated reversible drug-tolerant state in cancer cell subpopulations
Haven, B., Heilig, E., Donham, C., Settles, M., Vasilevsky, N., Owen, K. A., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.09462 · Cited by 16
Evans, B., Griner, E., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.07420 · Cited by 15
Replication Study: Intestinal inflammation targets cancer-inducing activity of the microbiota
Eaton, K. A., Pirani, A. M., Snitkin, E. S., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., Errington, T. M., Iorns, E. J., et al. (2018) · eLife · doi:10.7554/elife.34364 · Cited by 14
Self-citationPanton Principles, Principles for Open Data in Science
Murray-Rust, P., Neylon, C., Pollock, R., Wilbanks, J., & Open Knowledge Foundation (2010) · Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) · Cited by 13
Fiering, S., Ang, L., Lacoste, J., Smith, T. D., Griner, E., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04796 · Cited by 12
Incardona, F., Doroudchi, M., Ismail, N. I., Carreño, A., Griner, E., Lim, M. A., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.06938 · Cited by 11
Registered report: Transcriptional amplification in tumor cells with elevated c-Myc
Blum, D. L., Hao, H., McCarthy, M., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04024 · Cited by 11
Fung, J. J., Kosaka, A. H., Shan, X., Danet-Desnoyers, G. A., Gormally, M. V., Owen, K. A., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.08997 · Cited by 11
Richarson, A. D., Scott, D. A., Zagnitko, O. P., Aza‐Blanc, P., Chang, C., Russler‐Germain, D. A., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.10860 · Cited by 11
Lesnik, J., Antes, T. J., Kim, J., Griner, E., Pedro, L., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.07383 · Cited by 9
Wang, H., Radomska, H. S., Phelps, M. A., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., Perfito, N., & Errington, T. M. (2020) · eLife · doi:10.7554/elife.56651 · Cited by 9
Self-citationKandela, I. K., Chou, J., Chow, K., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.06959 · Cited by 8
Registered report: Intestinal inflammation targets cancer-inducing activity of the microbiota
Eaton, K., Yang, W., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04186 · Cited by 8
Bhargava, A., Pelech, S., Woodard, B., Kerwin, J., Maherali, N., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.09976 · Cited by 8
Bhargava, A., Anant, M., Mack, H. I. D., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.11999 · Cited by 6
Chroscinski, D., Maherali, N., Griner, E., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.04586 · Cited by 5
Registered report: Melanoma genome sequencing reveals frequent PREX2 mutations
Chroscinski, D., Sampey, D. B., Hewitt, A. W., & Reproducibility Project: Cancer Biology (2014) · eLife · doi:10.7554/elife.04180 · Cited by 5
Registered report: Diverse somatic mutation patterns and pathway alterations in human cancers
Sharma, V., Young, L., Allison, A. B., Owen, K. A., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.11566 · Cited by 5
Greenfield, E. A., Griner, E., & Reproducibility Project: Cancer Biology (2014) · eLife · doi:10.7554/elife.04037 · Cited by 4
Registered report: Systematic identification of genomic markers of drug sensitivity in cancer cells
Heuvel, J. P. V., Bullenkamp, J., & Reproducibility Project: Cancer Biology (2016) · eLife · doi:10.7554/elife.13620 · Cited by 4
Pelech, S., Gallagher, C., Sutter, C., Yue, L., Kerwin, J., Bhargava, A., Iorns, E. J., Tsui, R., Denis, A., Perfito, N., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.30.470372 · Cited by 4
Self-citationKandela, I. K., Zervantonakis, I. K., & Reproducibility Project: Cancer Biology (2015) · eLife · doi:10.7554/elife.06847 · Cited by 3
Research works printed but not linked: 2
- Putnam, 1975, Philosophical Papers: Mathematics, Matter, and Method
- Raphael, 2020, A controlled trial for reproducibility, Nature, 579, 190, 10.1038/d41586-020-00672-7 · doi:10.1038/d41586-020-00672-7
Cited by
Reproducible brain-wide association studies require thousands of individuals
Marek, S., Tervo-Clemmens, B., Calabro, F. J., Montez, D. F., Kay, B. P., Hatoum, A. S., Donohue, M. R., Foran, W., Miller, R. L., Hendrickson, T. J., et al. (2022) · Nature · doi:10.1038/s41586-022-04492-9 · Cited by 1,928
Investigating the replicability of preclinical cancer biology
Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.71601 · Cited by 462
“After the replication results were known, some reviewers and commentators offered hypotheses for why the findings might have differed from the original (Errington et al., 2021b).”
ResultSelf-citationArtificial Intelligence for Drug Discovery: Are We There Yet?
Hasselgren, C., & Oprea, T. I. (2024) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-040323-040828 · Cited by 236
“Lessons (174) from eLife's Reproducibility Project, which focused on cancer biology, highlight issues like weaker-than-previously-published (175) effects and inaccurate protocol descriptions (176),”
BackgroundHamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023) · BMJ · doi:10.1136/bmj-2023-075767 · Cited by 86
Björndahl, L., Barratt, C. L. R., Mortimer, D., Agarwal, A., Aitken, R. J., Alvarez, J. G., Aneck-Hahn, N., Arver, S., Baldi, E., Bassas, L., et al. (2022) · Human Reproduction · doi:10.1093/humrep/deac189 · Cited by 71
Metadata
- Authors
- Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2021-12-07
- Volume
- 10
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W4200099901
- Cited by
- 267
- References
- 192
- FWCI
- 42.63
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0/ (vor)
- creativecommons.org/licenses/by/4.0/ (am)
- creativecommons.org/licenses/by/4.0/ (tdm)
- Funders
- Arnold Ventures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.