Reproducibility: The risks of the replication drive
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and failed replications are often disputed [50,51,52].”
From The natural selection of bad science (2016) · cites this paper as [50]
In the citing paper
“It may herald genuine heterogeneity in biological and experimental systems5,6 that is poorly controlled or not well understood.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [6]
Citations
Cites
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Petersen, O. W., Rønnov-Jessen, L., Howlett, A. R., & Bissell, M. J. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.19.9064 · Cited by 1,094
Self-citationBarcellos-Hoff, M. H., Aggeler, J., Ram, T. G., & Bissell, M. J. (1989) · Development · doi:10.1242/dev.105.2.223 · Cited by 711
Self-citationAnnouncement: Reducing our irreproducibility
(2013) · Nature · doi:10.1038/496398a · Cited by 243
NIH mulls rules for validating key results
Wadman, M. (2013) · Nature · doi:10.1038/500014a · Cited by 78
Scientists' Elusive Goal: Reproducing Study Results
Naik, G. K. (2011) · The Wall Street journal (Eastern ed. : Online)/The Wall Street journal. Eastern edition · Cited by 59
ATM Suppresses SATB1-Induced Malignant Progression in Breast Epithelial Cells
Ordinario, E., Han, H. J., Furuta, S., Heiser, L. M., Jakkula, L. R., Rodier, F., Spellman, P. T., Campisi, J., Gray, J. W., Bissell, M. J., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051786 · Cited by 25
Self-citation(2012) · Nature Medicine · doi:10.1038/nm.2978 · Cited by 5
Research works printed but not linked: 1
- Onodera, Y., Nam, J.-M. & Bissell, M. J. J. Clin. Invest. (in the press).
Cited by
Standards and Guidelines for the Interpretation and Reporting of Sequence Variants in Cancer
Li, M. M., Datto, M., Duncavage, E. J., Kulkarni, S., Lindeman, N. I., Roy, S., Tsimberidou, A. M., Vnencak-Jones, C. L., Wolff, D. J., Younes, A., et al. (2017) · The Journal of Molecular Diagnostics · doi:10.1016/j.jmoldx.2016.10.002 · Cited by 2,030
Pereira, B., Chin, S.-F., Rueda, O. M., Vollan, H.-K. M., Provenzano, E., Bardwell, H. A., Pugh, M., Jones, L., Russell, R., Sammut, S.-J., et al. (2016) · Nature Communications · doi:10.1038/ncomms11479 · Cited by 1,717
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
“However, the laboratories that are likely to respond to such a request may not be the ideal laboratories to perform such studies.(52)”
InfluentialThe natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“For example, it has been estimated that less than 1% of all psychological research is ever replicated (Makel, Plucker & Hegarty, 2012), and failed replications are often disputed (Bissell, 2013; Schnall, 2014; Kahneman, 2014).”
BackgroundHow to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel, M. C., & Plucker, J. A. (2014) · Educational Researcher · doi:10.3102/0013189x14545513 · Cited by 609
“Although writing cautions against putting too much emphasis on and trust in replication attempts, some (e.g., Bissell, 2013; Cesario, 2014) have proposed that published findings AUgUST/SEpTEMbER 2014 313 should be treated with deference until shown otherwise and that false findings will eventually…”
BackgroundDetecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
An open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
“A low reproducibility estimate might prompt concern that the reputation of cancer biology research will be damaged ( Bissell, 2013 ).”
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
“…high profile or is potentially field-defining—qualities that one would assume would increase the novelty and interest of the (non) replication itself (Goldacre, 2011; Wilson, 2011; Nosek et al., 2012; Yong, 2012a, b; Aldhous, 2011; for a view from the other side of replication, see Bissell, 2013).”
BackgroundCancer-Associated PIK3CA Mutations in Overgrowth Disorders
Madsen, R. R., Vanhaesebroeck, B., & Semple, R. K. (2018) · Trends in Molecular Medicine · doi:10.1016/j.molmed.2018.08.003 · Cited by 276
Models Are Stupid, and We Need More of Them
Smaldino, P. E. (2017) · Computational Social Psychology · doi:10.4324/9781315173726-14 · Cited by 236
“…to ensure that a “file drawer effect” doesn’t lead to over-representation of positive results (Franco, Malhotra, & Simonovits, 2014), while others are skeptical of the value of failed replications because replication studies may have diminished power (Kahneman, 2011; Bissell, 2013; Schnall, 2014).”
BackgroundCombining DNA damaging therapeutics with immunotherapy: more haste, less speed
Brown, J. S., Sundar, R., & Lopez, J. (2018) · British Journal of Cancer · doi:10.1038/bjc.2017.376 · Cited by 231
Finkel, E. J., Eastwick, P. W., & Reis, H. T. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000007 · Cited by 202
Bergh, D. D., Sharp, B. M., Aguinis, H., & Li, M. (2017) · Strategic Organization · doi:10.1177/1476127017701076 · Cited by 182
“Discussion A high profile debate on the replicability of study findings is emerging across multiple disciplines (e.g. Baker, 2012; Bissell, 2013; Bosco et al., 2016; Carpenter, 2012) raising concerns about”
BackgroundIoannidis, J. P. A., Kim, B. Y. S., & Trounson, A. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0314-y · Cited by 175
Cheng, J., Zhang, J., Han, Y., Wang, X., Ye, X., Meng, Y., Parwani, A., Han, Z., Feng, Q., & Huang, K. (2017) · Cancer Research · doi:10.1158/0008-5472.can-17-0313 · Cited by 142
Understanding replication of experiments in software engineering: A classification
Gómez, O. S., Juristo, N., & Vegas, S. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.04.004 · Cited by 125
“– Bisell [8] claims that it takes her from four to six years, and at times much longer, to get results conclusive enough to be able to write a paper about her experiments on the roles of the microenvironment and extracellular matrix in cancer.”
BackgroundResultReplication, Communication, and the Population Dynamics of Scientific Discovery
McElreath, R., & Smaldino, P. E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136088 · Cited by 117
“What is the evidential value of replication, positive or negative? What is the impact of publication bias [13]? If replication is part of an “invisible hand”[14] that corrects scientific errors, how much replication is needed? And what are the risks of poorly designed or interpreted replication attempts [9]? When repl…”
BackgroundHow to make more published research true
Ioannidis, J. P. A. (2015) · Acimed · Cited by 134
Next-generation sequencing: recent applications to the analysis of colorectal cancer
Vecchio, F. D., Mastroiaco, V., Marco, A. D., Compagnoni, C., Capece, D., Zazzeroni, F., Capalbo, C., Alesse, E., & Tessitore, A. (2017) · Journal of Translational Medicine · doi:10.1186/s12967-017-1353-y · Cited by 120
Enhancing Reuse of Data and Biological Material in Medical Research: From FAIR to FAIR-Health
Holub, P., Kohlmayer, F., Prasser, F., Mayrhofer, M. T., Schlünder, I., Martin, G. M., Casati, S., Koumakis, L., Wutte, A., Kozera, Ł., et al. (2018) · Biopreservation and Biobanking · doi:10.1089/bio.2017.0110 · Cited by 102
Bringing the Gold Standard into the Classroom: Replication in University Teaching
Janz, N. (2015) · International Studies Perspectives · doi:10.1111/insp.12104 · Cited by 113
BBMRI-ERIC Directory: 515 Biobanks with Over 60 Million Biological Samples
Holub, P., Swertz, M. A., Reihs, R., van Enckevort, D., Müller, H., & Litton, J. (2016) · Biopreservation and Biobanking · doi:10.1089/bio.2016.0088 · Cited by 95
Data management plans: the missing perspective
Williams, M., Bagwell, J., & Nahm Zozus, M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.004 · Cited by 75
Cracking the context-specific PI3K signaling code
Madsen, R. R., & Vanhaesebroeck, B. (2020) · Science Signaling · doi:10.1126/scisignal.aay2940 · Cited by 82
Reproducibility of science: Fraud, impact factors and carelessness
Eisner, D. A. (2018) · Journal of Molecular and Cellular Cardiology · doi:10.1016/j.yjmcc.2017.10.009 · Cited by 73
“Noting that NIH is considering making validation compulsory, Bissell points out that validation can sometimes take a long time (and for really novel work) be very difficult [45].”
BackgroundGüttinger, S. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-019-0269-1 · Cited by 84
“…is generic and therefore not context-sensitive (ibid, p. 5).10 The history-dependent nature of organisms also explains certain research practices in biology, for instance why researchers often exchange cell lines or other living model systems with each other (see also (Bissell 2013) on this point).”
BackgroundRigor or Mortis: Best Practices for Preclinical Research in Neuroscience
Steward, O., & Balice‐Gordon, R. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.042 · Cited by 63
“This is especially true with complicated modern techniques that require years of experience to master (for a viewpoint on this, see Bissell, 2013).”
Parrish, M. C., Tan, Y. J., Grimes, K., & Mochly‐Rosen, D. (2018) · The Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010818-021625 · Cited by 69
Modulation of the cancer cell transcriptome by culture media formulations and cell density
Kim, S. W., KIM, S.-J., Langley, R. R., & Fidler, I. J. (2015) · International Journal of Oncology · doi:10.3892/ijo.2015.2930 · Cited by 52
Time to do something about reproducibility
Morrison, S. J. (2014) · eLife · doi:10.7554/elife.03981 · Cited by 44
“However, others have argued there are bound to be errors, but that science is self-correcting and that the system is working (Bissell, 2013).”
BackgroundWhat paint can tell us: A fractal analysis of neurological changes in seven artists.
Forsythe, A., Williams, T., & Reilly, R. G. (2016) · Neuropsychology · doi:10.1037/neu0000303 · Cited by 50
Guidelines for manuscript submission in the peer-reviewed pharmacological literature
Mullane, K., Enna, S. J., Piette, J. G., & Williams, M. J. (2015) · Biochemical Pharmacology · doi:10.1016/j.bcp.2015.06.023 · Cited by 44
Reproducible research: a minority opinion
Drummond, C. (2017) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2017.1413140 · Cited by 39
“Bissell (2013) confirms that this is already happening.”
BackgroundPrivacy in Sensor-Driven Human Data Collection: A Guide for PractitionersPreprint
Stopczynski, A., Pietri, R., Pentland, A., Lazer, D. M. J., & Lehmann, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.5299 · Cited by 42
“Mina Bissell points in [92] to the challenges of replication in a biomedical context, due to the required cost, expertise, sensitivity to conditions etc.”
BackgroundLuxenhofer, R. (2015) · Nanomedicine · doi:10.2217/nnm.15.139 · Cited by 42
Morvan, M. L., Zinovyev, A. Y., & Vert, J. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005573 · Cited by 35
Hirotsu, Y., Kojima, Y., Okimoto, K., Amemiya, K., Mochizuki, H., & Omata, M. (2016) · BMC Genomics · doi:10.1186/s12864-016-3166-4 · Cited by 34
Can cancer researchers accurately judge whether preclinical reports will reproduce?
Benjamin, D., Mandel, D. R., & Kimmelman, J. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2002212 · Cited by 32
Enhancing reproducibility: Failures from Reproducibility Initiatives underline core challenges
Mullane, K., & Williams, M. (2017) · Biochemical Pharmacology · doi:10.1016/j.bcp.2017.04.008 · Cited by 28
Cheng, H. G., & Anthony, J. C. (2016) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-016-1318-0 · Cited by 34
“Nevertheless, as a final note of this introduction, we draw attention to recent concerns about reproducibility of findings, one of the most important but often neglected criteria when assessing scientific validity of evidence [22].”
BackgroundWho Should Do Replication Labor?
Romero, F. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918803619 · Cited by 29
“Another option is to suggest that the replication experiment was not executed correctly because the design is hard to export to other laboratories (Bissell, 2013).”
BackgroundVirtual Reference Environments: a simple way to make research reproducible
Hurley, D., Budden, D., & Crampin, E. J. (2014) · Briefings in Bioinformatics · doi:10.1093/bib/bbu043 · Cited by 27
Forgotten treasures: the fate of data in animal behaviour studies
Caetano, D. S., & Aisenberg, A. (2014) · Animal Behaviour · doi:10.1016/j.anbehav.2014.09.025 · Cited by 29
“Behavioral plasticity, geographic variation and environmental fluctuations make the reproducibility of such studies challenging (see related discussion in Bissell, 2013).”
BackgroundOpen Science is for Aging Research, Too
Isaacowitz, D. M., & Lind, M. (2019) · Innovation in Aging · doi:10.1093/geroni/igz028 · Cited by 26
Jagged competencies: Measuring the reliability of generative AI in academic research
Thomas, L. D. W., Romasanta, A. K. S., & Priego, L. P. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115804 · Cited by 28
Caring for Social Complexity in Nanomedicine
Schillmeier, M. (2015) · Nanomedicine · doi:10.2217/nnm.15.149 · Cited by 21
Strupler, N., & Wilkinson, T. C. (2017) · Open Archaeology · doi:10.1515/opar-2017-0019 · Cited by 11
“Although, as some have rightly argued, simply mimicking data, script and output is not the same as understanding an analysis (Bissell 2013).”
ResultFDG-PET scans in patients with Kraepelinian and non-Kraepelinian schizophrenia
Bralet, M., Buchsbaum, M. S., DeCastro, A., Shihabuddin, L., & Mitelman, S. A. (2015) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-015-0633-x · Cited by 21
Cumulative Science via Bayesian Posterior Passing
Brand, C. O., Ounsley, J., van der Post, D. J., & Morgan, T. J. H. (2019) · Meta-Psychology · doi:10.15626/mp.2017.840 · Cited by 17
Inherited Disease Genetics Improves the Identification of Cancer-Associated Genes
Zhao, B., & Pritchard, J. R. (2016) · PLoS Genetics · doi:10.1371/journal.pgen.1006081 · Cited by 21
Applying Findable, Accessible, Interoperable, and Reusable Principles to Biospecimens and Biobanks
Rush, A., Byrne, J. A., & Watson, P. H. (2024) · Biopreservation and Biobanking · doi:10.1089/bio.2023.0110 · Cited by 16
“14 Just as with the issue of scientific reproducibility, 15 there will be a range of viewpoints, 16 but we believe that there are many possible impacts from lost opportunities to share biospecimens.”
Cellular Metrology: Scoping for a Value Proposition in Extra- and Intracellular Measurements
Faruqui, N., Kummrow, A., Fu, B., Divieto, C., Rojas-Cornejo, F., Kisulu, F., Cavalcante, J. J. V., Wang, J., Campbell, J. J., Martins, J. L., et al. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00456 · Cited by 16
“This can also mitigate the growing risks of the replication drive that threatens to compromise promising research results due to the lack of reference systems that can fully address the complexity of cellular measurements (Bissell, 2013; Freedman, 2017).”
BackgroundThe nature of the biological material and the irreproducibility problem in biomedical research
Papamokos, G. (2019) · The EMBO Journal · doi:10.15252/embj.2018101011 · Cited by 14
“From the wealth of literature on irreproducibility, I here discuss two papers that highlight and emphasize the sensitivity of the biological material to environmental factors no matter how minute these are (Bissell, 2013).”
Zozus, M. N., Richesson, R., Walden, A., Tenenbaum, J., & Hammond, W. E. (2016) · PubMed Central · Cited by 14
A very simple and fast way to access and validate algorithms in reproducible research
Stegmayer, G. S., Pividori, M., & Milone, D. H. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbv054 · Cited by 12
Reproducibility: A Primer on Semantics and Implications for Research
Pellizzari, E. D., Lohr, K. N., Blatecky, A. R., & Creel, D. V. (2017) · doi:10.3768/rtipress.2017.bk.0020.1708 · Cited by 13
Translational Research: From Biological Discovery to Public Benefit (or Not)
Emmert‐Buck, M. R. (2014) · Advances in Biology · doi:10.1155/2014/278789 · Cited by 12
“At one level, nonreproducibility and lack of scalability of novel research findings is expected and is an important part of the scientific process; risk-taking, daring established scientific and medical dogma, and contrarian thinking are the lifeblood of the enterprise, leading inevitably to some false leads, incorrec…”
BackgroundAhuis, T. P., Smyk, M. K., Laloux, C., Aulehner, K., Bray, J. G., Waldron, A., Miljanovic, N., Seiffert, I., Song, D., Boulanger, B., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309521 · Cited by 10
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00005-7 · Cited by 13
State of FAIRness in ESFRI Projects
Wittenburg, P., de Jong, F. M. G., Uytvanck, D. V., Cocco, M., Jeffery, K., Lautenschlager, M., Thiemann, H., Hellström, M., Asmi, A., & Holub, P. (2019) · Data Intelligence · doi:10.1162/dint_a_00045 · Cited by 10
“· Reproducibility and reusability: Having biomedical research facing dramatic reproducibility challenges for more than a decade [13-20], BBMRI-ERIC promotes quality management in biobanks and leads development of provenance information management standard in ISO TC276 (PWI23494-1).”
BackgroundGenetic Markers of Cisplatin-Induced Hearing Loss in Children
Carleton, B., Ross, C. J., Pussegoda, K., Bhavsar, A. P., Visscher, H., Lee, J. W., Brooks, B., Rassekh, S. R., Dubé, M., & Hayden, M. R. (2014) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2014.92 · Cited by 9
Matarese, V. (2023) · Inquiry · doi:10.1080/0020174x.2023.2278032 · Cited by 8
Social Information use by Barnacle GeeseBranta leucopsis, an Experiment Revisited
Kurvers, R. H. J. M., Straates, K., Ydenberg, R. C., van Wieren, S. E., Swierstra, P. S., & Prins, H. H. T. (2014) · Ardea · doi:10.5253/arde.v102i2.a7 · Cited by 8
The Division of Replication Labor
Romero, F. (2020) · Philosophy of Science · doi:10.1086/710625 · Cited by 13
“…it is possible to question the epistemic import of either on at least four grounds: (1) random variation, (2) the commonality of QRPs (John et al. 2012), (3) un-discovered mediators and moderators (Cesario 2014), or (4) the dif fi culties of importing original designs from other labs (Bissell 2013).”
BackgroundMethodResearch Wranglers: Initiatives to Improve Reproducibility of Study Findings
Schmidt, C. W. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.122-a188 · Cited by 8
“Epithelial cell lines, for instance, are exquisitely sensitive to slight shifts in their microenvironment, and even highly skilled scientists can unknowingly introduce changes that affect experimental outcomes, wrote Mina Bisell, a cancer researcher at Lawrence Berkeley National Laboratory, in a 2013 commentary on rep…”
BackgroundMora, A. R., & Forstmeier, W. (2014) · Ethology · doi:10.1111/eth.12263 · Cited by 7
Cooper, T. (2023) · FEMS Yeast Research · doi:10.1093/femsyr/foac065 · Cited by 5
Life sciences lag in stringent standards
Freedman, L. (2013) · Nature · doi:10.1038/504376c · Cited by 5
Science with no fiction: measuring the veracity of scientific reports by citation analysisPreprint
Grabitz, P., Lazebnik, Y. A., Nicholson, J. M., & Rife, S. C. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/172940 · Cited by 5
“Because the R-factor relies on experimental reports from experts in the field, this approach alleviates or bypasses the concerns associated with replication initiatives (Bissell, 2013; Editorial, 2017b), such as lack of technical expertise or of suitable experimental models in a laboratory specialized in replicating p…”
BackgroundThe role of theory in mitigating the ‘reproducibility crisis’
Marone, L. (2024) · Ecología Austral · doi:10.25260/ea.24.34.1.0.2291 · Cited by 4
“First of all, irreproducibility in many disciplines may result from the variability of nature and historical contingency (Bissell 2013; Fidler et al. 2017; Pérez-Velázquez 2019; Desjardins et al. 2021).”
BackgroundReplication: A Critique and Overview for Kinesiology
Martin, J. J., & Yukhymenko–Lescroart, M. A. (2025) · Kinesiology Review · doi:10.1123/kr.2024-0057 · Cited by 5
The Tangled Knots of Neuroscientific Experimentation
Frisch, S. (2021) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-021-09617-9 · Cited by 3
“Even slight shifts in the microenvironment affect how cells divide, thereby rapidly acquiring epigenetic and genetic changes which may affect forthcoming results in unpredictable ways (Bissell, 2013).”
BackgroundA Modelling Ecosystem for Prognostics
Astfalck, L., Hodkiewicz, M. R., KEATING, A. J., Cripps, E., & PECHT, M. G. (2016) · Annual Conference of the PHM Society · doi:10.36001/phmconf.2016.v8i1.2568 · Cited by 3
“Bissel (2013) has warned that the increase in reproducibility exposure should not encourage scepticism towards other scientists in the field, but encourage that research is conducted in a scientific and ethical manner.”
BackgroundThe R-Factor: A Measure of Scientific VeracityPreprint
Nicholson, J. M., & Lazebnik, Y. A. (2014) · doi:10.15200/winn.140832.20404 · Cited by 6
A conceptual review of uses and meanings of reproducibility and replicationPreprint
Ulpts, S., & Schneider, J. W. (2024) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/entu4 · Cited by 3
Reproducibility literature analysis - a federal information professional perspective
Antognoli, E., Avila, R. L., Sears, J., Christiansen, L. L., Tieman, J., & Hart, J. (2020) · IASSIST Quarterly · doi:10.29173/iq967 · Cited by 2
Villain of Molecular Biology: Why are we not reproducible in research?
Bhardwaj, V. (2015) · F1000Research · doi:10.12688/f1000research.6854.1 · Cited by 2
Viswanathan, V. K. (2014) · Gut Microbes · doi:10.4161/gmic.28340 · Cited by 2
“In a thoughtprovoking article on the reproducibility of scientific results, cancer biologist Mina Bissell expressed concern about the drive from the NIH, and some journals, to put pressure on investigators to demonstrate that their experiments can be replicated.(1) While Bissell clearly supports the necessity for repl…”
BackgroundAnalyzing the concept of independence in psychedelic research
Cheung, K., Ehrenkranz, R. C., Earp, B. D., Jacobs, E., & Yaden, D. B. (2026) · Accountability in Research · doi:10.1080/08989621.2025.2601225 · Cited by 1
“Further paralleling IEPs, some in biology have suggested that replications should be conducted by an independent, self-appointed entity that charges for the service (Bissell 2013): yet, the kind of independence sought after for independent replications is often similarly unclear.”
Privacy in Sensor-Driven Human Data Collection: A Guide for Practitioners Working Paper
Stopczynski, A., Pietri, R., Pentland, A., & Lazer, D. M. J. (2014) · Cited by 5
Do We Need a Science of Science?
Maiväli, Ü. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-418689-7.00001-6 · Cited by 1
Brunette, D. M. (2016) · Endodontic Topics · doi:10.1111/etp.12097 · Cited by 1
Replication and Knowledge Production in Empirical Software Engineering Research
Krein, J. L. (2014) · ScholarsArchive (Brigham Young University) · Cited by 3
How often are replication attempts questioned?
Hensel, P. G. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2198126 · Cited by 1
“Reputational harm may result in serious professional consequences, including reduced chances of obtaining funding for future research (Bissell 2013; Bohannon 2014).”
Bikard, M. A. (2017) · SSRN Electronic Journal · Cited by 1
(2014) · Nature Genetics · doi:10.1038/ng.2972 · Cited by 1
A conceptual review of uses and meanings of reproducibility and replicationPreprint
Ulpts, S., & Schneider, J. W. (2025) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/entu4_v3 · Cited by 1
Como tornar mais confiável a pesquisa publicada
Ioannidis, J. P. A. (2015) · Acimed · doi:10.36512/rcics.v26i2.791
Shavit, A. (2014) · PhilSci-Archive (University of Pittsburgh)
A new standard in reproducibility
Haas, M. J. (2014) · Science-Business eXchange · doi:10.1038/scibx.2014.76
Zellkultur-Qualitätsmanagement — Kontrolle der biologischen Variabilität
Irelan, J., Schwengberg, S., & Ketterlinus, R. (2014) · BIOspektrum · doi:10.1007/s12268-014-0444-z
Shavit, A. (2016) · Perspectives on Science · doi:10.1162/posc_a_00215
Prediction of Molecular Mechanisms of Breast Cancer MetastasisPreprint
Siwo, G., Stolovitzky, G. A., & Assefa, S. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/106179
The Changing Nature of the Information Supply Chain
Beard, R. R. (2017) · IAFOR Journal of Business & Management · doi:10.22492/ijbm.2.1.03
A survey on information sources used by academic researchers to evaluate scientific instrumentsPreprint
Bergenholtz, C., MacAulay, S. C., Kolympiris, C., & Seim, I. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/253799
Replication and preregistration
Krause, M. S. (2019) · Quality & Quantity · doi:10.1007/s11135-019-00877-7
(2016) · Wiley eBooks · doi:10.1002/9783527681969.biblio
Nature's readers comment online
(2013) · Nature · doi:10.1038/505026d
A conceptual review of uses and meanings of reproducibility and replicationPreprint
Ulpts, S., & Schneider, J. W. (2025) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/entu4_v2
Metadata
- Authors
- Bissell, M.
- Affiliations
- Lawrence Berkeley National Laboratory (US)
- Corresponding author
- Bissell, Mina
- ORCID
- Bissell, Mina
- Venue
- Nature
- Published
- 2013-11-20
- Volume
- 503
- Issue
- 7476
- Pages
- 333-334
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2003816086
- Cited by
- 99
- References
- 8
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 3 · 2021: 1 · 2020: 5 · 2019: 5 · 2018: 6 · 2017: 20 · 2016: 14 · 2015: 13 · 2014: 23 · 2013: 2
- FWCI
- 37.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Cancer Institute (R37CA064786)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- research reproducibility, replication study, research misconduct, scientific reputation, publication pressure
- MeSH terms
- Animals, Costs and Cost Analysis, Humans, Indicators and Reagents, Research, Time Factors, Reproducibility of Results, Cell Culture Techniques, Information Dissemination, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.