Reproducibility: The risks of the replication drive
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and failed replications are often disputed [50,51,52].”
From The natural selection of bad science (2016) · cites this paper as [50]
In the citing paper
“It may herald genuine heterogeneity in biological and experimental systems5,6 that is poorly controlled or not well understood.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [6]
Citations
Cites
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Petersen, O. W., Rønnov-Jessen, L., Howlett, A. R., & Bissell, M. J. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.19.9064 · Cited by 1,094
Self-citationBarcellos-Hoff, M. H., Aggeler, J., Ram, T. G., & Bissell, M. J. (1989) · Development · doi:10.1242/dev.105.2.223 · Cited by 711
Self-citationAnnouncement: Reducing our irreproducibility
(2013) · Nature · doi:10.1038/496398a · Cited by 243
NIH mulls rules for validating key results
Wadman, M. (2013) · Nature · doi:10.1038/500014a · Cited by 78
Scientists' Elusive Goal: Reproducing Study Results
Naik, G. K. (2011) · The Wall Street journal (Eastern ed. : Online)/The Wall Street journal. Eastern edition · Cited by 59
ATM Suppresses SATB1-Induced Malignant Progression in Breast Epithelial Cells
Ordinario, E., Han, H. J., Furuta, S., Heiser, L. M., Jakkula, L. R., Rodier, F., Spellman, P. T., Campisi, J., Gray, J. W., Bissell, M. J., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051786 · Cited by 25
Self-citation(2012) · Nature Medicine · doi:10.1038/nm.2978 · Cited by 5
Research works printed but not linked: 1
- Onodera, Y., Nam, J.-M. & Bissell, M. J. J. Clin. Invest. (in the press).
Cited by
Standards and Guidelines for the Interpretation and Reporting of Sequence Variants in Cancer
Li, M. M., Datto, M., Duncavage, E. J., Kulkarni, S., Lindeman, N. I., Roy, S., Tsimberidou, A. M., Vnencak-Jones, C. L., Wolff, D. J., Younes, A., et al. (2017) · The Journal of Molecular Diagnostics · doi:10.1016/j.jmoldx.2016.10.002 · Cited by 2,030
Pereira, B., Chin, S.-F., Rueda, O. M., Vollan, H.-K. M., Provenzano, E., Bardwell, H. A., Pugh, M., Jones, L., Russell, R., Sammut, S.-J., et al. (2016) · Nature Communications · doi:10.1038/ncomms11479 · Cited by 1,717
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
“However, the laboratories that are likely to respond to such a request may not be the ideal laboratories to perform such studies.(52)”
InfluentialThe natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“For example, it has been estimated that less than 1% of all psychological research is ever replicated (Makel, Plucker & Hegarty, 2012), and failed replications are often disputed (Bissell, 2013; Schnall, 2014; Kahneman, 2014).”
BackgroundHow to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Metadata
- Authors
- Bissell, M.
- Affiliations
- Lawrence Berkeley National Laboratory (US)
- Corresponding author
- Bissell, Mina
- ORCID
- Bissell, Mina
- Venue
- Nature
- Published
- 2013-11-20
- Volume
- 503
- Issue
- 7476
- Pages
- 333-334
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2003816086
- Cited by
- 99
- References
- 8
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 3 · 2021: 1 · 2020: 5 · 2019: 5 · 2018: 6 · 2017: 20 · 2016: 14 · 2015: 13 · 2014: 23 · 2013: 2
- FWCI
- 37.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Cancer Institute (R37CA064786)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- research reproducibility, replication study, research misconduct, scientific reputation, publication pressure
- MeSH terms
- Animals, Costs and Cost Analysis, Humans, Indicators and Reagents, Research, Time Factors, Reproducibility of Results, Cell Culture Techniques, Information Dissemination, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.