1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 3,501–3,600 of 4,204
Peer Review #1 of "Nine best practices for research software registries and repositories (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1023v0.1/reviews/1
Peer Review #2 of "Nine best practices for research software registries and repositories (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1023v0.2/reviews/2
Peer Review #2 of "Nine best practices for research software registries and repositories (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1023v0.1/reviews/2
Peer Review #1 of "Nine best practices for research software registries and repositories (v0.3)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1023v0.3/reviews/1
Turoman, N., Heyard, R., Schwab, S., Furrer, E., Vergauwe, E., & Held, L. (2022) · doi:10.31222/osf.io/nb928
Nguyen, M., La, V., Le, T.-T., & Vuong, Q. (2022) · doi:10.31219/osf.io/nkq5v
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.013
Rejection Fallacies: Who’s Exaggerating What?
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.010
More Auditing: Objectivity and Model Checking
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.012
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.018
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.006
Error Probing Tools versus Logics of Evidence
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.003
Evaluating organizational research climate to assess research integrity
Kennett, M. R. (2022) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/91588
Van, J., Nielsen, S. E., & Kirwan, C. B. (2022) · Neuroimage Reports · doi:10.1016/j.ynirp.2022.100135
(2022) · Haug Verlag in Georg Thieme Verlag KG eBooks · doi:10.1055/b-0042-191131
Wissenschaft in ›Unordnung‹? Gefiltertes Wissen und die Glaubwürdigkeit der Wissenschaft
Mößner, N. (2022) · Science studies · doi:10.1515/9783839462102-005 · Cited by 4
Silva, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4210504
Teaching replication through replication to solve the replication “crisis”
Perrault, E. K. (2022) · Communication Teacher · doi:10.1080/17404622.2022.2123110
Auditing: Biasing Selection Effects and Randomization
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.011
Capability and Severity: Deeper Concepts
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.008
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.007
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.001
Deconstructing the N-P versus Fisher Debates
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.015
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.019
Wissenschaftliche Fairness: Wissenschaft zwischen Integrität und Fehlverhalten
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.1515/9783839459669 · Cited by 7
Navigating the challenges in creating complex data systems: a development philosophyPreprint
Dittmer, S., Roberts, M. T., Gilbey, J., Biguri, A., AIX-COVNET Collaboration, Preller, J., Rudd, J. H. F., Aston, J. A. D., & Schönlieb, C. (2022) · arXiv (Cornell University) · doi:10.17863/cam.96892
Zheng, Y.-T., Liu, Y., Yang, J., Dong, L.-H., Zhang, R., Tian, S., Yu, Y., Ren, L., Hou, W., Zhu, F., et al. (2022) · bioRxiv · doi:10.1101/2022.10.24.513612 · Cited by 1
Hagenström, F. (2022) · Science studies · doi:10.14361/9783839459669-005
Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-006
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-009
Czesnick, H. (2022) · Science studies · doi:10.14361/9783839459669-002
Frisch, K. (2022) · Science studies · doi:10.14361/9783839459669-007
Schlussüberlegungen - Faire Wissenschaft
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-008
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-001
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-toc
Steckt die Wissenschaft in einer Krise?
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-003
Kapitel 1: Zwischen Integrität und Fehlverhalten
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-004
Frisch, K., Hagenström, F., & Reeg, N. (2022) · Science studies · doi:10.14361/9783839459669-fm
Reconstructing the electrical dynamics on the heart
Rüchardt, B. (2022) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-9545
Problems of Measurement and Meaning in Biology
Weimer, W. B. (2022) · Palgrave studies in classical liberalism · doi:10.1007/978-3-031-17173-4_4
A literature review of methods for assessment of reproducibility in sciencePreprint
Nordling, T. E. M., & Peralta, T. M. (2022) · Research Square · doi:10.21203/rs.3.rs-2267847/v3
Open-Source Workflows for Reproducible Molecular Simulation
Fothergill, J. W. (2022) · ScholarWorks (Boise State University) · doi:10.18122/td.1968.boisestate
[PhD Dissertation] Good Research PracticesPreprint
Sarafoglou, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7aj5h
“Voodoo” Science in Neuroimaging: How a Controversy Transformed into a Crisis
Sauvayre, R. (2022) · Social Sciences · doi:10.3390/socsci12010015
Un plan d’action pour l’édition Diamant
Borrell-Damián, L., & Rooryck, J. (2022) · doi:10.4000/books.oep.15942 · Cited by 1
Nair, S. (2022) · doi:10.4000/books.oep.15859 · Cited by 1
Science ouverte et évaluation académique dans un monde pluriel
Beigel, F. (2022) · doi:10.4000/books.oep.15986 · Cited by 2
The PRO-RES Guidance Framework for Scientific Research: A Novel Response to Long-Standing Issues
Kavouras, P., & Charitidis, C. A. (2022) · Research ethics forum · doi:10.1007/978-3-031-15746-2_7
Making Room for Everyone’s Talent
Huijpen, K. (2022) · doi:10.4000/books.oep.16171 · Cited by 1
Academic Publishing and Open Science – Where do we stand?
Mounier, P. (2022) · doi:10.4000/books.oep.16136
Policies to support Open Source and Open science
Choudhury, S. (2022) · doi:10.4000/books.oep.16192
Nair, S. (2022) · doi:10.4000/books.oep.16091
Construire le pilier logiciel de la science ouverte
Cosmo, R. D. (2022) · doi:10.4000/books.oep.16034 · Cited by 1
Science ouverte, édition et code
Harrison, M. (2022) · doi:10.4000/books.oep.16052
Conference, O. S. E. (2022) · doi:10.4000/books.oep.16237
To What extend are Early Career Researchers the Harbingers of Change?
Boukacem‐Zeghmouri, C. (2022) · doi:10.4000/books.oep.16159
How Psychology deals with Open Science. Principles and practices
Cristea, I. A. (2022) · doi:10.4000/books.oep.16112
New forms of publication. Why? How? How far?
Polka, J. (2022) · doi:10.4000/books.oep.16139
Gabriel, M. (2022) · doi:10.4000/books.oep.15852
Open Science Awards Ceremony and Conclusions: Opening interventions
Giry, C., & Berre, D. L. (2022) · doi:10.4000/books.oep.16194
Science ouverte, évaluation de la recherche et SHS (sciences humaines et sociales)
Kulczycki, E. (2022) · doi:10.4000/books.oep.16012 · Cited by 1
Conference, O. S. E. (2022) · doi:10.4000/books.oep.16236
Faire de la place pour les talents de chacun
Huijpen, K. (2022) · doi:10.4000/books.oep.16006
Transparency of Health Research
Boutron, I. (2022) · doi:10.4000/books.oep.16107
Academic Publishing and Latin America
Becerril-García, A. (2022) · doi:10.4000/books.oep.16142
Time‐resolved microscopy made easy
Loidolt-Krüger, M. (2023) · PhotonicsViews · doi:10.1002/phvs.202300002
Schilder, B. M., Murphy, A. E., & Skene, N. (2023) · Research Square · doi:10.21203/rs.3.rs-2399015/v1
British Psychological Society (2018) · The Cognitive Psychology Bulletin · doi:10.53841/bpscog.2018.1.3.22
Report of the Working Group on Electronic Lab Notebooks
Rabemanantsoa, T., Pigeon, D., Mathieu, G., Chipeaux, C., Duvillard, S., Gruson-Daniel, C., Herbet, M. E., Legrand, A., Leon, N., Libri, D., et al. (2021) · doi:10.52949/30 · Cited by 2
The future of psychology: Approaches to enhance therapeutic outcomes
Stapleton, P., Baumann, O., & Church, D. (2023) · Frontiers research topics · doi:10.3389/978-2-83251-265-4
Folkerts, J. (2023) · Springer eBooks · doi:10.1007/978-3-658-39221-5_3
LISTER: Semi-automatic metadata extraction from annotated experiment documentation in eLabFTWPreprint
Musyaffa, F. A., Rapp, K., & Gohlke, H. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.02.20.529231
2022 IEEE Signal Processing Society Awards [Society News]
(2023) · IEEE Signal Processing Magazine · doi:10.1109/msp.2023.3236465
Open and Reproducible Science: Desirable or Even Mandatory, But Not So Simple! [From the Editor]
Christian Jutten, B. (2023) · IEEE Signal Processing Magazine · doi:10.1109/msp.2023.3235560
Ethics, Legality, and Safety for Geneticists
Kolstoe, S. E. (2023) · Methods in molecular biology · doi:10.1007/978-1-0716-3004-4_17
Vila, G., Bonnet, A., Chauveau, F., Gaillard, S., Durand‐Dubief, F., Camarasu-Pop, S., & Ratiney, H. (2023) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi53787.2023.10230744
Doctoral and professional programs
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00013-4 · Cited by 1
Taylor, J. A., & Hedges, L. V. (2023) · doi:10.1063/9780735425514_023 · Cited by 4
Viviani, M., Montemurro, M., Trusolino, L., Bertotti, A., Urgese, G., & Grassi, E. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1143014
Nakagawa, S., Lagisz, M., Yang, Y., & Drobniak, S. M. (2023) · doi:10.31219/osf.io/h7ufg
Chind, A. P. (2023) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnad046
Haim, A., Shaw, S. T., & Heffernan, N. T. (2023) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/xkmfw · Cited by 2
Cognitive Metascience: A New Approach to the Study of TheoriesPreprint
Miłkowski, M. (2023) · doi:10.31234/osf.io/xvyz3
ЕПОХА ПОСТПРАВДИ У СУЧАСНОМУ СВІТІ: ВИТОКИ ТА ПРИЧИНИ
Коркос, Я. (2023) · Наукові перспективи (Naukovì perspektivi) · doi:10.52058/2708-7530-2023-4(34)-537-554
The multiversal methodology as a remedy of the replication crisisPreprint
Cantone, G. G. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/kuhmz
Mapping the Narrow Reproducibility Discourse
Ulpts, S., & Schneider, J. W. (2023) · International Conference on Science, Technology and Innovation Indicators (STI) · doi:10.55835/6442f12449e01ad5eb48d798
Bennett, G. (2023) · New Perspectives in Behavioral & Health Sciences · doi:10.1007/978-981-99-2359-5_1 · Cited by 1
Diamond open access with preregistration: a new publishing model for palaeontologyPreprint
Drage, H. B., & Hearing, T. W. W. (2023) · doi:10.31223/x57679
Research History on “BioVL2: An Egocentric Biochemical Video-and-Language Dataset”
Nishimura, T. (2023) · Journal of Natural Language Processing · doi:10.5715/jnlp.30.833
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.