1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 3,401–3,500 of 4,204
seqgra: principled selection of neural network architectures for genomics prediction tasks
Krismer, K., Hammelman, J., & Gifford, D. K. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac101
Sterken, P. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/4ehns
Qualitätskontrolle und Cell Banking
Gstraunthaler, G. J. A., & Lindl, T. (2021) · Springer eBooks · doi:10.1007/978-3-662-62606-1_14
Towards Reproducible Enzyme Modeling with Isothermal Titration CalorimetryPreprint
Ott, F., Rabe, K. S., Niemeyer, C. M., et al. (2021) · ChemRxiv · doi:10.26434/chemrxiv.14555874
Practicing What is Preached: Exploring Reproducibility Compliance of Papers on Reproducible Research
Curty, R. G., Lee, J., Chang, W., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-96957-8_23
Chlumsky, R., Craig, J. R., Lin, S. G. M., et al. (2022) · Geoscientific model development · doi:10.5194/gmd-2021-336-rc2
Current Status and Future of Surface Analysis and Micro-beam Analysis in the Industrial Field
Yanagiuchi, K. (2022) · Vacuum and Surface Science · doi:10.1380/vss.65.128
Replication crisisPreprint
Quang-Loc, N. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/4wd5x
Reproducibility problem with a proposed standard method to measure disinfection efficacyPreprint
Hilgren, J., Srikanth, M., Brutofsky, M., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.03.15.484496
Chlumsky, R. (2022) · Geoscientific model development · doi:10.5194/gmd-2021-336-ac2
Purpose of the Special Issues : Reliability of Surface Analysis Measurement Data
Suzuki, M. (2022) · Vacuum and Surface Science · doi:10.1380/vss.65.100
Chlumsky, R. (2022) · Geoscientific model development · doi:10.5194/gmd-2021-336-ac1
The Neural Correlates of Expectations Effects
Wicht, C. A. (2022) · doi:10.51363/unifr.sth.2022.003
Datanhallinnan merkitys, tutkijoiden osaaminen ja kirjaston rooli kulttuurinmuutoksessa
Rantasaari, J. (2022) · Signum · doi:10.25033/sig.116007
Statistics: The Practice of Data Surgeon
Olubusoye, O. E., & Akintande, O. J. (2022) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003261148-14
Hauswedell, H. (2021) · Computational biology · doi:10.1007/978-3-030-90990-1_3
Arévalo, H. E. A., & Contreras, M. G. R. (2022) · Revista Ciencia Multidisciplinaria CUNORI · doi:10.36314/cunori.v6i1.181 · Cited by 1
L'urgence de l'intégrité académique
Furrer, P. (2021) · EMS Editions eBooks · doi:10.3917/ems.berga.2021.01.0459
Are the statistical tests the best way to deal with the biomarker selection problem?
Urkullu, A., Pérez, A., & Calvo, B. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01677-6 · Cited by 1
Rostovtseva, V. V., Mezentseva, A. A., & Бутовская, М. Л. (2020) · Tomsk Journal of Linguistics and Anthropology · doi:10.23951/2307-6119-2020-2-127-140
Distilling knowledge from the flood
(2018) · Nature Climate Change · doi:10.1038/s41558-018-0200-3
Beegle, J. R. (2018) · Stem Cells · doi:10.1002/stem.2930
Can we Trust Science and, if so, Why?Preprint
Wuttke, A. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/7fmt9
Políticas de Ciência Aberta e a abertura dos dados de pesquisa
Costa, M. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap2 · Cited by 2
(2020) · Advances in Pulmonary Hypertension · doi:10.21693/1933-088x-19.2.i
Reports of recent Committee meetings
(2017) · Physiology News · doi:10.36866/pn.107.6
Peer Review #2 of "Towards FAIR protocols and workflows: the OpenPREDICT use case (v0.1)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.281v0.1/reviews/2
Park, K. (2017) · Journal of Controlled Release · doi:10.1016/j.jconrel.2017.12.011
Peer Review #2 of "Towards FAIR protocols and workflows: the OpenPREDICT use case (v0.2)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.281v0.2/reviews/2
Open Science & Development Engineering: Evidence to Inform Improved Replication ModelsPreprint
Galiani, S., Gertler, P., & Romero, M. (2017) · doi:10.31222/osf.io/ryvud
Are Most Published Research Findings False In A Continuous Universe?Preprint
Neves, K., Tan, P. B., & Amaral, O. B. (2021) · doi:10.31222/osf.io/jk7sa
Significance Testing in Natural and Biological Systems: A ReviewPreprint
Kak, S. C. (2021) · doi:10.36227/techrxiv.14599836
Willison, J. (2020) · Springer briefs in education · doi:10.1007/978-981-15-2683-1_5
The Nature of Experimental Work
Moffat, R. J., & Henk, R. W. (2020) · Wiley eBooks · doi:10.1002/9781119532828.ch2
Webb, A. A. R. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.734610015.793554734
Gonzalez-Beltran, A. N., Osborne, F., Peroni, S., et al. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3055257
Faculty Opinions recommendation of Systematic benchmarking of omics computational tools.
Thompson, J. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.735401949.793560098
(2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1751.pub2
First group of Members awarded Fellowship
(2017) · Physiology News · doi:10.36866/pn.107.8
Rittman, M. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6
Mergny, J. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.737405003.793575646
(2019) · Elsevier eBooks · doi:10.1016/b978-0-12-815043-6.09998-5
Schmid, B. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736726087.793578052
Improving quality of preclinical academic research through auditing:Preprint
Kurreck, C., Castaños‐Vélez, E., Freyer, D., Blumenau, S., Przesdzing, I., Bernard, R., & Dirnagl, U. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/y8tpd
Peer Review #1 of "Sustainable computational science: the ReScience initiative (v0.1)"
(2017) · PeerJ Computer Science · doi:10.7287/peerj-cs.142v0.1/reviews/1
Peer Review #2 of "Sustainable computational science: the ReScience initiative (v0.1)"
(2017) · PeerJ Computer Science · doi:10.7287/peerj-cs.142v0.1/reviews/2
Kammerer, J. J. (2016) · Sage eBooks · doi:10.4135/9781483349985.n407
INDUCTION IS NOT ROBUST TO SEARCH
Gollnick, C. (2018) · Amsterdam University Press eBooks · doi:10.2307/j.ctvhrd092.22 · Cited by 3
Integration of Reproducible Methods into Community CyberinfrastructurePreprint
Tarboton, D. G., Malik, T., Goodakk, J., et al. (2020) · doi:10.1002/essoar.10503642.1
As potencialidades do data paper na ciência atual
Rocha, L. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap13 · Cited by 16
Nwogugu, M. C. I. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3410631
Almgren, H., Parsons, N., Bossche, S. V. D., & Marinazzo, D. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/9hg3j
Recent developments in scholarly publishing to improve research practices in the life sciencesPreprint
Eglen, S. J., Mounce, R., Gatto, L., Currie, A., & Nobis, Y. (2018) · doi:10.31219/osf.io/57hcs
Puthenveedu, M. A., & Weinberg, Z. Y. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.734610015.793554867
Um estudo para representação de dados abertos de editoração científica na web de dados
Rautenberg, S., & de SOUZA, L. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap5 · Cited by 1
Publishing Reproducible Geoscientific Papers: Status quo, benefits, and opportunitiesPreprint
Konkol, M. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/mcdrn · Cited by 1
Tracy, D. K., Joyce, D. W., & Shergill, S. S. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.211.6.404
Towards reproducible, transparent, and systematic benchmarking of omics computational toolsPreprint
Mangul, S., Martin, L. S., Hill, B., Lam, A. K.-M., DISTLER, M., Zelikovsky, A., Eskin, E., & Flint, J. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/p8yd9
Research equity: Incentivizing high-risk basic research with market mechanismsPreprint
Ellgen, C., & Kang, D. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/cvngq
(2019) · Elsevier eBooks · doi:10.1016/b978-0-12-817443-2.00025-2
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.012
Vandersickel, N. (2022) · The Project Repository Journal · doi:10.54050/prj1318816
Optimizing the quality of research in Veterinary Parasitology
Perusso, C. O., Nagata, W. B., Inácio, S. V., Castilho, G., Ferrari, A. M., Gomes, J. F., & Bresciani, K. D. S. (2022) · Experimental Parasitology · doi:10.1016/j.exppara.2022.108303
A database of accurate electrophoretic migration patterns for human proteins in cell linesPreprint
Mylonas, R., Potts, A., Waridel, P., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.22.496709
Introducing Mouffet, a unified framework to make model creation easier and more reproduciblePreprint
Christin, S., & Lecomte, N. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.06.498965
Informatics health policy for the APRN
Hefley, J. B. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-99993-9.00014-7
Connelly, R., & Gayle, V. (2022) · doi:10.31219/osf.io/tb2vn
Interim Design Analysis Using Bayes Factor ForecastsPreprint
Stefan, A. M., Gronau, Q. F., & Wagenmakers, E. (2022) · doi:10.31234/osf.io/9sazk
C., E. R. F., López-Fernández, M., Dieste, Ó., & Juristo, N. (2025) · IET Software · doi:10.1049/sfw2/7082969
Qualitative Methods in Radiology Research
Huang, A. J., & Gunderman, R. B. (2022) · Academic Radiology · doi:10.1016/j.acra.2022.07.002
Industrial Applications of Inkjet Printing in Life Sciences
Stasiak, J. W., White, J. D., & Wenger, R. (2022) · Wiley eBooks · doi:10.1002/9783527828074.ch65
Peer Review #2 of "Nine best practices for research software registries and repositories (v0.3)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.1023v0.3/reviews/2
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.