1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 3,201–3,300 of 4,204
Towards a Bayesian Approach in Criminology: A Case Study of Risk Assessment in Youth Justice
Hodges, H. R. (2018) · Cronfa (Swansea University) · doi:10.23889/suthesis.48027 · Cited by 2
“Fickleness” in Biological Systems - Really?
Er, B. (2017)
A Framework To Evaluate Pipeline Reproducibility Across Operating Systems
Scaria, L. (2018) · Spectrum Research Repository (Concordia University) · Cited by 1
Cáceres, A., & González, J. R. (2019) · BMC Genomics · doi:10.1186/s12864-018-5340-3
The Brazilian Reproducibility Initiative: a systematic assessment of Brazilian biomedical sciencePreprint
Amaral, O. B., Neves, K., Wasilewska‐Sampaio, A. P., & Carneiro, C. F. D. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ahf7t
Time Is Precious—Quo Vadis, Creativity?
Velázquez, J. L. P. (2019) · Springer eBooks · doi:10.1007/978-3-030-12326-0_2
Refining our research practices in clinical science: Challenges and steps towards solutions
Craske, M. G. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.03.006
Radical research honesty in a post-truth society
Twidale, M. B., & Nichols, D. M. (2019) · iConference · doi:10.21900/iconf.2019.103140
Probability in HPLC-MS Metabolomics
Urban, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-17938-0_13
Power analysis for RNA sequencing and mass spectrometry-based proteomics data
Xu, Q. (2019) · UTUPub (University of Turku)
Understanding Replication: Trust But Verify
Suter, W. N., & Suter, P. M. (2019) · Home Health Care Management & Practice · doi:10.1177/1084822319850501 · Cited by 1
How much can we trust the literature?
Harris, I. A., & Giannoudis, P. V. (2019) · Injury · doi:10.1016/j.injury.2019.06.017
Ho, D. (2019) · Routledge eBooks · doi:10.4324/9781315626871-4
bayes4psy—An Open Source R Package for Bayesian Statistics in Psychology
Demšar, J., Repovš, G., & Štrumbelj, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00947 · Cited by 5
DEMETRIOS PRIZE 2019! Optimizing T-Cell Culture in Microfluidic Devices
Pinter, J. (2019) · Journal of Science Humanities and Arts - JOSHA · doi:10.17160/josha.6.7.587
Harding, K. G. (2019) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-019-01669-9
Disease in a Dish: Cellular Models to Understand Human Conditions
Tidball, A. M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816573-7.00002-x · Cited by 2
STAR: Statistical Tests with Auditable ResultsPreprint
Servan-Schreiber, S., Ohrimenko, O., Kraska, T., & Zgraggen, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10875 · Cited by 3
Frameworks, Committed Testers, and Science as a Form of Life
Gee, J. (2019) · Contemporary trends and issues in science education · doi:10.1007/978-3-030-24013-4_3
Doubts, Assumptions, and Social Sciences and Psychology Today
Toomela, A. (2019) · SpringerBriefs in psychology · doi:10.1007/978-3-030-31449-1_3
Using BioDepot-workflow-builder to Access Public Databases in a Containerized Environment
Scott, C., Hung, L., Lloyd, W., et al. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983263
Status and Challenges of Reproducibility in Computational Systems and Synthetic Biology
Choi, K., Karr, J. R., & Sauro, H. M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-801238-3.11525-9 · Cited by 1
Bio‐Based Chemicals and Sustainability
Philp, J. C. (2019) · Wiley eBooks · doi:10.1002/9781119300762.wsts0091
Hunter, H., Hahn, D. D. G., Duret, A., Im, Y., Cheah, Q., Dong, J., Fairey, M., Hjalmarsson, C., Li, A., Lim, H., et al. (2019) · bioRxiv · doi:10.1101/2019.12.31.887919
Development of artificial cell culture platforms using microfluidics
Karamahmutoğlu, H. (2019) · Sabanci University
Stressing out the immune system
Riddell, N. E. (2017) · Physiology News · doi:10.36866/pn.107.38
Reddit ‘Ask me Anything’ (AMA) with Kim Barrett
Barrett, K. E. (2017) · Physiology News · doi:10.36866/pn.107.19
Introducing our MOOC in Physiology
Stokes, C. (2017) · Physiology News · doi:10.36866/pn.107.18
The membership survey results are in!
Brammer, J. (2017) · Physiology News · doi:10.36866/pn.107.12
H3 Symposium: Practical Innovations in the Life Sciences
Stokes, C., Witchel, H. J., & Evans, P. (2017) · Physiology News · doi:10.36866/pn.107.22
Ahmed, A. (2017) · Physiology News · doi:10.36866/pn.107.50
How many Members of The Society have won the Nobel Prize?
Em, T. (2017) · Physiology News · doi:10.36866/pn.107.44
Stressed-out Britain? A report on our annual Theme and our survey
Donaldson, L. F. (2017) · Physiology News · doi:10.36866/pn.107.16
Obituary: Olof Conrad John Lippold
Bindman, L. J., & Cogdell, R. (2017) · Physiology News · doi:10.36866/pn.107.49
The dangers of careless press releases
Cork, S. C. (2017) · Physiology News · doi:10.36866/pn.107.42
Science and politics: The 1923 International Physiology Congress in Edinburgh
Cerveró, F. (2017) · Physiology News · doi:10.36866/pn.107.33
The Society welcomes our new Treasurer, Frank Sengpiel
Sengpiel, F. (2017) · Physiology News · doi:10.36866/pn.107.43
Getting excited about pacemaking in the athletic heart, the first R Jean Banister Prize Lecture
D’Souza, A. (2017) · Physiology News · doi:10.36866/pn.108.8a
Lovett, H. (2017) · Physiology News · doi:10.36866/pn.107.9
Improving the Reproducibility of LaTeX Documents by Enriching Figures with Embedded Scripts and Data
Jacobs, C. T. (2020) · International Journal of Digital Curation · doi:10.2218/ijdc.v14i1.656
Our Workshop: Introduction to Molecular Biology Techniques, Transfection and Functional Studies
Kaisis, E. (2017) · Physiology News · doi:10.36866/pn.107.21a
Tipton, M., & White, M. J. D. (2017) · Physiology News · doi:10.36866/pn.107.14
Marxism and the Crisis in Modern Biology
Hasan, N. (2020) · Organisms. Journal of Biological Sciences · doi:10.13133/2532-5876_6.9
Possiamo fidarci delle linee guida cliniche quando parlano di laboratorio?
Cappelletti, P. (2020) · La Rivista Italiana della Medicina di Laboratorio - Italian Journal of Laboratory Medicine · doi:10.23736/s1825-859x.19.00044-6
Gestão de dados em periódicos científicos
Pavão, C. M. G., da Silva, F. C. C., & da Silveira, L. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap14 · Cited by 2
iEnvironment: Perspectives on Metadata-Oriented Testing of Research Software
Mulholland, D., Alencar, P., & Cowan, D. D. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006441
Como os indexadores estão vendo a questão de dados abertos de pesquisa para o processo de indexação?
Santos, G. C. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap9 · Cited by 1
Open Science and Research Data Platforms
Kitsuregawa, M. (2019) · TRENDS IN THE SCIENCES · doi:10.5363/tits.24.10_86
SeMAntic RepresenTation for experimental Protocols
Pasmín, O. X. G. (2019) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.55408
Direitos autorais e os dados de pesquisa abertos
Muriel-Torrado, E., & Andrade, R. S. F. D. M. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap11 · Cited by 1
Ampliando as fronteiras da editoração científica: o papel dos repositórios de dados
Sales, L. F., & Sayão, L. F. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap4 · Cited by 1
Web semântica e linked data como aliados na consolidação da Ciência Aberta
Segundo, J. E. S. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap6 · Cited by 2
What Can Journals Do to Increase the Reliability of Scientific Research?
Lee, W. R. (2020) · Practical Radiation Oncology · doi:10.1016/j.prro.2020.03.001
Prieto, M. (2019) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.57930
Reproducible Online Search Experiments
Breuer, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45442-5_77
The Myth of “The Myth of Objectivity”
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.009
Mendez, K. M. (2020) · Australasian Journal of Paramedicine
Deleted (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3773285
Verification of genetic engineering in yeasts with nanopore whole genome sequencingPreprint
Collins, J. H., Keating, K. W., Jones, T. R., Balaji, S., Marsan, C. B., Çomo, M., Newlon, Z. J., Mitchell, T., Bartley, B., Adler, A., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.05.079368
Incremental science: papers and grants - yes, discoveries - no
Свердлов, Е. Д. (2018) · Molecular Genetics Microbiology and Virology (Russian) · doi:10.17116/molgen201836041168
Methodological Issues with Search in MEDLINE: A Longitudinal Query AnalysisPreprint
Burns, C. S., Nix, T., Shapiro, R. M., & Huber, J. T. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.22.110403
Shedding light on cognitive control
Skau, S. (2020) · Gothenburg University Publications Electronic Archive (Gothenburg University)
The Importance of Applying Computational Creativity to Scientific and Mathematical Domains
Pease, A., Colton, S., Warburton, C., Nathanail, A., Preda, I., Arnold, D., Winterstein, D., & Cook, M. (2019) · Discovery Research Portal (University of Dundee) · doi:10.5281/zenodo.3951571 · Cited by 4
Wuttke, A. (2020) · Politics and the Life Sciences · doi:10.1017/pls.2020.13 · Cited by 3
Workshop on reproducibility in research
KALICHMAN, M. W., & Mills, P. J. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.496
Estudo QSAR aplicado a pesticidas benzimidazólicos para a análise de risco ambiental
Peruquetti, P. H. (2020) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.59.2020.tde-16042020-142023
Judging Research: How Should Research and Researchers Be Evaluated and Rewarded?
Bihorac, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-8
Achievement of the Paper and Its Honor for a Researcher
Lin, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-13
Judging Research in the Doors of Irreproducibility Crisis Era
Flores-Guerrero, J. L. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-6
Impact Factor /= Impact: Lessons Learned from Research Evaluation
Bertzbach, L. D. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-10
Research Quality and How to Find It?
Rojas, L. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-15
Judging Research: How Should Research and Researchers Be Evaluated and Rewarded?
Muhammed, F. K. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-16
Mathematics in Current Science and in Scientific Evaluation
Rivera, I. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-12
Gualtierotti, R. (2015) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-9
Tangible and Non-Tangible Rewards- a Balancing Act
Sivapragasam, M. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-4
Judging Research: Is There Even a Need of Evaluating the Research?
Chauhan, P. S. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-14
Judging and Rewarding Research and Researchers: Beyond Bibliometrics
Sharma, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-5
Scientific Metrics: How Useful Are They?
Ogashawara, I. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-3
Should the Quality of the Journal Determine the Quality of the Research?
Yüksek, A. (2020) · MDPI eBooks · doi:10.3390/books978-3-03928-315-6-7
Objektivní poznání v kontextu naturalizace filosofie
Paitlová, J., & Jedlička, P. (2020) · Philosophica Critica · doi:10.17846/pc.2020.6.1.37-51
Integration of Reproducible Methods into Community CyberinfrastructurePreprint
Tarboton, D. G., Malik, T., Goodall, J. L., et al. (2020) · doi:10.1002/essoar.10503642.2
sits.rep: Pesquisa Reprodutível em Classificações de Uso e Cobertura da Terra
Mariano, R., de Queiroz, G. R., Andrade, P., & Santos, R. M. (2020) · Anais do Workshop de Computação Aplicada à Gestão do Meio Ambiente e Recursos Naturais (WCAMA) · doi:10.5753/wcama.2020.11019
Limitations and Flaws of Preclinical Pulmonary Hypertension Studies
Shimauchi, T., Potus, F., Bonnet, S., Provencher, S., Paulin, R., & Boucherat, O. (2020) · Advances in Pulmonary Hypertension · doi:10.21693/1933-088x-19.2.47
Efficient and reproducible research in quantum open systems using Maxima with a Fortran interface
Blekos, K. (2020) · Software Impacts · doi:10.1016/j.simpa.2020.100031
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.003
How Can We Teach Philosophy of Science to Biologists?
Kampourakis, K., & Uller, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108648981.016 · Cited by 2
Teaching Metrology and Examinology in Chemistry at the University
da Silva, R. J. N. B. (2020) · Eurachem Workshop on Quality Assurance for Analytical Laboratories in the University Curriculum · doi:10.3390/proceedings2020055011
Peer Review #1 of "Towards FAIR protocols and workflows: the OpenPREDICT use case (v0.1)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.281v0.1/reviews/1
Science’s endangered reputation
Tsybeskov, L. (2020) · Physics Today · doi:10.1063/pt.3.4580
Objektivita přírodních věd pohledem experimentální filosofie
Jedlička, P., & Paitlová, J. (2020) · Teorie vědy / Theory of Science · doi:10.46938/tv.2019.411 · Cited by 1
Young, S. S., Cheng, K.-C., Chen, J., Chen, S., & Kindzierski, W. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10922
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.