1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 3,101–3,200 of 4,204
Guidelines for reporting protein modelling studiesPreprint
Vihinen, M. (2021) · Authorea · doi:10.22541/au.162040347.71324039/v1 · Cited by 1
The Next Big Developments – The Lab of the Future
Shute, R. E., & Lynch, N. (2021) · Wiley eBooks · doi:10.1002/9783527825042.ch1 · Cited by 1
Rapid Evidence Review 1 on the Critical Appraisal of Third-Party Evidence
Thomas, S., Gregory, P., O’Brien, S. J., McCallion, C., Goodall, B., Chan, C., & Nunn, P. (2021) · doi:10.46756/sci.fsa.elm525 · Cited by 1
Bản hòa tấu dữ liệu xã hộiPreprint
Quan-Hoang, V., La, V., Nguyen, M., & Ho, M.-T. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/9jreq · Cited by 1
A Guide to Reproducible Research in Signal Processing and Machine Learning.Preprint
Shenouda, J., & Bajwa, W. U. (2021) · arXiv (Cornell University) · Cited by 1
Editorial: Factualities – establishing empirical truths in child psychology and psychiatry
Oldehinkel, A. J. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13515 · Cited by 1
Ten simple rules for good research practicePreprint
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2021) · doi:10.31219/osf.io/am5ck · Cited by 1
Doerksen, E., & Boivin, J.-C. (2021) · AJOB Neuroscience · doi:10.1080/21507740.2021.2001092 · Cited by 1
Developing an Executable Paper With the Python in Heliophysics CommunityPreprint
Polson, S., Ringuette, R., Zheng, Y., et al. (2022) · doi:10.1002/essoar.10510006.1 · Cited by 1
Secondary Data Analysis: Lessons and perspective of a research parasitePreprint
Raman, A. T. (2021) · doi:10.31219/osf.io/bec69 · Cited by 1
Gonçalves, B. D. F. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.75.2021.tde-11012022-110019 · Cited by 1
Ibaviosa, C. M., & Chin, J. M. (2022) · doi:10.31222/osf.io/tvcm6 · Cited by 1
Data sharing for global, unspecified reusePreprint
Reichmann, S. (2022) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/tbex2 · Cited by 2
Be the Change You Seek in SciencePreprint
Milham, M. P., & Klein, A. (2018) · doi:10.31234/osf.io/gry2j · Cited by 1
Proposal to NSF 19-565 to Create a STEM Education Research HubPreprint
Nosek, B. A., Ofiesh, L., Grasty, F. L., Pfeiffer, N., Mellor, D. T., Brooks, R. E., Benjamin, M., Booth, A., Bowman, S. D., Davis, J. C., et al. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/4mpuc · Cited by 3
Minor, W., & Cooper, D. R. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.737405003.793574963 · Cited by 1
Neves, K., Carneiro, C. F. D., Wasilewska‐Sampaio, A. P., Abreu, M., Valério‐Gomes, B., Tan, P. B., & Amaral, O. B. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/njs6k · Cited by 1
scFlow: A Scalable and Reproducible Analysis Pipeline for Single-Cell RNA Sequencing DataPreprint
Khozoie, C., Fancy, N. N., Marjaneh, M. M., Murphy, A. E., Matthews, P. M., & Skene, N. (2021) · doi:10.22541/au.162912533.38489960/v2 · Cited by 1
Hellen, E., & Ranger, H. (2019) · LISSA (OSF Preprints) · doi:10.31229/osf.io/vft39 · Cited by 1
Translational Medicine – The Bridging Discipline. Role and Tools in the Drug Development Process
Hinder, M., & Hartl, D. (2022) · Wiley eBooks · doi:10.1002/9783527824014.ch7 · Cited by 2
Nguyen, M., La, V., & Le, T.-T. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/8nc92 · Cited by 1
A literature review of methods for assessment of reproducibility in sciencePreprint
Nordling, T. E. M., & Peralta, T. M. (2022) · Research Square · doi:10.21203/rs.3.rs-2267847/v1 · Cited by 2
A literature review of methods for assessment of reproducibility in sciencePreprint
Nordling, T. E. M., & Peralta, T. M. (2022) · Research Square · doi:10.21203/rs.3.rs-2267847/v2 · Cited by 1
A literature review of methods for assessment of reproducibility in sciencePreprint
Nordling, T. E. M., & Peralta, T. M. (2022) · Research Square · doi:10.21203/rs.3.rs-2267847/v4 · Cited by 1
Arend, D., Beier, S., Brilhaus, D., et al. (2023) · doi:10.37044/osf.io/ekhdw · Cited by 1
A Multi-omics Data Analysis Workflow Packaged as a FAIR Digital ObjectPreprint
Niehues, A., de Visser, C., Hagenbeek, F. A., Kulkarni, P., Pool, R., Karu, N., Kindt, A. S. D., Singh, G., Vermeiren, R. R. J. M., Boomsma, D. I., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.06.07.543986 · Cited by 1
Vuong, Q., Tri, N. P., Jin, R., Hoang, G., La, V., Le, T.-T., & Nguyen, M. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/54z9y · Cited by 1
Straightening the ‘Value-Laden Turn’: Minimising the Influence of Values in SciencePreprint
Stamenkovic, P. (2023) · Qeios · doi:10.32388/y10xw3 · Cited by 1
Multi-language retrieval of United States hydrologic dataPreprint
Hodson, T., Hodson, T., Hodson, T. O., et al. (2023) · doi:10.22541/essoar.169264772.27243384/v1 · Cited by 1
A Celebration of the Publication of the 100th Volume of Organic Syntheses
Faul, M. M., & Brummond, K. M. (2023) · ACS Organic & Inorganic Au · doi:10.1021/acsorginorgau.3c00057 · Cited by 1
Linkflows: Towards Genuine Semantic Publishing in Science
Bucur, C.-I. (2024) · doi:10.5463/thesis.592 · Cited by 2
Communicating mass spectrometry quality information in mzQC with Python, R, and JavaPreprint
Bielow, C., Hoffmann, N., Jimenez‐Morales, D., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.06.592686 · Cited by 1
Pairwise Collinearity Detection Using Parallel Algorithms: Preliminary DetailsPreprint
Tîrnȃucȃ, C., & Homocianu, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4742523 · Cited by 2
Sørensen, M. P., Lambert, M., & Ravn, T. (2024) · Research Square · doi:10.21203/rs.3.rs-4467477/v1 · Cited by 2
A Review of Reinforcement Learning Enabled Autonomous Cyber Operations PlatformsPreprint
Saeed, S., Black, P., Pang, S., & Vamplew, P. W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4902209 · Cited by 3
Marty, I. O., Stryhn, H., Paquet, É. R., et al. (2024) · animal · doi:10.1016/j.animal.2024.101291 · Cited by 1
Munoz, A. Z., Soni, K., Li, A., Lakkundi, V., Iyer, A., Adler, A., Kirkendall, K., Petrigliano, F. A., Benayoun, B. A., Lozito, T. P., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.21.629913 · Cited by 1
A longitudinal data framework for context-specific genotype-to-phenotype mappingPreprint
Veith, T. A., Beck, R. J., Tagal, V., Li, T., Alahmari, S. S., Cole, J. P., Hannaby, D., Kyei, J., Yu, X., Maksin, K., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.07.652202 · Cited by 1
Guilloteau, Q., Waehren, A., & Ciorba, F. M. (2025) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3736731.3746146 · Cited by 3
Andersen, R. (2025) · Human Resource Management Journal · doi:10.1111/1748-8583.70019 · Cited by 3
Raising the Reproducibility Bar
Wonsil, J., Guerra, R. R., Pocock, A., Sullivan, J., & Seltzer, M. (2025) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3736731.3746157 · Cited by 2
Supp, S. R., Holler, J., Nurse, A., Horton, N. J., Kedron, P., & Ball, R. (2025) · The Conversation · doi:10.64628/aai.pqqug3wwh · Cited by 1
What we have learned: reflections on eighteen years of editorship of research in engineering design
Reich, Y. (2026) · Research in Engineering Design · doi:10.1007/s00163-026-00474-4 · Cited by 1
Christensen, R., Haugegaard, T., & Madry, H. (2026) · Osteoarthritis and Cartilage Open · doi:10.1016/j.ocarto.2026.100776 · Cited by 1
EthoClaw: An Integrated AI Workflow Platform for Automated Analysis in NeuroethologyPreprint
Chen, K., Chen, Z., Zheng, D., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.03.25.714141 · Cited by 1
High Performance Computing : towards better Performance Predictions and Experiments
Cornebize, T. (2021) · theses.fr (ABES) · doi:10.70675/47848f25z3115z4930z9a20z87c52ceab9c2 · Cited by 2
Ambroise, C. (2024) · theses.fr (ABES) · doi:10.70675/d2529d35z93e6z4d60zb2c5z752d5f0edda3 · Cited by 2
Does Peer Review Need to Change? A Panel on Reporting Standards and Checklists in the Age of AI
Duchowski, A. T., Stefik, A., Ralph, P., Dix, A. J., Krejtz, K., Myers, B. A., Jorge, J., & Wehbe, R. R. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3790074 · Cited by 1
A call to ensure reproducibility of machine learning applications in industrial ecologyPreprint
Rankin, K. H., Donati, F., Tu, Q., Ward-Bond, J., Reitz, N., Hiser, B., van Lierde, S., Suh, S., Saxe, S., Posen, I. D., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9270723/v1 · Cited by 1
Open and FAIR data practices in palaeontology: guidance for authors at Historical Biology
Long-Fox, B. L. (2026) · Historical Biology · doi:10.1080/08912963.2026.2658932 · Cited by 1
Ali, S. A., & Lynn, A. (2026) · Aperture Neuro · doi:10.52294/001c.160138 · Cited by 3
ReproAgent: Contract-Guided Paper-to-Code Reproduction
Hu, X., Pan, Z., Wang, Z., Liu, Z., Su, Z., & Zhang, W. (2026) · arXiv · doi:10.48550/arxiv.2608.24291
“Large language models are increasingly used to assist scientific research, but a long-standing re-producibility crisis persists (Baker, 2016; Pineau et al., 2021).”
Gonzalez-Beltran, A. N., Osborne, F., & Peroni, S. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872518.2890600
Leveraging Doctoral Requirements to Promote ReproducibilityPreprint
Jorstad, A. (2016) · doi:10.15200/winn.146600.03810
The man-machine integration eraPreprint
Bilar, D. (2016) · doi:10.7287/peerj.preprints.2402v1
Adaptive Filtering Multiple Testing Procedures for Partial Conjunction HypothesesPreprint
Wang, J., Sabatti, C., & Owen, A. B. (2016) · arXiv (Cornell University)
Doctoral and professional programs
Miller, S. M., Moos, W. H., Munk, B. H., & Munk, S. A. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100625-2.00008-8
Rethinking the ExperimentPreprint
Nadin, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.02491
How open access is crucial to the future of science: A reply
Romesburg, H. C. (2017) · Journal of Wildlife Management · doi:10.1002/jwmg.21244
Franco, E. L. (2017) · Journal of Obstetrics and Gynaecology Canada · doi:10.1016/j.jogc.2017.03.122
Cáceres, A., & González, J. R. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/125450
Morrison, J. S., & Hageman, M. J. (2017) · AAPS advances in the pharmaceutical sciences series · doi:10.1007/978-3-319-50042-3_14
Reliability issues in imaging genetics
Eriksson, A. (2017) · doi:10.6083/m4cr5sf2
Enriching Agronomic Experiments with Data Provenance
da Cruz, S. M. S., & do Nascimento, J. A. P. (2017) · International Journal of Agricultural and Environmental Information Systems · doi:10.4018/ijaeis.2017070102
Leeder, S. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyx100
The metabolic effects of leptin therapy and glucagon suppression therapy in mouse models of diabetes
Neumann, U. H. (2017) · cIRcle (University of British Columbia) · doi:10.14288/1.0348695
The Cognitive Mechanisms of Value-Based Choice
Winkle, J. A. (2017) · DukeSpace (Duke University)
der Heyden, J. V. (2017) · Ghent University Academic Bibliography (Ghent University)
revisit: a Workflow Tool for Data SciencePreprint
Matloff, N., Davis, R., Beckett, L. A., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04789
Witzell, J. (2017) · Scandinavian Journal of Forest Research · doi:10.1080/02827581.2017.1388965
A Replication of Pindyck's Willingness to Pay: On the Sacrifice Needed to Obtain ResultsPreprint
Gerotto, L., & Pellizzari, P. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3065870
Bioinformatics for dermatology: why we should learn about code
Foulkes, A., Watson, D., & Barnes, M. R. (2017) · British Journal of Dermatology · doi:10.1111/bjd.16277
Junior, N. A. A., Cordeiro, W. L. D. C., & Gaspary, L. P. (2018) · doi:10.5753/sbrc.2018.2424
Lösel, F. A., & Bender, D. (2018) · Springer eBooks · doi:10.1007/978-3-658-20506-5_15
Pragmatic statistical issues in biological research: Introduction to special series
Danziger, R. S., & Berbaum, M. L. (2018) · Journal of Molecular and Cellular Cardiology · doi:10.1016/j.yjmcc.2018.03.013
Folgueras-Flatschart, Á. V., Gomes, B. C., Leve, F., & Boldrini, L. D. C. (2018) · Vigilância Sanitária em Debate · doi:10.22239/2317-269x.01083 · Cited by 2
Machine Learning Methods To Identify Hidden Phenotypes In The Electronic Health Record
Beaulieu‐Jones, B. K. (2017) · ScholarlyCommons (University of Pennsylvania) · Cited by 2
Replizierbarkeit ist kein Muss
Schulze, M. (2018) · Nachrichten aus der Chemie · doi:10.1002/nadc.20184074497
The p-value Case, a Review of the Debate: Issues and Plausible Remedies
Pauli, F. (2018) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-319-73906-9_9
Supporting open science in big data frameworks and data science education
Cotterell, M. E. (2017)
Quantifying cognition: Applications for ubiquitous data
Ahonen, L. (2018) · Työväentutkimus Vuosikirja
Concetti di base nella metodologia di ricerca clinica nel campo della fisioterapia
Bruyneel, A.-V. (2018) · EMC - Medicina Riabilitativa · doi:10.1016/s1283-078x(18)91456-2
Occurrence of non-western magic in the European brainPreprint
Koten, J. W., Schüppen, A., Kumar, V., & Wood, G. M. D. O. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/395285
Conceptos básicos en metodología de investigación clínica en el campo de la fisioterapia
Bruyneel, A.-V. (2018) · EMC - Kinesiterapia - Medicina Física · doi:10.1016/s1293-2965(18)91382-4 · Cited by 2
‘Mål- og resultatstyring’ i universitetssektoren – realitets- eller illusionsdannelse?
Røge, K. M., Kure, N., & Nørreklit, H. (2018) · Samfundslederskab i Skandinavien · doi:10.22439/sis.v33i4.5568
Triboulet, J. (2018) · HEGEL - HEpato-GastroEntérologie Libérale · doi:10.3917/heg.084.0275
¿Sabemos leer?: La lectura crítica al servicio de la calidad asistencial.
Rodríguez, J. M. ́. (2018) · Archivos de coloproctología · doi:10.26754/ojs_arcol/arch_colo.201833261
Future Directions to Support People with Intellectual Disabilities
Shaw, S. R., & Jankowska, A. M. (2018) · Pediatric school psychology · doi:10.1007/978-3-030-02992-0_9
Commentary: Who is who in this storm?
Bruno, V. D., & Ascione, R. (2018) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2018.11.115
Learning to Teach: A Mixed-Methods Study of Interns Learning the Skills of Teaching
Mascio, B. (2018) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
The debate over open access is missing the point
Buck, S. (2019) · Learned Publishing · doi:10.1002/leap.1223
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.