1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 3,301–3,400 of 4,204
Comparing the results of replications in software engineering
Santos, A., Vegas, S., Oivo, M., & Juristo, N. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09907-7 · Cited by 19
Reteig, L. C., Newman, L. A., Ridderinkhof, K. R., & Slagter, H. A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.17605/osf.io/y6hsf
Non-determinism in nowadays computing and IT
Henno, J., Jaakkola, H., & Mäkelä, J. (2020) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro48935.2020.9245377
Scheuer, K. S., Hanlon, B. M., Dresel, J. W., Nolan, E. D., Davis, J. C., & Loewe, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/099192
Sassower, R. (2020) · Springer eBooks · doi:10.1007/978-3-030-60573-5_1
Ribeiro, C. J. S., Santos, L. O. B. D. S., & Moreira, J. (2020) · Informação & Informação · doi:10.5433/1981-8920.2020v25n3p28 · Cited by 1
Independent replication of classic trials in neurosurgery: A missing validation practice
Kerr, N., Kerr, J., Sheridan, M. M. P., & Holcombe, A. O. (2020) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2020.10.028
Issues and pitfalls in the use of p-values
Counotte, M. J., Flammer, S. A., & Hartnack, S. (2020) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2020.10.007
Usoltsev, V. A., Chen, B., Shobairi, S. O. R., Tsepordey, I. S., & Anees, S. A. (2020) · Research Square · doi:10.21203/rs.3.rs-71384/v1
We need to improve the welfare of life science trainees
Simoneschi, D. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024143118
Effect of right censoring bias on survival analysisPreprint
Barrajón, E., & Barrajón, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08649 · Cited by 10
Falsification, Pseudoscience, Induction
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.005
Best Practices in Scientific ComputingPreprint
Sanchez, R., Griffin, B. A., & McCaffrey, D. F. (2021) · arXiv (Cornell University)
Be the Change You Seek in SciencePreprint
Milham, M. P., & Klein, A. (2018) · Preprints.org · doi:10.20944/preprints201809.0543.v1
Regenerative technologies for oral structures
Hanwatkar, P., & Kashi, A. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-821085-7.00010-5
La imperiosa necesidad de reconstruir el sistema valorativo de los aportes científicos
Silva, L. C. (2020) · Revista Facultad Nacional de Salud Pública · doi:10.17533/udea.rfnsp.e344778
Transparency and replication in alcohol research
Drax, K., & Munafo, M. R. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-816720-5.00005-0
Replicability and Reproducibility in Drug Discovery
Novick, S. J., & Könings, P. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820472-6.00030-x
Morales, C. (2020) · Modern Concepts in Material Science · doi:10.33552/mcms.2020.03.000565
Powell, K. (2021) · Hypothesis Research Journal for Health Information Professionals · doi:10.18060/25199
Reproducibilidad y replicabilidad en la investigación en ciencias naturales: ¿Hay una crisis?
Gorla, D. E. (2021) · Ecología Austral · doi:10.25260/ea.21.31.1.0.1060 · Cited by 2
Zimring, J. C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108569149.006
da Silva, W., Schepke, C., & Leiria, R. (2020) · doi:10.5753/wscad_estendido.2020.14087
On the Value of Biomedical Research and Medical Care
Catillon, M. (2020) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1
ChIP-AP – An Integrated ChIP-Seq Analysis PipelinePreprint
Suryatenggara, J., Yong, K. J., Tenen, D. E., Tenen, D. G., & Bassal, M. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.18.440382
A replication of Pindyck’s willingness to pay: on the efforts required to obtain results
Gerotto, L., & Pellizzari, P. (2021) · SN Business & Economics · doi:10.1007/s43546-021-00069-2
Automated End-to-End Management of the Deep Learning Lifecycle
Gharibi, G. (2020) · MOspace Institutional Repository (University of Missouri)
A Framework for Representing Clinical Research in FHIR.
Leroux, H., Denney, C. K., Hastak, S., & Glover, H. (2019)
Considerations of sample size and power calculations given a range of analytical scenariosPreprint
Carter, A. R., Tilling, K. M., & Munafo, M. R. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tcqrn
Claims and statistical inference in animal physical cognition research.Preprint
Farrar, B. G., Altschul, D., Fischer, J., van der Mescht, J., Placì, S., Troisi, C. A., Vernouillet, A., Clayton, N. S., & Ostojić, L. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/x5ya3
Registered Reports as an elegant means of improving research quality
French, S. (2021) · Journal of Health Information and Libraries Australasia · doi:10.55999/johila.v2i1.44
When Values Collide: Why Scientists Argue About Open Science and How to Move ForwardPreprint
Fife, D. A., Lung, M., Sullivan, N., & Young, C. (2020) · doi:10.31234/osf.io/q9d28
Beyond Probabilism and Performance
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.002 · Cited by 1
Deep Learning for Enhancing Precision Medicine
Oh, M. (2021) · VTechWorks (Virginia Tech)
A Language for Modeling and Optimizing Experimental Biological Protocols
Cardelli, L., Kwiatkowska, M., & Laurenti, L. (2021) · Computation · doi:10.3390/computation9100107 · Cited by 3
Evidence Based Practice Integration into Polygraph Practice: A suggested paradigm
Amsel, T. T., & Ginton, A. (2021) · European Polygraph · doi:10.2478/ep-2021-0001
FAIR and bias-free network modules for mechanism-based disease redefinitions
Hassan, A. (2021) · Research Publications (Maastricht University) · doi:10.26481/dis.20210707ah
HATAKENAKA, T., HARADA, Y., & KUSABA, M. (2021) · Journal of Research in Science Education · doi:10.11639/sjst.sp20019
Die Replikations- und Translationskrise: Eine Chance zur Veränderung?
Smolka, M. N. (2021) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911/a000717
Logsheets and the Academic Progress of Ph.D. Students
Maity, K., & Pillai, K. S. (2021) · Springer eBooks · doi:10.1007/978-981-16-3074-3_7
Assessing the Temporal Validity of Design Knowledge
Beese, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-84655-8_11 · Cited by 1
Why Do We Need a Statistical Experiment Design?
Parkinson, M., & Sorzano, C. Ó. S. (2020) · Laboratory animal science and medicine · doi:10.1007/978-3-030-66147-2_6 · Cited by 1
Nwogugu, M. C. I. (2021) · Springer eBooks · doi:10.1007/978-3-030-71415-4_2 · Cited by 1
A City upon a Hill: Casting Light on a Real Experimental Process.Preprint
Fonseca, R., Dieste, Ó., & Juristo, N. (2021) · arXiv (Cornell University)
Fitt, B., Loy, G., Christopher, E., Brennan, P. M., & Poon, M. T. C. (2021) · medRxiv · doi:10.1101/2021.09.04.21263119
Yata, N. (2021) · Folia Pharmacologica Japonica · doi:10.1254/fpj.21044
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.004
Artificial Intelligence and Healthcare Ethics
Rana, A., Goedmakers, C. M. W., & Smith, T. R. (2021) · Springer eBooks · doi:10.1007/978-3-030-78075-3_31 · Cited by 1
A preclinical randomized multicenter trial of anti-IL-17A treatment for acute ischemic strokePreprint
Gelderblom, M., Koch, S., Strecker, J., Jørgensen, C., García‐Bonilla, L., Ludewig, P., Bernreuther, C., Pinnschmidt, H. O., Arumugam, T. V., Thomalla, G., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.09.29.462381
Woutersen-Windhouwer, S., Méndez, E., Sondervan, J., & Oort, F. J. (2020) · European Research Libraries Cooperation
User dashboard for reusable analysis platform
Pérez, S. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.2415738
An FSKX compliant source attribution model for salmonellosis and a look at its major hidden pitfalls
Sundermann, E. M., Carreira, G. C., & Käsbohrer, A. (2021) · Food Modelling Journal · doi:10.3897/fmj.2.70008 · Cited by 1
El‐Nasr, M. S., Dinh, T. H. N., Canossa, A., et al. (2021) · doi:10.1093/oso/9780192897879.003.0013
Pragmatic and Error Statistical Bayesians
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.017
What Ever Happened to Bayesian Foundations?
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.016
262) メロンえそ斑点病防除におけるニューメロン台木の利用の可能性 (日本植物病理大会)
井上, 興., 亀谷, 満., 鍛治原, 寛., 宮川, 久., & 片川, 聖. (1996) · 日本植物病理學會報
Bettin, R. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/y94gu
Hakim, S. M. (2021) · Minerva Anestesiologica · doi:10.23736/s0375-9393.21.16222-4
Kelter, R. (2021) · International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt) · doi:10.3390/psf2021003010
Chlumsky, R., Craig, J. R., Lin, S. G. M., et al. (2021) · Geoscientific model development · doi:10.5194/gmd-2021-336-rc1
The ground truth of the Data-Iceberg: Correct Meta-dataPreprint
Caliskan, A., Dangwal, S., & Dandekar, T. (2021) · bioRxiv · doi:10.1101/2021.12.17.473021
Kampourakis, K., & Uller, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108648981.001
Kampourakis, K., & Uller, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108648981.018
The Transparency of Quantitative Empirical Legal Research (2018–2020)Preprint
Chin, J. M., Zeiler, K., Dilevski, N., Holcombe, A. O., Gatfield-Jeffries, R., Bishop, R., Vazire, S., & Schiavone, S. R. (2022) · doi:10.31222/osf.io/43uj8
Quiroga, L. C., & Pérez, B. C. (2021) · Journal of Biological Education · doi:10.1080/00219266.2021.2012230 · Cited by 3
An Brief Examination of Case Studies in Reproducibility for Bioinformatics Training
Alsafwani, Z. W., & Cooper, K. M. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669698
Lecture 1: Phân tích dữ liệu xã hội sử dụng BMF, MCMC và bayesvl với ngôn ngữ RPreprint
Nguyen, M. (2021) · doi:10.31219/osf.io/s9rq7
Guidance document on Good Cell and Tissue Culture Practice 2.0 (GCCP 2.0)_suppl
Pamies, D. (2021) · ALTEX · doi:10.14573/altex.2111011s
Kampourakis, K., & Uller, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108648981.017
Does relativistic cosmology software handle emergent volume evolution?
Borkowska, J., & Roukema, B. F. (2022) · Classical and Quantum Gravity · doi:10.1088/1361-6382/ac8ddb
On Research Integrity in Arboriculture and (Urban) Forestry: a qualitative systematic reviewPreprint
Sterken, P. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/dzfbx
Tanksley, D., Hier, D. B., & Wunsch, D. C. (2022) · European Scientific Journal ESJ · doi:10.19044/esj.2022.v18n4p61
Peer Review #1 of "Research artifacts and citations in computer systems papers (v0.3)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.3/reviews/1
Nwogugu, M. C. I. (2021) · Springer eBooks · doi:10.1007/978-3-030-71415-4_1
Peer Review #1 of "Research artifacts and citations in computer systems papers (v0.5)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.5/reviews/1
Homocianu, D. (2022) · Electronics · doi:10.3390/electronics11040528
Peer Review #3 of "Research artifacts and citations in computer systems papers (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.2/reviews/3
Subjectivity, Truth, and Theological Anthropology
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.009
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.001
Peer Review #3 of "Research artifacts and citations in computer systems papers (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.1/reviews/3
Peer Review #2 of "Research artifacts and citations in computer systems papers (v0.3)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.3/reviews/2
The Practices Shaping the Entrepreneurial Subject
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.006
Peer Review #2 of "Research artifacts and citations in computer systems papers (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.2/reviews/2
Ethical Issues and Responsible Parties
André, J. (2018) · doi:10.1002/9781119451501.ch4
Acquiring the Virtue of Truth-Speaking in Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.008
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.011
Teleology and the Craft of Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.005
Peer Review #1 of "Research artifacts and citations in computer systems papers (v0.4)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.4/reviews/1
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.004
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.010
Reshaping the Entrepreneurial Subject of Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.007
Peer Review #1 of "Research artifacts and citations in computer systems papers (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.1/reviews/1
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.002
General Analytic Considerations
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.034
Peer Review #2 of "Research artifacts and citations in computer systems papers (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.887v0.1/reviews/2
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.