1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
The nf-core framework for community-curated bioinformatics pipelines
Ewels, P. A., Peltzer, A., Fillinger, S., Patel, H., Alneberg, J., Wilm, A., Garcia, M. U., Di Tommaso, P., & Nahnsen, S. (2020) · Nature Biotechnology · doi:10.1038/s41587-020-0439-x · Cited by 4,050
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Bioconda: sustainable and comprehensive software distribution for the life sciences
The Bioconda Team, Grüning, B., Dale, R., Sjödin, A., Chapman, B. A., Rowe, J., Tomkins-Tinch, C. H., Valieris, R., & Köster, J. (2018) · Nature Methods · doi:10.1038/s41592-018-0046-7 · Cited by 1,641
Boutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
“Improving transparency is particularly important in the context of the replication crisis in science (37).”
BackgroundCamerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0399-z · Cited by 1,521
Renewed Prospects for Organic Photovoltaics
Zhang, G., Lin, F. R., Qi, F., Heumüller, T., Distler, A., Egelhaaf, H.-J., Li, N., Chow, P. C. Y., Brabec, C. J., Jen, A. K.-Y., et al. (2022) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00955 · Cited by 1,052
The ARRIVE guidelines 2019: updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703181 · Cited by 1,036
Self-citationMechanistic Studies in Photocatalysis
Buzzetti, L., Crisenza, G. E. M., & Melchiorre, P. (2019) · Angewandte Chemie International Edition · doi:10.1002/anie.201809984 · Cited by 942
Muratov, E. N., Bajorath, J., Sheridan, R. P., Tetko, I. V., Filimonov, D., Poroikov, V., Oprea, T. I., Baskin, I. I., Varnek, A., Roitberg, A., et al. (2020) · Chemical Society Reviews · doi:10.1039/d0cs00098a · Cited by 913
A step-by-step guide to perform x-ray photoelectron spectroscopy
Greczyński, G., & Hultman, L. (2022) · Journal of Applied Physics · doi:10.1063/5.0086359 · Cited by 810
Sustainable data analysis with Snakemake
Mölder, F., Jablonski, K. P., Letcher, B., Hall, M. B., Tomkins-Tinch, C. H., Sochat, V., Forster, J., Lee, S., Twardziok, S. O., Kanitz, A., et al. (2021) · F1000Research · doi:10.12688/f1000research.29032.1 · Cited by 786
Self-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Vrabel, M. (2015) · Oncology Nursing Forum · doi:10.1188/15.onf.552-554 · Cited by 669
Rewriting results sections in the language of evidence
Muff, S., Nilsen, E. B., O’Hara, R. B., & Nater, C. R. (2022) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2021.10.009 · Cited by 636
Organic synthesis in a modular robotic system driven by a chemical programming language
Steiner, S., Wolf, J., Glatzel, S., Andreou, A., Granda, J. M., Keenan, G., Hinkley, T., Aragon-Camarasa, G., Kitson, P. J., Angelone, D., et al. (2019) · Science · doi:10.1126/science.aav2211 · Cited by 622
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608
Sex and gender analysis improves science and engineering
Tannenbaum, C., Ellis, R. P., Eyssel, F., Zou, J., & Schiebinger, L. (2019) · Nature · doi:10.1038/s41586-019-1657-6 · Cited by 581
Noble, S., Scheinost, D., & Constable, R. T. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116157 · Cited by 580
The Space Physics Environment Data Analysis System (SPEDAS)
Angelopoulos, V., Cruce, P., Drozdov, A., Grimes, E. W., Hatzigeorgiu, N., King, D. A., Larson, D., Lewis, J. W., McTiernan, J. M., Roberts, D. A., et al. (2019) · Space Science Reviews · doi:10.1007/s11214-018-0576-4 · Cited by 540
Guidelines for the Content of Statistical Analysis Plans in Clinical Trials
Gamble, C., Krishan, A., Stocken, D., Lewis, S., Juszczak, E., Doré, C., Williamson, P. R., Altman, D. G., Montgomery, A., Lim, P., et al. (2017) · JAMA · doi:10.1001/jama.2017.18556 · Cited by 536
Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition)
Cossarizza, A., Chang, H., Radbruch, A., Abrignani, S., Addo, R., Akdis, M., Andrä, I., Andreata, F., Annunziato, F., Arranz, E., et al. (2021) · European Journal of Immunology · doi:10.1002/eji.202170126 · Cited by 531
Dealing with the positive publication bias: Why you should really publish your negative results
Mlinarić, A., Horvat, M., & Šupak Smolčić, V. (2017) · Biochemia Medica · doi:10.11613/bm.2017.030201 · Cited by 514
Barratt, C. L. R., Björndahl, L., De Jonge, C. J., Lamb, D. J., Osorio Martini, F., McLachlan, R., Oates, R. D., van der Poel, S., St John, B., Sigman, M., et al. (2017) · Human Reproduction Update · doi:10.1093/humupd/dmx021 · Cited by 505
“, 2016) and is of course not just a theme in reproductive medicine (Baker, 2016).”
BackgroundFetal Bovine Serum (FBS): past ‐ present ‐ future
van der Valk, J. (2018) · ALTEX · doi:10.14573/altex.1705101 · Cited by 481
Zwaan, R. A., Etz, A., Lucas, R. E., & Donnellan, M. B. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17001972 · Cited by 444
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
Reporting Guidelines to Increase the Reproducibility and Comparability of Research on Microplastics
Cowger, W., Booth, A. M., Hamilton, B. M., Thaysen, C., Primpke, S., Munno, K., Lusher, A. L., Dehaut, A., Vaz, V. P., Liboiron, M., et al. (2020) · Applied Spectroscopy · doi:10.1177/0003702820930292 · Cited by 462
The MIMIC Code Repository: enabling reproducibility in critical care research
Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx084 · Cited by 442
“Concerns about the reproducibility of results in science are becoming increasingly prominent in both scientific and mainstream literature.(1) Some commentators have gone so far as to call the current state a crisis, citing causes such as pressure to publish positive results, the cost of replicating studies such as dou…”
BackgroundIs science really facing a reproducibility crisis, and do we need it to?
Fanelli, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708272114 · Cited by 416
DNA metabarcoding—Need for robust experimental designs to draw sound ecological conclusions
Zinger, L., Bonin, A., Alsos, I. G., Bálint, M., Bik, H., Boyer, F., Chariton, A. A., Creer, S., Coissac, E., Deagle, B. E., et al. (2019) · Molecular Ecology · doi:10.1111/mec.15060 · Cited by 438
Amrhein, V., Trafimow, D., & Greenland, S. (2019) · The American Statistician · doi:10.1080/00031305.2018.1543137 · Cited by 425
Poynton, F. E., Bright, S. A., Blasco, S., Williams, D. C., Kelly, J. M., & Gunnlaugsson, T. (2017) · Chemical Society Reviews · doi:10.1039/c7cs00680b · Cited by 421
Reproducibility of animal research in light of biological variation
Voelkl, B., Altman, N. S., Forsman, A., Forstmeier, W., Gurevitch, J., Jaric, I., Karp, N. A., Kas, M. J., Schielzeth, H., Van de Casteele, T., et al. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0313-3 · Cited by 390
Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., Grahe, J. E., McCarthy, R. J., Musser, E. D., Antfolk, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918797607 · Cited by 377
Small sample sizes reduce the replicability of task-based fMRI studies
Turner, B. O., Paul, E. J., Miller, M. B., & Barbey, A. K. (2018) · Communications Biology · doi:10.1038/s42003-018-0073-z · Cited by 387
Blood Pressure Estimation from Photoplethysmogram Using a Spectro-Temporal Deep Neural Network
Slapničar, G., Mlakar, N., & Luštrek, M. (2019) · Sensors · doi:10.3390/s19153420 · Cited by 387
Toxicity testing in the 21st century: progress in the past decade and future perspectives
Krewski, D., Andersen, M. E., Tyshenko, M. G., Krishnan, K., Hartung, T., Boekelheide, K., Wambaugh, J. F., Jones, D., Whelan, M., Thomas, R., et al. (2020) · Archives of Toxicology · doi:10.1007/s00204-019-02613-4 · Cited by 383
Noble, S., Spann, M. N., Tokoglu, F., Shen, X., Constable, R. T., & Scheinost, D. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx230 · Cited by 377
Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars
Mayo, D. G. (2018) · doi:10.1017/9781107286184 · Cited by 376
Mirowski, P. (2018) · Social Studies of Science · doi:10.1177/0306312718772086 · Cited by 372
Validation practices for satellite soil moisture retrievals: What are (the) errors?
Gruber, A., De Lannoy, G., Albergel, C., Al-Yaari, A., Brocca, L., Calvet, J.-C., Colliander, A., Cosh, M., Crow, W., Dorigo, W., et al. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111806 · Cited by 368
X-ray photoelectron spectroscopy of thin films
Greczyński, G., Haasch, R. T., Hellgren, N., et al. (2023) · Nature Reviews Methods Primers · doi:10.1038/s43586-023-00225-y · Cited by 358
Insightful classification of crystal structures using deep learning
Ziletti, A., Kumar, D., Scheffler, M., & Ghiringhelli, L. M. (2018) · Nature Communications · doi:10.1038/s41467-018-05169-6 · Cited by 347
Computer-Aided Drug Design and Drug Discovery: A Prospective Analysis
Niazi, S. K., & Mariam, Z. (2023) · Pharmaceuticals · doi:10.3390/ph17010022 · Cited by 336
The Role of Artificial Intelligence in Early Cancer Diagnosis
Hunter, B., Hindocha, S., & Lee, R. W. (2022) · Cancers · doi:10.3390/cancers14061524 · Cited by 332
A Review of Bioplastics and Their Adoption in the Circular Economy
Di Bartolo, A., Infurna, G., & Dintcheva, N. T. (2021) · Polymers · doi:10.3390/polym13081229 · Cited by 331
Meta-Analysis Reveals Reproducible Gut Microbiome Alterations in Response to a High-Fat Diet
Bisanz, J. E., Upadhyay, V., Turnbaugh, J. A., Ly, K., & Turnbaugh, P. J. (2019) · Cell Host & Microbe · doi:10.1016/j.chom.2019.06.013 · Cited by 333
Luechtefeld, T., Marsh, D., Rowlands, C., & Hartung, T. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfy152 · Cited by 327
Machine Learning in Chemical Engineering: Strengths, Weaknesses, Opportunities, and Threats
Dobbelaere, M. R., Plehiers, P. P., Van de Vijver, R., Stevens, C. V., & Van Geem, K. M. (2021) · Engineering · doi:10.1016/j.eng.2021.03.019 · Cited by 323
“Although chemistry and chemical engineering do not face a reproducibility crisis as much as the social sciences do [177], skepticism might grow in the community due to the increasing irreproducible use of machine learning in the field.”
BackgroundA checklist for maximizing reproducibility of ecological niche models
Feng, X., Park, D. S., Walker, C., Peterson, A. T., Merow, C., & Papeş, M. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-0972-5 · Cited by 323
BCPT 2023 policy for experimental and clinical studies
Tveden‐Nyborg, P., Bergmann, T. K., Jessen, N., Simonsen, U., & Lykkesfeldt, J. (2023) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.13944 · Cited by 322
“In this, research transparency has been highlighted as instrumental.(2,3) Enhancing transparency enables independent replication of published findings, and for findings to be reviewed in greater detail, including comparisons of methodology, statistical applications and experimental protocols, raising the credibility a…”
BackgroundGutiérrez, J. M., Maraun, D., Widmann, M., Huth, R., Hertig, E., Benestad, R., Roessler, O., Wibig, J., Wilcke, R., Kotlarski, S., et al. (2019) · International Journal of Climatology · doi:10.1002/joc.5462 · Cited by 320
Depression's Unholy Trinity: Dysregulated Stress, Immunity, and the Microbiome
Cruz-Pereira, J. S., Rea, K., Nolan, Y. M., O'Leary, O. F., Dinan, T. G., & Cryan, J. F. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011613 · Cited by 320
Meta-research: Why research on research matters
Ioannidis, J. P. A. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005468 · Cited by 314
BCPT policy for experimental and clinical studies
Tveden‐Nyborg, P., Bergmann, T. K., Jessen, N., Simonsen, U., & Lykkesfeldt, J. (2021) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.13492 · Cited by 316
Hickey, J. W., Neumann, E. K., Radtke, A. J., Camarillo, J. M., Beuschel, R. T., Albanese, A., McDonough, E., Hatler, J., Wiblin, A. E., Fisher, J., et al. (2022) · Nature Methods · doi:10.1038/s41592-021-01316-y · Cited by 311
“NATuRE METHoDS | www.nature.com/naturemethods”
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Binder 2.0 - Reproducible, interactive, sharable environments for science at scale
Jupyter, P., Bussonnier, M., Forde, J., Freeman, J., Granger, B., Head, T., Holdgraf, C., Kelley, K., Nalvarte, G., Osheroff, A., et al. (2018) · Proceedings of the Python in Science Conference · doi:10.25080/majora-4af1f417-011 · Cited by 302
A machine learning Automated Recommendation Tool for synthetic biology
Radivojević, T., Costello, Z., Workman, K., & Garcia Martin, H. (2020) · Nature Communications · doi:10.1038/s41467-020-18008-4 · Cited by 277
A knowledge graph to interpret clinical proteomics data
Santos, A., Colaço, A. R., Nielsen, A. B., Niu, L., Strauss, M., Geyer, P. E., Coscia, F., Albrechtsen, N. J. W., Mundt, F., Jensen, L. J., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01145-6 · Cited by 295
No raw data, no science: another possible source of the reproducibility crisis
Miyakawa, T. (2020) · Molecular Brain · doi:10.1186/s13041-020-0552-2 · Cited by 268
Elhaik, E. (2022) · Scientific Reports · doi:10.1038/s41598-022-14395-4 · Cited by 293
“(1) 2068 global modern-DNA samples genotyped over 621,799 SNPs14 available at https:// reich.”
BackgroundThe 3Rs in research: a contemporary approach to replacement, reduction and refinement
MacArthur Clark, J. (2018) · British Journal of Nutrition · doi:10.1017/s0007114517002227 · Cited by 290
Prospects and challenges of multi-omics data integration in toxicology
Canzler, S., Schor, J., Busch, W., Schubert, K., Rolle-Kampczyk, U. E., Seitz, H., Kamp, H., von Bergen, M., Buesen, R., & Hackermüller, J. (2020) · Archives of Toxicology · doi:10.1007/s00204-020-02656-y · Cited by 286
Our path to better science in less time using open data science tools
Lowndes, J. S. S., Best, B. D., Scarborough, C., Afflerbach, J. C., Frazier, M. R., O’Hara, C. C., Jiang, N., & Halpern, B. S. (2017) · Nature Ecology & Evolution · doi:10.1038/s41559-017-0160 · Cited by 286
Publication bias and the canonization of false facts
Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T. (2016) · eLife · doi:10.7554/elife.21451 · Cited by 266
“But what is the status of these facts in light of the widely reported replication crisis in science? Large scale analyses have revealed that many published papers in fields ranging from cancer biology to psychology to economics cannot be replicated in subsequent experiments (Begley and Ellis, 2012; Open Science Collab…”
BackgroundNakayasu, E. S., Gritsenko, M., Piehowski, P. D., Gao, Y., Orton, D. J., Schepmoes, A. A., Fillmore, T. L., Frohnert, B. I., Rewers, M., Krischer, J. P., et al. (2021) · Nature Protocols · doi:10.1038/s41596-021-00566-6 · Cited by 275
Nguyen, M.-H., La, V.-P., Le, T.-T., & Vuong, Q.-H. (2022) · MethodsX · doi:10.1016/j.mex.2022.101808 · Cited by 277
Mohammed, I., Hollenberg, M. D., Ding, H., & Triggle, C. R. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.718942 · Cited by 278
Reproducibility in machine learning for health research: Still a ways to go
McDermott, M. B. A., Wang, S., Marinsek, N., Ranganath, R., Foschini, L., & Ghassemi, M. (2021) · Science Translational Medicine · doi:10.1126/scitranslmed.abb1655 · Cited by 273
“INTRODUCTION Reproducibility is required for scientific research, but many subfields of science have recently experienced a reproducibility crisis, eroding trust in processes and results and potentially influencing the rising rates of scientific paper retractions (1, 2).”
BackgroundOn the External Validity of Social Preference Games: A Systematic Lab-Field Study
Galizzi, M. M., & Navarro-Martinez, D. (2019) · Management Science · doi:10.1287/mnsc.2017.2908 · Cited by 270
Basic & Clinical Pharmacology & Toxicology Policy for Experimental and Clinical studies
Tveden‐Nyborg, P., Bergmann, T. K., & Lykkesfeldt, J. (2018) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.13059 · Cited by 271
Wallach, J. D., Boyack, K. W., & Ioannidis, J. P. A. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2006930 · Cited by 269
Pinder, J. W., Major, G. H., Baer, D. R., Terry, J., Whitten, J. E., Čechal, J., Crossman, J. D., Lizarbe, A. J., Jafari, S., Easton, C. D., et al. (2024) · Applied Surface Science Advances · doi:10.1016/j.apsadv.2023.100534 · Cited by 263
Evidence-based Guidelines for Controlling pH in Mammalian Live-Cell Culture Systems
Michl, J., Park, K. C., & Swietach, P. (2019) · Communications Biology · doi:10.1038/s42003-019-0393-7 · Cited by 267
Applying the new SABV (sex as a biological variable) policy to research and clinical care
Clayton, J. A. (2018) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.08.012 · Cited by 260
Considering aspects of the 3Rs principles within experimental animal biology
Sneddon, L. U., Halsey, L. G., & Bury, N. R. (2017) · Journal of Experimental Biology · doi:10.1242/jeb.147058 · Cited by 254
Towards operando computational modeling in heterogeneous catalysis
Grajciar, L., Heard, C. J., Bondarenko, A. A., Polynski, M. V., Meeprasert, J., Pidko, E. A., & Nachtigall, P. (2018) · Chemical Society Reviews · doi:10.1039/c8cs00398j · Cited by 250
Open science saves lives: lessons from the COVID-19 pandemic
Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, E., Deforet, M., & Leyrat, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01304-y · Cited by 249
“Distrust of published results In 2016, a survey identified a phenomenon that had later been called the ‘reproducibility crisis’ [49].”
BackgroundComputational deconvolution of transcriptomics data from mixed cell populations
Avila Cobos, F., Vandesompele, J., Mestdagh, P., & De Preter, K. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty019 · Cited by 248
Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines
Monks, T., Currie, C. S. M., Onggo, B. S., Robinson, S., Kunc, M., & Taylor, S. J. E. (2019) · Journal of Simulation · doi:10.1080/17477778.2018.1442155 · Cited by 248
“A recent survey in Nature suggests that around 50% of scientists believe there is a substantial reproducibility “crisis” (Baker, 2016). Within our own ORMS paradigm, several authors have investigated the reproducibility of research. Rahmandad and Sterman (2012), Boylan et al. (2015), Janssen (2017) and Kurkowski et al.”
BackgroundInfluentialPromises and pitfalls of using high‐throughput sequencing for diet analysis
Alberdi, A., Aizpurua, O., Bohmann, K., Gopalakrishnan, S., Lynggaard, C., Nielsen, M., & Gilbert, M. T. P. (2019) · Molecular Ecology Resources · doi:10.1111/1755-0998.12960 · Cited by 239
Ten common statistical mistakes to watch out for when writing or reviewing a manuscript
Makin, T. R., & Orban de Xivry, J.-J. (2019) · eLife · doi:10.7554/elife.48175 · Cited by 238
Baer, D. R., Artyushkova, K., Richard Brundle, C., Castle, J. E., Engelhard, M. H., Gaskell, K. J., Grant, J. T., Haasch, R. T., Linford, M. R., Powell, C. J., et al. (2019) · Journal of Vacuum Science & Technology A: Vacuum, Surfaces, and Films · doi:10.1116/1.5065501 · Cited by 238
On the Reuse of Scientific Data
Pasquetto, I. V., Randles, B. M., & Borgman, C. L. (2017) · Data Science Journal · doi:10.5334/dsj-2017-008 · Cited by 223
Global chemical analysis of biology by mass spectrometry
Aksenov, A. A., da Silva, R., Knight, R., Lopes, N. P., & Dorrestein, P. C. (2017) · Nature Reviews Chemistry · doi:10.1038/s41570-017-0054 · Cited by 230
Pineau, J., Vincent-Lamarre, P., Sinha, K., Larivière, V., Beygelzimer, A., d'Alché-Buc, F., Fox, E., & Larochelle, H. (2020) · arXiv · doi:10.48550/arxiv.2003.12206 · Cited by 232
Early Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review
Moor, M., Rieck, B., Horn, M., Jutzeler, C. R., & Borgwardt, K. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.607952 · Cited by 231
Variability and reproducibility in deep learning for medical image segmentation
Renard, F., Guedria, S., Palma, N. D., & Vuillerme, N. (2020) · Scientific Reports · doi:10.1038/s41598-020-69920-0 · Cited by 229
MOSFiT: Modular Open Source Fitter for Transients
Guillochon, J., Nicholl, M., Villar, V. A., Mockler, B., Narayan, G., Mandel, K. S., Berger, E., & Williams, P. K. G. (2018) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/aab761 · Cited by 228
Nguyen, M.-H., Le, T.-T., Nguyen, H.-K. T., Ho, M.-T., Nguyen, H. T. T., & Vuong, Q.-H. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073681 · Cited by 229
Modelling science trustworthiness under publish or perish pressure
Grimes, D. R., Bauch, C. T., & Ioannidis, J. P. A. (2018) · Royal Society Open Science · doi:10.1098/rsos.171511 · Cited by 225
Isothermal titration calorimetry
Bastos, M., Abian, O., Johnson, C. M., Ferreira-da-Silva, F., Vega, S., Jimenez-Alesanco, A., Ortega-Alarcon, D., & Velazquez-Campoy, A. (2023) · Nature Reviews Methods Primers · doi:10.1038/s43586-023-00199-x · Cited by 212
Machine Learning for Chemical Reactivity: The Importance of Failed Experiments
Strieth‐Kalthoff, F., Sandfort, F., Kühnemund, M., Schäfer, F. R., Kuchen, H., & Glorius, F. (2022) · Angewandte Chemie International Edition · doi:10.1002/anie.202204647 · Cited by 217
Recommended standards for conducting and reporting ethnopharmacological field studies
Weckerle, C. S., de Boer, H. J., Puri, R. K., van Andel, T., Bussmann, R. W., & Leonti, M. (2018) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2017.08.018 · Cited by 216
Towards reproducible computational drug discovery
Schaduangrat, N., Lampa, S., Simeon, S., Gleeson, M. P., Spjuth, O., & Nantasenamat, C. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-0408-x · Cited by 208
Assessing and mitigating batch effects in large-scale omics studies
Yu, Y., Mai, Y., Zheng, Y., & Shi, L. (2024) · Genome Biology · doi:10.1186/s13059-024-03401-9 · Cited by 202
“Among the massive factors contributing to irre-producibility, batch effect(s) from reagent variability and experimental bias are paramount factors [16, 42].”
BackgroundInfluentialThe spatial and temporal domains of modern ecology
Estes, L., Elsen, P. R., Treuer, T., Ahmed, L., Caylor, K., Chang, J., Choi, J. J., & Ellis, E. C. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-018-0524-4 · Cited by 204
Automation in the Life Science Research Laboratory
Holland, I., & Davies, J. A. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.571777 · Cited by 200
Transparency in Ecology and Evolution: Real Problems, Real Solutions
Parker, T. H., Forstmeier, W., Koricheva, J., Fidler, F., Hadfield, J. D., Chee, Y. E., Kelly, C. D., Gurevitch, J., & Nakagawa, S. (2016) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2016.07.002 · Cited by 201
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.