1,500 scientists lift the lid on reproducibility
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an online survey of 1576 researchers by Nature , the collected opinions emphasised the need for better reproducibility in research: “More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments.” 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“Our findings support the seriousness of the findings from the survey conducted by Nature regarding reproducibility of basic science research (70%). 1”
From Validity of data extraction in evidence synthesis practice of adverse events: reproducibility study (2022) · cites this paper as [1]
In the citing paper
“However, the reproducibility crisis (Baker, 2016;Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
From Toward good in vitro reporting standards (2019) · cites this paper as Baker, 2016
In the citing paper
“Furthermore, thorough documentation and recording improve the transparency and efficiency of scientific research, can be used to improve reproducibility, and enable work to be repeated (Baker, 2016a,b; Munafo et al., 2017).”
From Guidance document on Good cell and tissue culture practice 2.0 (GCCP 2.0) (2021) · cites this paper as Baker, 2016a,b
In the citing paper
“The biomedical reproducibility crisis [19] has demonstrated that multistage analytical pipelines can generate apparently compelling but non-replicable results even when each individual component is carefully designed.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [19]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Patel, R., & Alahmad, A. J. (2016) · Fluids and Barriers of the CNS · doi:10.1186/s12987-016-0030-5 · Cited by 48
Activities of Psilostachyin A and Cynaropicrin against Trypanosoma cruzi In Vitro and In Vivo
da Silva, C. F., Batista, D. D. G. J., de Araújo, J. S., et al. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00595-13 · Cited by 40
Cited by
Items 101–200 of 4,204
Endogenous Enterobacteriaceae underlie variation in susceptibility to Salmonella infection
Velazquez, E. M., Nguyen, H., Heasley, K. T., Saechao, C. H., Gil, L. M., Rogers, A. W. L., Miller, B. M., Rolston, M. R., Lopez, C. A., Litvak, Y., et al. (2019) · Nature Microbiology · doi:10.1038/s41564-019-0407-8 · Cited by 201
Machine Learning in Psychometrics and Psychological Research
Orrù, G., Monaro, M., Conversano, C., Gemignani, A., & Sartori, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02970 · Cited by 195
Beresford-Jones, B. S., Forster, S. C., Stares, M. D., Notley, G., Viciani, E., Browne, H. P., Boehmler, D. J., Soderholm, A. T., Kumar, N., Vervier, K., et al. (2022) · Cell Host & Microbe · doi:10.1016/j.chom.2021.12.003 · Cited by 194
“As variation in the mouse gut microbiota is recognized as a confounding factor of mouse studies (Baker, 2016; Forster et al., 2021; Stappenbeck and Virgin, 2016), we assessed the effect of host genetic and environmental factors on compositional variation in themouse gut microbiota (Figure S2B;…”
BackgroundHardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190806 · Cited by 217
Standardized and reproducible measurement of decision-making in mice
Laboratory, T. I. B., Aguillon-Rodriguez, V., Angelaki, D., Bayer, H., Bonacchi, N., Carandini, M., Cazettes, F., Chapuis, G., Churchland, A. K., Dan, Y., et al. (2021) · eLife · doi:10.7554/elife.63711 · Cited by 189
The R-based climate4R open framework for reproducible climate data access and post-processing
Iturbide, M., Bedia, J., Herrera, S., Baño-Medina, J., Fernández, J., Frías, M. D., Manzanas, R., San-Martín, D., Cimadevilla, E., Cofiño, A. S., et al. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.09.009 · Cited by 190
Mapping brain asymmetry in health and disease through the ENIGMA consortium
Kong, X., Postema, M. C., Guadalupe, T., de Kovel, C., Boedhoe, P. S. W., Hoogman, M., Mathias, S. R., van Rooij, D., Schijven, D., Glahn, D. C., et al. (2022) · Human Brain Mapping · doi:10.1002/hbm.25033 · Cited by 186
Hardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Aguinis, H., Hill, N. S., & Bailey, J. R. (2021) · Organizational Research Methods · doi:10.1177/1094428119836485 · Cited by 180
High-Throughput Methods in the Discovery and Study of Biomaterials and Materiobiology
Yang, L., Pijuan-Galito, S., Rho, H. S., Vasilevich, A. S., Eren, A. D., Ge, L., Habibović, P., Alexander, M. R., de Boer, J., Carlier, A., et al. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00752 · Cited by 180
Rubin, M. (2017) · Review of General Psychology · doi:10.1037/gpr0000128 · Cited by 182
Estimating the Reproducibility of Experimental Philosophy
Cova, F., Strickland, B., Abatista, A., Allard, A., Andow, J., Attie, M., Beebe, J., Berniūnas, R., Boudesseul, J., Colombo, M., et al. (2021) · Review of Philosophy and Psychology · doi:10.1007/s13164-018-0400-9 · Cited by 179
Reducing bias, increasing transparency and calibrating confidence with preregistration
Hardwicke, T. E., & Wagenmakers, E.-J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01497-2 · Cited by 179
Comprehensive multi-center assessment of small RNA-seq methods for quantitative miRNA profiling
Giraldez, M. D., Spengler, R. M., Etheridge, A., Godoy, P. M., Barczak, A. J., Srinivasan, S., De Hoff, P. L., Tanriverdi, K., Courtright, A., Lu, S., et al. (2018) · Nature Biotechnology · doi:10.1038/nbt.4183 · Cited by 177
Ioannidis, J. P. A., Kim, B. Y. S., & Trounson, A. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0314-y · Cited by 175
Steroid hormones in the aquatic environment
Ojoghoro, J. O., Scrimshaw, M. D., & Sumpter, J. P. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.148306 · Cited by 173
Toward Neurosubtypes in Autism
Hong, S.-J., Vogelstein, J. T., Gozzi, A., Bernhardt, B. C., Yeo, B. T. T., Milham, M. P., & Di Martino, A. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.03.022 · Cited by 171
Reproducibility of EEG functional connectivity in Alzheimer’s disease
Briels, C. T., Schoonhoven, D. N., Stam, C. J., de Waal, H., Scheltens, P., & Gouw, A. A. (2020) · Alzheimer's Research & Therapy · doi:10.1186/s13195-020-00632-3 · Cited by 171
Application of the Hierarchical Bootstrap to Multi-Level Data in Neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2019) · doi:10.1101/819334 · Cited by 170
Enhancing Rigor in Quantitative Entrepreneurship Research
Maula, M., & Stam, W. (2020) · Entrepreneurship Theory and Practice · doi:10.1177/1042258719891388 · Cited by 167
Assessing data availability and research reproducibility in hydrology and water resources
Stagge, J. H., Rosenberg, D. E., Abdallah, A. M., Akbar, H., Attallah, N. A., & James, R. (2019) · Scientific Data · doi:10.1038/sdata.2019.30 · Cited by 165
Volpato, V., Smith, J., Sandor, C., Ried, J. S., Baud, A., Handel, A., Newey, S. E., Wessely, F., Attar, M., Whiteley, E., et al. (2018) · Stem Cell Reports · doi:10.1016/j.stemcr.2018.08.013 · Cited by 165
Systematic benchmarking of omics computational tools
Mangul, S., Martin, L. S., Hill, B. L., Lam, A. K.-M., Distler, M. G., Zelikovsky, A., Eskin, E., & Flint, J. (2019) · Nature Communications · doi:10.1038/s41467-019-09406-4 · Cited by 164
A versatile and customizable low-cost 3D-printed open standard for microscopic imaging
Diederich, B., Lachmann, R., Carlstedt, S., Marsikova, B., Wang, H., Uwurukundo, X., Mosig, A. S., & Heintzmann, R. (2020) · Nature Communications · doi:10.1038/s41467-020-19447-9 · Cited by 164
Goshisht, M. K. (2024) · ACS Omega · doi:10.1021/acsomega.3c05913 · Cited by 161
Reyes, D. R., van Heeren, H., Guha, S., Herbertson, L., Tzannis, A. P., Ducrée, J., Bissig, H., & Becker, H. (2021) · Lab on a Chip · doi:10.1039/d0lc00963f · Cited by 162
Improvements in reports of species redistribution under climate change are required
Taheri, S., Naimi, B., Rahbek, C., & Araújo, M. B. (2021) · Science Advances · doi:10.1126/sciadv.abe1110 · Cited by 161
In Vitro research Reproducibility: Keeping up High Standards
Hirsch, C., & Schildknecht, S. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.01484 · Cited by 161
Rational Cell Culture Optimization Enhances Experimental Reproducibility in Cancer Cells
Wright Muelas, M., Ortega, F., Breitling, R., Bendtsen, C., & Westerhoff, H. V. (2018) · Scientific Reports · doi:10.1038/s41598-018-21050-4 · Cited by 160
“We conclude that, in order to ensure that (1) cells are in exponential growth from 24 hours after seeding, (2) confluence is reached as late as possible, and (3) changes in glucose, glutamine and pH are kept to a minimum, the volume of culture media should be increased up to 3 mL and seeding density reduced according…”
BackgroundA review on blockchain technology and blockchain projects fostering open science
Leible, S., Schlager, S., Schubotz, M., & Gipp, B. (2019) · Frontiers in Blockchain · doi:10.3389/fbloc.2019.00016 · Cited by 134
Bayesian analysis for social data: A step-by-step protocol and interpretation
Vuong, Q.-H., La, V.-P., Nguyen, M.-H., Ho, M.-T., Tran, T., & Ho, M.-T. (2020) · MethodsX · doi:10.1016/j.mex.2020.100924 · Cited by 159
Practical Computational Reproducibility in the Life Sciences
Grüning, B. A., Chilton, J. M., Köster, J., Dale, R., Soranzo, N., van den Beek, M., Goecks, J., Backofen, R., Nekrutenko, A., & Taylor, J. (2017) · Cell Systems · doi:10.1016/j.cels.2018.03.014 · Cited by 212
Threats of a replication crisis in empirical computer science
Cockburn, A., Dragicevic, P., Besançon, L., & Gutwin, C. (2020) · Communications of the ACM · doi:10.1145/3360311 · Cited by 155
Insightful classification of crystal structures using deep learning
Ziletti, A., Kumar, D., Scheffler, M., & Ghiringhelli, L. M. (2018) · MPG.PuRe (Max Planck Society) · Cited by 175
Replication across space and time must be weak in the social and environmental sciences
Goodchild, M. F., & Li, W. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2015759118 · Cited by 157
Ocean acidification does not impair the behaviour of coral reef fishes
Clark, T. D., Raby, G. D., Roche, D. G., Binning, S. A., Speers‐Roesch, B., Jutfelt, F., & Sundin, J. (2020) · Nature · doi:10.1038/s41586-019-1903-y · Cited by 182
Fetal bovine serum, an important factor affecting the reproducibility of cell experiments
Liu, S., Yang, W. C., Li, Y., & Sun, C. (2023) · Scientific Reports · doi:10.1038/s41598-023-29060-7 · Cited by 206
Sajjadian, M., Lam, R. W. M., Milev, R. V., Rotzinger, S., Frey, B. N., Soares, C. N., Parikh, S. V., Foster, J. A., Turecki, G., Müller, D. J., et al. (2021) · Psychological Medicine · doi:10.1017/s0033291721003871 · Cited by 183
The seven deadly sins of psychology a manifesto for reforming the culture of scientific practice
Kaplan, D. M., Sowman, P. F., Abel, L., Arbige, S., Chandler, C. B., Chen, C., Chard, T., Higgins, W. C., Jones, S., Murray, L., et al. (2020) · Philosophical Psychology · doi:10.1080/09515089.2020.1837360 · Cited by 173
Standardisation needs for organ on chip devices
Piergiovanni, M., Leite, S. B., Corvi, R., & Whelan, M. (2021) · Lab on a Chip · doi:10.1039/d1lc00241d · Cited by 155
Validation of Molecular Simulation: An Overview of Issues
van Gunsteren, W. F., Daura, X., Hansen, N., Mark, A. E., Oostenbrink, C., Riniker, S., & Smith, L. J. (2017) · Angewandte Chemie International Edition · doi:10.1002/anie.201702945 · Cited by 178
Network localization of heterogeneous neuroimaging findings
Darby, R. R., Joutsa, J., & Fox, M. D. (2019) · Brain · doi:10.1093/brain/awy292 · Cited by 153
Toward Machine Learning-Enhanced High-Throughput Experimentation
Eyke, N. S., Koscher, B. A., & Jensen, K. F. (2021) · Trends in Chemistry · doi:10.1016/j.trechm.2020.12.001 · Cited by 155
Peng, J., Jury, E. C., Dönnes, P., & Ciurtin, C. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.720694 · Cited by 229
Reproducible Computational Workflows with Continuous Analysis
Beaulieu-Jones, B. K., & Greene, C. S. (2016) · doi:10.1101/056473 · Cited by 154
Seven Easy Steps to Open Science: An Annotated Reading List
Crüwell, S., van Doorn, J., Etz, A., Makel, M. C., Moshontz, H., Niebaum, J. C., Orben, A., Parsons, S., & Schulte-Mecklenbeck, M. (2019) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000387 · Cited by 153
Rapid, accurate, precise and reproducible ligand–protein binding free energy prediction
Wan, S., Bhati, A. P., Zasada, S. J., & Coveney, P. V. (2020) · Interface Focus · doi:10.1098/rsfs.2020.0007 · Cited by 173
A consensus-based transparency checklist
Aczel, B., Szaszi, B., Sarafoglou, A., Kekecs, Z., Kucharský, Š., Benjamin, D., Chambers, C. D., Fisher, A., Gelman, A., Gernsbacher, M. A., et al. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0772-6 · Cited by 152
Oxygenation in Cell Culture: Critical Parameters for Reproducibility Are Routinely Not Reported
Al-Ani, A., Toms, D., Kondro, D., Thundathil, J., Yu, Y., & Ungrin, M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204269 · Cited by 152
Reproducibility of computational workflows is automated using continuous analysis
Beaulieu-Jones, B. K., & Greene, C. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3780 · Cited by 151
Sharing Is Caring—Data Sharing Initiatives in Healthcare
Hulsen, T. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17093046 · Cited by 198
Artificial Intelligence for Surface‐Enhanced Raman Spectroscopy
Bi, X., Lin, L. L., Chen, Z., & Ye, J. (2023) · Small Methods · doi:10.1002/smtd.202301243 · Cited by 164
Answers to 18 Questions About Open Science Practices
Banks, G. C., Field, J. G., Oswald, F. L., O’Boyle, E. H., Landis, R. S., Rupp, D. E., & Rogelberg, S. G. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9547-8 · Cited by 180
Li, W., Wang, H., Zhao, Z., Gao, H., Liu, C., Zhu, L., Wang, C., & Yang, Y. (2018) · Advanced Materials · doi:10.1002/adma.201805344 · Cited by 160
The replicability crisis and public trust in psychological science
Anvari, F., & Lakens, D. (2018) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2019.1684822 · Cited by 178
Statistical inference as severe testing how to get beyond the statistics wars
Mayo, D. G. (2018) · Cited by 159
Yang, D. (2019) · Journal of Renewable and Sustainable Energy · doi:10.1063/1.5087462 · Cited by 162
Benchmarking satellite-derived shoreline mapping algorithms
Vos, K., Splinter, K. D., Palomar-Vázquez, J. M., Pardo-Pascual, J. E., Almonacid-Caballer, J., Cabezas-Rabadán, C., Kras, E., Luijendijk, A. P., Calkoen, F., Almeida, L. P., et al. (2023) · Communications Earth & Environment · doi:10.1038/s43247-023-01001-2 · Cited by 184
THE AGORA HIGH-RESOLUTION GALAXY SIMULATIONS COMPARISON PROJECT. II. ISOLATED DISK TEST
Kim, J.-H., Agertz, O., Teyssier, R., Butler, M. J., Ceverino, D., Choi, J.-H., Feldmann, R., Keller, B., Lupi, A., Quinn, T., et al. (2016) · The Astrophysical Journal · doi:10.3847/1538-4357/833/2/202 · Cited by 171
Clayton, A., Boilard, E., Buzas, E. I., Cheng, L., Falcón‐Perez, J. M., Gardiner, C., Gustafson, D., Gualerzi, A., Hendrix, A., Hoffman, A., et al. (2019) · Journal of Extracellular Vesicles · doi:10.1080/20013078.2019.1647027 · Cited by 140
Zheng, Y., Liu, Y., Yang, J., Dong, L., Zhang, R., Tian, S., Yu, Y., Ren, L., Hou, W., Zhu, F., et al. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01934-1 · Cited by 178
Deep Reinforcement Learning at the Edge of the Statistical Precipice
Agarwal, R., Schwarzer, M., Castro, P. S., Courville, A., & Bellemare, M. G. (2021) · arXiv · doi:10.48550/arxiv.2108.13264 · Cited by 142
Provencher, S., Archer, S. L., Ramirez, F. D., Hibbert, B., Paulin, R., Boucherat, O., Lacasse, Y., & Bonnet, S. (2018) · Circulation Research · doi:10.1161/circresaha.117.312579 · Cited by 141
Global trends and challenges in multimetric indices of biological condition
Ruaro, R., Gubiani, É. A., Hughes, R. M., & Mormul, R. P. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2019.105862 · Cited by 153
EMPOWERING MULTI-COHORT GENE EXPRESSION ANALYSIS TO INCREASE REPRODUCIBILITY
Haynes, W. A., Vallania, F., Liu, C. Y., Bongen, E., Tomczak, A., Andres-Terrè, M., Lofgren, S., Tam, A., Deisseroth, C. A., Li, M., et al. (2016) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789813207813_0015 · Cited by 134
von Kortzfleisch, V. T., Karp, N. A., Palme, R., Kaiser, S., Sachser, N., & Richter, S. H. (2020) · Scientific Reports · doi:10.1038/s41598-020-73503-4 · Cited by 154
Assessment of transparency indicators across the biomedical literature: How open is open?
Serghiou, S., Contopoulos-Ioannidis, D. G., Boyack, K. W., Riedel, N., Wallach, J. D., & Ioannidis, J. P. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001107 · Cited by 139
“Research reproducibility [1] is a fundamental tenet of science, yet recent reports suggest that reproducibility of published findings should not be taken for granted [2].”
BackgroundReproducibility in systems biology modelling
Tiwari, K., Kananathan, S., Roberts, M. G., Meyer, J. P., Sharif Shohan, M. U., Xavier, A., Maire, M., Zyoud, A., Men, J., Ng, S., et al. (2021) · Molecular Systems Biology · doi:10.15252/msb.20209982 · Cited by 131
PIC, a paediatric-specific intensive care database
Zeng, X., Yu, G., Lu, Y., Tan, L., Wu, X., Shi, S., Duan, H., Shu, Q., & Li, H. (2020) · Scientific Data · doi:10.1038/s41597-020-0355-4 · Cited by 138
Ramirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138
The reproducibility crisis in the age of digital medicine
Stupple, A., Singerman, D., & Celi, L. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0079-z · Cited by 137
Knowledge-integrated machine learning for materials: lessons from gameplaying and robotics
Hippalgaonkar, K., Li, Q., Wang, X., Fisher, J. S., Kirkpatrick, J., & Buonassisi, T. (2023) · Nature Reviews Materials · doi:10.1038/s41578-022-00513-1 · Cited by 174
A Primer for Conducting Experiments in Human–Robot Interaction
Hoffman, G., & Zhao, X. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3412374 · Cited by 135
A large-scale study on research code quality and execution
Trisovic, A., Lau, M. K., Pasquier, T., & Crosas, M. (2022) · Scientific Data · doi:10.1038/s41597-022-01143-6 · Cited by 135
On expert curation and scalability: UniProtKB/Swiss-Prot as a case study
Poux, S., Arighi, C. N., Magrane, M., Bateman, A., Wei, C.-H., Lu, Z., Boutet, E., Bye-A-Jee, H., Famiglietti, M. L., Roechert, B., et al. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx439 · Cited by 135
“One of these reported that > 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments (Baker, 2016; Santori, 2016).”
BackgroundMechanistische Studien in der Photokatalyse
Buzzetti, L., Crisenza, G. E. M., & Melchiorre, P. (2018) · Angewandte Chemie · doi:10.1002/ange.201809984 · Cited by 135
Messner, C. B., Demichev, V., Wang, Z., Hartl, J., Kustatscher, G., Mülleder, M., & Ralser, M. (2022) · PROTEOMICS · doi:10.1002/pmic.202200013 · Cited by 154
Jang, E. S., Preda, M., Mammou, K., Tourapis, A. M., Kim, J., Graziosi, D. B., Rhyu, S., & Budagavi, M. (2019) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2900721 · Cited by 149
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
The devil is in the details: incomplete reporting in preclinical animal research
Avey, M. T., Moher, D., Sullivan, K. J., Fergusson, D., Griffin, G., Grimshaw, J. M., Hutton, B., Lalu, M. M., Macleod, M., Marshall, J., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166733 · Cited by 130
Selecting the “Best” Factor Structure and Moving Measurement Validation Forward: An Illustration
Schmitt, T. A., Sass, D. A., Chappelle, W. L., & Thompson, W. T. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1449116 · Cited by 163
Academic Misconduct, Misrepresentation and Gaming: A ReassessmentPreprint
Biagioli, M., Kenney, M. F., Martin, B. R., & Walsh, J. P. (2018) · SSRN Electronic Journal · doi:10.1016/j.respol.2018.10.025 · Cited by 146
Revolutionizing drug formulation development: The increasing impact of machine learning
Bao, Z., Bufton, J., Hickman, R. J., Aspuru‐Guzik, A., Bannigan, P., & Allen, C. J. (2023) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2023.115108 · Cited by 156
Systems Toxicology: Real World Applications and Opportunities
Härtung, T., FitzGerald, R., Jennings, P., Mirams, G. R., Peitsch, M. C., Rostami‐Hodjegan, A., Shah, I., Wilks, M. F., & Sturla, S. J. (2017) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.7b00003 · Cited by 153
Quality control in mass spectrometry‐based proteomics
Bittremieux, W., Tabb, D. L., Impens, F., Staes, A., Timmerman, E., Martens, L., & Laukens, K. (2018) · Mass Spectrometry Reviews · doi:10.1002/mas.21544 · Cited by 124
Open Science Practices are on the Rise: The State of Social Science (3S) SurveyPreprint
Christensen, G., Wang, Z., Paluck, E. L., Swanson, N., Birke, D. J., Miguel, E. A., & Littman, R. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/5rksu · Cited by 152
Conceptualizing and evaluating replication across domains of behavioral research
Tackett, J. L., & McShane, B. B. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000882 · Cited by 124
Sofia, G. (2020) · Geomorphology · doi:10.1016/j.geomorph.2020.107055 · Cited by 125
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120
Buscher, K., Ehinger, E., Gupta, P., Pramod, A. B., Wolf, D., Tweet, G., Pan, C., Mills, C. D., Lusis, A. J., & Ley, K. (2017) · Nature Communications · doi:10.1038/ncomms16041 · Cited by 123
Understanding the Replication Crisis as a Base Rate Fallacy
Bird, A. (2018) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axy051 · Cited by 147
Data Quality in Citizen Science
Balázs, B., Mooney, P., Nováková, E., Bastin, L., & Arsanjani, J. J. (2021) · Springer eBooks · doi:10.1007/978-3-030-58278-4_8 · Cited by 239
A survey of early-career researchers in Australia
Christian, K., Johnstone, C., Larkins, J., Wright, W., & Doran, M. R. (2021) · eLife · doi:10.7554/elife.60613 · Cited by 141
The digitization of organic synthesis
Davies, I. W. (2019) · Nature · doi:10.1038/s41586-019-1288-y · Cited by 122
Gene set enrichment for reproducible science: comparison of CERNO and eight other algorithms
Zyla, J., Marczyk, M., Domaszewska, T., Kaufmann, S. H. E., Polanska, J., & Weiner, J. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz447 · Cited by 122
Ubermag: Toward More Effective Micromagnetic Workflows
Beg, M., Lang, M., & Fangohr, H. (2021) · IEEE Transactions on Magnetics · doi:10.1109/tmag.2021.3078896 · Cited by 134
Baseline brain function in the preadolescents of the ABCD Study
Chaarani, B., Hahn, S., Allgaier, N. A., Adise, S., Owens, M. M., Juliano, A., Yuan, D., Loso, H., Ivanciu, A., Albaugh, M. D., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00867-9 · Cited by 139
Chinazzo, G., Andersen, R. K., Azar, E., Barthelmes, V. M., Becchio, C., Belussi, L., Berger, C., Carlucci, S., Corgnati, S. P., Crosby, S., et al. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109719 · Cited by 137
Nanofibrous materials affect the reaction of cytotoxicity assays
Podgórski, R., Wojasiński, M., & Ciach, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-13002-w · Cited by 131
Materia, S., García, L. P., van Straaten, C., O, S., Mamalakis, A., Cavicchia, L., Coumou, D., de Luca, P., Kretschmer, M., & Donat, M. (2024) · WIREs Climate Change · doi:10.1002/wcc.914 · Cited by 130
“However, more than 60% of earth scientists have failed to reproduce other researchers' work, and over 40% could not reproduce their own experiments (Baker, 2016), raising concerns about a “ reproducibility crisis ” exacerbated in AI literature (Hutson, 2018).”
Metadata
- Authors
- Baker, M.
- Corresponding author
- Baker, Monya
- Venue
- Nature
- Published
- 2016-05-25
- Volume
- 533
- Issue
- 7604
- Pages
- 452-454
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2406493898
- Semantic Scholar
- 57b101db87fb0b67fbe8b57f90b83f8e9efe81a6
- Cited by
- 4,209
- References
- 4
- Citations by year
- 2026: 301 · 2025: 374 · 2024: 447 · 2023: 440 · 2022: 526 · 2021: 487 · 2020: 502 · 2019: 443 · 2018: 363 · 2017: 260 · 2016: 59
- Type
- other
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- reproducibility, scientific credibility, research integrity
- MeSH terms
- Attitude, Data Interpretation, Statistical, Mentors, Periodicals as Topic, Publishing, Surveys and Questionnaires, Research, Research Design, Research Personnel, Research Support as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.