A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Irreproducibility of preclinical biomedical research has gained recent attention. It is suggested that requiring authors to complete a checklist at the time of manuscript submission would improve the quality and transparency of scientific reporting, and ultimately enhance reproducibility. Whether a checklist enhances quality and transparency in reporting preclinical animal studies, however, has not been empirically studied. Here we searched two highly cited life science journals, one that requires a checklist at submission (Nature) and one that does not (Cell), to identify in vivo animal studies. After screening 943 articles, a total of 80 articles were identified in 2013 (pre-checklist) and 2015 (post-checklist), and included for the detailed evaluation of reporting methodological and analytical information. We compared the quality of reporting preclinical animal studies between the two journals, accounting for differences between journals and changes over time in reporting. We find that reporting of randomization, blinding, and sample-size estimation significantly improved when comparing Nature to Cell from 2013 to 2015, likely due to implementation of a checklist. Specifically, improvement in reporting of the three methodological information was at least three times greater when a mandatory checklist was implemented than when it was not. Reporting the sex of animals and the number of independent experiments performed also improved from 2013 to 2015, likely from factors not related to a checklist. Our study demonstrates that completing a checklist at manuscript submission is associated with improved reporting of key methodological information in preclinical animal studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Reporting guidelines and checklists provided to authors during the review or manuscript preparation processes have been reported to cause modest improvements limited to a few items in in vivo animal studies [19, 20, 28, 40].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In contrast, other studies using shorter checklists (primarily focused on experimental design) with more editorial follow-up have shown a marked improvement in the nature and detail of the information included in publications [34–36].”
From The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research (2020) · cites this paper as [35]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Quality of reporting is used to evaluate study quality in meta-analyses [36], as well as the effect of interventions focused on improving transparency [19, 20, 40].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Guidelines for the Design and Statistical Analysis of Experiments Using Laboratory Animals
Festing, M. F. W., & Altman, D. G. (2002) · ILAR Journal · doi:10.1093/ilar.43.4.244 · Cited by 1,110
Research works printed but not linked: 1
- Drummond C, editor Replicability is not Reproducibility: Nor is it Good Science. Proc of the Evaluation Methods for Machine Learning Workshop at the 26th ICML; 2009; Montreal, Quebec, Canada.
Cited by
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000410 · Cited by 5,939
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Experimental Physiology · doi:10.1113/ep088870 · Cited by 3,497
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research*
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x20943823 · Cited by 1,443
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
“The use of checklists has also been impactful in improving reporting practices in the few fields that have adopted them.(70) Although checklists and model cards provide concrete best practices for reporting standards, current efforts do not address pitfalls arising because of leakage.”
BackgroundThe ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · British Journal of Pharmacology · doi:10.1111/bph.15193 · Cited by 1,081
The ARRIVE guidelines 2019: updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703181 · Cited by 1,036
Minimum information reporting in bio–nano experimental literature
Faria, M., Björnmalm, M., Thurecht, K. J., Kent, S. J., Parton, R. G., Kavallaris, M., Johnston, A. P. R., Gooding, J. J., Corrie, S. R., Boyd, B. J., et al. (2018) · Nature Nanotechnology · doi:10.1038/s41565-018-0246-4 · Cited by 710
The ARRIVE guidelines 2.0: updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · The Journal of Physiology · doi:10.1113/jp280389 · Cited by 593
“…contrast, other studies using shorter checklists (primarily focused on experimental design) with more editorial follow-up have shown a marked improvement in the nature and detail of the information included in publications (Han et al. 2017, Ramirez et al. 2017; The NPQIP Collaborative group, 2019).”
ResultThe ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · BMC Veterinary Research · doi:10.1186/s12917-020-02451-y · Cited by 496
A Systematic Review of Automatic Question Generation for Educational Purposes
Kurdi, G., Leo, J., Parsia, B., Sattler, U., & Al-Emari, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00186-y · Cited by 514
Bøtker, H. E., Hausenloy, D., Andreadou, I., Antonucci, S., Boengler, K., Davidson, S. M., Deshwal, S., Devaux, Y., Di Lisa, F., Di Sante, M., et al. (2018) · Basic Research in Cardiology · doi:10.1007/s00395-018-0696-8 · Cited by 423
“Some journals [54, 176] have established additional guidelines for planning, performing and reporting experimental studies and the respective data.”
BackgroundA systematic approach to quantitative Western blot analysis
Pillai-Kastoori, L., Schutz-Geschwender, A. R., & Harford, J. A. (2020) · Analytical Biochemistry · doi:10.1016/j.ab.2020.113608 · Cited by 407
Challenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 267
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · BMJ Open Science · doi:10.1136/bmjos-2020-100115 · Cited by 273
on behalf of the IICARus Collaboration, Hair, K., Macleod, M. R., & Sena, E. S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0069-3 · Cited by 174
Leung, V., Rousseau-Blass, F., Beauchamp, G., & Pang, D. S. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0197882 · Cited by 172
Problems and Progress regarding Sex Bias and Omission in Neuroscience Research
Will, T. R., Proaño, S. B., Thomas, A. M., Kunz, L. M., Thompson, K. C., Ginnari, L. A., Jones, C. H., Lucas, S.-C., Reavis, E. M., Dorris, D. M., et al. (2017) · eneuro · doi:10.1523/eneuro.0278-17.2017 · Cited by 154
“…mandate the inclusion of sex in both the title and methods of manuscripts (Blaustein, 2012); journals that include animal sex is reported on author, reviewer, or editor checklists (Han et al., 2017); journals with statements in the author guidelines; and journals with no relevant policies at all.”
BackgroundREFORMS: Consensus-based Recommendations for Machine-learning-based Science
Kapoor, S., Cantrell, E. M., Peng, K., Pham, T. H., Bail, C. A., Gundersen, O. E., Hofman, J. M., Hullman, J., Lones, M. A., Malik, M. M., et al. (2024) · Science Advances · doi:10.1126/sciadv.adk3452 · Cited by 129
Carneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De-Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00101-3 · Cited by 146
Best Practices for Translational Disease Modeling Using Human iPSC-Derived Neurons
Engle, S. J., Blaha, L., & Kleiman, R. J. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.033 · Cited by 142
Soto, F., & Chrostowski, R. (2018) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2018.00170 · Cited by 142
“, 2018), which has shown to increase the quality of reporting for preclinical biomedical research (Han et al., 2017).”
BackgroundMamlouk, G. M., Dorris, D. M., Barrett, L. R., & Meitzen, J. (2020) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2020.100835 · Cited by 130
“Author, reviewer, or editor checklists that also incorporate animals have been demonstrated to be an effective approach (Han et al. 2017).”
BackgroundReproducibility in machine‐learning‐based research: Overview, barriers, and drivers
Semmelrock, H., Ross‐Hellauer, T., Kopeinik, S., Theiler, D., Haberl, A., Thalmann, S., & Kowald, D. (2025) · AI Magazine · doi:10.1002/aaai.70002 · Cited by 118
Reporting guideline checklists are not quality evaluation forms: they are guidance for writing
Logullo, P., MacCarthy, A., Kirtley, S., & Collins, G. S. (2020) · Health Science Reports · doi:10.1002/hsr2.165 · Cited by 92
“Others assign three options, for example, ‘not reported’, ‘fully reported’, and ‘partially reported’ or ‘not applicable’.(15,17,20-24,26,27,31,33,37-40) Some studies also use more options, such as a five-point scale of quality for each item.”
BackgroundReproducibility in Machine Learning-based Research: Overview, Barriers and Drivers
Semmelrock, H., Ross-Hellauer, T., Kopeinik, S., Theiler, D., Haberl, A., Thalmann, S., & Kowald, D. (2024) · arXiv · doi:10.48550/arxiv.2406.14325 · Cited by 88
“A systematic review in biomedical research has shown that the use of checklists is linked to increased reporting quality [49].”
Non-Coding RNAs in Human Breast Milk: A Systematic Review
Tingö, L., Ahlberg, E., Johansson, L. E., Pedersen, S. A., Chawla, K., Sætrom, P., Cione, E., & Simpson, M. R. (2021) · Frontiers in Immunology · doi:10.3389/fimmu.2021.725323 · Cited by 96
Methods for Heart Rate Variability Biofeedback (HRVB): A Systematic Review and Guidelines
Lalanza, J. F., Lorente, S., Bullich, R., García, C., Losilla, J.-M., & Capdevila, L. (2023) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-023-09582-6 · Cited by 117
The five pillars of computational reproducibility: bioinformatics and beyond
Ziemann, M., Poulain, P., & Bora, A. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad375 · Cited by 121
“Journals are partly responsible, as their editorial policies influence author behaviors [148].”
BackgroundMacleod, M., Collings, A. M., Graf, C., Kiermer, V., Mellor, D., Swaminathan, S., Sweet, D., & Vinson, V. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103238118 · Cited by 77
Imaging methods are vastly underreported in biomedical research
Marqués, G., Pengo, T., & Sanders, M. A. (2020) · eLife · doi:10.7554/elife.55133 · Cited by 77
“DOI: https://doi.org/10.7554/eLife.55133 1 of 10 FEATURE ARTICLE Collaboration Group, 2017; Han et al., 2017; NPG, 2018).”
InfluentialToward good in vitro reporting standards
Hartung, T. (2019) · ALTEX · doi:10.14573/altex.1812191 · Cited by 65
“…life science checklists (e.g., the Nature Research reporting summary), and results of recent meta-research studying the efficacy of such interventions (e.g., Macleod et al., 2017; Han et al., 2017) to devise a set of minimal expectations that journals could agree to ask their authors to meet.”
Using digital health to enable ethical health research in conflict and other humanitarian settings
Perakslis, E. D. (2018) · Conflict and Health · doi:10.1186/s13031-018-0163-z · Cited by 48
“In contrast, simple checklists have been shown to improve methodological information such as randomization, sample-size calculation and blinding [59].”
BackgroundLoss, C. M., Melleu, F. F., Domingues, K., Lino-de-Oliveira, C., & Viola, G. G. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.763428 · Cited by 44
“This suggests that the participation of research funding agencies is necessary as well as of peer reviewers and journal editors in demanding adherence to these directives (Kilkenny et al., 2009; Baker et al., 2014; Han et al., 2017; Hair et al., 2019).”
BackgroundTesta, B., Reid, J., Scott, M., Murison, P. J., & Bell, A. M. (2021) · Frontiers in Veterinary Science · doi:10.3389/fvets.2021.751949 · Cited by 43
Landoll, R. R., Vargas, S. E., Samardzic, K. B., Clark, M. F., & Guastaferro, K. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab146 · Cited by 41
Fergusson, D. A., Avey, M. T., Barron, C. C., Bocock, M., Biefer, K., Boet, S., Bourque, S. L., Conic, I., Chen, K., Dong, Y., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215221 · Cited by 40
“Despite this recognition, previous reviews of experimental animal research found key elements, such as randomization and blinding, are infrequently reported [10, 11].”
ResultMousa, A., Flanagan, M., Tay, C. T., Norman, R. J., Costello, M., Li, W., Wang, R., Teede, H. J., & Mol, B. W. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102717 · Cited by 47
Deana, N. F., Seiffert, A., Aravena‐Rivas, Y., Alonso‐Coello, P., Muñoz‐Millán, P., Espinoza‐Espinoza, G., Pineda, P., & Zaror, C. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910059 · Cited by 38
Deun, J. V., & Hendrix, A. (2017) · Journal of Extracellular Vesicles · doi:10.1080/20013078.2017.1379835 · Cited by 36
“[12] Journals have the greatest potential for immediate and significant impact on methodological rigour and reporting and, by extension, reproducibility [13].”
Müller-Hansen, F., Callaghan, M. W., & Minx, J. C. (2020) · Energy Research & Social Science · doi:10.1016/j.erss.2020.101691 · Cited by 32
Moving towards less biased research
Yarborough, M. A. (2021) · BMJ Open Science · doi:10.1136/bmjos-2020-100116 · Cited by 45
Improving energy research practices: guidance for transparency, reproducibility and quality
Huebner, G., Fell, M., & Watson, N. (2021) · Buildings and Cities · doi:10.5334/bc.67 · Cited by 22
Kousholt, B. S., Præstegaard, K. F., Stone, J., Thomsen, A. F., Johansen, T. T., Ritskes-Hoitinga, M. J., & Wegener, G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275962 · Cited by 29
Carneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., de Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De‐Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/581892 · Cited by 28
Improving rigor and reproducibility in nonhuman primate research
Bliss‐Moreau, E., Amara, R. R., Buffalo, E. A., Colman, R. J., Embers, M. E., Morrison, J. H., Quillen, E. E., Sacha, J. B., & Roberts, C. T. (2021) · American Journal of Primatology · doi:10.1002/ajp.23331 · Cited by 24
Translational Sepsis Research: Spanning the Divide
Lewis, A., Lee, J. S., & Rosengart, M. R. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003271 · Cited by 27
Self-citationRufiange, M., Rousseau‐Blass, F., & Pang, D. (2019) · Veterinary Record Open · doi:10.1136/vetreco-2018-000322 · Cited by 26
Jani, C., Kandregula, R. S., Bhosale, S., Chavan, A., Lakhote, A., Bhandari, S., Kothyari, G. C., Chauhan, G. D., Dumka, R. K., Babu, D. S., et al. (2021) · Quaternary Science Advances · doi:10.1016/j.qsa.2021.100034 · Cited by 24
Azarpazhooh, A., Khazaei, S., Jafarzadeh, H., Malkhassian, G., Sgro, A., Elbarbary, M., Cardoso, E., Oren, A., Kishen, A., & Shah, P. S. (2021) · Journal of Endodontics · doi:10.1016/j.joen.2021.09.017 · Cited by 28
A Checklist for Reproducible Computational Analysis in Clinical Metabolomics Research
Du, X., Aristizabal‐Henao, J. J., Garrett, T. J., Brochhausen, M., Hogan, W. R., & Lemas, D. J. (2022) · Metabolites · doi:10.3390/metabo12010087 · Cited by 26
“The checklist is a helpful tool to reduce complexity and improve research reproducibility [23].”
MethodEllis, R. J. (2022) · eNeuro · doi:10.1523/eneuro.0017-22.2022 · Cited by 30
“…Vivo Experiments; Percie du Sert et al., 2020), PREPARE (Planning Research and Experimental Procedures on Animals: Recommendations for Excellence; Smith et al., 2018), and others (Landis et al., 2012; Medical Research Council, 2015; Han et al., 2017; Bert et al., 2019; Smith, 2020; Gladman, 2021).”
BackgroundRahmani, N., Salehi, A., Vardanjani, H. M., Marzban, M., & Behbood, A. (2019) · Scientometrics · doi:10.1007/s11192-019-03317-3 · Cited by 24
Assessing the Completeness of Reporting in Preclinical Oncolytic Virus Therapy Studies
Fergusson, D. A., Wesch, N. L., Leung, G. J., MacNeil, J. L., Conic, I., Presseau, J., Cobey, K. D., Diallo, J., Auer, R. C., Kimmelman, J., et al. (2019) · Molecular Therapy — Oncolytics · doi:10.1016/j.omto.2019.05.004 · Cited by 21
Thébaud, B., Lalu, M. M., Renesme, L., van Katwyk, S., Presseau, J., Thavorn, K., Cobey, K. D., Hutton, B., Moher, D., Soll, R. F., et al. (2021) · Stem Cells Translational Medicine · doi:10.1002/sctm.20-0508 · Cited by 19
Understanding the importance of quality control and quality assurance in preclinical PET/CT imaging
McDougald, W., & Mannheim, J. G. (2022) · EJNMMI Physics · doi:10.1186/s40658-022-00503-w · Cited by 22
Animal welfare requirements in publishing guidelines
Novak, A., Shaw, D. J., & Clutton, R. E. (2022) · Laboratory Animals · doi:10.1177/00236772221097825 · Cited by 15
Understanding of researcher behavior is required to improve data reliability
Wass, M. N., Ray, L., & Michaelis, M. (2019) · GigaScience · doi:10.1093/gigascience/giz017 · Cited by 22
“One study suggested that reporting of randomization, blinding, and sample-sizeestimation in animalexperiments had improved inthejour-nal Nature in response to the introduction of the publication checklist based on a comparison of articles published in Nature and Cell from 2013 to 2015 [80].”
Four erroneous beliefs thwarting more trustworthy research
Yarborough, M. A., Nadon, R., & Karlin, D. (2019) · eLife · doi:10.7554/elife.45261 · Cited by 17
Ahmad, R., Riaz, M., Aldholmi, M., Qureshi, M. A., Uddin, S., Bhat, A., Pratheeshkumar, P., Baig, M., Pourahmad, J., Ganesan, T., et al. (2021) · Asian Pacific Journal of Cancer Prevention · doi:10.31557/apjcp.2021.22.12.3735 · Cited by 16
“The journals with appropriate checklist requirements prior to any submission improved the procedural information in pre-clinical studies (Han et al., 2017).”
BackgroundTargeted hyperthermia with plasmonic nanoparticles
Vilches, C., & Quidant, R. (2020) · Frontiers of nanoscience · doi:10.1016/b978-0-08-102828-5.00012-7 · Cited by 15
Phage diversity in human breast milk: a systematic review
Guo, Y., Liu, Y., Xu, S., Zhang, R., Yu, Z., & He, W. (2025) · European Journal of Pediatrics · doi:10.1007/s00431-025-06173-x · Cited by 15
“The quality of the included studies was assessed using a check-list incorporating relevant questions from both NICE checklist for studies reporting correlations and associations [26] and the checklist proposed by Han et al. [27].”
Kim, S. H., Shin, Y., Choi, Y., Lim, K. M., Jeong, Y., Dayem, A. A., Lee, Y., An, J., Song, K., Jang, S. B., et al. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24086964 · Cited by 15
Toxicoepigenetics for Risk Assessment: Bridging the Gap Between Basic and Regulatory Science
Goff, A. L., Louvel, S., Boullier, H., & Allard, P. (2022) · Epigenetics Insights · doi:10.1177/25168657221113149 · Cited by 13
Quality of meta‐analyses in freshwater ecology: A systematic review
Lodi, S., Godoy, B., Ortega, J., & Bini, L. (2021) · Freshwater Biology · doi:10.1111/fwb.13695 · Cited by 10
“We expect that the use of checklists will increase the quality of meta- analyses, as has been reported, for example, for biomedical research (Han et al., 2017).”
BackgroundRecommendations to improve use and reporting of statistics in animal experiments
Rowe, A. (2022) · Laboratory Animals · doi:10.1177/00236772221140669 · Cited by 15
Prostate cancer MRI methodological radiomics score: a EuSoMII radiomics auditing group initiative
Cavallo, A. U., Stanzione, A., Ponsiglione, A., Trotta, R., Fanni, S. C., Ghezzo, S., Vernuccio, F., Klontzas, M. E., Triantafyllou, M., Ugga, L., et al. (2024) · European Radiology · doi:10.1007/s00330-024-11299-x · Cited by 11
“Indeed, checklists can not only increase the quality of reporting [29] but could highlight relevant issues for researchers to consider when conceptualizing and designing their studies.”
Munro, B. A., Bergen, P., & Pang, D. (2021) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2021.09.004 · Cited by 11
Townsend, H. G. G., Osterrieder, K., Jelinski, M. D., Morck, D. W., Waldner, C., Cox, W. R., Gerdts, V., Potter, A. A., Babiuk, L. A., & Cross, J. C. (2025) · Scientific Reports · doi:10.1038/s41598-025-15935-4 · Cited by 17
“Numerous high-impact journals, including several from the Nature Publishing Group 48,50,51,53,54,65 have highlighted the inadequate quality of reporting in laboratory animal research.”
Misidentified biomedical resources: Journal guidelines are not a quick fix
Hepkema, W. M., Horbach, S. P. J. M., Hoek, J. M., & Halffman, W. (2021) · International Journal of Cancer · doi:10.1002/ijc.33882 · Cited by 10
Bench-to-Bedside: A Translational Perspective on Murine Models of Sepsis
Lewis, A., & Rosengart, M. R. (2018) · Surgical Infections · doi:10.1089/sur.2017.308 · Cited by 12
“Essential components of trial design (population, enrollment, exposure, intervention, endpoints) may not be clear in laboratory research manuscripts [8].”
BackgroundGonadal sex and animal experimentation: Perfection vs. 3R principle?
Bie, P., & Debrabant, B. (2020) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.13411 · Cited by 12
“Although publications in prominent journals may improve as a result of checklists (50), researchers themselves seem motivated only to a limited extent (51).”
BackgroundMoré, A. O. O., Harris, R. E., Napadow, V., Taylor-Swanson, L. J., Wayne, P. M., Witt, C. M., & Lao, L. (2021) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2021.0076 · Cited by 10
Hassan, M. M., Al-Obaidi, H. O., Karrick, M., Merza, N., Nawras, Y., Saab, O. N., Al‐Obaidi, A. D., Merza, F. A., Hashim, H. T., Zubaidi, K. A., et al. (2024) · Gastroenterology Research · doi:10.14740/gr1750 · Cited by 11
“For cross-sectional studies, we employed the National Institutes of Health (NIH) Quality Assessment Tools [18].”
MethodMartins, T., Ramos-Hryb, A. B., Silva, M. A. B. D., do Prado, C. S. H., Eckert, F. B., Triches, F. F., da Costa, J. E., Bolzan, J. A., McCann, S., & de Oliveira, C. L. (2025) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000844 · Cited by 10
O'Connor, A. M. C., Totton, S. C., Cullen, J. N., Ramezani, M., Kalivarapu, V., Yuan, C., & Gilbert, S. B. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199441 · Cited by 13
Minimum Information in In Vivo Research
Voehringer, P., & Nicholson, J. R. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_285 · Cited by 13
“showed that the mandatory application of a checklist improved the reporting of crucial methodological details, such as randomisation, blinding and sample size estimation, in preclinical in vivo animal studies (Han et al. 2017).”
BackgroundHankenson, F. C., Prager, E. M., & Berridge, B. R. (2024) · Annual Review of Animal Biosciences · doi:10.1146/annurev-animal-021022-043531 · Cited by 10
The Reporting Quality of Machine Learning Studies on Pediatric Diabetes Mellitus: Systematic Review
Zrubka, Z., Kertész, G., Gulàcsi, L., Czere, J. T., Hölgyesi, Á., Motahari-Nezhad, H., Mosavi, A. H., Kovács, L., Butte, A. J., & Péntek, M. (2024) · Journal of Medical Internet Research · doi:10.2196/47430 · Cited by 14
“Although the association between incomplete reporting and biased treatment effects has been shown in clinical trials [44], evidence supports the positive effect of using checklists on reporting quality [45,46].”
Replicability in Empirical Legal Research
Chin, J. M., & Zeiler, K. (2021) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-121620-085055 · Cited by 21
Zhang, J.-J., Chen, Y.-K., Chen, Y.-Q., Zhang, Q.-Y., Liu, Y., Wang, Q., & Xie, X. (2025) · Toxics · doi:10.3390/toxics13080617 · Cited by 7
Williams, J. L., Chu, H., Lown, M. K., Daniel, J., Meckl, R. D., Patel, D. A., & Ibrahim, R. (2022) · Cureus · doi:10.7759/cureus.21086 · Cited by 11
“Consistent with other studies [10,11,26], our findings suggest that the inclusion of a checklist improves the quality of the research reports.”
ResultHeld, U., Steigmiller, K., Hediger, M., Gosteli, M., Reeve, K. A., von Felten, S., & Furrer, E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241897 · Cited by 7
Nunamaker, E. A., & Reynolds, P. S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274738 · Cited by 6
The effect of journal guidelines on the reporting of antibody validation
Hoek, J. M., Hepkema, W. M., & Halffman, W. (2020) · PeerJ · doi:10.7717/peerj.9300 · Cited by 6
“A recent evaluation of the 2013 Nature life science checklist shows that it improved the reporting of some items, but also that approximately half of the compliant articles did not actually use the tools recommended by the checklist (Han et al., 2017).”
MethodThe Impact of Social and Behavioral Factors on Reproducibility in Terrestrial Vertebrate Models
Whittaker, A. L., & Hickman, D. L. (2019) · ILAR Journal · doi:10.1093/ilar/ilaa005 · Cited by 6
A Consensus-Based Tool for Evaluating Threats to the Validity of Empirical ResearchPreprint
Schiavone, S. R., Quinn, K. A., & Vazire, S. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fc8v3 · Cited by 9
Jordan, C. Y., Romanò, N., & Menzies, J. R. W. (2025) · Experimental Physiology · doi:10.1113/ep092884 · Cited by 5
Cameron, A., Freeman, S. L., Wild, I., Burridge, J., & Burrell, K. L. (2026) · Animals · doi:10.3390/ani16020165 · Cited by 5
“Reporting guidelines and checklists are freely available for a wide variety of study designs [134], and their use has been found to improve the reporting quality of publications [135,136].”
Zeiler, K., Mellor, D., Pickett, J., Steltenpohl, C., Chin, J. M., DeHaven, A. C., Heycke, T., Vazire, S., & Holcombe, A. O. (2020) · Law Technology and Humans · doi:10.5204/lthj.1875 · Cited by 9
Bergen, P., Munro, B. A., & Pang, D. (2023) · Journal of Veterinary Emergency and Critical Care · doi:10.1111/vec.13312 · Cited by 7
Transparency of research practices in cardiovascular literature
Heckerman, G. O., Tzng, E., Campos-Melendez, A., Ekwueme, C., & Mueller, A. L. (2025) · eLife · doi:10.7554/elife.81051 · Cited by 4
“…practices to incentivize researchers to share their materials, methods, data, and analysis scripts, such as open science badges (Kidwell et. al., 2016)), reporting checklists (Han et al., 2017), and checking articles for reproducibility (Organic Syntheses ) or replicability (Nosek et al., 2015).”
Biomonitoring and Digital Data Technology as an Opportunity for Enhancing Animal Study Translation
Defensor, E. B., Lim, M. A., & Schaevitz, L. R. (2021) · ILAR Journal · doi:10.1093/ilar/ilab018 · Cited by 4
Maaloul, A., Pérez, C. I., Decara, J. M., Marí‐Beffa, M., Álvarez‐Torres, D., Redoli, S. L., Martínez‐Albardonedo, B., Araya‐Rojas, M., Fajardo, V., & Abdala‐Díaz, R. (2025) · Pharmaceutics · doi:10.3390/pharmaceutics17030335 · Cited by 4
Refinement of the motorised laminectomy-assisted rat spinal cord injury model by analgesic treatment
Sreelatha, H. V., Palekkodan, H., Fasaludeen, A., Krishnan, L. K., & Abelson, K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0294720 · Cited by 4
Considerations on Preclinical Neuromuscular Disease Gene Therapy Studies
Duan, D. (2019) · Springer eBooks · doi:10.1007/978-3-030-03095-7_17 · Cited by 6
Gerrits, R. G., Klazinga, N., van den Berg, M. J., & Kringos, D. S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0797-6 · Cited by 4
Lasagna, M., Mardirosian, M. N., Zappia, D., Enriquez, L., Miret, N. V., Dahir, L., Zotta, E., Randi, A. S., Núñez, M., & Cocca, C. (2025) · Toxicology · doi:10.1016/j.tox.2025.154059 · Cited by 3
Alfonso, C., Haydt, V., Allen, M. S., Capdevila, L., & Laborde, S. (2025) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2025.2541350 · Cited by 5
Where Is the Evidence in Evidence-Based Law Reform?
Chin, J. M., Nakagawa, S., & Lagisz, M. (2022) · University of New South Wales law journal · doi:10.53637/fmhk9486 · Cited by 4
Lisik, D., Shah, S. A., Basna, R., Dinh, D.-T., Browne, R. P., Andrews, J. L., Wallace, M. L., Ezugwu, A. E.-S., Marušić, A., Tran, D., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-099609 · Cited by 2
“20 Although adherence generally remains suboptimal, 21 there is evidence indicating that reporting guidelines improve reporting, 22–24 which in turn catalyses methodological development and innovation by highlighting limitations to be bridged in subsequent research.”
Metadata
- Authors
- Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S.
- Affiliations
- University of Pittsburgh (US)
- Baylor College of Medicine (US)
- Corresponding author
- Han, SeungHye
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-09-13
- Volume
- 12
- Issue
- 9
- Pages
- e0183591
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5597130
- OpenAlex
- W2755142264
- Cited by
- 131
- References
- 33
- Citations by year
- 2026: 3 · 2025: 15 · 2024: 7 · 2023: 8 · 2022: 11 · 2021: 24 · 2020: 32 · 2019: 18 · 2018: 11 · 2017: 2
- FWCI
- 3.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Institutes of Health (UL1TR001857, HL086884, AI119042)
- American Heart Association (15POST25700096)
- breathe Pennsylvania (Lung Health Research Grant)
- Howard Hughes Medical Institute (Research Fellow Award)
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- reporting checklist, preclinical animal studies, research reproducibility, reporting quality, randomization, blinding, sample size determination, nature, cells
- MeSH terms
- Data Accuracy, Animals, Drug Evaluation, Preclinical, Humans, Publications, Research Design, Reproducibility of Results, Models, Animal, Biomedical Research, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.