Two years later: journals are not yet enforcing the ARRIVE guidelines on reporting standards for pre-clinical animal studies
Open accessAbstract
There is growing concern that poor experimental design and lack of transparent reporting contribute to the frequent failure of pre-clinical animal studies to translate into treatments for human disease. In 2010, the Animal Research: Reporting of In Vivo Experiments (ARRIVE) guidelines were introduced to help improve reporting standards. They were published in PLOS Biology and endorsed by funding agencies and publishers and their journals, including PLOS, Nature research journals, and other top-tier journals. Yet our analysis of papers published in PLOS and Nature journals indicates that there has been very little improvement in reporting standards since then. This suggests that authors, referees, and editors generally are ignoring guidelines, and the editorial endorsement is yet to be effectively implemented.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies measuring the impact of ARRIVE on the quality of reporting have produced mixed results.
“Studies measuring the impact of ARRIVE on the quality of reporting have produced mixed results [6–11]”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 35 · Cited by 305
Research works printed but not linked: 28
- [1]Cumberland Consensus Working Group (2009) Cheeran B, Cohen L, Dobkin B, Ford G, et al (2009) The future of restorative neurosciences in stroke: driving the translational research pipeline from basic science to rehabilitation of people after stroke. Neurorehabil Neural Repair 23: 97– 107. 19189939 PMC3230220
- [2]Vesterinen HM, Sena ES, Ffrench-Constant C, Williams A, Chandran S, et al (2010) Improving the translational hit of experimental treatments in multiple sclerosis. Mult Scler 16: 1044– 1055. 20685763
- [3]Billiau A, Heremans H, Vandekerckhove F, Dijkmans R, Sobis H, et al (1988) Enhancement of experimental allergic encephalomyelitis in mice by antibodies against IFN-gamma. J Immunol 140: 1506– 1510. 3126227
- [4]Baker D, Butler D, Scallon BJ, O'Neill JK, Turk JL, et al (1994) Control of established experimental allergic encephalomyelitis by inhibition of tumor necrosis factor (TNF) activity within the central nervous system using monoclonal antibodies and TNF receptor-immunoglobulin fusion proteins. Eur J Immunol 24: 2040– 2048. 8088324
- [5]Panitch HS, Hirsch RL, Haley AS, Johnson KP (1987) Exacerbations of multiple sclerosis in patients treated with gamma interferon. Lancet 1: 893– 895. 2882294
- [6]The Lenercept Multiple Sclerosis Study Group (1999) TNF neutralization in MS: results of a randomized, placebo-controlled multicenter study. The Lenercept Multiple Sclerosis Study Group and The University of British Columbia MS/MRI Analysis Group. Neurology 53: 457– 465. 10449104
- [7]Baker D, Gerritsen W, Rundle J, Amor S (2011) Critical appraisal of animal models of multiple sclerosis. Mult Scler 17: 647– 657. 21372117
- [9]Kilkenny C, Parsons N, Kadyszewski E, Festing MFW, Cuthill IC, et al (2009) Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PLoS ONE 4: e7824 doi: 10.1371/journal.pone.0007824 19956596 PMC2779358 · DOI · Paper page
- [10]Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG (2010) Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol 8: e1000412 doi: 10.1371/journal.pbio.1000412 20613859 PMC2893951 · DOI · Paper page
- [11]National Research Council Institute for Laboratory Animal Research (2011) Guidance for the description of animal research in scientific publications. Washington (District of Columbia): National Academies Press. 22379656
- [13]Baker D, Amor S (2012) Publication guidelines for refereeing and reporting on animal use in experimental autoimmune encephalomyelitis. J Neuroimmunol 242: 78– 83. 22119102
- [14]Schwarz F, Iglhaut G, Becker J (2012) Quality assessment of reporting of animal studies on pathogenesis and treatment of peri-implant mucositis and peri-implantitis. A systematic review using the ARRIVE guidelines. J Clin Periodontol 39 (Suppl 12) 63– 72. 22533947
- [15]Al-Izki S, Pryce G, O'Neill JK, Butter C, Giovannoni G, et al (2012) Practical guide to the induction of relapsing progressive experimental autoimmune encephalomyelitis in the Biozzi ABH mouse. Mult Scler Rel Dis 1: 29– 38. 25876448
- [16]Allen SJ, Baker D, O'Neill JK, Davison AN, Turk JL (1993) Isolation and characterization of cells infiltrating the spinal cord during the course of chronic relapsing experimental allergic encephalomyelitis in the Biozzi AB/H mouse. Cell Immunol 146: 335– 350. 8174174
- [17]Flemming KK, Bovaird JA, Mosier MC, Emerson MR, Le Vine SM, et al (2005) Statistical analysis of data from studies on experimental autoimmune encephalomyelitis. J Neuroimmunol 170: 71– 84. 16198426
- [18]Newcombe RG (1998) Two-sided confidence intervals for the single proportion: comparison of seven methods. Stats Med 17: 857– 872. 9595616
- [19]Tressoldi PE, Giofé D, Sella F, Cumming G (2013) High impact = high statistical standards? Not necessarily so. PLoS ONE 8: e56180 doi: 10.1371/journal.pone.0056180 23418533 PMC3571951 · DOI
- [20]Drummond GB, Paterson DJ, McLoughlin P, McGrath JC (2011) Statistics: all together now, one step at a time. Exp Physiol 96: 481– 482. 21511756
- [21]Hackam DG, Redelmeier DA (2006) Translation of research evidence from animals to humans. JAMA 296: 1727– 1732. 17032985
- [22]Vesterinen HM, Egan K, Deister A, Schlattmann P, Macleod MR, et al (2011) Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 volume of the Journal of Cerebral Blood Flow and Metabolism. J Cereb Blood Flow Metab 31: 1064– 1072. 21157472 PMC3070978
- [24]Amor S, Baker D (2012) Checklist for reporting and reviewing studies of experimental animal models of multiple sclerosis and related disorders. Mult Scler Rel Dis 1: 111– 115. 25877075
- [25]McGrath JC, Drummond GB, McLachlan EM, Kilkenny C, Wainwright CL (2010) Guidelines for reporting experimental experiments involving animals. Br J Pharmacol 160: 1573– 1576. 20649560 PMC2936829
- [27]Croxford JL, Miller SD (2003) Immunoregulation of a viral model of multiple sclerosis using the synthetic cannabinoid R+WIN55,212. J Clin Invest 111: 1231– 1240. 12697742 PMC152941
- [28]Croxford JL, Pryce G, Jackson SJ, Ledent C, Giovannoni G, et al (2008) Cannabinoid-mediated neuroprotection, not immunosuppression, may be more relevant to multiple sclerosis. J Neuroimmunol 193: 120– 129. 18037503
- [29]Yoshimura T, Nishio M, Goto M, Ebihara S (1994) Differences in circadian photosensitivity between retinally degenerate CBA/J mice (rd/rd) and normal CBA/N mice (+/+). J Biol Rhythms 9: 51– 60. 7949306
- [30]Ohlemiller KK, Wright JS, Heidbreder AF (2000) Vulnerability to noise-induced hearing loss in ‘middle-aged’ and young adult mice: a dose-response approach in CBA, C57BL and BALB inbred strains. Hear Res 149: 239– 247. 11033262
- [31]Jasny BR, Chin G, Chong L, Viguiieri S (2011) Again and again and again. Science 334: 1225. 22144612
- [32]Baker D, Amor S (2010) Quality control of experimental autoimmune encephalomyelitis. Mult Scler 16: 1025– 1027. 20813776
- Authors
- Baker, D., Lidster, K., Sottomayor, A., & Amor, S.
- Affiliations
- Queen Mary University of London (GB)
- University of London (GB)
- Corresponding author
- Lidster, Katie
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-07
- Volume
- 12
- Issue
- 1
- Pages
- e1001756
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3883646
- OpenAlex
- W1965872454
- Cited by
- 305
- References
- 35
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 13 · 2023: 16 · 2022: 17 · 2021: 24 · 2020: 35 · 2019: 33 · 2018: 25 · 2017: 35 · 2016: 42 · 2015: 37 · 2014: 19
- FWCI
- 64.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Pure Amsterdam UMC (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by-nc-nd)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- National Centre for the Replacement, Refinement and Reduction of Animals in Research (G1000094/1)
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- ARRIVE guidelines, reporting guidelines, research transparency, experimental design, journal editorial policy, peer review, PLOS journals, Nature journal, reproducibility
- MeSH terms
- Animals, Humans, Publishing, Research Design, Statistics as Topic, Guidelines as Topic, Animal Experimentation, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
