Refinement of Experimental Design and Conduct in Laboratory Animal Research
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
The scientific literature of laboratory animal research is replete with papers reporting poor reproducibility of results as well as failure to translate results to clinical trials in humans. This may stem in part from poor experimental design and conduct of animal experiments. Despite widespread recognition of these problems and implementation of guidelines to attenuate them, a review of the literature suggests that experimental design and conduct of laboratory animal research are still in need of refinement. This paper will review and discuss possible sources of biases, highlight advantages and limitations of strategies proposed to alleviate them, and provide a conceptual framework for improving the reproducibility of laboratory animal research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 4×
“In the human clinical trial literature, the ethical and scientific costs of underpowered study designs have long been recognized (Halpern 2002); it is crucial that formal power calculations become standard practice in animal research so that scientific gain is maximized while animal use is minimized (Button et al. 201…”
BackgroundInfluentialImproving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Can the pharmaceutical industry reduce attrition rates?
Kola, I., & Landis, J. (2004) · Nature Reviews Drug Discovery · doi:10.1038/nrd1470 · Cited by 4,167 · cited 2×
“A 10-year review (1991–2000) of drug development revealed that the main causes of such attrition at the clinical trials stage are lack of efficacy and safety, which together account for 60% of the overall attrition rate (Kola and Landis 2004).”
BackgroundAssessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 3×
“Complications that require exclusion of animals are an inherent risk in animal studies, especially with animal models involving invasive surgical procedures (e.g., Jüni et al. 2001) and in models of stroke (Crossley et al. 2008).”
BackgroundMethodResultImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Animal models of neuropsychiatric disorders
Nestler, E. J., & Hyman, S. E. (2010) · Nature Neuroscience · doi:10.1038/nn.2647 · Cited by 2,023
Genetics of Mouse Behavior: Interactions with Laboratory Environment
Crabbe, J. C., Wahlsten, D., & Dudek, B. C. (1999) · Science · doi:10.1126/science.284.5420.1670 · Cited by 1,666
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Can Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354 · cited 6×
“Definitions adapted from van der Worp et al. (2010) and from the Cochrane Collaboration.”
BackgroundMethodResultInfluentialPolicy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Guidelines for the Design and Statistical Analysis of Experiments Using Laboratory Animals
Festing, M. F. W., & Altman, D. G. (2002) · ILAR Journal · doi:10.1093/ilar.43.4.244 · Cited by 1,110
The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey
Ioannidis, J. P. A., & Trikalinos, T. A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060410 · Cited by 1,052
Kilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860
Revised standards for statistical evidence
Johnson, V. E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1313476110 · Cited by 808
Taming anxiety in laboratory mice
Hurst, J. L., & West, R. S. (2010) · Nature Methods · doi:10.1038/nmeth.1500 · Cited by 599
Statistics notes: How to randomise
Altman, D. G., & Bland, J. M. (1999) · BMJ · doi:10.1136/bmj.319.7211.703 · Cited by 506
Ideal homes? Housing effects on rodent brain and behaviour
Würbel, H. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01718-5 · Cited by 471 · cited 2×
“…current standard practices of housing and care in laboratory animals are associated with abnormal brain and behavioral development and other signs of poor welfare, which may also compromise the scientific validity of research findings (Garner 2005; Knight 2001; Martin et al. 2010; Würbel 2001).”
BackgroundSelf-citationPublic Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · cited 1×
“Although this topic is not without issue or debate (e.g., Alsheikh-Ali et al. 2011; Editor 2014; Nelson 2009; Roche et al. 2014), the transparency of collected data can only improve the quality of published scientific results.”
Background“Control” laboratory rodents are metabolically morbid: Why it matters
Martin, B., Ji, S., Maudsley, S., & Mattson, M. P. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0912955107 · Cited by 354 · cited 2×
“…current standard practices of housing and care in laboratory animals are associated with abnormal brain and behavioral development and other signs of poor welfare, which may also compromise the scientific validity of research findings (Garner 2005; Knight 2001; Martin et al. 2010; Würbel 2001).”
BackgroundGarner, J. P. (2005) · ILAR Journal · doi:10.1093/ilar.46.2.106 · Cited by 329
Baker, D., Lidster, K., Sottomayor, A., & Amor, S. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001756 · Cited by 305 · cited 3×
“Nevertheless, a recent analysis of papers published in the PLoS and Nature journals after the endorsement of the ARRIVE guidelines found as yet very little improvement in reporting standards, indicating that authors are still ignoring, and referees and editors are not enforcing, these guidelines (Baker et al. 2014).”
BackgroundEvaluation of excess significance bias in animal studies of neurological diseases
Tsilidis, K. K., Panagiotou, O. A., Sena, E. S., Aretouli, E., Evangelou, E., Howells, D. W., Salman, R. A.-S., Macleod, M. R., & Ioannidis, J. P. A. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001609 · Cited by 295 · cited 5×
“, most significant) result is presented (Ioannidis 2008; Tsilidis et al. 2013).”
BackgroundInfluentialAnimal Research: Reporting In Vivo Experiments: The ARRIVE Guidelines
Kilkenny, C., Browne, W., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · The Journal of Gene Medicine · doi:10.1002/jgm.1473 · Cited by 256
Distinguishing between exploratory and confirmatory preclinical research will improve translation
Kimmelman, J., Mogil, J. S., & Dirnagl, U. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001863 · Cited by 236 · cited 2×
“…are only applicable to “confirmatory research” but not to “exploratory research” since “effect sizes may be unknown” and “research in the exploratory mode will often test many different strategies in parallel, and this is only feasible if small sample sizes are used” (Kimmelman et al. 2014).”
BackgroundImproving the translational hit of experimental treatments in multiple sclerosis
Vesterinen, H. M., Sena, E. S., ffrench-Constant, C., Williams, A., Chandran, S., & Macleod, M. R. (2010) · Multiple Sclerosis Journal · doi:10.1177/1352458510379612 · Cited by 182
Bringing rigour to translational medicine
Howells, D. W., Sena, E. S., & Macleod, M. R. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2013.232 · Cited by 130 · cited 2×
“…experiments across many research areas (c.f., Richter et al. 2009) and widespread failure to translate preclinical animal research to clinical trials (i.e., translational failure; e.g., Kola and Landis 2004; Howells et al. 2014; van der Worp et al. 2010) suggest that these expectations are not met.”
Background
Cited by
Pound, P., & Ritskes-Hoitinga, M. (2018) · Journal of Translational Medicine · doi:10.1186/s12967-018-1678-1 · Cited by 419
Considering sex as a biological variable in preclinical research
Miller, L. R., Marks, C., Becker, J. B., Hurn, P. D., Chen, W., Woodruff, T., McCarthy, M. M., Sohrabji, F., Schiebinger, L., Wetherington, C. L., et al. (2017) · The FASEB Journal · doi:10.1096/fj.201600781r · Cited by 391
Reproducibility and replicability of rodent phenotyping in preclinical studies
Kafkafi, N., Agassi, J., Chesler, E. J., Crabbe, J. C., Crusio, W. E., Eilam, D., Gerlai, R., Golani, I., Gomez-Marin, A., Heller, R., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.01.003 · Cited by 215
Self-citationMore than 3Rs: The importance of scientific validity for harm-benefit analysis of animal research
Würbel, H. (2017) · Lab Animal · doi:10.1038/laban.1220 · Cited by 152
“HBA follows the legal principle of proportionality and involves three main questions, namely (1) whether the study is suitable for achieving a legitimate aim, (2) whether it is necessary, and (3) whether it is adequate.”
BackgroundSelf-citationSamuel, G. O., Hoffmann, S., Wright, R. A., Lalu, M. M., Patlewicz, G., Becker, R. A., DeGeorge, G. L., Fergusson, D., Hartung, T., Lewis, R. J., et al. (2016) · Environment International · doi:10.1016/j.envint.2016.03.010 · Cited by 82
Metadata
- Authors
- Bailoo, J. D., Reichlin, T. S., & Wurbel, H.
- Venue
- ILAR Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-12-20
- Volume
- 55
- Issue
- 3
- Pages
- 383-391
- ISSN
- 1084-2020 (ISSN-L)
- OpenAlex
- W2024585519
- Cited by
- 107
- References
- 34
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.