Meta-Analyses of Animal Studies: An Introduction of a Valuable Instrument to Further Improve Healthcare
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
In research aimed at improving human health care, animal studies still play a crucial role, despite political and scientific efforts to reduce preclinical experimentation in laboratory animals. In animal studies, the results and their interpretation are not always straightforward, as no single study is executed perfectly in all steps. There are several possible sources of bias, and many animal studies are replicates of studies conducted previously. Use of meta-analysis to combine the results of studies may lead to more reliable conclusions and a reduction of unnecessary duplication of animal studies. In addition, due to the more exploratory nature of animal studies as compared to clinical trials, meta-analyses of animal studies have greater potential in exploring possible sources of heterogeneity. There is an abundance of literature on how to perform meta-analyses on clinical data. Animal studies, however, differ from clinical studies in some aspects, such as the diversity of animal species studied, experimental design, and study characteristics. In this paper, we will discuss the main principles and practices for meta-analyses of experimental animal studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 5×
“Avalue of 0% indicates no observed heterogeneity, larger values show increasing heterogeneity (Higgins et al. 2003).”
BackgroundMethodInfluentialCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · cited 2×
“Joanna IntHout, MSc, is an assistant professor and biostatistician at the Radboud University Medical Center in the Department for Health Evidence, Nijmegen, The Netherlands.”
BackgroundBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Estimating the mean and variance from the median, range, and the size of a sample
Hozo, S. P., Djulbegovic, B., & Hozo, I. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-13 · Cited by 9,062
SYRCLE’s risk of bias tool for animal studies
Hooijmans, C. R., Rovers, M. M., de Vries, R. B., Leenaars, M., Ritskes-Hoitinga, M., & Langendam, M. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-43 · Cited by 4,415 · cited 1×
“Also, the quality of the primary studies is crucial for the reliability of the meta-analysis results and can be assessed with a variety of tools (Hooijmans et al. 2014; Krauth et al. 2013).”
BackgroundSelf-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884 · cited 3×
“The random-effects model results in an “average” effect estimate, whereas the fixedeffects model results in an estimate of the one, true, underlying effect (Higgins et al. 2009; Riley et al. 2011).”
BackgroundMethodA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“The random-effects model results in an “average” effect estimate, whereas the fixedeffects model results in an estimate of the one, true, underlying effect (Higgins et al. 2009; Riley et al. 2011).”
BackgroundAnalysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140 · cited 1×
“In addition, meta-analysis, especially cumulative meta-analysis, can help to minimize unnecessary duplication of animal studies (Lau et al. 1992; Sena, Briscoe et al. 2010).”
MethodKilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860 · cited 1×
“Furthermore, the methodological quality of the included animal studies is often poor, which increases the risk of bias (Kilkenny et al. 2009).”
BackgroundPublication bias in reports of animal stroke studies leads to major overstatement of efficacy
Sena, E. S., van der Worp, H. B., Bath, P. M. W., Howells, D. W., & Macleod, M. R. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000344 · Cited by 600
Meta-analysis of data from animal studies: A practical guide
Vesterinen, H. M., Sena, E. S., Egan, K. J., Hirst, T. C., Churolov, L., Currie, G. L., Antonic, A., Howells, D. W., & Macleod, M. R. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.010 · Cited by 488
Higgins, J. P., Deeks, J. J., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch16 · Cited by 475 · cited 1×
“A simple option is to diminish the number of animals in the shared control group by splitting the “shared” group into two or more groups with smaller sample size (Higgins et al. 2008).”
BackgroundHooijmans, C. R., Tillema, A., Leenaars, M., & Ritskes-Hoitinga, M. (2010) · Laboratory Animals · doi:10.1258/la.2010.009117 · Cited by 297
Self-citationEmergency medicine animal research: does use of randomization and blinding affect the results?
Bebarta, V., Luyten, D., & Heard, K. (2003) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2003.tb00056.x · Cited by 244 · cited 2×
“showed in 2003 that animal studies that do not utilize randomization or blinding are more likely to report a difference between study groups than studies that employ these methods (Bebarta et al. 2003).”
BackgroundResultNimodipine in Animal Model Experiments of Focal Cerebral Ischemia: A Systematic Review
Horn, J., de Haan, R. J., Vermeulen, M., Luiten, P. G. M., & Limburg, M. (2001) · Stroke · doi:10.1161/hs1001.096009 · Cited by 230 · cited 1×
“However, at the time of the meta-analysis of the animal experiments, 29 clinical trials with approximately 7500 patients were already conducted (Horn et al. 2001).”
BackgroundFluid Resuscitation Strategies: A Systematic Review of Animal Trials
Mapstone, J., Roberts, I., & Evans, P. (2003) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/01.ta.0000062968.69867.6f · Cited by 208 · cited 2×
“…of interventions or study pathology and mechanisms of disease than provided by clinical trials, meta-analyses of animal studies have a greater potential in exploring possible sources of heterogeneity compared to meta-analyses of clinical studies (Mapstone et al. 2003; Vesterinen et al. 2013).”
BackgroundA step-by-step guide to systematically identify all relevant animal studies
Leenaars, M., Hooijmans, C. R., van Veggel, N., ter Riet, G., Leeflang, M., Hooft, L., van der Wilt, G. J., Tillema, A., & Ritskes-Hoitinga, M. (2012) · Laboratory Animals · doi:10.1258/la.2011.011087 · Cited by 198
Self-citationIschemic Preconditioning in the Animal Kidney, a Systematic Review and Meta-Analysis
Wever, K. E., Menting, T. P., Rovers, M., van der Vliet, J. A., Rongen, G. A., Masereeuw, R., Ritskes-Hoitinga, M., Hooijmans, C. R., & Warlé, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032296 · Cited by 176 · cited 1×
“In addition, it was demonstrated that the IPC was more effective in rats than in mice (Wever et al. 2012).”
BackgroundSelf-citationSystematic reviews of animal experiments
Sandercock, P. A., & Roberts, I. (2002) · The Lancet · doi:10.1016/s0140-6736(02)09812-4 · Cited by 173 · cited 1×
“Some scientists even suggested that a more rigorous assessment of the results of animal studies in the form of a systematic review should be a prerequisite before starting studies in patients (Sandercock and Roberts 2002).”
BackgroundKrauth, D., Woodruff, T. J., & Bero, L. (2013) · Environmental Health Perspectives · doi:10.1289/ehp.1206389 · Cited by 147 · cited 1×
“Also, the quality of the primary studies is crucial for the reliability of the meta-analysis results and can be assessed with a variety of tools (Hooijmans et al. 2014; Krauth et al. 2013).”
Backgroundter Riet, G., Korevaar, D. A., Leenaars, M., Sterk, P. J., Van Noorden, C. J. F., Bouter, L. M., Lutter, R., Elferink, R. P. O., & Hooft, L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043404 · Cited by 131 · cited 1×
“Publication bias is no less of an issue for animal studies than for human studies (ter Riet et al. 2012).”
BackgroundA search filter for increasing the retrieval of animal studies in Embase
de Vries, R. B. M., Hooijmans, C. R., Tillema, A., Leenaars, M., & Ritskes-Hoitinga, M. (2011) · Laboratory Animals · doi:10.1258/la.2011.011056 · Cited by 114
Self-citationSena, E. S., Briscoe, C. L., Howells, D. W., Donnan, G. A., Sandercock, P. A., & Macleod, M. R. (2010) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2010.116 · Cited by 107 · cited 1×
“Animal studies, however, differ from clinical studies in some aspects, such as the diversity of animal species studied, experimental design, and study characteristics.”
ResultMeta-analyses: what they can and cannot do
Nordmann, A. J., Kasenda, B., & Briel, M. (2012) · Swiss Medical Weekly · doi:10.4414/smw.2012.13518 · Cited by 104 · cited 1×
“So far, many papers and guidelines have been published regarding meta-analyses for clinical data (Borenstein et al. 2009b; Higgins and Green 2008; Nordmann et al. 2012).”
Backgroundde Vries, R. B. M., Hooijmans, C. R., Tillema, A., Leenaars, M., & Ritskes-Hoitinga, M. (2014) · Laboratory Animals · doi:10.1177/0023677213494374 · Cited by 102
Self-citationPETERS, J. L., SUTTON, A. J., JONES, D. R., RUSHTON, L., & ABRAMS, K. R. (2006) · Journal of Environmental Science and Health, Part B · doi:10.1080/03601230600857130 · Cited by 94
Ritskes-Hoitinga, M., Leenaars, M., Avey, M., Rovers, M., & Scholten, R. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000078 · Cited by 88 · cited 1×
“Fewer than 250 systematic reviews of preclinical animal studies had been published prior to 2010, as opposed to almost 6000 Cochrane Reviews of clinical studies to date (Ritskes-Hoitinga et al. 2014).”
BackgroundSelf-citationTHE PROMISE AND PITFALLS OF SYSTEMATIC REVIEWS
Mullen, P. D., & Ramírez, G. (2006) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.27.021405.102239 · Cited by 82 · cited 1×
“As we learned from systematic reviews in the clinical field (Mullen and Ramirez 2006), it is to be expected that the methodological quality of animal studies will increase as a consequence of conducting systematic reviews.”
BackgroundCan quality of clinical trials and meta-analyses be quantified?
Ioannidis, J. P. A., & Lau, J. (1998) · The Lancet · doi:10.1016/s0140-6736(98)22034-4 · Cited by 75 · cited 1×
“Combining studies that meet specific predefined criteria regarding content and quality may result in more reliable conclusions (Ioannidis and Lau 1998).”
BackgroundReade, M. C., Delaney, A., Bailey, M. J., & Angus, D. C. (2008) · Critical Care · doi:10.1186/cc6941 · Cited by 72 · cited 2×
“Therefore, the results should be interpreted with caution (Reade et al. 2008).”
BackgroundMethodMeta‐Analysis Methods Based on Direction and p‐Values
(2009) · Introduction to Meta‐Analysis · doi:10.1002/9780470743386.ch36 · Cited by 36 · cited 5×
“…studies are considered too heterogeneous for pooling, a comparison between the number of studies with findings in one direction, and those with findings in the other direction (irrespective of whether or not the findings were significant) can be done with a sign test (Borenstein et al. 2009b).”
InfluentialBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · Wiley eBooks · doi:10.1002/9780470743386.ch42 · Cited by 15 · cited 4×
“When the meta-analyses are sorted chronologically, the display shows how the evidence accumulated, and how the conclusions have shifted over a period of time (Borenstein et al. 2009a).”
BackgroundResultInfluentialInterpreting meta-analysis in systematic reviews
Rafael Perera, D., & Carl Heneghan, B. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-4-200902170-02002 · Cited by 8
Cited by
Hooijmans, C. R., de Vries, R. B. M., Ritskes-Hoitinga, M., Rovers, M. M., Leeflang, M. M., IntHout, J., Wever, K. E., Hooft, L., de Beer, H., Kuijpers, T., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0187271 · Cited by 176
Self-citationA primer on systematic reviews in toxicology
Hoffmann, S., de Vries, R. B. M., Stephens, M. L., Beck, N. B., Dirven, H. A. A. M., Fowle, J. R., Goodman, J. E., Hartung, T., Kimber, I., Lalu, M. M., et al. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-1980-3 · Cited by 85
da Costa Daniele, T. M., de Bruin, P. F. C., de Matos, R. S., de Bruin, G. S., Maia Chaves, C., & de Bruin, V. M. S. (2020) · Behavioural Brain Research · doi:10.1016/j.bbr.2020.112488 · Cited by 59
Hayat, M., Khola, N. U. H., & Ahmed, T. (2025) · Brain Sciences · doi:10.3390/brainsci15080849 · Cited by 12
“The I 2 statistic is used to evaluate the extent of the inevitable heterogeneity among studies [55,56].”
Metadata
- Authors
- Hooijmans, C. R., IntHout, J., Ritskes-Hoitinga, M., & Rovers, M. M.
- Venue
- ILAR Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-12-20
- Volume
- 55
- Issue
- 3
- Pages
- 418-426
- ISSN
- 1084-2020 (ISSN-L)
- OpenAlex
- W2133856218
- Cited by
- 199
- References
- 34
- FWCI
- 6.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.