Are some animal models more equal than others? A case study on the translational value of animal models of efficacy for Alzheimer's disease
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Clinical trial failures (>99%) in Alzheimer's disease are in stark contrast to positive efficacy data in animals. We evaluated the correlation between animal and clinical efficacy outcomes (cognition) in Alzheimer's disease using data from registered drugs as well as interventions tested in phase II or III clinical trials for Alzheimer's disease. We identified 20 interventions, which were tested in 208 animal studies in 63 different animal models. Clinical outcome was correlated with animal results in 58% of cases. But, individual animal models showed divergent results across interventions, individual interventions showed divergent results across animal models, and animal model outcomes were determined with 16 different methods. This result is unsurprising due to poor external validity (what do we model) of the animal models. Although the animal models all share Alzheimer's disease symptoms, none represents the whole syndrome. Investigators did not motivate why one model was chosen over another, and did not consider the ways the disease phenomena were generated (spontaneous, (experimentally) induced or by genetic modification), or the species characteristics, which determine the outcomes. The explanation for the lack of correlation between animal and human outcomes can be manifold: the pathogenesis of Alzheimer's disease is not reflected in the animal model or the outcomes are not comparable. Our conclusion is that currently no animal models exist which are predictive for the efficacy of interventions for Alzheimer's disease.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
2018 Alzheimer's disease facts and figures
Alzheimer's Association (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.001 · Cited by 1,912
Alzheimer’s disease drug-development pipeline: Few candidates, frequent failures
Cummings, J. L., Morstorf, T., & Zhong, K. (2014) · Alzheimer's Research & Therapy · doi:10.1186/alzrt269 · Cited by 1,744 · cited 1×
“With a failure rate of more than 99%, drug development in Alzheimer's disease has been largely unsuccessful: since 2002 over than 400 clinical trials failed due to lack of efficacy (Cummings et al., 2014; Rinaldi, 2018).”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Can Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354
Millan, M. J., Agid, Y., Brüne, M., Bullmore, E. T., Carter, C. S., Clayton, N. S., Connor, R., Davis, S., Deakin, B., DeRubeis, R. J., et al. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3628 · Cited by 1,292
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248 · cited 4×
“In addition, the design of animal studies is often inadequately described, and positive outcomes are selectively reported (Begley and Ioannidis, 2015; Fanelli, 2012), making the results unreliable.”
BackgroundResultInfluentialDonepezil for dementia due to Alzheimer’s disease.
Birks, J. S., & Harvey, R. J. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001190.pub3 · Cited by 1,200
McShane, R., Areosa Sastre, A., & Minakaran, N. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003154.pub5 · Cited by 1,155
Webster, S. J., Bachstetter, A. D., Nelson, P. T., Schmitt, F. A., & Van Eldik, L. J. (2014) · Frontiers in Genetics · doi:10.3389/fgene.2014.00088 · Cited by 755 · cited 1×
“For complex diseases such as Alzheimer's disease one could consider a (properly designed) test battery of different (animal) models simulating different aspects of the disease (Stukalin and Einat, 2019; Webster et al., 2014; Wolf et al., 2016).”
BackgroundAnimal Model of Depression: I. Review of Evidence: Implications for Research
McKinney, W. T. (1969) · Archives of General Psychiatry · doi:10.1001/archpsyc.1969.01740200112015 · Cited by 727
Animal models of neurodegenerative diseases
Dawson, T. M., Golde, T. E., & Lagier-Tourenne, C. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0236-8 · Cited by 576
Rivastigmine for Alzheimer’s disease.
Birks, J. S., Chong, L.-Y., & Grimley Evans, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001191.pub4 · Cited by 534
Tau Aggregation and Its Interplay with Amyloid-β
Nisbet, R. M., Polanco, J.-C., Ittner, L. M., & Götz, J. (2015) · Acta Neuropathologica · doi:10.1007/s00401-014-1371-2 · Cited by 359 · cited 1×
“…hallmarks of Alzheimer's disease include (age induced) cognitive impairment (Alzheimer's Association, 2018), decreased levels of neurotransmitters (Francis, 2005), increased neurological markers such as amyloid β plaques and tau tangles (Nisbet et al., 2015) or genetic alterations (Reitz, 2015).”
BackgroundThe interplay of neurotransmitters in Alzheimer's disease
Francis, P. T. (2005) · CNS Spectrums · doi:10.1017/s1092852900014164 · Cited by 302 · cited 2×
“…hallmarks of Alzheimer's disease include (age induced) cognitive impairment (Alzheimer's Association, 2018), decreased levels of neurotransmitters (Francis, 2005), increased neurological markers such as amyloid β plaques and tau tangles (Nisbet et al., 2015) or genetic alterations (Reitz, 2015).”
BackgroundThe need for randomization in animal trials: an overview of systematic reviews
Hirst, J. A., Howick, J., Aronson, J. K., Roberts, N., Perera, R., Koshiaris, C., & Heneghan, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098856 · Cited by 294 · cited 1×
“Despite the introduction of reporting guidelines and an increasing number of publications creating awareness of how poor design affects study outcomes (Henderson et al., 2015; Hirst et al., 2014; Hooijmans and Ritskes-Hoitinga, 2013), the reporting quality of animal studies did not improve between 1988 and 2018.”
BackgroundA Comprehensive Behavioral Test Battery to Assess Learning and Memory in 129S6/Tg2576 Mice
Wolf, A., Bauer, B., Abner, E. L., Ashkenazy-Frolinger, T., & Hartz, A. M. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147733 · Cited by 281 · cited 1×
“For complex diseases such as Alzheimer's disease one could consider a (properly designed) test battery of different (animal) models simulating different aspects of the disease (Stukalin and Einat, 2019; Webster et al., 2014; Wolf et al., 2016).”
BackgroundThe present and future of pharmacotherapy of Alzheimer's disease: a comprehensive review
Anand, A., Patience, A. A., Sharma, N., & Khurana, N. (2017) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2017.09.043 · Cited by 174 · cited 2×
“A few examples of mixed animal models have been reported, some of which used aged species in an induced model (Anand et al., 2017; Provensi et al., 2016; Zhai et al., 2016) or a genetically modified model, where cognitive impairment was tested in aged animals (Devi and Ohno, 2016; Martinez-Coria et al.”
Nonhuman Primate Models of Alzheimer-Like Cerebral Proteopathy
Heuer, E., F. Rosen, R., Cintron, A., & C. Walker, L. (2012) · Current Pharmaceutical Design · doi:10.2174/138161212799315885 · Cited by 169
Bringing rigour to translational medicine
Howells, D. W., Sena, E. S., & Macleod, M. R. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2013.232 · Cited by 130 · cited 1×
“non-randomized, non-blinded), minimally standardized and underpowered (Egan et al., 2016; Howells et al., 2014; Ioannidis et al., 2014; van der Worp et al., 2010).”
Alzheimer's disease: The forgetting gene
Spinney, L. (2014) · Nature · doi:10.1038/510026a · Cited by 98 · cited 1×
“(Mullane and Williams, 2019; Reardon, 2018; Spinney, 2014).”
Strategies to optimize the validity of disease models in the drug discovery process
Sams-Dodd, F. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.02.005 · Cited by 60 · cited 3×
“Animal models can be compared to the human disease according to different aspects: face validity (the similarity in clinical symptoms), construct validity (the similarity in etiology) and predictive validity (the similarity in the clinical response to treatment) (McKinney and Bunney, 1969; Sams-Dodd, 2006; Willner, 19…”
BackgroundMethodBe open about drug failures to speed up research
Alteri, E., & Guizzaro, L. (2018) · Nature · doi:10.1038/d41586-018-07352-7 · Cited by 50
Frustrated Alzheimer’s researchers seek better lab mice
Reardon, S. (2018) · Nature · doi:10.1038/d41586-018-07484-w · Cited by 35
Cited by
Poor Translatability of Biomedical Research Using Animals — A Narrative Review
Marshall, L. J., Bailey, J., Cassotta, M., Herrmann, K., & Pistollato, F. (2023) · Alternatives to Laboratory Animals · doi:10.1177/02611929231157756 · Cited by 219
Systematic Phenotyping and Characterization of the 3xTg-AD Mouse Model of Alzheimer’s Disease
Javonillo, D. I., Tran, K. M., Phan, J., Hingco, E., Kramár, E. A., da Cunha, C., Forner, S., Kawauchi, S., Milinkeviciute, G., Gomez-Arboledas, A., et al. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.785276 · Cited by 203
Polis, B., & Samson, A. O. (2024) · Journal of Alzheimer's Disease · doi:10.3233/jad-240058 · Cited by 43
Cognitive go/No-go decision-making criteria in Alzheimer’s disease drug development
Wessels, A. M., Edgar, C. J., Nathan, P. J., Siemers, E. R., Maruff, P., & Harrison, J. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.01.012 · Cited by 7
Metadata
- Authors
- Veening-Griffioen, D. H., Ferreira, G. S., van Meer, P. J. K., Boon, W. P. C., Gispen-de Wied, C. C., Moors, E. H. M., & Schellekens, H.
- Venue
- European Journal of Pharmacology
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 859
- Pages
- 172524
- ISSN
- 0014-2999 (ISSN-L)
- OpenAlex
- W2954797325
- Cited by
- 55
- References
- 25
- FWCI
- 3.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.