Modeling and prediction of clinical symptom trajectories in Alzheimer’s disease using longitudinal data
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Computational models predicting symptomatic progression at the individual level can be highly beneficial for early intervention and treatment planning for Alzheimer's disease (AD). Individual prognosis is complicated by many factors including the definition of the prediction objective itself. In this work, we present a computational framework comprising machine-learning techniques for 1) modeling symptom trajectories and 2) prediction of symptom trajectories using multimodal and longitudinal data. We perform primary analyses on three cohorts from Alzheimer's Disease Neuroimaging Initiative (ADNI), and a replication analysis using subjects from Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing (AIBL). We model the prototypical symptom trajectory classes using clinical assessment scores from mini-mental state exam (MMSE) and Alzheimer's Disease Assessment Scale (ADAS-13) at nine timepoints spanned over six years based on a hierarchical clustering approach. Subsequently we predict these trajectory classes for a given subject using magnetic resonance (MR) imaging, genetic, and clinical variables from two timepoints (baseline + follow-up). For prediction, we present a longitudinal Siamese neural-network (LSN) with novel architectural modules for combining multimodal data from two timepoints. The trajectory modeling yields two (stable and decline) and three (stable, slow-decline, fast-decline) trajectory classes for MMSE and ADAS-13 assessments, respectively. For the predictive tasks, LSN offers highly accurate performance with 0.900 accuracy and 0.968 AUC for binary MMSE task and 0.760 accuracy for 3-way ADAS-13 task on ADNI datasets, as well as, 0.724 accuracy and 0.883 AUC for binary MMSE task on replication AIBL dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, the prediction of Mild Cognitive Impairment or Alzheimer’s disease based on the ADNI dataset is frequently investigated27–32. But their predictive accuracy varies, and many studies do not discuss which input modalities or features contributed most to the prediction.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, fusion strategies were often applied to the diagnosis and prediction of Alzheimer’s disease25,28,33,36,41.”
From Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines (2020) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Six of these studies showed an improvement in performance when using fusion25,26,28,29,31,33, and the remaining one achieved the same performance but reduced standard deviation27, alluding to a model with better stability.”
From Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines (2020) · cites this paper as [33]
In the citing paper
“By integrating neuroimaging, genetic, and clinical data, researchers have developed models that can identify individuals at high risk of developing Alzheimer’s disease [15–18].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [18]
In the citing paper
“Bhagwat et al. (2018) used a neural-network algorithm to predict the conversion from mild cognitive impairment to Alzheimer’s disease with as high as 0.90 accuracy [18].”
From Integrating machine learning and artificial intelligence in life-course epidemiology: pathways to innovative public health solutions (2024) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., & Joliot, M. (2002) · NeuroImage · doi:10.1006/nimg.2001.0978 · Cited by 16,319
N4ITK: Improved N3 Bias Correction
Tustison, N. J., Avants, B. B., Cook, P. A., Zheng, Y., Egan, A., Yushkevich, P. A., & Gee, J. C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2046908 · Cited by 6,073
Jack, C. R., Knopman, D. S., Jagust, W. J., Petersen, R. C., Weiner, M. W., Aisen, P. S., Shaw, L. M., Vemuri, P., Wiste, H. J., Weigand, S. D., et al. (2013) · The Lancet Neurology · doi:10.1016/s1474-4422(12)70291-0 · Cited by 4,396
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Siamese Neural Networks for One-shot Image Recognition
Koch, G. E., Zemel, R. S., & Salakhutdinov, R. (2015) · Cited by 3,740
Cognitive reserve in ageing and Alzheimer's disease
Stern, Y. (2012) · The Lancet Neurology · doi:10.1016/s1474-4422(12)70191-6 · Cited by 3,557
Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space
Collins, D. L., Neelin, P., Peters, T. M., & Evans, A. C. (1994) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199403000-00005 · Cited by 3,431
The clinical use of structural MRI in Alzheimer disease
Frisoni, G. B., Fox, N. C., Jack, C. R., Scheltens, P., & Thompson, P. M. (2010) · Nature Reviews Neurology · doi:10.1038/nrneurol.2009.215 · Cited by 2,113
Murray, M. E., Graff-Radford, N. R., Ross, O. A., Petersen, R. C., Duara, R., & Dickson, D. W. (2011) · The Lancet Neurology · doi:10.1016/s1474-4422(11)70156-9 · Cited by 972
Cuingnet, R., Gerardin, E., Tessieras, J., Auzias, G., Lehéricy, S., Habert, M.-O., Chupin, M., Benali, H., & Colliot, O. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.013 · Cited by 959
Defining imaging biomarker cut points for brain aging and Alzheimer's disease
Jack, C. R., Wiste, H. J., Weigand, S. D., Therneau, T. M., Lowe, V. J., Knopman, D. S., Gunter, J. L., Senjem, M. L., Jones, D. T., Kantarci, K., et al. (2017) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2016.08.005 · Cited by 931
Automated 3-D Extraction of Inner and Outer Surfaces of Cerebral Cortex from MRI
MacDonald, D., Kabani, N., Avis, D., & Evans, A. C. (2000) · NeuroImage · doi:10.1006/nimg.1999.0534 · Cited by 850
Kim, J. S., Singh, V., Lee, J. K., Lerch, J., Ad-Dab'bagh, Y., MacDonald, D., Lee, J. M., Kim, S. I., & Evans, A. C. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.036 · Cited by 824
Cortical thickness analysis examined through power analysis and a population simulation
Lerch, J. P., & Evans, A. C. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.045 · Cited by 710
Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects
Moradi, E., Pepe, A., Gaser, C., Huttunen, H., & Tohka, J. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.002 · Cited by 708
Schneider, L. S., Mangialasche, F., Andreasen, N., Feldman, H., Giacobini, E., Jones, R., Mantua, V., Mecocci, P., Pani, L., Winblad, B., et al. (2014) · Journal of Internal Medicine · doi:10.1111/joim.12191 · Cited by 651
Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification
Davatzikos, C., Bhatt, P., Shaw, L. M., Batmanghelich, K. N., & Trojanowski, J. Q. (2011) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.05.023 · Cited by 578
MISRA, C., FAN, Y., & DAVATZIKOS, C. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.031 · Cited by 552
World Alzheimer Report 2011 : The benefits of early diagnosis and intervention
Prince, M. J., Bryce, R., & Ferri, C. P. (2018) · Cited by 539
Baseline MRI predictors of conversion from MCI to probable AD in the ADNI cohort
Risacher, S., Saykin, A., Wes, J., Shen, L., Firpi, H., & McDonald, B. (2009) · Current Alzheimer Research · doi:10.2174/156720509788929273 · Cited by 538
Different regional patterns of cortical thinning in Alzheimer's disease and frontotemporal dementia
Du, A.-T., Schuff, N., Kramer, J. H., Rosen, H. J., Gorno-Tempini, M. L., Rankin, K., Miller, B. L., & Weiner, M. W. (2006) · Brain · doi:10.1093/brain/awm016 · Cited by 482
BEaST: Brain extraction based on nonlocal segmentation technique
Eskildsen, S. F., Coupé, P., Fonov, V., Manjón, J. V., Leung, K. K., Guizard, N., Wassef, S. N., Østergaard, L. R., & Collins, D. L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.012 · Cited by 472
Early diagnosis of Alzheimer's disease using cortical thickness: impact of cognitive reserve
Querbes, O., Aubry, F., Pariente, J., Lotterie, J.-A., Démonet, J.-F., Duret, V., Puel, M., Berry, I., Fort, J.-C., Celsis, P., et al. (2009) · Brain · doi:10.1093/brain/awp105 · Cited by 444
Clinical, imaging, and pathological heterogeneity of the Alzheimer's disease syndrome
Lam, B., Masellis, M., Freedman, M., Stuss, D. T., & Black, S. E. (2013) · Alzheimer's Research & Therapy · doi:10.1186/alzrt155 · Cited by 386
The Dynamics of Cortical and Hippocampal Atrophy in Alzheimer Disease
Sabuncu, M. R. (2011) · Archives of Neurology · doi:10.1001/archneurol.2011.167 · Cited by 339
Lehmann, M., Ghosh, P. M., Madison, C., Laforce, R., Corbetta-Rastelli, C., Weiner, M. W., Greicius, M. D., Seeley, W. W., Gorno-Tempini, M. L., Rosen, H. J., et al. (2013) · Brain · doi:10.1093/brain/aws327 · Cited by 325
Predicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers
Zhang, D., Shen, D., & Initiative, A. D. N. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033182 · Cited by 292
Self-citationLerch, J. P., Pruessner, J., Zijdenbos, A. P., Collins, D. L., Teipel, S. J., Hampel, H., & Evans, A. C. (2008) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2006.09.013 · Cited by 281
Barnett, J. H., Lewis, L., Blackwell, A. D., & Taylor, M. (2014) · BMC Neurology · doi:10.1186/1471-2377-14-101 · Cited by 251
MRI cortical thickness biomarker predicts AD-like CSF and cognitive decline in normal adults
Dickerson, B. C., & Wolk, D. A. (2012) · Neurology · doi:10.1212/wnl.0b013e31823efc6c · Cited by 240
Ferreira, D., Verhagen, C., Hernández-Cabrera, J. A., Cavallin, L., Guo, C.-J., Ekman, U., Muehlboeck, J.-S., Simmons, A., Barroso, J., Wahlund, L.-O., et al. (2017) · Scientific Reports · doi:10.1038/srep46263 · Cited by 226
Varol, E., Sotiras, A., & Davatzikos, C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.041 · Cited by 208
Li, Y., Wang, Y., Wu, G., Shi, F., Zhou, L., Lin, W., & Shen, D. (2012) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.11.008 · Cited by 197
Korolev, I. O., Symonds, L. L., Bozoki, A. C., & Initiative, A. D. N. (2016) · PLOS ONE · doi:10.1371/journal.pone.0138866 · Cited by 194
Self-citationBoosting power for clinical trials using classifiers based on multiple biomarkers
Kohannim, O., Hua, X., Hibar, D. P., Lee, S., Chou, Y.-Y., Toga, A. W., Jack, C. R., Weiner, M. W., & Thompson, P. M. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.04.022 · Cited by 190
Anatomical heterogeneity of Alzheimer disease: Based on cortical thickness on MRIs
Noh, Y., Jeon, S., Lee, J. M., Seo, S. W., Kim, G. H., Cho, H., Ye, B. S., Yoon, C. W., Kim, H. J., Chin, J., et al. (2014) · Neurology · doi:10.1212/wnl.0000000000001003 · Cited by 185
Trajectories of cognitive decline in Alzheimer's disease
Wilkosz, P. A., Seltman, H. J., Devlin, B., Weamer, E. A., Lopez, O. L., DeKosky, S. T., & Sweet, R. A. (2010) · International Psychogeriatrics · doi:10.1017/s1041610209991001 · Cited by 166
MRI-Based Automated Computer Classification of Probable AD Versus Normal Controls
Duchesne, S., Caroli, A., Geroldi, C., Barillot, C., Frisoni, G. B., & Collins, D. L. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.908685 · Cited by 150
Sparse learning and stability selection for predicting MCI to AD conversion using baseline ADNI data
Initiative, F. T. A. D. N., Ye, J., Farnum, M., Yang, E., Verbeeck, R., Lobanov, V., Raghavan, N., Novak, G., DiBernardo, A., & Narayan, V. A. (2012) · BMC Neurology · doi:10.1186/1471-2377-12-46 · Cited by 143
Self-citationStructural imaging biomarkers of Alzheimer's disease: predicting disease progression
Eskildsen, S. F., Coupé, P., Fonov, V. S., Pruessner, J. C., & Collins, D. L. (2015) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2014.04.034 · Cited by 126
Huang, L., Jin, Y., Gao, Y., Thung, K.-H., & Shen, D. (2016) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2016.07.005 · Cited by 118
Relating one-year cognitive change in mild cognitive impairment to baseline MRI features
Duchesne, S., Caroli, A., Geroldi, C., Collins, D. L., & Frisoni, G. B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.023 · Cited by 116
Small, B. J., & Bäckman, L. (2007) · Cortex · doi:10.1016/s0010-9452(08)70682-8 · Cited by 90
Neuroimaging insights into network-based neurodegeneration
Greicius, M. D., & Kimmel, D. L. (2012) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32835a26b3 · Cited by 75
Huang, M., Yang, W., Feng, Q., Chen, W., Initiative, T. A. D. N., Weiner, M. W., Aisen, P., Petersen, R., Jack, C. R., Jagust, W., et al. (2017) · Scientific Reports · doi:10.1038/srep39880 · Cited by 55
Sankar, T., Park, M. T. M., Jawa, N. A., Patel, R., Bhagwat, N., Voineskos, A. N., Lozano, A. M., Chakravarty, M. M., & Initiative, T. A. D. N. (2017) · Human Brain Mapping · doi:10.1002/hbm.23559 · Cited by 28
Self-citationPredicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers
Zhang, D., & Shen, D. G. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/n3xz-w331 · Cited by 13
Lin, W., Zhou, L., Shen, D. G., Guorong Wu, A., Shi, F., Li, Y., & Wang, Y. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/gk3a-zz78 · Cited by 12
Research works printed but not linked: 3
- Y Noh, 2014, Anatomical heterogeneity of Alzheimer disease, Neurology
- CR Jack Jr, 2017, Defining imaging biomarker cut points for brain aging and Alzheimer’s disease, Alzheimers Dement, 13, 205, 10.1016/j.jalz.2016.08.005 · DOI · Paper page
- M Huang, 2017, Longitudinal measurement and hierarchical classification framework for the prediction of Alzheimer’s disease, Sci Rep, 7, 39880, 10.1038/srep39880 · DOI · Paper page
Cited by
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
“[145] consider the use of longitudinal Siamese network for the prediction of future Alzheimer’s disease onset, using two early time points.”
BackgroundHuang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I., & Lungren, M. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00341-z · Cited by 934
“Six of these studies showed an improvement in performance when using fusion 25,26,28,29,31,33 , and the remaining one achieved the same performance but reduced standard deviation 27 , alluding to a model with better stability.”
BackgroundMethodInfluentialWen, J., Thibeau-Sutre, E., Diaz-Melo, M., Samper-González, J., Routier, A., Bottani, S., Dormont, D., Durrleman, S., Burgos, N., & Colliot, O. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101694 · Cited by 809
Deep learning-based approaches for multi-omics data integration and analysis
Ballard, J. L., Wang, Z., Li, W., Shen, L., & Long, Q. (2024) · BioData Mining · doi:10.1186/s13040-024-00391-z · Cited by 258
“Bhagwat et al. [63] use longitudinal cognitive scores to model Alzheimer’s disease progression trajectories and then develop a longitudinal Siamese network (LSN) to combine MRI data from two time points, along with genetic and clinical information, to predict the prognostic trajectories of…”
Background
Metadata
- Authors
- Bhagwat, N., Viviano, J. D., Voineskos, A. N., Chakravarty, M. M., & Initiative, A. D. N.
- Affiliations
- Centre for Addiction and Mental Health (CA)
- University of Toronto (CA)
- Corresponding author
- Bhagwat, Nikhil
- Viviano, Joseph D.
- Voineskos, Aristotle N.
- Chakravarty, M. Mallar
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-09-14
- Volume
- 14
- Issue
- 9
- Pages
- e1006376
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC6157905
- OpenAlex
- W2889611173
- Semantic Scholar
- 543e816d43063a40b9ee6a7c51d347683acbc060
- Cited by
- 157
- References
- 48
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 30 · 2023: 12 · 2022: 23 · 2021: 36 · 2020: 21 · 2019: 7 · 2018: 1
- FWCI
- 12.70
- Type
- journal article
- Language
- en
- Update notices
- new_version (2018-09-26)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Alzheimer Society (16 29)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Alzheimer's disease research and treatments
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- Alzheimer's disease, longitudinal data, Siamese network, multimodal data integration, individual prognosis, cognitive decline, Mini-Mental State Examination, hierarchical clustering, ADNI, AIBL
- MeSH terms
- Machine Learning, Aged, Aging, Algorithms, Alzheimer Disease, Australia, Female, Follow-Up Studies, Humans, Longitudinal Studies, Magnetic Resonance Imaging, Male, Models, Neurological, Nerve Net, Software, Reproducibility of Results, Biomarkers, Disease Progression, Area Under Curve, Neuroimaging, Symptom Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.