Deep Learning Based Multimodal Progression Modeling for Alzheimer’s Disease
Abstract
The progression of Alzheimer’s disease (AD) is a continuous process in cognitive and biomarker changes, with only a fraction of mild cognitive impairment (MCI) patients eventually advancing to AD. There is no definite biomarker signature to determine this eventual progress. The discovery and development of prognostic biomarker signatures for AD is essential to address the challenges of AD drug discovery and development. The deep learning (DL) technique is a recent breakthrough in data science that enables researchers to discover previously unknown features comprised by complicated patterns learnt from large datasets. It has outperformed many traditional machine learning methods in computer vision tasks. In this article, we evaluated the performance of DL algorithms in differentiating patients with diagnosis of AD, MCI, or no evidence of dementia using baseline MRI data of the brain, and integrated features extracted from the neural network with other baseline biomarkers to develop an AD prognostic signature. This signature can be used to understand the patient heterogeneity in a study cohort and provide enrichment strategies for AD clinical trial design.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
NIA‐AA Research Framework: Toward a biological definition of Alzheimer's disease
Jack, C. R., Bennett, D. A., Blennow, K., Carrillo, M. C., Dunn, B., Haeberlein, S. B., Holtzman, D. M., Jagust, W., Jessen, F., Karlawish, J., et al. (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.018 · Cited by 10,537 · see citing works
A reproducible evaluation of ANTs similarity metric performance in brain image registration
Avants, B. B., Tustison, N. J., Song, G., Cook, P. A., Klein, A., & Gee, J. C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.025 · Cited by 4,796 · see citing works
Clinical and biomarker changes in dominantly inherited Alzheimer's disease
Bateman, R. J., Xiong, C., Benzinger, T. L. S., Fagan, A. M., Goate, A., Fox, N. C., Marcus, D. S., Cairns, N. J., Xie, X., Blazey, T. M., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1202753 · Cited by 3,814 · see citing works
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930 · see citing works
xgboost: Extreme Gradient Boosting
Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., Chen, K., Mitchell, R., Cano, I., Zhou, T., et al. (2014) · doi:10.32614/cran.package.xgboost · Cited by 2,735 · see citing works
2019 Alzheimer’s disease facts and figures.
Alzheimer's Association (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2019.01.010 · Cited by 2,461 · see citing works
Within-subject template estimation for unbiased longitudinal image analysis
Reuter, M., Schmansky, N. J., Rosas, H. D., & Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.084 · Cited by 2,356 · see citing works
van der Laan, M. J., Polley, E., & Hubbard, A. (2007) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1309 · Cited by 1,472 · see citing works
Matthews, K. A., Xu, W., Gaglioti, A. H., Holt, J. B., Croft, J. B., Mack, D., & McGuire, L. C. (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.06.3063 · Cited by 1,124 · see citing works
Saltz, J., Gupta, R., Hou, L., Kurc, T., Singh, P., Nguyen, V., Samaras, D., Shroyer, K. R., Zhao, T., Batiste, R., et al. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.03.086 · Cited by 1,027 · see citing works
Self-citationMachine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects
Moradi, E., Pepe, A., Christian Gaser, B., Huttunen, H. J., & Tohka, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.002 · Cited by 720 · see citing works
Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements
Tustison, N. J., Cook, P. A., Klein, A., Song, G., Das, S. R., Duda, J. T., Kandel, B. M., van Strien, N., Stone, J. R., Gee, J. C., et al. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.044 · Cited by 670 · see citing works
Mehta, D. G., Jackson, R., Paul, G., Shi, J., & Sabbagh, M. N. (2017) · Expert Opinion on Investigational Drugs · doi:10.1080/13543784.2017.1323868 · Cited by 603 · see citing works
Jack, C. R., Wiste, H. J., Vemuri, P., Weigand, S. D., Senjem, M. L., Zeng, G., Bernstein, M. A., Gunter, J. L., Pankratz, V. S., Aisen, P. S., et al. (2010) · Brain · doi:10.1093/brain/awq277 · Cited by 531 · see citing works
Spasov, S., Passamonti, L., Duggento, A., Lió, P., & Toschi, N. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.01.031 · Cited by 429 · see citing works
Chris Hinrichs, A., Singh, V., Xu, G., & Johnson, S. C. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.081 · Cited by 405 · see citing works
Lin, W.-M., Tong, T., Gao, Q., Guo, D., Du, X., Yang, Y., Guo, G., Xiao, M., Du, M., Qu, X., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00777 · Cited by 391 · see citing works
Sheehan, B. (2012) · Therapeutic Advances in Neurological Disorders · doi:10.1177/1756285612455733 · Cited by 338 · see citing works
Towards Alzheimer's disease classification through transfer learning
Hon, M., & Khan, N. (2017) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217822 · Cited by 268 · see citing works
Biomarkers for the Early Detection and Progression of Alzheimer's Disease
Counts, S. E., Ikonomovic, M. D., Mercado, N., Vega, I. E., & Mufson, E. J. (2017) · Neurotherapeutics · doi:10.1007/s13311-016-0481-z · Cited by 224 · see citing works
Korolev, I. O., Symonds, L. L., Bozoki, A., & Initiative, A. D. N. (2016) · PLoS ONE · doi:10.1371/journal.pone.0138866 · Cited by 192 · see citing works
Cummings, J., Ritter, A., & Zhong, K. (2018) · Journal of Alzheimer's Disease · doi:10.3233/jad-179901 · Cited by 176 · see citing works
Ledig, C., Schuh, A., Guerrero, R., Heckemann, R. A., & Rueckert, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-29295-9 · Cited by 166 · see citing works
Tong, T., Gao, Q., Guerrero, R., Ledig, C., Chen, L., Rueckert, D., & Initiative, A. D. N. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2549363 · Cited by 162 · see citing works
The Journal of Prevention of Alzheimer's Disease
(2021) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2021.5 · Cited by 152 · see citing works
Staging Alzheimer's disease progression with multimodality neuroimaging
Ewers, M., Frisoni, G. B., Teipel, S. J., Grinberg, L. T., Amaro, E., Heinsen, H., Thompson, P. M., & Hampel, H. J. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.06.004 · Cited by 77 · see citing works
Deep Residual Nets for Improved Alzheimer's Diagnosis
Valliani, A. A.-A., & Soni, A. B. (2017) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3107411.3108224 · Cited by 74 · see citing works
Amygdalar Atrophy in Early Alzheimer’s Disease
Klein, Y., Heckemann, R. A., Ramdeen, K. T., Moreaud, O., Keignart, S., Krainik, A., Hammers, A., Baciu, M. V., Hot, P., & Initiative, A. D. N. (2014) · Current Alzheimer Research · doi:10.2174/1567205011666140131123653 · Cited by 58 · see citing works
Tractenberg, R. E., Schafer, K. A., & Morris, J. C. (2001) · Alzheimer Disease & Associated Disorders · doi:10.1097/00002093-200107000-00007 · Cited by 34 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Multimodal machine learning in precision health: A scoping review
Kline, A., Wang, H., Li, Y., Dennis, S., Hutch, M., Xu, Z., Wang, F., Cheng, F., & Luo, Y. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00712-8 · Cited by 528 · see citing works
Sisodia, P. S., Ameta, G., Kumar, Y., & Chaplot, N. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09870-0 · Cited by 77 · see citing works
Lu, P., Hu, L., Mitelpunkt, A., Bhatnagar, S., Lu, L. J., & Liang, H. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105669 · Cited by 73 · see citing works
Ensemble deep learning for Alzheimer’s disease characterization and estimation
Tanveer, M., Goel, T., Sharma, R., Malik, A. K., Beheshti, I., Ser, J. D., Suganthan, P. N., & Lin, C. (2024) · Nature Mental Health · doi:10.1038/s44220-024-00237-x · Cited by 62 · see citing works
Ahmed, K., Senan, E. M., Al-Wagih, K. S., Al-Azzam, M. M. A., & Alkhraisha, Z. M. (2023) · Diagnostics · doi:10.3390/diagnostics13091654 · Cited by 49 · see citing works
Zhu, C., Han, J., Liang, F., Zhu, M., Zhang, G., James, T. D., & Wang, Z. (2024) · Coordination Chemistry Reviews · doi:10.1016/j.ccr.2024.216002 · Cited by 34 · see citing works
Valizadeh, G., Elahi, R., Hasankhani, Z., Rad, H. S., & Shalbaf, A. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10176-6 · Cited by 31 · see citing works
RESNET-53 for Extraction of Alzheimer’s Features Using Enhanced Learning Models
Boyapati, R. L., & YALAVAR, R. (2024) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.519 · Cited by 28 · see citing works
Nayak, V., Patra, S., Rout, S., Jena, A. B., Sharma, R., Pattanaik, K. P., Singh, J., Pandey, S. S., Singh, R. P., Majhi, S., et al. (2023) · Phytomedicine · doi:10.1016/j.phymed.2023.155150 · Cited by 25 · see citing works
Radiomics, deep learning and early diagnosis in oncology
Wei, P. (2021) · Emerging Topics in Life Sciences · doi:10.1042/etls20210218 · Cited by 23 · see citing works
A review of machine learning techniques for diagnosing Alzheimer’s disease using imaging modalities
Kishore, N., & Goel, N. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10399-5 · Cited by 15 · see citing works
Classification on Alzheimer’s Disease MRI Images with VGG-16 and VGG-19
Antony, F., Anita, H. B., & George, J. A. (2022) · Smart innovation, systems and technologies · doi:10.1007/978-981-19-3575-6_22 · Cited by 13 · see citing works
Multimodal AI for Alzheimer Disease Diagnosis: Systematic Review of Datasets, Models, and Modalities
Yu, Z., Mulholland, A. J., Huang, T., & Liu, Q. (2026) · Journal of Medical Internet Research · doi:10.2196/85414 · Cited by 8 · see citing works
Zhu, J., Zhou, J., Pan, J., Гу, Ф., & Guo, J. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9020030 · Cited by 8 · see citing works
Fang, S.-J., Yin, Z.-D., Cai, Q., Li, L., Zheng, P.-F., & Chen, L. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1615523 · Cited by 9 · see citing works
Zhou, W., Wang, Y., Yz, W., Li, X., Liu, H., Wang, H., Zhang, Z., & Huang, H. (2026) · Digital Health · doi:10.1177/20552076251412649 · Cited by 6 · see citing works
Machine learning–enhanced screening funnel for clinical trials in Alzheimer's disease
Gladstein, S., Yang, L., Wooten, D., Huang, X., Comley, R. A., Guo, Q., & Initiative, T. A. D. N. (2025) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1002/trc2.70084 · Cited by 4 · see citing works
Self-citationBoyapati, R. L., & Yalavarthi, R. (2024) · International Conference on Sustainable Expert Systems (ICSES) · doi:10.1109/icses63445.2024.10763183 · Cited by 4 · see citing works
Cogninet: an explainable deep learning model for multi-class MRI-based Alzheimer’s disease staging
White, T., & Rowlands, S. (2026) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-026-03617-z · Cited by 3 · see citing works
Boyapati, R. L., & Yalavarthi, R. (2024) · International Journal of experimental research and review · doi:10.52756/ijerr.2024.v46.007 · Cited by 3 · see citing works
Chen, W., Xu, S., Peng, Y., Zhang, H., Zhang, J., Zheng, H., Yan, H., & Chen, Z. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1630838 · Cited by 1 · see citing works
Hassan, S., Salem, M., Papineni, V. R. K., Elsayed, A., & Yaqub, M. K. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05185-1_34 · Cited by 1 · see citing works
The 2019 Nonclinical Biostatistics Conference
Altan, S., & Kolassa, J. E. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1938444
Overview of Artificial Intelligence Methods for Alzheimer’s Disease Prediction and Progression
Comito, C., Pizzuti, C., & Sammarra, M. (2023) · International Conference on Signal-Image Technology & Internet-Based Systems (SITIS) · doi:10.1109/sitis61268.2023.00014
Dementia Disease Progression Analysis from 2D Cellular Automata Architecture
Kesu, S. M. R., Sinha, N., & Ramasangu, H. (2024) · Indian Conference on Computer Vision, Graphics and Image Processing · doi:10.1145/3702250.3702288
A Review of Deep Learning Techniques for Classification of Alzheimer’s Disease Using MRI
Kishore, N., & Goel, N. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-4170-3_19
Masood, F., Ahmad, J. E., Alasbali, N. A., Nafea, I. T., Saeed, F., & Ullah, R. (2025) · Journal of Intelligent Systems · doi:10.1515/jisys-2024-0417
Guo, X., Sun, Y., Chen, Y., Liu, H., Liu, X., & Wang, X. (2026) · Biosensors · doi:10.3390/bios16090514
Self-citation
- Authors
- Yang, L., Wang, X., Guo, Q., Gladstein, S., Wooten, D., Li, T., Robieson, W. Z., Sun, Y., Huang, X., & Initiative, F. T. A. D. N.
- Affiliations
- AbbVie (United States) (US)
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Huang, Xin
- ORCID
- Venue
- Statistics in Biopharmaceutical Research
- Publisher
- Informa UK Limited
- Published
- 2021-03-10
- Volume
- 13
- Issue
- 3
- Pages
- 337-343
- ISSN
- 1946-6315 (ISSN-L)
- OpenAlex
- W3129113421
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 8 · 2023: 5 · 2022: 2 · 2021: 2
- FWCI
- 3.05
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Biopharmaceutical Research (publishedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Medicine › Physiology › Alzheimer's disease research and treatments
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Alzheimer's disease, mild cognitive impairment, disease progression, prognostic factors, multimodal biomarker integration, baseline MRI, deep feature extraction, patient heterogeneity, clinical trial enrichment, dementia diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
