The DOI matches its Crossref record; 90 of the 92 references it cites were found in a registry or an index.
Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis
Open accessAbstract
For the last decade, it has been shown that neuroimaging can be a potential tool for the diagnosis of Alzheimer's Disease (AD) and its prodromal stage, Mild Cognitive Impairment (MCI), and also fusion of different modalities can further provide the complementary information to enhance diagnostic accuracy. Here, we focus on the problems of both feature representation and fusion of multimodal information from Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET). To our best knowledge, the previous methods in the literature mostly used hand-crafted features such as cortical thickness, gray matter densities from MRI, or voxel intensities from PET, and then combined these multimodal features by simply concatenating into a long vector or transforming into a higher-dimensional kernel space. In this paper, we propose a novel method for a high-level latent and shared feature representation from neuroimaging modalities via deep learning. Specifically, we use Deep Boltzmann Machine (DBM)(2), a deep network with a restricted Boltzmann machine as a building block, to find a latent hierarchical feature representation from a 3D patch, and then devise a systematic method for a joint feature representation from the paired patches of MRI and PET with a multimodal DBM. To validate the effectiveness of the proposed method, we performed experiments on ADNI dataset and compared with the state-of-the-art methods. In three binary classification problems of AD vs. healthy Normal Control (NC), MCI vs. NC, and MCI converter vs. MCI non-converter, we obtained the maximal accuracies of 95.35%, 85.67%, and 74.58%, respectively, outperforming the competing methods. By visual inspection of the trained model, we observed that the proposed method could hierarchically discover the complex latent patterns inherent in both MRI and PET.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Neuropathological stageing of Alzheimer-related changes.
Braak, H., & Braak, E. (1991) · Acta Neuropathologica · doi:10.1007/bf00308809 · Cited by 16,123 · cited 1×
“Those were distributed around a medial temporal lobe (that includes amygdala, hippocampal formation, entorhinal cortex) (Braak and Braak, 1991; Visser et al., 2002; Mosconi, 2005; Lee et al., 2006; Devanand et al., 2007; Burton et al., 2009; Desikan et al., 2009; Ewers et al., 2012; Walhovd et al., 2010), superior/med…”
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,043
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,869
Zhang, Y., Brady, M., & Smith, S. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 7,628
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 7,330
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,050
Cited by
Sorted by citations
Items 901–968 of 968
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073477
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073462
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073468
Sadiq, M. U., Kwak, K., & Dayan, E. (2022) · Figshare · doi:10.6084/m9.figshare.19029210
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073474
Lu, B., Li, H.-X., Chang, Z.-K., Li, L., Chen, N.-X., Zhu, Z.-C., Zhou, H.-X., Li, X.-Y., Wang, Y.-W., Cui, S.-X., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21332746
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073459
Yang, J., Lei, D., Qin, K., Pinaya, W. H. L., Suo, X., Li, W., Li, L., Kemp, G. J., & Gong, Q. (2021) · Figshare · doi:10.6084/m9.figshare.16900831
Dyrba, M., Hanzig, M., Altenstein, S., Bader, S., Ballarini, T., Brosseron, F., Büerger, K., Cantré, D., Dechent, P., Dobisch, L., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17073471
MOST: MR Reconstruction Optimization for Multiple DownStream Tasks via Continual Learning
Jeong, H., Chun, S. Y., & Lee, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04947-6_38
Yan, C., & Qi, N. (2026) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104695
AI research trends in liver cancer bibliometric analysis
Zhang, T., Zheng, Y., Zhang, C., Li, W. D., Wang, Z., kaihao, D., & Wang, Z. (2026) · Medicine · doi:10.1097/md.0000000000046891
Tao, Z., Zhou, R., Zheng, Y., & Xiong, L. (2026) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2025.1605231
Multimodal Deep Learning for Alzheimer’s Diagnosis Using PET and MRI
Jayman, Z. S., & Lakmal, H. K. I. S. (2025) · SLAAI International Conference on Artificial Intelligence (SLAAI-ICAI) · doi:10.1109/slaai-icai68534.2025.11318489
Zhang, T., Sun, L., Li, S., Fan, Y., & Dong, X. (2025) · IEEE International Conference on Frontiers Technology of Information and Computer (ICFTIC) · doi:10.1109/icftic68075.2025.11324663 · Cited by 1
Jumutc, V., Bondarenko, A. N., Kovaļovs, M., Lihacova, I., Lihachev, A., & Bļizņuks, D. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1763105
Deep Learning based Multi-Model Approach for Alzheimer’s Disease Prediction
Reddy, A. S., & Kumar, K. M. (2025) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca66444.2025.11382732
Singh, S., & Ma, D. (2026) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.3087877
Muthulingam, G. A., Nagaraj, P., Kanna, R. R., Sakthi Sanjay, S., Vijayakumar, M., & Rohith, K. (2025) · International Conference on Intelligent Computing, Information and Control Systems (ICOIICS) · doi:10.1109/icoiics67115.2025.11390403
Mahapatra, H., & Sriharsha, A. V. (2025) · Global AI Summit - International Conference on Artificial Intelligence and Emerging Technology (AI Summit) · doi:10.1109/aisummit66170.2025.11410801
The Deep Learning Revolution in Neuroimaging: Insights from a Bibliometric Analysis (2014–2024)
Chaki, J., & Deshpande, G. (2026) · Neuroinformatics · doi:10.1007/s12021-026-09775-4
Multi-scale and multimodal imaging biomarkers for the early detection of Alzheimer’s disease
Hett, K. (2019) · theses.fr (ABES) · doi:10.70675/0d4a3118z347az4e13z812cz9ad7566ef5ba
Aderghal, K. (2021) · theses.fr (ABES) · doi:10.70675/b467dba8z5f34z4fafz8d11z5d8aa1f680d5 · Cited by 3
New radiomics approaches for hepatic tumor characterization through imaging analysis
Ouhmich, F. (2021) · theses.fr (ABES) · doi:10.70675/b5d050c9zbcc8z4ba2z8e59z8b953b2cebea
Numerical methods to estimate brain micro-structure from diffusion MRI data
Yang, Z. (2023) · theses.fr (ABES) · doi:10.70675/75403483z9a47z4dd0z9802z2ec97417231f
A multimodal AI model for modeling the genetic risk factor of Alzheimer’s diseasePreprint
Nguyen, T., Woods, C., Liu, J., Wang, C., Lin, A., & Cheng, J. (2026) · medRxiv · doi:10.64898/2026.04.13.26350803
Deep Learning in Medical Imaging: Application Progress and Future Challenges
Wang, J., Yang, P., An, Z., Luo, R., Feng, J., & Zhang, L. (2026) · Scientific Journal of Technology · doi:10.54691/kskfkp57
Maithili, T., Sanjula, M., V, Shivani, S., & Madhumathi (2026) · International Conference on Expert Clouds and Applications (ICOECA) · doi:10.1109/icoeca68095.2026.11485245
A Topological Classification for Alzheimer's Disease via Hemoglobin Concentration fNIRS Data
Liu, S., Sun, C., Wu, H., Dang, Z., Wei, Y., Yang, Z., Li, K., Chen, P., Yang, L., & Zhang, W. (2025) · International Conference on Industrial Automation, Robotics and Control Engineering (IARCE) · doi:10.1109/iarce68366.2025.11485743
Xu, G., & Zhang, S. Y. (2025) · International Conference on Big Data, Artificial Intelligence and Risk Management (ICBAR) · doi:10.1145/3800227.3800398
Stage Classification of Alzheimer’s Disease MRI Data via Deep Neural Network Architectures
GÜVEN, A., Ezirmik, A. H., Ceylan, M. F., & Aydın, F. (2026) · Mühendislik Bilimleri ve Araştırmaları Dergisi · doi:10.46387/bjesr.1869200
Liu, S., Wu, H., Sun, C., Qiu, Y., Wu, H., Wei, Y., Lv, Y., & Yang, Z. (2026) · Sensors · doi:10.3390/s26165221
Generative Models in Medical Imaging for Cognitive Disease Detection
Jothe, J. S., Naitam, M. G., Ponmariappan, S., & Pandey, A. C. (2026) · Cognitive systems monographs · doi:10.1007/978-3-032-18782-6_3
Patterson, C., Chattopadhyay, T., Thomopoulos, S. I., Saykin, A. J., Davatzikos, C. A., Mormino, E. C., Tosun, D., Beecham, G. W., Biber, S., Kukull, W. A., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.2139/ssrn.6791127
Gowda, S. L. H., Yadahalli, S. V., Mirjanik, S., Muskan, S., & Pramee, L. (2026) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom70271.2026.11526237
Early prediction of Alzheimer's disease using convolutional neural network
Benkaddour, M. K. (2025) · Nigerian Journal of Technology · doi:10.4314/njt.v44i4.14
Chen, J., Li, G., Yu, K., Cheng, G., Fan, X., & Wang, K. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109232
Explainable Deep NeuroDiagnostics: Interpretable AI for Alzheimer's Disease Classification
Mishra, H. V., Bhat, K., Venugopal, V., Ramyashree, R., Raghavendra, S., & Anoop, B. N. (2026) · International Conference on Computing and Data Engineering (ICCDE) · doi:10.1145/3801839.3801866
Shet, A., Sabahuddin, S., Priyadarshini, B., Jami, B. N. S. S. R., Alex, J. S. R., Lin, C. Y., & Lung, C.-W. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1867451
Xu, B., Yang, G., Lin, J., Zheng, D., He, L., & Luo, K. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110794
Gasmi, K., Ammar, L. B., Krichen, M., & Alghuried, A. (2026) · Diagnostics · doi:10.3390/diagnostics16132029
Mursalim, M. K. N., Susanty, M., Syafarina, I., & Syafiandini, A. F. (2026) · In Silico Research in Biomedicine · doi:10.1016/j.insi.2026.100502
Lahbel, M., Hanae, B., & Minaoui, K. (2026) · International Symposium on Signal, Image, Video and Communications (ISIVC) · doi:10.1109/isivc69944.2026.11574196
Research Advances in Diagnostic Methods for Prevalent Neurological Diseases
Lv, M., Sun, X., & Wang, X. (2026) · Biosensors · doi:10.3390/bios16070368
Poursaeid, M., Seyedarabi, H., & Asadpour, M. (2026) · SN Computer Science · doi:10.1007/s42979-026-05206-y
Shi, B., Wang, Z., Lian, J., Yang, Z., & Zuo, X. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1885491
Automated Classification of Alzheimer's Disease Based on Structural MRI Using Vision Transformer
Rani, D. M., Rajasekaran, A. S., Ramkumar, N., Kumar, G. K., & Abhitesh, N. (2025) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac65734.2025.11597615
Abdollahi, J., Mehrpour, O., Nouri-Moghaddam, B., Hoseini, F., Mirzaei, A., Gudakahriz, S. J., & Yaghoobi, M. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100436
Early Diagnosis of Alzheimer’s Disease USING DEEP learning MRI Images: A Systematic Review
Obaid, A. K., & Farjami, Y. (2026) · Kufa Journal of Engineering · doi:10.30572/2018/kje/170329
XGBoost-Based Alzheimer Prediction with Feature Selection and Randomized Tuning
Gurlani, P., Dobariya, D., Geryani, J., Swain, D., Kumar, M., & Mehra, V. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-24360-7_16
NeuroWise: AI-Based NLP Model for Early Alzheimer’s Detection Using Clinical Text
Shar, J., Hussain, F., Ali, I., Jabbar, A., & Ali, M. (2025) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1314
Mdluli, N. T., Chang, Y., Wu, C.-H., & Cheng, W.-J. (2026) · doi:10.2196/preprints.108578
Interpretable Alzheimer’s Disease Diagnosis via Multimodal Fusion of Regional Brain Experts
Zhuang, F., Yang, S., Aliyeva, D., Wen, Z., Duong-Tran, D., Davatzikos, C. A., Chen, T., Wang, S., & Shen, L. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00049
Chandra, A., & Roy, S. (2026) · IEEE Guwahati Subsection Conference (GCON) · doi:10.1109/gcon69192.2026.11648878
Menezes, J., Barbosa, M. I. A., & Rodrigues, P. M. (2026) · Sensors · doi:10.3390/s26175489
MiFAD: A multimodal image fusion-assisted diagnosis framework for early Alzheimer’s disease
Zhao, X., Shi, Y., Yuan, S., Cheng, J., & Liu, Y. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104744
Sajid, M. A. R., Raheem, A., Farooqui, M. A., Hussain, A., & Sairam, U. (2026) · International Conference on Inventive Systems and Control (ICISC) · doi:10.1109/icisc69558.2026.11681515
AI‐Driven Early Disease Detection
Deepa, K., Banu, N. S., & Dhanraj, G. (2026) · Wiley eBooks · doi:10.1002/9781394477623.ch4
Deep Learning-Based Early Detection and Classification of Dementia Using MRI
Carpio, A., Martín-Buro, M. C., del Pino, A. B., Galán, D., & García-Montes, M. E. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0462-3.ch015
Das, R., & Das, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0462-3.ch009
Nguyen, T., Woods, C., Liu, J., Wang, C., Lin, A., & Cheng, J. (2026) · Bioengineering · doi:10.3390/bioengineering13101113
Harikrishnan, K., & Thasni, T. (2026) · International Conference on Smart Communication and Sustainable Technologies (ICSCST) · doi:10.1109/icscst70031.2026.11709650
Adolescents with serious depressive disorder: Artificial intelligence for detecting mental disorders
Thamizhmaran, K., & Kumar, S. R. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27722-1.00002-x
Modeling cognitive impairment in Parkinson's patients using deep learning
Thakur, A., Sharma, R., Devi, A., Kumar, K., & Shah, T. M. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27722-1.00013-4
Medical Image Analysis For Alzheimer’s Detection Using CNN And Transfer Learning
Reddy, A. K. K., Tripathy, H. K., Shanagonda, A., Peneti, S., Vasantha, T., & Krishna, M. R. (2026) · International Conference on Advancements in Smart, Secure and Intelligent Computing (ASSIC) · doi:10.1109/assic70037.2026.11716778
A Review of MRI-PET Fusion for Alzheimer’s Disease Diagnosis
秦, 傲. (2026) · Journal of Image and Signal Processing · doi:10.12677/jisp.2026.154042
Resting-state functional Magnetic Resonance Imaging
Choe, A. S. (2026) · Advances in magnetic resonance technology and applications · doi:10.1016/b978-0-443-21425-7.00001-4
Resen, I. A. (2026) · Interdisciplinary Journal of Health Environment and Computation · doi:10.65983/ijhec.2026.01.0005
Metadata
- Authors
- Suk, H.-I., Lee, S.-W., & Shen, D.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Korea University (KR)
- Corresponding author
- Shen, Dinggang
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2014-11
- Volume
- 101
- Pages
- 569-582
- ISSN
- 1053-8119 (ISSN-L)
- PMC
- PMC4165842
- OpenAlex
- W2126598020
- Cited by
- 968
- References
- 92
- Citations by year
- 2026: 62 · 2025: 74 · 2024: 81 · 2023: 93 · 2022: 104 · 2021: 128 · 2020: 117 · 2019: 107 · 2018: 85 · 2017: 57 · 2016: 41 · 2015: 17 · 2014: 1
- FWCI
- 29.50
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- NeuroImage (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
- UNC Libraries
- Funders
- NIH (EB006733, EB008374, EB009634, AG041721, MH100217, AG042599)
- National Research Foundation (2012-005741)
- Korean Government
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Alzheimer's disease research and treatments
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- Alzheimer's disease, mild cognitive impairment, multimodal fusion, MRI-PET fusion, hierarchical feature representation, deep Boltzmann machine, neuroimaging diagnosis, MCI conversion, ADNI
- MeSH terms
- Aged, Aged, 80 and over, Alzheimer Disease, Artificial Intelligence, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Neural Networks, Computer, Positron-Emission Tomography, Cognitive Dysfunction, Multimodal Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review