Multimodal Neuroimaging Feature Learning for Multiclass Diagnosis of Alzheimer's Disease
Open accessThe DOI matches its Crossref record; 69 of the 76 references it cites were found in a registry or an index.
Abstract
The accurate diagnosis of Alzheimer's disease (AD) is essential for patient care and will be increasingly important as disease modifying agents become available, early in the course of the disease. Although studies have applied machine learning methods for the computer-aided diagnosis of AD, a bottleneck in the diagnostic performance was shown in previous methods, due to the lacking of efficient strategies for representing neuroimaging biomarkers. In this study, we designed a novel diagnostic framework with deep learning architecture to aid the diagnosis of AD. This framework uses a zero-masking strategy for data fusion to extract complementary information from multiple data modalities. Compared to the previous state-of-the-art workflows, our method is capable of fusing multimodal neuroimaging features in one setting and has the potential to require less labeled data. A performance gain was achieved in both binary classification and multiclass classification of AD. The advantages and limitations of the proposed framework are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · cited 2×
“The SVM-based experiments were performed using LIBSVM [58].”
MethodMcKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., & Stadlan, E. M. (1984) · Neurology · doi:10.1212/wnl.34.7.939 · Cited by 27,915
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Deep learning architectures extract high-level features progressively via several layers of feature representations [37].”
BackgroundJenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888 · cited 1×
“The PET images were aligned to the corresponding MR image using FSL FLIRT [49].”
MethodLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 1×
“The features extracted by the unsupervised network are fed to an output layer with softmax regression [55].”
Method3D Slicer as an image computing platform for the Quantitative Imaging Network
Fedorov, A., Beichel, R., Kalpathy-Cramer, J., Finet, J., Fillion-Robin, J.-C., Pujol, S., Bauer, C., Jennings, D., Fennessy, F., Sonka, M., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.05.001 · Cited by 9,023
Self-citation(2012) · Cited by 8,009
Research works printed but not linked: 4
- liu, 2014, High-level feature based PET image retrieval with deep learning architecture, J Nucl Med, 55, 2018
- liu, 2013, Sparse auto-encoded hypo-metabolism patterns in Alzheimer's disease and mild cognitive impairment, J Nucl Med, 54, 1807
- liu, 0, Multifold Bayesian kernelization in Alzheimers diagnosis, Proc Int Conf Med Image Comput Comput -Assisted Intervention, 303
- zou, 0, Unsupervised learning of visual invariance with temporal coherence, Proc NIPS Workshop on Deep Learning and Unsupervised Feature Learning
Cited by
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139
Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Wen, J., Thibeau-Sutre, E., Diaz-Melo, M., Samper-González, J., Routier, A., Bottani, S., Dormont, D., Durrleman, S., Burgos, N., & Colliot, O. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101694 · Cited by 809
Multimodal deep learning models for early detection of Alzheimer’s disease stage
Venugopalan, J., Tong, L., Hassanzadeh, H. R., & Wang, M. D. (2021) · Scientific Reports · doi:10.1038/s41598-020-74399-w · Cited by 732
Jo, T., Nho, K., & Saykin, A. J. (2019) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2019.00220 · Cited by 724
Vieira, S., Pinaya, W. H. L., & Mechelli, A. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.01.002 · Cited by 656
Quo vadis artificial intelligence?
Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00022-8 · Cited by 544
“For instance, AI helps to markup suspicious lesion areas on optical images [106], X-ray images [107], or magnetic resonance images [108–110], and can analyze patients’ speech to diagnose Alzheimer’s disease [111].”
BackgroundLian, C., Liu, M., Zhang, J., & Shen, D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889096 · Cited by 544
“Our proposed H-FCN method is also different from existing deep-learning-based AD diagnosis methods in the literature [31], [33], [34], [50], [51], [66], [68].”
BackgroundMethodIslam, J., & Zhang, Y. (2018) · Brain Informatics · doi:10.1186/s40708-018-0080-3 · Cited by 478
“Liu et al. [76] have developed a multimodal stacked autoen-coder network using zero-masking strategy.”
MethodShi, J., Zheng, X., Li, Y., Zhang, Q., & Ying, S. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2655720 · Cited by 444
“While in our MM-SDPN algorithm, since DPN performs the feedforward supervised learning in each network layer without fine-turning, it is difficult to conduct the same learning strategy as in [38] to infer the correlations between MRI and PET.”
BackgroundMethodInfluentialDeep learning to detect Alzheimer's disease from neuroimaging: A systematic literature review
Ebrahimighahnavieh, M. A., Luo, S., & Chiong, R. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105242 · Cited by 429
Ramzan, F., Khan, M. U. G., Rehmat, A., Iqbal, S., Saba, T., Rehman, A., & Mehmood, Z. (2020) · Journal of Medical Systems · doi:10.1007/s10916-019-1475-2 · Cited by 432
“Siqi Liu et al. [26] presented a multi-modal method to extract neuro-imaging features for AD diagnosis.”
MethodMulti-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis
Initiative, T. A. D. N., Liu, M., Cheng, D., Wang, K., & Wang, Y. (2018) · Neuroinformatics · doi:10.1007/s12021-018-9370-4 · Cited by 400
“Recently, deep learning networks were also used to extract the latent features from measurements of ROIs with different image modalities for AD classification (Liu et al. 2015; Suk et al. 2015).”
BackgroundMethodInfluentialDEMNET: A Deep Learning Model for Early Diagnosis of Alzheimer Diseases and Dementia From MR Images
Murugan, S., Venkatesan, C., Sumithra, M. G., Gao, X.-Z., Elakkiya, B., Akila, M., & Manoharan, S. (2021) · IEEE Access · doi:10.1109/access.2021.3090474 · Cited by 393
“For initiation of clinical progress and efficient patient treatment, early and precise analysis of AD prediction is necessary [1].”
Lin, W., Tong, T., Gao, Q., Guo, D., Du, X., Yang, Y., Guo, G., Xiao, M., Du, M., Qu, X., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00777 · Cited by 390
“…classify AD patients at different disease stages or to predict the MCI-to-AD conversion (Cuingnet et al., 2011; Zhang et al., 2011; Tong et al., 2013, 2017; Guerrero et al., 2014; Suk et al., 2014; Cheng et al., 2015; Eskildsen et al., 2015; Li et al., 2015; Liu et al., 2015; Moradi et al., 2015).”
BackgroundLu, D., Popuri, K., Ding, G. W., Balachandar, R., Beg, M. F., Initiative, A. D. N., Weiner, M., Aisen, P., Petersen, R., Jack, C., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-22871-z · Cited by 376
“…into cortical and subcortical gray-matter compartments, and further subdividing each into patches of a hierarchical size, and extract features from each-sized patch 26–28 by averaging within the patch and use these multi-scale features taken from multiple modalities into a deep learning framework.”
Machine Learning Techniques for the Diagnosis of Alzheimer’s Disease: A Review
Tanveer, M., Richhariya, B., Khan, R. U., Rashid, A. H., Khanna, P., Prasad, M., & Lin, C. T. (2020) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3344998 · Cited by 329
“Liu et al. [102] used SAE-based DL architecture for diagnosis of AD in four stages by obtaining high level features and soft-max logistic regressor (LR).”
MethodA deep CNN based multi-class classification of Alzheimer's disease using MRI
Farooq, A., Anwar, S., Awais, M., & Rehman, S. (2017) · 2017 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2017.8261460 · Cited by 303
DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI
Sarraf, S., DeSouza, D. D., Anderson, J., Tofighi, G., & Initiativ, F. T. A. D. N. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/070441 · Cited by 325
Alzheimer's disease diagnostics by adaptation of 3D convolutional network
Hosseini-Asl, E., Keynton, R., & El-Baz, A. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532332 · Cited by 328
“[13] extracted 83 regions-of-interest (ROI) from the MRI and PET scans and used multimodal fusion to create a set of features to train stacked layers of denoising autoencoders.”
MethodWeiner, M. W., Veitch, D. P., Aisen, P. S., Beckett, L. A., Cairns, N. J., Green, R. C., Harvey, D., Jack, C. R., Jagust, W., Morris, J. C., et al. (2017) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2016.11.007 · Cited by 315
Liu, M., Zhang, J., Adeli, E., & Shen, D. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2869989 · Cited by 308
A new switching-delayed-PSO-based optimized SVM algorithm for diagnosis of Alzheimer’s disease
Zeng, N., Qiu, H., Wang, Z., Liu, W., Zhang, H., & Li, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.001 · Cited by 303
Multimodal medical image fusion review: Theoretical background and recent advances
Hermessi, H., Mourali, O., & Zagrouba, E. (2021) · Signal Processing · doi:10.1016/j.sigpro.2021.108036 · Cited by 301
Diagnosis of Alzheimer’s Disease via Multi-Modality 3D Convolutional Neural Network
Huang, Y., Xu, J., Zhou, Y., Tong, T., Zhuang, X., & (ADNI), T. A. D. N. I. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00509 · Cited by 291
“They used the patch-based information of a whole brain to train or test their models and they integrated the information from the two modalities by concatenating the feature maps [43].”
MethodDeep Learning Framework for Alzheimer’s Disease Diagnosis via 3D-CNN and FSBi-LSTM
Feng, C., Elazab, A., Yang, P., Wang, T., Zhou, F., Hu, H., Xiao, X., & Lei, B. (2019) · IEEE Access · doi:10.1109/access.2019.2913847 · Cited by 286
“features in early diagnosis of AD, including region of interest (ROI) based features [4], [12]–[14], [16], [18] and voxel based features [7], [8], [10].”
BackgroundDeep neural networks in psychiatry
Durstewitz, D., Koppe, G., & Meyer-Lindenberg, A. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0365-9 · Cited by 278
“ML algorithms fed with multimodal data, allowing them to harvest predictive inter-relationships among data types [59, 94, 95] (Fig.”
MethodLi, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274
“Gravina et al. (2024) introduced a Multi-Input–Multi-Output 3D CNN designed for the assessment of dementia severity, specifically tailored for scenarios involving incomplete multimodal brain MRI and PET data.”
BackgroundMethodInfluentialZhou, T., Thung, K., Zhu, X., & Shen, D. (2019) · Human Brain Mapping · doi:10.1002/hbm.24428 · Cited by 269
“…& Strother, 2012), which provides us functional brain information, has also been widely used to investigate the neurophysiological characteristics of AD (Chetelat et al., 2003; Escudero, Ifeachor et al., 2013; Liu et al., 2015; Mosconi et al., 2008; Nordberg, Rinne, Kadir, & Långström, 2010).”
MethodGómez-Valverde, J. J., Antón, A., Fatti, G., Liefers, B., Herranz, A., Santos, A., Sánchez, C. I., & Ledesma-Carbayo, M. J. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.000892 · Cited by 265
Khosla, A., Khandnor, P., & Chand, T. (2020) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2020.02.002 · Cited by 267
Wang, H., Shen, Y., Wang, S., Xiao, T., Deng, L., Wang, X., & Zhao, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.12.018 · Cited by 257
“Liu et al. [24] trained a deep neural network contained auto-encoders to combine multimodal features which were extracted from 83 ROIs of PET and MRI scans.”
Liu, M., Cheng, D., Yan, W., & Initiative, A. D. N. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2018.00035 · Cited by 252
“Recently, deep learning methods can take the advantage of the data privilege to extract the latent features from measurements of ROIs with different image modalities for AD classification (Liu et al., 2015; Suk et al., 2015).”
BackgroundSurvey on Deep Neural Networks in Speech and Vision Systems
Alam, M., Samad, M. D., Vidyaratne, L., Glandon, A., & Iftekharuddin, K. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.053 · Cited by 252
RNN-based longitudinal analysis for diagnosis of Alzheimer’s disease
Cui, R., & Liu, M. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.01.005 · Cited by 243
High‐order resting‐state functional connectivity network for MCI classification
Chen, X., Zhang, H., Gao, Y., Wee, C., Li, G., Shen, D., & Initiative, T. A. D. N. (2016) · Human Brain Mapping · doi:10.1002/hbm.23240 · Cited by 242
“…algorithms include support vector machine (SVM) [Jie et al., 2014b; Zhang et al., 2011], Bayesian network [Seixas et al., 2014], multi-task and sparse learning [Huang et al., 2010; Suk et al., 2014a], deep neural networks [Li et al., 2015; Liu et al., 2015; Suk et al., 2013, 2014b], and so forth.”
MethodMulti-modal deep learning model for auxiliary diagnosis of Alzheimer’s disease
Zhang, F., Li, Z., Zhang, B., Du, H., Wang, B., & Zhang, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.093 · Cited by 230
Yamanakkanavar, N., Choi, J. Y., & Lee, B. (2020) · Sensors · doi:10.3390/s20113243 · Cited by 222
A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis
Zhang, L., Wang, M., Liu, M., & Zhang, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00779 · Cited by 220
“The SAE contained 3 hidden layers to reduce 315 dimension measurements to only 2 features [96].”
BackgroundZhang, J., Zheng, B., Gao, A., Feng, X., Liang, D., & Long, X. (2021) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2021.02.001 · Cited by 219
“Later they enhanced the algorithm by applying a zero-mask strategy for data fusion to extract complementary information from images [30].”
Technology and Dementia: The Future is Now
Astell, A. J., Bouranis, N., Hoey, J., Lindauer, A., Mihailidis, A., Nugent, C., Robillard, J. M., & ..., T. A. D. P. I. A. (2019) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000497800 · Cited by 213
Classification of Alzheimer's Disease Using Whole Brain Hierarchical Network
Liu, J., Li, M., Lan, W., Wu, F.-X., Pan, Y., & Wang, J. (2018) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2016.2635144 · Cited by 212
“ROIs based methods can be divided into two groups according to the number of ROI: single ROI methods [8], [13] and multiple ROIs methods [14], [15], [16], [17].”
MethodIslam, J., & Zhang, Y. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70772-3_20 · Cited by 197
“They have used SVM to classify the neuroimaging features obtained from MR/PET data [13].”
MethodHao, X., Bao, Y., Guo, Y., Yu, M., Zhang, D., Risacher, S. L., Saykin, A. J., Yao, X., & Shen, L. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101625 · Cited by 202
“For example, Liu et al. (Liu et al., 2016a; Liu et al., 2015a) used the hierarchical relationship between different template data to establish a structurally constrained integrated learning AD diagnostic prediction model.”
BackgroundInfluentialDuc, N. T., Ryu, S., Qureshi, M. N. I., Choi, M., Lee, K. H., & Lee, B. (2020) · Neuroinformatics · doi:10.1007/s12021-019-09419-w · Cited by 198
“Many papers have classified dementia, MCI, and healthy controls (Suk and Shen 2013; Liu et al. 2015; Suk et al. 2015).”
BackgroundAutomated MRI-Based Deep Learning Model for Detection of Alzheimer’s Disease Process
Feng, W., Halm-Lutterodt, N. V., Tang, H., Mecum, A., Mesregah, M. K., Ma, Y., Li, H., Zhang, F., Wu, Z., Yao, E., et al. (2020) · International Journal of Neural Systems · doi:10.1142/s012906572050032x · Cited by 187
Gao, X., Shi, F., Shen, D., & Liu, M. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3097721 · Cited by 173
Gala, D., Behl, H., Shah, M., & Makaryus, A. N. (2024) · Healthcare · doi:10.3390/healthcare12040481 · Cited by 183
“For example, the use of AI algorithms has been revolutionary in classifying and detecting diseases from MRI scans as demonstrated by a study conducted in 2018, which used AI to effectively diagnose Alzheimer’s disease from MRI images [31].”
Alzheimer's disease diagnosis based on multiple cluster dense convolutional networks
Li, F., & Liu, M. (2018) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2018.09.009 · Cited by 185
Deep Multimodal Subspace Clustering Networks
Abavisani, M., & Patel, V. M. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2875385 · Cited by 181
“Various deep supervised multimodal fusion approaches have also been proposed in the literature for different applications including medical image analysis applications [55], [56] visual recognition [40], [41] and visual question answering [43], [53].”
BackgroundAlSaeed, D., & Omar, S. F. (2022) · Sensors · doi:10.3390/s22082911 · Cited by 181
Deep Learning and Neurology: A Systematic Review
Valliani, A. A.-A., Ranti, D., & Oermann, E. K. (2019) · Neurology and Therapy · doi:10.1007/s40120-019-00153-8 · Cited by 179
An effective multimodal image fusion method using MRI and PET for Alzheimer’s disease diagnosis
Song, J., Zheng, J., Li, P., Lu, X., Zhu, G., & Shen, P. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.637386 · Cited by 178
Yadav, S. P., Zaidi, S., Mishra, A., & Yadav, V. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09647-x · Cited by 169
Automatic assessment of Alzheimer’s disease diagnosis based on deep learning techniques
Puente-Castro, A., Fernandez-Blanco, E., Pazos, A., & Munteanu, C. R. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103764 · Cited by 168
“Liu et al. [14] proposed the use, in their medical application, of autoencoders with Softmax output layers to avoid bottleneck during diagnostic support.”
BackgroundBae, J. B., Lee, S., Jung, W., Park, S., Kim, W., Oh, H., Han, J. W., Kim, G. E., Kim, J. S., Kim, J. H., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-79243-9 · Cited by 168
Hypergraph based multi-task feature selection for multimodal classification of Alzheimer's disease
Shao, W., Peng, Y., Zu, C., Wang, M., & Zhang, D. (2020) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.101663 · Cited by 165
Towards a brain‐based predictome of mental illness
Rashid, B., & Calhoun, V. (2020) · Human Brain Mapping · doi:10.1002/hbm.25013 · Cited by 167
“Summary for posttraumatic stress disorder (PTSD) and social anxiety disorder (SAD) were excluded due to very few publication number.”
BackgroundInfluentialShi, J., Zhou, S., Liu, X., Zhang, Q., Lu, M., & Wang, T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.074 · Cited by 166
A Survey on Multimodal Data-Driven Smart Healthcare Systems: Approaches and Applications
Cai, Q., Wang, H., Li, Z., & Liu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2941419 · Cited by 164
Loddo, A., Buttau, S., & Di Ruberto, C. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105032 · Cited by 163
Effect of data leakage in brain MRI classification using 2D convolutional neural networks
Yagis, E., Atnafu, S. W., García Seco de Herrera, A., Marzi, C., Scheda, R., Giannelli, M., Tessa, C., Citi, L., & Diciotti, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-01681-w · Cited by 161
“Other studies performed lesion detection and segmentation 11–13 and image-based diagnosis using different CNNs architectures 14,15 .”
MethodA Multimodal Approach for Identifying Autism Spectrum Disorders in Children
Han, J., Jiang, G., Ouyang, G., & Li, X. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3192431 · Cited by 175
Gupta, N. S., & Kumar, P. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107051 · Cited by 197
Ensembles of Patch-Based Classifiers for Diagnosis of Alzheimer Diseases
Ahmed, S., Choi, K. Y., Lee, J. J., Kim, B. C., Kwon, G.-R., Lee, K. H., & Jung, H. Y. (2019) · IEEE Access · doi:10.1109/access.2019.2920011 · Cited by 181
“AD is an irreversible, progressive neurobiological brain disorder and multifaceted disease of unknown etiology that slowly destroys brain cells, causes memory and thinking skill losses, and ultimately accelerates the loss of ability to carry out even the simplest tasks [2].”
BackgroundMethodResultInfluentialMultimodal neuroimaging computing: a review of the applications in neuropsychiatric disorders
Liu, S., Cai, W., Liu, S., Zhang, F., FULHAM, M., Feng, D., Pujol, S., & Kikinis, R. (2015) · Brain Informatics · doi:10.1007/s40708-015-0019-x · Cited by 160
Self-citationArtificial Intelligence for Alzheimer’s Disease: Promise or Challenge?
Fabrizio, C., Termine, A., Caltagirone, C., & Sancesario, G. M. (2021) · Diagnostics · doi:10.3390/diagnostics11081473 · Cited by 177
Multi-modality approaches for medical support systems: A systematic review of the last decade
Salvi, M., Loh, H. W., Seoni, S., Barua, P. D., García, S., Molinari, F., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102134 · Cited by 144
“Liu et al. [22] proposed a multimodal neuroimaging feature learning framework using stacked auto-encoders for diagnosing different stages of Alzheimer ’ s disease.”
BackgroundOhsugi, H., Tabuchi, H., Enno, H., & Ishitobi, N. (2017) · Scientific Reports · doi:10.1038/s41598-017-09891-x · Cited by 154
Tensorizing GAN With High-Order Pooling for Alzheimer’s Disease Assessment
Yu, W., Lei, B., Ng, M. K., Cheung, A. C., Shen, Y., & Wang, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3063516 · Cited by 144
“Early work for AD diagnosis using MR images primarily focused on traditional machine learning techniques [4], [5], which heavily relied on specific assumptions about brain structural abnormalities, such as regional cortical thickness, hippocampal volume, and gray matter volume.”
BackgroundMethodLama, R. K., Gwak, J., Park, J.-S., & Lee, S. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/5485080 · Cited by 151
“[29, 30] proposed deep learning-based multiclass classification among normal controls (NC), MCI nonconverters (ncMCI), MCI converters (cMCI), and AD subjects based on 83 ROIs of sMRI images and the corresponding registered PET images.”
BackgroundDeep learning-based selection of human sperm with high DNA integrity
McCallum, C., Riordon, J., Wang, Y., Kong, T. F., You, J. B., Sanner, S., Lagunov, A., Hannam, T., Jarvi, K. A., & Sinton, D. A. (2019) · Communications Biology · doi:10.1038/s42003-019-0491-6 · Cited by 150
Multi-modal data Alzheimer’s disease detection based on 3D convolution
Kong, Z., Zhang, M., Zhu, W., Yi, Y., Wang, T., & Zhang, B. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103565 · Cited by 148
Amoroso, N., Diacono, D., Fanizzi, A., Rocca, M. L., Monaco, A., Lombardi, A., Guaragnella, C., Bellotti, R., & Tangaro, S. (2017) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2017.12.011 · Cited by 152
Attention-Guided Hybrid Network for Dementia Diagnosis With Structural MR Images
Lian, C., Liu, M., Pan, Y., & Shen, D. G. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3005859 · Cited by 139
Machine learning studies on major brain diseases: 5-year trends of 2014–2018
Sakai, K., & Yamada, K. (2018) · Japanese Journal of Radiology · doi:10.1007/s11604-018-0794-4 · Cited by 143
Chen, X., Xie, H., Tao, X., Wang, F. L., Leng, M., & Lei, B. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10712-7 · Cited by 175
Early diagnosis of Alzheimer's disease based on deep learning: A systematic review
Fathi, S., Ahmadi, M., & Dehnad, A. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105634 · Cited by 136
A new deep belief network-based multi-task learning for diagnosis of Alzheimer’s disease
Zeng, N., Li, H., & Peng, Y. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06149-6 · Cited by 136
Early Diagnosis of Alzheimer's Disease Using Deep Learning
Ji, H., Liu, Z., Yan, W. Q., & Klette, R. (2019) · International Conference on Control and Computer Vision (ICCCV) · doi:10.1145/3341016.3341024 · Cited by 142
3D DenseNet Ensemble in 4-Way Classification of Alzheimer’s Disease
Ruiz, J., Mahmud, M., Modasshir, M., Kaiser, M. S., & Initiative, A. D. N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59277-6_8 · Cited by 110
Structured sparsity regularized multiple kernel learning for Alzheimer’s disease diagnosis
Peng, J., Zhu, X., Wang, Y., An, L., & Shen, D. G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.11.027 · Cited by 115
“However, this simple concatenation strategy has shown to be suboptimal to integrate heterogeneous modalities [10], as it tends to ignore relationships within and/or across modalities [9,28,35].”
BackgroundRelation-induced multi-modal shared representation learning for Alzheimer’s disease diagnosis
Ning, Z., Xiao, Q., Feng, Q., Chen, W., & Zhang, Y. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3063150 · Cited by 106
“Therefore, an interesting topic is to develop a robust and accurate model based on multi-modal neuroimages for early diagnosis of AD [6], [7].”
BackgroundGöçeri, E. (2019) · International Journal for Numerical Methods in Biomedical Engineering · doi:10.1002/cnm.3225 · Cited by 112
“In Liu et al, 18 recurrent and CNNs were combined to diagnose the disease using inter and intraslice features.”
MethodDeep and joint learning of longitudinal data for Alzheimer's disease prediction
Lei, B., Yang, M., Yang, P., Zhou, F., Wen, H., Zou, W., Li, X., Wang, T., Xiao, X., & Wang, S. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107247 · Cited by 125
Barua, A., Ahmed, M. U., & Begum, S. (2023) · IEEE Access · doi:10.1109/access.2023.3243854 · Cited by 152
“[106], [108], [110], [112], [113], [114], [115], [117], [120], [121], [122], [123], [128], [130], [134], [135], [137], [138], [139], [140], [141], [142], [143], [144], [145], [146], [147], [148], [150], [151], [153], [154], [156], [157], [159], [161], [170], [171], [172], [174], [176], [189], [192], [193], [194], [196…”
Classification of MR brain images by combination of multi-CNNs for AD diagnosis
Cheng, D., Liu, M., Fu, J., & Wang, Y. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2281808 · Cited by 109
“Liu et al.(3) extracted a set of latent features from 83 ROIs of the MRI and PET scans and trained a multi-layered neural network consisting of several auto-encoders to combine multimodal features for classification.”
BackgroundAlzheimer Disease Classification through Transfer Learning Approach
Raza, N., Naseer, A., Tamoor, M., & Zafar, K. (2023) · Diagnostics · doi:10.3390/diagnostics13040801 · Cited by 121
“In the paper [29] a framework with the combination of sparse auto-encoders (SAEs) and a softmax logistic regression was used, along with autoencoders, to use unlabeled data.”
MethodInformation fusion and artificial intelligence for smart healthcare: a bibliometric study
Chen, X., Xie, H., Li, Z., Cheng, G., Leng, M., & Wang, F. L. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103113 · Cited by 112
Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional NetworkPreprint
Hosseini-Asl, E., Gimel’farb, G., & El-Baz, A. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.00556 · Cited by 213
“…(BM) was used [23] to extract one feature from each selected patch of the MRI and PET scans and predict the AD with an ensemble of SVMs. Liu et al. [24] extracted 83 regions-of-interest (ROI) from the MRI and PET scans and used multimodal fusion to create a set of features to train stacked layers…”
MethodA Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer’s Disease using MRI Images
Fathi, S., Ahmadi, A., Dehnad, A., Almasi‐Dooghaee, M., Sadegh, M., & Initiative, A. D. N. (2023) · Neuroinformatics · doi:10.1007/s12021-023-09646-2 · Cited by 130
“DL approaches can extract high-level features, shown to be more efficient than other traditional approaches in a number of studies (Liu et al., 2015).”
BackgroundNonlinear feature transformation and deep fusion for Alzheimer's Disease staging analysis
Shi, B., Chen, Y., Zhang, P., Smith, C. D., & Liu, J. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.09.032 · Cited by 93
Lin, W.-M., Gao, Q., Du, M., Chen, W., & Tong, T. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104478 · Cited by 105
“For four-way classification, Liu et al. [22] designed a zero-masking deep learning architecture for fusion of MRI and PET features and achieved an accuracy of 53.8%.”
InfluentialReview on Alzheimer Disease Detection Methods: Automatic Pipelines and Machine Learning Techniques
Shukla, A., Tiwari, R., & Tiwari, S. (2023) · Sci · doi:10.3390/sci5010013 · Cited by 106
Multi-Modal Neuroimaging Feature Fusion for Diagnosis of Alzheimer’s Disease
Zhang, T., & Shi, M. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108795 · Cited by 91
Semi-Supervised Discriminative Classification Robust to Sample-Outliers and Feature-Noises
Adeli, E., Thung, K., An, L., Guorong Wu, A., Shi, F., Wang, T., & Shen, D. G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2794470 · Cited by 91
CNNs based multi-modality classification for AD diagnosis
Cheng, D., & Liu, M. (2017) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2017.8302281 · Cited by 94
“In recent years, various pattern recognition methods have been investigated in analyzing multi-modality neuroimages to identify those patterns related to AD and release the disease states for computer-aided-diagnosis (CAD) [2-8].”
BackgroundMethodIllimoottil, M., & Ginat, D. T. (2023) · Cancers · doi:10.3390/cancers15133267 · Cited by 110
“Diverse datasets, preprocessing techniques, model architectures, and training strategies have been used in different studies, making it difficult to compare the performance of various models and to assess their clinical utility [38].”
BackgroundMethodMatsuba, S., Tabuchi, H., Ohsugi, H., Enno, H., Ishitobi, N., Masumoto, H., & Kiuchi, Y. (2018) · International Ophthalmology · doi:10.1007/s10792-018-0940-0 · Cited by 98
Deep Learning-Based Segmentation in Classification of Alzheimer’s Disease
Buvaneswari, P. R., & Gayathri, R. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-020-05193-z · Cited by 108
Metadata
- Authors
- Liu, S., Liu, S., Cai, W., Che, H., Pujol, S., Kikinis, R., Feng, D., Fulham, M. J., & ADNI
- Affiliations
- Brigham and Women's Hospital (US)
- The University of Sydney (AU)
- ORCID
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2015-04
- Volume
- 62
- Issue
- 4
- Pages
- 1132-1140
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- PMC
- PMC4394860
- OpenAlex
- W2130371234
- Cited by
- 637
- References
- 76
- Citations by year
- 2026: 49 · 2025: 54 · 2024: 59 · 2023: 68 · 2022: 64 · 2021: 64 · 2020: 63 · 2019: 95 · 2018: 53 · 2017: 44 · 2016: 18 · 2015: 5
- FWCI
- 17.04
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- IEEE Transactions on Biomedical Engineering (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- The Sydney eScholarship Repository (The University of Sydney) (submittedVersion)
- Funders
- ARC
- AADRF
- NA-MIC (NIH U54EB005149)
- NAC (NIH P41EB015902)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Alzheimer's disease research and treatments
- Keywords
- Alzheimer's disease, computer-aided diagnosis, multimodal neuroimaging, representation learning, data fusion, neuroimaging biomarkers, multi-class classification, deep learning, early diagnosis
- MeSH terms
- Alzheimer Disease, Brain, Humans, Image Interpretation, Computer-Assisted, Neuroimaging, Support Vector Machine, Multimodal Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.