The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease
Open accessAbstract
Many machine learning and pattern classification methods have been applied to the diagnosis of Alzheimer’s disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Recently, rather than predicting categorical variables as in classification, several pattern regression methods have also been used to estimate continuous clinical variables from brain images. However, most existing regression methods focus on estimating multiple clinical variables separately and thus cannot utilize the intrinsic useful correlation information among different clinical variables. On the other hand, in those regression methods, only a single modality of data (usually only the structural MRI) is often used, without considering the complementary information that can be provided by different modalities. In this paper, we propose a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Here, the variables include not only the clinical variables used for regression but also the categorical variable used for classification, with different tasks corresponding to prediction of different variables. Specifically, our method contains two key components, i.e., (1) a multi-task feature selection which selects the common subset of relevant features for multiple variables from each modality, and (2) a multi-modal support vector machine which fuses the above-selected features from all modalities to predict multiple (regression and classification) variables. To validate our method, we perform two sets of experiments on ADNI baseline MRI, FDG-PET, and cerebrospinal fluid (CSF) data from 45 AD patients, 91 MCI patients, and 50 healthy controls (HC). In the first set of experiments, we estimate two clinical variables such as Mini Mental State Examination (MMSE) and Alzheimer’s Disease Assessment Scale - Cognitive Subscale (ADAS-Cog), as well as one categorical variable (with value of ‘AD’, ‘MCI’ or ‘HC’), from the baseline MRI, FDG-PET, and CSF data. In the second set of experiments, we predict the 2-year changes of MMSE and ADAS-Cog scores and also the conversion of MCI to AD from the baseline MRI, FDG-PET, and CSF data. The results on both sets of experiments demonstrate that our proposed M3T learning scheme can achieve better performance on both regression and classification tasks than the conventional learning methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122
Zhang, Y., Brady, M., & Smith, S. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 6,982
Cited by
Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G., & Mechelli, A. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.004 · Cited by 1,012
The Alzheimer's Disease Neuroimaging Initiative: A review of papers published since its inception
Weiner, M. W., Veitch, D. P., Aisen, P. S., Beckett, L. A., Cairns, N. J., Green, R. C., Harvey, D., Jack, C. R., Jagust, W., Liu, E., et al. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2013.05.1769 · Cited by 1,010
Hierarchical Feature Representation and Multimodal Fusion with Deep Learning for AD/MCI Diagnosis
Suk, H.-I., Lee, S.-W., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.077 · Cited by 968
“…unlike the previous approaches (Hinrichs et al., 2011; Kohannim et al., 2010; Liu et al., 2012, 2013; Walhovd et al., 2010; Westman et al., 2012; Zhang and Shen, 2012; Zhang et al., 2011) that considered simple low-level features, which are often vulnerable to noises, we propose to consider…”
InfluentialSelf-citationSingle subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Zhang, F., & O'Donnell, L. J. (2020) · Machine Learning · doi:10.1016/b978-0-12-815739-8.00007-9 · Cited by 737
Rathore, S., Habes, M., Iftikhar, M. A., Shacklett, A., & Davatzikos, C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.057 · Cited by 622
Wefel, J. S., Kesler, S. R., Noll, K. R., & Schagen, S. B. (2015) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21258 · Cited by 532
Latent feature representation with stacked auto-encoder for AD/MCI diagnosis
Initiative, T. A. D. N., Suk, H.-I., Lee, S.-W., & Shen, D. (2015) · Brain Structure and Function · doi:10.1007/s00429-013-0687-3 · Cited by 526
Self-citationIslam, J., & Zhang, Y. (2018) · Brain Informatics · doi:10.1186/s40708-018-0080-3 · Cited by 478
Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation
Zhang, Y.-D., Dong, Z., Wang, S.-H., Yu, X., Yao, X., Zhou, Q., Hu, H., Li, M., Jiménez-Mesa, C., Ramirez, J., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.006 · Cited by 453
Deep Learning-Based Feature Representation for AD/MCI Classification
Suk, H.-I., & Shen, D. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_72 · Cited by 439
Self-citationPredicting alzheimer’s disease progression using multi-modal deep learning approach
Lee, G., Nho, K., Kang, B., Sohn, K.-A., Kim, D., Initiative, F. A. D. N., Weiner, M. W., Aisen, P., Petersen, R., Jack, C. R., et al. (2019) · Scientific Reports · doi:10.1038/s41598-018-37769-z · Cited by 406
Jiang, Y.-G., Wu, Z., Wang, J., Xue, X., & Chang, S.-F. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2670560 · Cited by 381
Lu, D., Popuri, K., Ding, G. W., Balachandar, R., Beg, M. F., Initiative, A. D. N., Weiner, M., Aisen, P., Petersen, R., Jack, C., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-22871-z · Cited by 376
A Survey on ensemble learning under the era of deep learning
Yang, Y., Lv, H., & Chen, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10283-5 · Cited by 369
El-Sappagh, S., Alonso, J. M., Islam, S. M. R., Sultan, A. M., & Kwak, K. S. (2021) · Scientific Reports · doi:10.1038/s41598-021-82098-3 · Cited by 363
Weiner, M. W., Veitch, D. P., Aisen, P. S., Beckett, L. A., Cairns, N. J., Cedarbaum, J., Green, R. C., Harvey, D., Jack, C. R., Jagust, W., et al. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.11.001 · Cited by 348
Deep ensemble learning of sparse regression models for brain disease diagnosis
Suk, H.-I., Lee, S.-W., & Shen, D. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.01.008 · Cited by 338
Self-citationSui, J., Jiang, R., Bustillo, J., & Calhoun, V. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.016 · Cited by 309
Liu, M., Zhang, J., Adeli, E., & Shen, D. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2869989 · Cited by 308
Self-citationGrueso, S., & Viejo-Sobera, R. (2021) · Alzheimer's Research & Therapy · doi:10.1186/s13195-021-00900-w · Cited by 303
A new switching-delayed-PSO-based optimized SVM algorithm for diagnosis of Alzheimer’s disease
Zeng, N., Qiu, H., Wang, Z., Liu, W., Zhang, H., & Li, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.001 · Cited by 303
Predicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers
Zhang, D., Shen, D., & Initiative, A. D. N. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033182 · Cited by 292
Self-citationWolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290
Deep Learning Framework for Alzheimer’s Disease Diagnosis via 3D-CNN and FSBi-LSTM
Feng, C., Elazab, A., Yang, P., Wang, T., Zhou, F., Hu, H., Xiao, X., & Lei, B. (2019) · IEEE Access · doi:10.1109/access.2019.2913847 · Cited by 286
Dual attention multi-instance deep learning for Alzheimer’s disease diagnosis with structural MRI
Zhu, W., Sun, L., Huang, J., Han, L., & Zhang, D. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3077079 · Cited by 278
Self-citationZhou, T., Thung, K., Zhu, X., & Shen, D. (2019) · Human Brain Mapping · doi:10.1002/hbm.24428 · Cited by 269
Self-citationA brief review on multi-task learning
Thung, K.-H., & Wee, C.-Y. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6463-x · Cited by 263
Multi-modal classification of Alzheimer's disease using nonlinear graph fusion
Tong, T., Gray, K., Gao, Q., Chen, L., & Rueckert, D. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.10.009 · Cited by 258
Zhu, X., Suk, H.-I., Wang, L., Lee, S.-W., & Shen, D. (2017) · Medical Image Analysis · doi:10.1016/j.media.2015.10.008 · Cited by 224
Self-citationLombardi, G., Crescioli, G., Cavedo, E., Lucenteforte, E., Casazza, G., Bellatorre, A.-G., Lista, C., Costantino, G., Frisoni, G., Virgili, G., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009628.pub2 · Cited by 214
Zhu, X., Suk, H.-I., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.078 · Cited by 202
“10, we can see that (1) both S -graph and V -graph based methods showed better performances in regression and classi fi cation than M3T.”
InfluentialSelf-citationEarly Alzheimer’s disease diagnosis based on EEG spectral images using deep learning
Bi, X., & Wang, H. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.02.005 · Cited by 169
Functional magnetic resonance imaging, deep learning, and Alzheimer's disease: A systematic review
Warren, S. L., & Moustafa, A. A. (2023) · Journal of Neuroimaging · doi:10.1111/jon.13063 · Cited by 161
Multi-modality approaches for medical support systems: A systematic review of the last decade
Salvi, M., Loh, H. W., Seoni, S., Barua, P. D., García, S., Molinari, F., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102134 · Cited by 144
Explainable AI-based Alzheimer’s prediction and management using multimodal data
Jahan, S., Abu Taher, K., Kaiser, M. S., Mahmud, M., Rahman, M. S., Hosen, A. S. M. S., & Ra, I.-H. (2023) · PLOS ONE · doi:10.1371/journal.pone.0294253 · Cited by 122
Multi-scale enhanced graph convolutional network for mild cognitive impairment detection
Lei, B., Zhu, Y., Yu, S., Hu, H., Xu, Y., Yue, G., Wang, T., Zhao, C., Chen, S., Yang, P., et al. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2022.109106 · Cited by 96
Popuri, K., Ma, D., Wang, L., & Beg, M. F. (2020) · Human Brain Mapping · doi:10.1002/hbm.25115 · Cited by 96
Initiative, T. A. D. N., Zu, C., Jie, B., Liu, M., Chen, S., Shen, D., & Zhang, D. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9480-7 · Cited by 95
Self-citationThung, K.-H., Yap, P.-T., Adeli, E., Lee, S.-W., & Shen, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.002 · Cited by 89
Self-citationAdvancing Alzheimer’s research: a review of big data promises
Zhang, R., Simon, G., & Yu, F. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.07.002 · Cited by 77
Cheplygina, V., de Bruijne, M., & Pluim, J. P. W. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.03.009 · Cited by 93
Raza, M. L., Hassan, S. T., Jamil, S., Hyder, N., Batool, K., Walji, S., & Abbas, M. K. (2025) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2025.1557177 · Cited by 74
Blanco, K., Salcidua, S., Orellana, P., Sauma-Pérez, T., León, T., Steinmetz, L. C. L., Ibañez, A., Duran-Aniotz, C., & de la Cruz, R. (2023) · Alzheimer's Research & Therapy · doi:10.1186/s13195-023-01304-8 · Cited by 73
Bayesian multi-task learning for decoding multi-subject neuroimaging data
Marquand, A. F., Brammer, M., Williams, S. C. R., & Doyle, O. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.02.008 · Cited by 59
Huang, M., Yang, W., Feng, Q., Chen, W., Initiative, T. A. D. N., Weiner, M. W., Aisen, P., Petersen, R., Jack, C. R., Jagust, W., et al. (2017) · Scientific Reports · doi:10.1038/srep39880 · Cited by 55
Algorithmic fairness of machine learning models for Alzheimer disease progression
Yuan, C., Linn, K. A., & Hubbard, R. A. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.42203 · Cited by 49
Zhang, S., & Li, C.-S. R. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00172 · Cited by 37
Predicting Conversion from MCI to AD Combining Multi-Modality Data and Based on Molecular Subtype
Li, H.-T., Yuan, S.-X., Wu, J.-S., Gu, Y., & Sun, X. (2021) · Brain Sciences · doi:10.3390/brainsci11060674 · Cited by 27
Donini, M., Monteiro, J. M., Pontil, M., Hahn, T., Fallgatter, A. J., Shawe-Taylor, J., & Mourão-Miranda, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.01.053 · Cited by 19
Multimodal continuous affect recognition based on LSTM and multiple kernel learning
Wei, J., Pei, E., Jiang, D., Sahli, H., Xie, L., & Fu, Z. (2014) · Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific · doi:10.1109/apsipa.2014.7041743 · Cited by 17
Feature Learning Using Stacked Autoencoder for Shared and Multimodal Fusion of Medical Images
Singh, V., Verma, N. K., Ul Islam, Z., & Cui, Y. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-13-1132-1_5 · Cited by 13
Using machine intelligence to uncover Alzheimer’s disease progression heterogeneity
Qorri, B., Tsay, M., Agrawal, A., Au, R., & Gracie, J. (2020) · Exploration of Medicine · doi:10.37349/emed.2020.00026 · Cited by 13
Tiwari, V. K., Indic, P., & Tabassum, S. (2024) · American Journal of Alzheimer's Disease & Other Dementias® · doi:10.1177/15333175241308645 · Cited by 8
Full Bayesian multi-task learning for multi-output brain decoding and accommodating missing data
Marquand, A. F., Williams, S. C. R., Doyle, O. M., & Rosa, M. J. (2014) · 2014 International Workshop on Pattern Recognition in Neuroimaging · doi:10.1109/prni.2014.6858533 · Cited by 4
Metadata
- Authors
- Zhang, D., & Shen, D.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2012-01
- Volume
- 59
- Issue
- 2
- Pages
- 895-907
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2000292092
- Cited by
- 689
- References
- 57
- FWCI
- 15.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.