The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease
Open accessAbstract
Many machine learning and pattern classification methods have been applied to the diagnosis of Alzheimer’s disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Recently, rather than predicting categorical variables as in classification, several pattern regression methods have also been used to estimate continuous clinical variables from brain images. However, most existing regression methods focus on estimating multiple clinical variables separately and thus cannot utilize the intrinsic useful correlation information among different clinical variables. On the other hand, in those regression methods, only a single modality of data (usually only the structural MRI) is often used, without considering the complementary information that can be provided by different modalities. In this paper, we propose a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Here, the variables include not only the clinical variables used for regression but also the categorical variable used for classification, with different tasks corresponding to prediction of different variables. Specifically, our method contains two key components, i.e., (1) a multi-task feature selection which selects the common subset of relevant features for multiple variables from each modality, and (2) a multi-modal support vector machine which fuses the above-selected features from all modalities to predict multiple (regression and classification) variables. To validate our method, we perform two sets of experiments on ADNI baseline MRI, FDG-PET, and cerebrospinal fluid (CSF) data from 45 AD patients, 91 MCI patients, and 50 healthy controls (HC). In the first set of experiments, we estimate two clinical variables such as Mini Mental State Examination (MMSE) and Alzheimer’s Disease Assessment Scale - Cognitive Subscale (ADAS-Cog), as well as one categorical variable (with value of ‘AD’, ‘MCI’ or ‘HC’), from the baseline MRI, FDG-PET, and CSF data. In the second set of experiments, we predict the 2-year changes of MMSE and ADAS-Cog scores and also the conversion of MCI to AD from the baseline MRI, FDG-PET, and CSF data. The results on both sets of experiments demonstrate that our proposed M3T learning scheme can achieve better performance on both regression and classification tasks than the conventional learning methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122
Zhang, Y., Brady, M., & Smith, S. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 6,982
A nonparametric method for automatic correction of intensity nonuniformity in MRI data
Sled, J. G., Zijdenbos, A. P., & Evans, A. C. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.668698 · Cited by 4,731 · cited 2×
“First, we do anterior commissure (AC) - posterior commissure (PC) correction on all images, and use the N3 algorithm (Sled et al., 1998) to correct the intensity inhomogeneity.”
MethodA new rating scale for Alzheimer's disease
(1984) · American Journal of Psychiatry · doi:10.1176/ajp.141.11.1356 · Cited by 4,175
Forecasting the global burden of Alzheimer's disease
Brookmeyer, R., Johnson, E., Ziegler‐Graham, K., & Arrighi, H. M. (2007) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2007.04.381 · Cited by 3,370
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects
Shaw, L. M., Vanderstichele, H., Knapik‐Czajka, M., Clark, C. M., Aisen, P. S., Petersen, R. C., Blennow, K., Soares, H., Simon, A., Lewczuk, P., et al. (2009) · Annals of Neurology · doi:10.1002/ana.21610 · Cited by 2,065
Mild Cognitive Impairment Represents Early-Stage Alzheimer Disease
Morris, J. C., Storandt, M., Miller, J. P., McKeel, D. W., Price, J. L., Rubin, E. H., & Berg, L. (2001) · Archives of Neurology · doi:10.1001/archneur.58.3.397 · Cited by 1,851
Convex multi-task feature learning
Argyriou, A., Evgeniou, T., & Pontil, M. (2008) · Machine Learning · doi:10.1007/s10994-007-5040-8 · Cited by 1,528
Prediction of AD with MRI-based hippocampal volume in mild cognitive impairment
Jack, C. R., Petersen, R. C., Xu, Y. C., O’Brien, P. C., Smith, G. E., Ivnik, R. J., Boeve, B. F., Waring, S. C., Tangalos, E. G., & Kokmen, E. (1999) · Neurology · doi:10.1212/wnl.52.7.1397 · Cited by 1,404
Multimodal classification of Alzheimer's disease and mild cognitive impairment
Zhang, D., Wang, Y., Zhou, L., Yuan, H., & Shen, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.008 · Cited by 1,314
Self-citationCSF Biomarkers and Incipient Alzheimer Disease in Patients With Mild Cognitive Impairment
Mattsson, N. (2009) · JAMA · doi:10.1001/jama.2009.1064 · Cited by 1,176
HAMMER: hierarchical attribute matching mechanism for elastic registration
Shen, D., & Davatzikos, C. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.803111 · Cited by 1,083
Self-citationMagnetic Resonance Image Tissue Classification Using a Partial Volume Model
Shattuck, D. W., Sandor-Leahy, S. R., Schaper, K. A., Rottenberg, D. A., & Leahy, R. M. (2001) · NeuroImage · doi:10.1006/nimg.2000.0730 · Cited by 950
Franke, K., Ziegler, G., Klöppel, S., & Gaser, C. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.005 · Cited by 794
Comparing predictors of conversion and decline in mild cognitive impairment
Landau, S. M., Harvey, D., Madison, C. M., Reiman, E. M., Foster, N. L., Aisen, P. S., Petersen, R. C., Shaw, L. M., Trojanowski, J. Q., Jack, C. R., et al. (2010) · Neurology · doi:10.1212/wnl.0b013e3181e8e8b8 · Cited by 616
FDG-PET improves accuracy in distinguishing frontotemporal dementia and Alzheimer's disease
Foster, N. L., Heidebrink, J. L., Clark, C. M., Jagust, W. J., Arnold, S. E., Barbas, N. R., DeCarli, C. S., Scott Turner, R., Koeppe, R. A., Higdon, R., et al. (2007) · Brain · doi:10.1093/brain/awm177 · Cited by 608
SLEP: Sparse Learning with Efficient Projections
Liu, J., Ji, S., & Ye, J. (2011) · Cited by 585
Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification
Davatzikos, C., Bhatt, P., Shaw, L. M., Batmanghelich, K. N., & Trojanowski, J. Q. (2011) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.05.023 · Cited by 578
MISRA, C., FAN, Y., & DAVATZIKOS, C. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.031 · Cited by 552
Hippocampal formation glucose metabolism and volume losses in MCI and AD
De Santi, S., de Leon, M. J., Rusinek, H., Convit, A., Tarshish, C. Y., Roche, A., Tsui, W. H., Kandil, E., Boppana, M., Daisley, K., et al. (2001) · Neurobiology of Aging · doi:10.1016/s0197-4580(01)00230-5 · Cited by 548
Different regional patterns of cortical thinning in Alzheimer's disease and frontotemporal dementia
Du, A.-T., Schuff, N., Kramer, J. H., Rosen, H. J., Gorno-Tempini, M. L., Rankin, K., Miller, B. L., & Weiner, M. W. (2006) · Brain · doi:10.1093/brain/awm016 · Cited by 482
Imaging cerebral atrophy: normal ageing to Alzheimer's disease
Fox, N. C., & Schott, J. M. (2004) · The Lancet · doi:10.1016/s0140-6736(04)15441-x · Cited by 436
Mapping gray matter loss with voxel-based morphometry in mild cognitive impairment
Ch??telat, G., Desgranges, B., de la Sayette, V., Viader, F., Eustache, F., & Baron, J.-C. (2002) · NeuroReport · doi:10.1097/00001756-200210280-00022 · Cited by 410
Hinrichs, C., Singh, V., Xu, G., & Johnson, S. C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.081 · Cited by 405
MRI and CSF biomarkers in normal, MCI, and AD subjects: Predicting future clinical change
Vemuri, P., Wiste, H. J., Weigand, S. D., Shaw, L. M., Trojanowski, J. Q., Weiner, M. W., Knopman, D. S., Petersen, R. C., & Jack, C. R. (2009) · Neurology · doi:10.1212/wnl.0b013e3181af79fb · Cited by 396
Convit, A., de Asis, J., de Leon, M. J., Tarshish, C. Y., De Santi, S., & Rusinek, H. (2000) · Neurobiology of Aging · doi:10.1016/s0197-4580(99)00107-4 · Cited by 359
Visser, P. J., Verhey, F. R. J., Hofman, P. A. M., Scheltens, P., & Jolles, J. (2002) · PubMed · doi:10.1136/jnnp.72.4.491 · Cited by 353
McEvoy, L. K., Fennema-Notestine, C., Roddey, J. C., Hagler, D. J., Holland, D., Karow, D. S., Pung, C. J., Brewer, J. B., & Dale, A. M. (2009) · Radiology · doi:10.1148/radiol.2511080924 · Cited by 330
Fan, Y., Resnick, S. M., Wu, X., & Davatzikos, C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.043 · Cited by 288
Walhovd, K. B., Fjell, A. M., Brewer, J., McEvoy, L. K., Fennema-Notestine, C., Hagler, D. J., Jennings, R. G., Karow, D., Dale, A. M., & Initiative, T. A. D. N. (2010) · American Journal of Neuroradiology · doi:10.3174/ajnr.a1809 · Cited by 279
Predicting clinical scores from magnetic resonance scans in Alzheimer's disease
Stonnington, C. M., Chu, C., Klöppel, S., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.051 · Cited by 257
Fjell, A. M., Walhovd, K. B., Fennema-Notestine, C., McEvoy, L. K., Hagler, D. J., Holland, D., Brewer, J. B., Dale, A. M., & Initiative, F. T. A. D. N. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3785-09.2010 · Cited by 208
Wang, Y., Fan, Y., Bhatt, P., & Davatzikos, C. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.092 · Cited by 180
CSF biomarkers and medial temporal lobe atrophy predict dementia in mild cognitive impairment
Bouwman, F. H., Schoonenboom, S. N. M., van der Flier, W. M., van Elk, E. J., Kok, A., Barkhof, F., Blankenstein, M. A., & Scheltens, P. (2007) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2006.05.006 · Cited by 177
chételat, G., Eustache, F., Viader, F., Sayette, V. D. L., Pélerin, A., Mézenge, F., Hannequin, D., Dupuy, B., Baron, J.-C., & Desgranges, B. (2005) · Neurocase · doi:10.1080/13554790490896938 · Cited by 167
3D Anatomical Atlas of the Human Brain
Kabani, N. J., MacDonald, D. J., Holmes, C. J., & Evans, A. C. (1998) · NeuroImage · doi:10.1016/s1053-8119(18)31550-7 · Cited by 167
Multi-modal imaging predicts memory performance in normal aging and cognitive decline
Walhovd, K. B., Fjell, A. M., Dale, A. M., McEvoy, L. K., Brewer, J., Karow, D. S., Salmon, D. P., & Fennema-Notestine, C. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2008.08.013 · Cited by 158
3D PIB and CSF biomarker associations with hippocampal atrophy in ADNI subjects
Apostolova, L. G., Hwang, K., Andrawis, J. P., Green, A. E., Babakchanian, S., Morra, J. H., Cummings, J. L., Toga, A. W., Trojanowski, J. Q., Shaw, L. M. J., et al. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.05.003 · Cited by 150
Longitudinal changes of CSF biomarkers in memory clinic patients
Bouwman, F. H., van der Flier, W. M., Schoonenboom, N. S. M., van Elk, E. J., Kok, A., Rijmen, F., Blankenstein, M. A., & Scheltens, P. (2007) · Neurology · doi:10.1212/01.wnl.0000271375.37131.04 · Cited by 126
Relating one-year cognitive change in mild cognitive impairment to baseline MRI features
Duchesne, S., Caroli, A., Geroldi, C., Collins, D. L., & Frisoni, G. B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.023 · Cited by 116
Geroldi, C., Rossi, R., Calvagna, C., Testa, C., Bresciani, L., Binetti, G. G., Zanetti, O. O., & Frisoni, G. B. (2006) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.2005.082651 · Cited by 108
An Improved Multi-task Learning Approach with Applications in Medical Diagnosis
Bi, J., Xiong, T., Yu, S., Dündar, M., & Rao, R. B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87479-9_26 · Cited by 107
Longitudinal CSF isoprostane and MRI atrophy in the progression to AD
de Leon, M. J., Mosconi, L., Li, J., Santi, S. D., Yao, Y., Tsui, W.-H., Pirraglia, E., Rich, K. E., Javier, E., Bryś, M., et al. (2007) · Journal of Neurology · doi:10.1007/s00415-007-0610-z · Cited by 87
Heterogeneous multitask learning with joint sparsity constraints
Yang, X., Kim, S. Y., & Xing, E. P. (2009) · Cited by 76
FDG-PET and CSF phospho-tau for prediction of cognitive decline in mild cognitive impairment
Fellgiebel, A., Scheurich, A., Bartenstein, P., & Müller, M. J. (2007) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2006.12.002 · Cited by 63
Predicting Clinical Variable from MRI Features: Application to MMSE in MCI
Duchesne, S., Caroli, A., Geroldi, C., Frisoni, G. B., & Collins, D. L. (2005) · Lecture notes in computer science · doi:10.1007/11566465_49 · Cited by 35
Leung, K. K., Shen, K., Barnes, J., Ridgway, G. R., Clarkson, M. J., Fripp, J., Salvado, O., Mériaudeau, F., Fox, N. C., Bourgeat, P., et al. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15745-5_16 · Cited by 24
Joint estimation of multiple clinical variables of neurological diseases from imaging patterns
Fan, Y., Kaufer, D., & Shen, D. G. (2010) · IEEE International Symposium on Biomedical Imaging: From Nano to Macro (ISBI) · doi:10.1109/isbi.2010.5490120 · Cited by 22
Self-citation
Cited by
Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G., & Mechelli, A. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.004 · Cited by 1,012
The Alzheimer's Disease Neuroimaging Initiative: A review of papers published since its inception
Weiner, M. W., Veitch, D. P., Aisen, P. S., Beckett, L. A., Cairns, N. J., Green, R. C., Harvey, D., Jack, C. R., Jagust, W., Liu, E., et al. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2013.05.1769 · Cited by 1,010
Hierarchical Feature Representation and Multimodal Fusion with Deep Learning for AD/MCI Diagnosis
Suk, H.-I., Lee, S.-W., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.077 · Cited by 968
“…unlike the previous approaches (Hinrichs et al., 2011; Kohannim et al., 2010; Liu et al., 2012, 2013; Walhovd et al., 2010; Westman et al., 2012; Zhang and Shen, 2012; Zhang et al., 2011) that considered simple low-level features, which are often vulnerable to noises, we propose to consider…”
InfluentialSelf-citationSingle subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912
Zhang, F., & O'Donnell, L. J. (2020) · Machine Learning · doi:10.1016/b978-0-12-815739-8.00007-9 · Cited by 737
Metadata
- Authors
- Zhang, D., & Shen, D.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2012-01
- Volume
- 59
- Issue
- 2
- Pages
- 895-907
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2000292092
- Cited by
- 689
- References
- 57
- FWCI
- 15.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.