The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
A review of multivariate methods for multimodal fusion of brain imaging data
Open accessAbstract
The development of various neuroimaging techniques is rapidly improving the measurements of brain function/structure. However, despite improvements in individual modalities, it is becoming increasingly clear that the most effective research approaches will utilize multi-modal fusion, which takes advantage of the fact that each modality provides a limited view of the brain. The goal of multimodal fusion is to capitalize on the strength of each modality in a joint analysis, rather than a separate analysis of each. This is a more complicated endeavor that must be approached more carefully and efficient methods should be developed to draw generalized and valid conclusions from high dimensional data with a limited number of subjects. Numerous research efforts have been reported in the field based on various statistical approaches, e.g. independent component analysis (ICA), canonical correlation analysis (CCA) and partial least squares (PLS). In this review paper, we survey a number of multivariate methods appearing in previous reports, which are performed with or without prior information and may have utility for identifying potential brain illness biomarkers. We also discuss the possible strengths and limitations of each method, and review their applications to brain imaging data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis: algorithms and applications
Hyvärinen, A., & Oja, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,705
Correspondence of the brain's functional architecture during activation and rest
Smith, S. M., Fox, P. T., Miller, K. L., Glahn, D. C., Fox, P. M., Mackay, C. E., Filippini, N., Watkins, K. E., Toro, R., Laird, A. R., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905267106 · Cited by 5,150
Selection of relevant features and examples in machine learning
Blum, A. L., & Langley, P. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,298
A review of MRI findings in schizophrenia
Shenton, M. E., Dickey, C. C., Frumin, M., & McCarley, R. W. (2001) · Schizophrenia Research · doi:10.1016/s0920-9964(01)00163-3 · Cited by 2,346
Partial Least Squares (PLS) methods for neuroimaging: A tutorial and review
Krishnan, A., Williams, L. J., McIntosh, A. R., & Abdi, H. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.034 · Cited by 1,349
A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data
Calhoun, V. D., Liu, J., & Adalı, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.057 · Cited by 1,145
Self-citationAberrant “Default Mode” Functional Connectivity in Schizophrenia
Garrity, A. G., Pearlson, G. D., McKiernan, K., Lloyd, D., Kiehl, K. A., & Calhoun, V. D. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.3.450 · Cited by 1,114
Self-citationPartial least squares analysis of neuroimaging data: applications and advances
McIntosh, A. R., & Lobaugh, N. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.020 · Cited by 1,099
Tensorial extensions of independent component analysis for multisubject FMRI analysis
Beckmann, C. F., & Smith, S. M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.043 · Cited by 761
Research works printed but not linked: 1
- Worsley, 1998, Applications of random field theory to functional connectivity, Hum Brain Mapp, 6, 364, 10.1002/(SICI)1097-0193(1998)6:5/6<364::AID-HBM6>3.0.CO;2-T · doi:10.1002/(sici)1097-0193(1998)6:5/6<364::aid-hbm6>3.0.co;2-t
Cited by
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
“astrophysics [59], biomedics [60], telecommunications [61], audio-vision [23], chemometrics [62], and more.”
BackgroundMethodA survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821
Deep learning for neuroimaging: a validation study
Plis, S. M., Hjelm, D. R., Salakhutdinov, R., Allen, E. A., Bockholt, H. J., Long, J. D., Johnson, H. J., Paulsen, J. S., Turner, J. A., & Calhoun, V. D. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00229 · Cited by 586
Self-citationA Review of Feature Reduction Techniques in Neuroimaging
Mwangi, B., Tian, T. S., & Soares, J. C. (2014) · Neuroinformatics · doi:10.1007/s12021-013-9204-3 · Cited by 559
Calhoun, V. D., & Adali, T. (2012) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2012.2211076 · Cited by 543
Self-citationCalhoun, V. D., & Sui, J. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2015.12.005 · Cited by 461
Self-citationAdvances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation
Zhang, Y.-D., Dong, Z., Wang, S.-H., Yu, X., Yao, X., Zhou, Q., Hu, H., Li, M., Jiménez-Mesa, C., Ramirez, J., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.006 · Cited by 453
Tensor decomposition of EEG signals: A brief review
Cong, F., Lin, Q.-H., Kuang, L.-D., Gong, X.-F., Astikainen, P., & Ristaniemi, T. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.03.018 · Cited by 334
Sui, J., Jiang, R., Bustillo, J., & Calhoun, V. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.016 · Cited by 309
Self-citationMethods for Simultaneous EEG-fMRI: An Introductory Review
Huster, R. J., Debener, S., Eichele, T., & Herrmann, C. S. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0447-12.2012 · Cited by 308
Deep neural networks in psychiatry
Durstewitz, D., Koppe, G., & Meyer-Lindenberg, A. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0365-9 · Cited by 278
White matter development and early cognition in babies and toddlers
O'Muircheartaigh, J., Dean, D. C., Ginestet, C. E., Walker, L., Waskiewicz, N., Lehman, K., Dirks, H., Piryatinsky, I., & Deoni, S. C. L. (2014) · Human Brain Mapping · doi:10.1002/hbm.22488 · Cited by 183
Sui, J., Huster, R., Yu, Q., Segall, J. M., & Calhoun, V. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.044 · Cited by 162
Self-citationQi, S., Calhoun, V. D., van Erp, T. G. M., Bustillo, J., Damaraju, E., Turner, J. A., Du, Y., Yang, J., Chen, J., Yu, Q., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2725306 · Cited by 99
Self-citationA systematic review of intermediate fusion in multimodal deep learning for biomedical applications
Guarrasi, V., Aksu, F., Caruso, C. M., Di Feola, F., Rofena, A., Ruffini, F., & Soda, P. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105509 · Cited by 95
Hirjak, D., Meyer-Lindenberg, A., Fritze, S., Sambataro, F., Kubera, K. M., & Wolf, R. C. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.09.009 · Cited by 60
Mash, L. E., Reiter, M. A., Linke, A. C., Townsend, J., & Müller, R. (2018) · Developmental Neurobiology · doi:10.1002/dneu.22570 · Cited by 52
Adverse childhood experiences and fronto-subcortical structures in the developing brain
Buimer, E. E. L., Brouwer, R. M., Mandl, R. C. W., Pas, P., Schnack, H. G., & Hulshoff Pol, H. E. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.955871 · Cited by 29
Liang, C., Silva, R. F., Adali, T., Jiang, R., Zhang, D., Qi, S., & Calhoun, V. D. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3597045 · Cited by 3
“Increasing work has focused on combining functional and structural neuroimaging data to capture information hidden from a unimodal analysis [3], [4], [5].”
Self-citationFerariu, A., Chang, H., Kumar, A., Sahl, A., Gorka, S., Wang, L., Thompson, W. K., & Zhang, F. (2025) · doi:10.1101/2025.03.12.25323356 · Cited by 3
Ferariu, A., Chang, H., Kumar, A., Sahl, A., Gorka, S., Wang, L., Thompson, W. K., & Zhang, F. (2025) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2025.101597 · Cited by 3
Metadata
- Authors
- Sui, J., Adali, T., Yu, Q., Chen, J., & Calhoun, V. D.
- Venue
- Journal of Neuroscience Methods
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 204
- Issue
- 1
- Pages
- 68-81
- ISSN
- 0165-0270 (ISSN-L)
- OpenAlex
- W2065131965
- Cited by
- 401
- References
- 75
- FWCI
- 6.63
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- National Institutes of Health (R01EB 006841, R01EB 005846)
- National Sciences Foundation (1017718, 1016619)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.