Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer’s Disease Diagnosis: Enhancing Data Integration and Feature Extraction
Open accessThe DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Multimodal neuroimaging has gained traction in Alzheimer’s Disease (AD) diagnosis by integrating information from multiple imaging modalities to enhance classification accuracy. However, effectively handling heterogeneous data sources and overcoming the challenges posed by multiscale transform methods remains a significant hurdle. This article proposes a novel approach to address these challenges. To harness the power of diverse neuroimaging data, we employ a strategy that leverages optimized convolution techniques. These optimizations include varying kernel sizes and the incorporation of instance normalization, both of which play crucial roles in feature extraction from magnetic resonance imaging (MRI) and positron emission tomography (PET) images. Specifically, varying kernel sizes allow us to adapt the receptive field to different image characteristics, enhancing the model’s ability to capture relevant information. Furthermore, we employ transposed convolution, which increases spatial resolution of feature maps, and it is optimized with varying kernel sizes and instance normalization. This heightened resolution facilitates the alignment and integration of data from disparate MRI and PET data. The use of larger kernels and strides in transposed convolution expands the receptive field, enabling the model to capture essential cross-modal relationships. Instance normalization, applied to each modality during the fusion process, mitigates potential biases stemming from differences in intensity, contrast, or scale between modalities. This enhancement contributes to improved model performance by reducing complexity and ensuring robust fusion. The performance of the proposed fusion method is assessed on three distinct neuroimaging datasets, which include: Alzheimer’s Disease Neuroimaging Initiative (ADNI), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD, and Early Mild Cognitive); Open Access Series of Imaging Studies (OASIS), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, Mild Dementia, Very Mild Dementia); and whole-brain atlas neuroimaging (AANLIB) (consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD). To evaluate the quality of the fused images generated via our method, we employ a comprehensive set of evaluation metrics, including Structural Similarity Index Measurement (SSIM), which assesses the structural similarity between two images; Peak Signal-to-Noise Ratio (PSNR), which measures how closely the generated image resembles the ground truth; Entropy (E), which assesses the amount of information preserved or lost during fusion; the Feature Similarity Indexing Method (FSIM), which assesses the structural and feature similarities between two images; and Edge-Based Similarity (EBS), which measures the similarity of edges between the fused and ground truth images. The obtained fused image is further evaluated using a Mobile Vision Transformer. In the classification of AD vs. Cognitive Normal, the model achieved an accuracy of 99.00%, specificity of 99.00%, and sensitivity of 98.44% on the AANLIB dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Multimodal fusion strategies (which are categorized based on integration timing into early, late, and intermediate fusion) enhance the diagnostic and prognostic robustness in individuals with cognitive disorders by integrating complementary pathological information”
From Multimodal neuroimaging and AI integration in cognitive disorders: advances, challenges, and future directions for precision medicine (2026) · cites this paper as Odusami et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595 · cited 1×
“Vision transformers have garnered significant attention in the field of computer vision due to their remarkable performance in image classification tasks, demonstrating their ability to capture long-range dependencies within images [26].”
BackgroundTransformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Li, X., Wang, W., Hu, X., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00060 · Cited by 3,134 · cited 1×
“By varying the kernel size, the convolution operation can adapt to different spatial scales present in the input image [37,38].”
BackgroundDiagnosis and Management of Dementia: Review
Arvanitakis, Z., Shah, R. C., & Bennett, D. A. (2019) · JAMA · doi:10.1001/jama.2019.4782 · Cited by 1,403 · cited 2×
“It is anticipated that this will increase to 78 million by 2030 and rise to 139 million by 2050 [1].”
BackgroundMobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
Mehta, S., & Rastegari, M. (2021) · arXiv · doi:10.48550/arxiv.2110.02178 · Cited by 1,110 · cited 2×
“Simple ViT models trained faster and better than the original [27]; the performance of ViTs saturated faster when scaled to be deeper and improved image classification accuracy [28], and Mobile ViT allowed for light-weight global processing of information with transformers [29].”
BackgroundMethodHINet: Half Instance Normalization Network for Image Restoration
Chen, L., Lu, X., Zhang, J., Chu, X., & Chen, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00027 · Cited by 647 · cited 1×
“Instance normalization without learnable parameters is a variant of instance normalization, in which the scaling and shifting factors are not learned but are instead fixed and applied in a predetermined manner [40,41].”
BackgroundCrop yield prediction with deep convolutional neural networks
Nevavuori, P., Narra, N., & Lipping, T. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.104859 · Cited by 586 · cited 1×
“By varying the kernel size, the convolution operation can adapt to different spatial scales present in the input image [37,38].”
BackgroundDeepViT: Towards Deeper Vision Transformer
Zhou, D., Kang, B., Jin, X., Yang, L., Lian, X., Jiang, Z., Hou, Q., & Feng, J. (2021) · arXiv · doi:10.48550/arxiv.2103.11886 · Cited by 398 · cited 1×
“Simple ViT models trained faster and better than the original [27]; the performance of ViTs saturated faster when scaled to be deeper and improved image classification accuracy [28], and Mobile ViT allowed for light-weight global processing of information with transformers [29].”
BackgroundNeuroimaging biomarkers for Alzheimer’s disease.
Márquez, F., & Yassa, M. A. (2019) · Molecular Neurodegeneration · doi:10.1186/s13024-019-0325-5 · Cited by 289
Imaging biomarkers in neurodegeneration: current and future practices
Young, P. N. E., Estarellas, M., Coomans, E., Srikrishna, M., Beaumont, H., Maass, A., Venkataraman, A. V., Lissaman, R., Jiménez, D., Betts, M. J., et al. (2020) · Alzheimer's Research & Therapy · doi:10.1186/s13195-020-00612-7 · Cited by 225 · cited 1×
“Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) have become very useful for studying the structural and functional changes linked to Alzheimer’s Disease in the neuroimaging field [2].”
Background
Research works printed but not linked: 4
- Beyer, L., Zhai, X., and Kolesnikov, A. (2022). Better plain ViT baselines for ImageNet-1k. arXiv.
- Burduk, R., Kurzynski, M., and Wozniak, M. (2020). Advances in Intelligent Systems and Computing, Springer International Publishing.
- Chi, L., Jiang, B., and Mu, Y. (2020). Advances in Neural Information Processing Systems, Curran Associates, Inc.. Available online: https://proceedings.neurips.cc/paper/2020/hash/2fd5d41ec6cfab47e32164d5624269b1-Abstract.html.
- Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv.
Cited by
Liu, X., Li, W., Miao, S., Liu, F., Han, K., & Bezabih, T. T. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108564 · Cited by 51
Mubonanyikuzo, V., Yan, H., Komolafe, T. E., Zhou, L., Wu, T., & Wang, N. (2024) · Journal of Medical Internet Research · doi:10.2196/62647 · Cited by 47
“%) from 4 studies [23,24,27,30] that were unclear.”
Odusami, M., Damaševičius, R., Belousovienė, E., & Maskeliūnas, R. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e34402 · Cited by 34
“In AD research, multiscale fusion approaches that combine MRI and PET data have been developed to provide a comprehensive understanding of the pathophysiology of AD [23,24].”
BackgroundSelf-citationALSA-3: Customized CNN model through ablation study for Alzheimer's disease classification
Assaduzzaman, M., Dutta, M., Saha, A., & Paul, S. G. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101584 · Cited by 23
ConvADD: Exploring a Novel CNN Architecture for Alzheimer's Disease Detection
Alsubaie, M. G., Luo, S., & Shaukat, K. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150431 · Cited by 21
“Moreover, the integration of multimodal neuroimaging data [37], including structural MRI, functional MRI, and positron emission tomography (PET), presents an exciting opportunity to enhance the sensitivity and specificity of AD detection models.”
Odusami, M., Damaševičius, R., Belousovienė, E., & Maskeliūnas, R. (2024) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.23158 · Cited by 22
“In this study, we will use an optimized transposed convolution method proposed by Odusami, Maskeliūnas, and Damaševičius [23], for the fusion of sMRI and FDG-PET data.”
InfluentialSelf-citationIdentifying progression-specific Alzheimer’s subtypes using multimodal transformer
Machado Reyes, D., Chao, H., Hahn, J., Shen, L., Yan, P., & Initiative, F. T. A. D. N. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14040421 · Cited by 17
“Deep learning models have effectively identified diagnostic groups [23] and sub-types [18] using multimodal imaging data and correlation-based approaches that allow a greater explainability of of the relationships between the features learned by the model.”
BackgroundAfifi, I., Elgendy, M. A., Abdelfatah, M., & El–Sappagh, S. (2025) · Brain Informatics · doi:10.1186/s40708-025-00286-7 · Cited by 17
Explainability of Disease Classification from Medical Images Using XGrad-Cam
Tehsin, S., Nasir, I. M., & Damaševičius, R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-83435-6_17 · Cited by 11
Self-citationAnsari, A. S., Mohammadi, M. S., Cattani, C., & Tassaddiq, A. (2025) · Frontiers in Medical Technology · doi:10.3389/fmedt.2025.1699821 · Cited by 8
“Additionally, MRI modalities improve the utility for diagnosis, such as Diffusion Tensor Imaging (DTI), which assesses white matter (WM) integrity to show disruptions in neural connectivity, or by using functional MRI (fMRI) (5, 6).”
Dang, M., Liu, B., Chen, Y., & Zhang, Z. (2026) · Psychoradiology · doi:10.1093/psyrad/kkag007 · Cited by 10
Guo, H., Yang, Z., Zhang, G., Lv, L., & Zhao, X. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1641548 · Cited by 11
Detection and Classification of Alzheimer’s Disease Using Deep and Machine Learning
Khalid, M., Iqbal, N., Ali, B., Rahman, J. S. U., Iqbal, S., Almudaimeegh, L., Hamd, Z. Y., & Gareeballah, A. (2025) · Tomography · doi:10.3390/tomography12010004 · Cited by 10
“Early research relied on simple categorization algorithms, while more recent developments have included more sophisticated methods, like deep neural networks (DNNs) [31,32].”
Huang, Z., Li, J., Wan, J., Chen, J., Yang, Z. X., Shi, M., Zhou, R., & Gan, H. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.112739 · Cited by 6
Shi, Q., Hou, J., Peng, X., Xu, Z., Wang, Y., & Cao, D. (2025) · Ageing Research Reviews · doi:10.1016/j.arr.2025.102943 · Cited by 8
Hasan, E., Fuad, M. T. H., Sharif, O., & Wagler, A. E. (2026) · Journal of Imaging · doi:10.3390/jimaging12030098 · Cited by 4
“Hybrid CNN–fransformer frameworks have emerged as a promising direction, as they integrate fine-grained cellular morphology with global spatial context, both of which are critical for modeling neurodegenerative disease mechanisms [46,56].”
Grigas, O., Damaševičius, R., & Maskeliūnas, R. (2024) · Brain Sciences · doi:10.3390/brainsci14040381 · Cited by 8
“People with MCI may or may not convert to Alzheimer’s disease [4–6] or dementia [4].”
Self-citationAI-Enhanced Imaging Techniques for Understanding Alzheimer's Progression
Chaudhari, A., Saratkar, S., & Thute, T. (2025) · International Conference on Machine Learning and Autonomous Systems (ICMLAS) · doi:10.1109/icmlas64557.2025.10969042 · Cited by 3
“For instance, the transformer-based AI models can solve the complex task of summarizing MRI-shaped data, amyloid PET scan, and genetic risk predictors to provide a stronger diagnosis [13].”
Exploring transfer learning techniques for classifying Alzheimer's disease with rs-fMRI
Abbasabadi, S., Fattahi, P., & Shiri, M. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111075 · Cited by 2
Yang, Z., Su, P., Zhang, Y., Zheng, H., Deng, Y., Lin, X., Ding, C., Li, W., Liang, W., & Lv, B. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.109207 · Cited by 2
Chaieb, M., Ameur, N. B., Ghazouani, H., & Jaghdam, I. H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133541 · Cited by 3
MDWT: A Modified Discrete Wavelet Transformation-Based Algorithm for Image Fusion
Trivedi, G. J. (2024) · IntechOpen eBooks · doi:10.5772/intechopen.1006477 · Cited by 2
Multimodal Convolutional Mixer for Mild Cognitive Impairment Detection
Grigas, O., Damaševičius, R., & Maskeliūnas, R. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.064354 · Cited by 1
“In addition, study [28] focused on optimizing the convolutional fusion process itself.”
Self-citationElazab, A., Wang, H., Wang, C., Zhang, Y., Górriz, J. M., Cai, J., & Chang, C. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108485 · Cited by 2
Huang, S., Liu, Y., Zhang, J., & Wang, Y. (2025) · Artificial Cells Nanomedicine and Biotechnology · doi:10.1080/21691401.2025.2506591 · Cited by 3
“To explore effective fusion methods, Odusami et al. [14] proposed an optimized convolutional fusion method (TCVK) aimed at improving the accuracy of AD classification.”
Mabasha, S., Gupta, S., & Babu, K. K. (2026) · International Journal of Computers and Applications · doi:10.1080/1206212x.2026.2690510 · Cited by 1
“To address these issues, Odusami et al. [53] later proposed a novel optimized convolutional fusion technique using sharpening, transposed convolution, and mobile vision transformers, attaining near-perfect accuracy using different datasets.”
Yu, M., Lv, Q., Dong, X., Zhang, M., Feng, X., Sun, Q., Zhong, G., Li, W., & Li, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5361193 · Cited by 1
Enhanced Alzheimer's Disease Classification: A Stacked Model Fusion with Brain MRI Imaging
Chaitanya, T. V. S. S., & Annamalai, R. (2024) · IEEE International Conference on Contemporary Computing and Communications (InC4) · doi:10.1109/inc460750.2024.10649320
Prediction of Alzheimer's Disease using Watershed Segmentation Algorithm
Radhika, B., & Anthonisan, A. (2025) · International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · doi:10.1109/icdcece65353.2025.11036016
“[3].”
Brahma, B., Kumari, G. L. A., Panigrahi, B. S., Sen, S. K., & Sahoo, S. K. (2025) · Biomedical Materials & Devices · doi:10.1007/s44174-025-00485-0
“Odusami et al. [20] introduced optimized convolutional fusion for multimodal neuroimaging in AD diagnosis: enhancing data integration and feature extraction.”
InfluentialNathaniel, M., Dauda, W. P., Abraham, P., Ogra, I. O., Jonathan, E. U., Usman, S., Luka, M. I., Glen, E., Daji, M., Ndukwe, J. K., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-7915450/v1
Adaptive mask attention dual branch network with multi-modal data for Alzheimer’s Disease diagnosis
Zeng, A., Ou, Z., & Pan, D. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227206
Mehmood, A., Shahid, F., Khan, R., & AlZu’bi, H. S. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.12.032
Multimodal Approach for Alzheimer's Disease Detection
Shaikh, S., Revanker, S., Dhariwal, S., & Aswale, S. (2025) · International Conference on Converging Technology in Electrical and Information Engineering (ICCTEIE) · doi:10.1109/iccteie66144.2025.11341812
“The method uses different brain scans like MRI, PET, and fMRI to help doctors identify Alzheimer’s disease more accurately [17].”
Shruti, V. H., M, P. P., & R, V. S. M. R. (2025) · International Conference on Advances in Next-Gen Computer Science (ICANCS) · doi:10.1109/icancs65819.2025.11377222
“The conventional diagnostic methods used traditionally have been clinical tests and imaging, like the magnetic resonance imaging (MRI) and functional magnetic resonance imaging (fMRI) [9].”
Gürlek, E., & Gökbay, İ. Z. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12022-1
Devibala, S., & Akila, M. P. G. (2026) · International Conference on Mobile Computing and Sustainable Informatics (ICMCSI) · doi:10.1109/icmcsi67283.2026.11412896
Artificial intelligence and radiology integration in neuromodulation and deep brain stimulation
Vahedifard, F., Marathu, K. K., Diler, R. S., & Vattoth, S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26466-5.00013-1
Neuroimaging and Advanced Techniques in Alzheimer’s Diagnosis
Srivastava, S., Kurmi, R. K., & Mishra, S. (2026) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9798898814953126010007
Alam, A., Arunachalam, K. P., Kumar, J. S. R., & Pramila, R. P. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110849
CoMFormer: An explainable multimodal framework for Alzheimer’s disease diagnosis
Pallawi, S., Singh, D. K., Singh, A. P., Khan, S. B., Basheer, S., & Singh, S. K. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114472
Swathi, N. L., Prabhakar, P. K., Muzzamil, M., Arun, A., Martin, V. M., & AlEdani, E. M. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27722-1.00011-0
Metadata
- Authors
- Odusami, M., Maskeliūnas, R., & Damaševičius, R.
- Affiliations
- Kaunas University of Technology (LT)
- Vytautas Magnus University (LT)
- Corresponding author
- Damaševičius, Robertas
- Venue
- Journal of Personalized Medicine
- Publisher
- MDPI AG
- Published
- 2023-10-14
- Volume
- 13
- Issue
- 10
- Pages
- 1496
- ISSN
- 2075-4426 (ISSN-L)
- PMC
- PMC10608760
- OpenAlex
- W4387642613
- Cited by
- 42
- References
- 39
- Citations by year
- 2026: 11 · 2025: 21 · 2024: 10
- FWCI
- 8.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Personalized Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- KTUePubl (Repository of Kaunas University of Technology) (submittedVersion, other-oa)
- Vytautas Magnus University (submittedVersion, cc-by)
- Funders
- National Institute on Aging (P01AG003991, P30AG066444, P01AG026276)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Engineering › Media Technology › Advanced Image Fusion Techniques
- Keywords
- multimodal neuroimaging, Alzheimer's disease diagnosis, cross-modal fusion, MRI-PET fusion, convolutional neural networks, instance normalization, transposed convolution, feature extraction, ADNI, OASIS, multimodal data integration, fusion quality evaluation, SSIM, FSIM, entropy, brain MRI, brain PET, whole-brain atlas
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.