Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer’s Disease Diagnosis: Enhancing Data Integration and Feature Extraction
Open accessThe DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Multimodal neuroimaging has gained traction in Alzheimer’s Disease (AD) diagnosis by integrating information from multiple imaging modalities to enhance classification accuracy. However, effectively handling heterogeneous data sources and overcoming the challenges posed by multiscale transform methods remains a significant hurdle. This article proposes a novel approach to address these challenges. To harness the power of diverse neuroimaging data, we employ a strategy that leverages optimized convolution techniques. These optimizations include varying kernel sizes and the incorporation of instance normalization, both of which play crucial roles in feature extraction from magnetic resonance imaging (MRI) and positron emission tomography (PET) images. Specifically, varying kernel sizes allow us to adapt the receptive field to different image characteristics, enhancing the model’s ability to capture relevant information. Furthermore, we employ transposed convolution, which increases spatial resolution of feature maps, and it is optimized with varying kernel sizes and instance normalization. This heightened resolution facilitates the alignment and integration of data from disparate MRI and PET data. The use of larger kernels and strides in transposed convolution expands the receptive field, enabling the model to capture essential cross-modal relationships. Instance normalization, applied to each modality during the fusion process, mitigates potential biases stemming from differences in intensity, contrast, or scale between modalities. This enhancement contributes to improved model performance by reducing complexity and ensuring robust fusion. The performance of the proposed fusion method is assessed on three distinct neuroimaging datasets, which include: Alzheimer’s Disease Neuroimaging Initiative (ADNI), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD, and Early Mild Cognitive); Open Access Series of Imaging Studies (OASIS), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, Mild Dementia, Very Mild Dementia); and whole-brain atlas neuroimaging (AANLIB) (consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD). To evaluate the quality of the fused images generated via our method, we employ a comprehensive set of evaluation metrics, including Structural Similarity Index Measurement (SSIM), which assesses the structural similarity between two images; Peak Signal-to-Noise Ratio (PSNR), which measures how closely the generated image resembles the ground truth; Entropy (E), which assesses the amount of information preserved or lost during fusion; the Feature Similarity Indexing Method (FSIM), which assesses the structural and feature similarities between two images; and Edge-Based Similarity (EBS), which measures the similarity of edges between the fused and ground truth images. The obtained fused image is further evaluated using a Mobile Vision Transformer. In the classification of AD vs. Cognitive Normal, the model achieved an accuracy of 99.00%, specificity of 99.00%, and sensitivity of 98.44% on the AANLIB dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Multimodal fusion strategies (which are categorized based on integration timing into early, late, and intermediate fusion) enhance the diagnostic and prognostic robustness in individuals with cognitive disorders by integrating complementary pathological information”
From Multimodal neuroimaging and AI integration in cognitive disorders: advances, challenges, and future directions for precision medicine (2026) · cites this paper as Odusami et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595 · cited 1×
“Vision transformers have garnered significant attention in the field of computer vision due to their remarkable performance in image classification tasks, demonstrating their ability to capture long-range dependencies within images [26].”
BackgroundTransformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
Li, X., Wang, W., Hu, X., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00060 · Cited by 3,134 · cited 1×
“By varying the kernel size, the convolution operation can adapt to different spatial scales present in the input image [37,38].”
BackgroundDiagnosis and Management of Dementia: Review
Arvanitakis, Z., Shah, R. C., & Bennett, D. A. (2019) · JAMA · doi:10.1001/jama.2019.4782 · Cited by 1,403 · cited 2×
“It is anticipated that this will increase to 78 million by 2030 and rise to 139 million by 2050 [1].”
BackgroundMobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
Mehta, S., & Rastegari, M. (2021) · arXiv · doi:10.48550/arxiv.2110.02178 · Cited by 1,110 · cited 2×
“Simple ViT models trained faster and better than the original [27]; the performance of ViTs saturated faster when scaled to be deeper and improved image classification accuracy [28], and Mobile ViT allowed for light-weight global processing of information with transformers [29].”
BackgroundMethodHINet: Half Instance Normalization Network for Image Restoration
Chen, L., Lu, X., Zhang, J., Chu, X., & Chen, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00027 · Cited by 647 · cited 1×
“Instance normalization without learnable parameters is a variant of instance normalization, in which the scaling and shifting factors are not learned but are instead fixed and applied in a predetermined manner [40,41].”
BackgroundCrop yield prediction with deep convolutional neural networks
Nevavuori, P., Narra, N., & Lipping, T. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.104859 · Cited by 586 · cited 1×
“By varying the kernel size, the convolution operation can adapt to different spatial scales present in the input image [37,38].”
BackgroundDeepViT: Towards Deeper Vision Transformer
Zhou, D., Kang, B., Jin, X., Yang, L., Lian, X., Jiang, Z., Hou, Q., & Feng, J. (2021) · arXiv · doi:10.48550/arxiv.2103.11886 · Cited by 398
Neuroimaging biomarkers for Alzheimer’s disease.
Márquez, F., & Yassa, M. A. (2019) · Molecular Neurodegeneration · doi:10.1186/s13024-019-0325-5 · Cited by 289
Imaging biomarkers in neurodegeneration: current and future practices
Young, P. N. E., Estarellas, M., Coomans, E., Srikrishna, M., Beaumont, H., Maass, A., Venkataraman, A. V., Lissaman, R., Jiménez, D., Betts, M. J., et al. (2020) · Alzheimer's Research & Therapy · doi:10.1186/s13195-020-00612-7 · Cited by 225 · cited 1×
“Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) have become very useful for studying the structural and functional changes linked to Alzheimer’s Disease in the neuroimaging field [2].”
Background
Research works printed but not linked: 4
- Beyer, L., Zhai, X., and Kolesnikov, A. (2022). Better plain ViT baselines for ImageNet-1k. arXiv.
- Burduk, R., Kurzynski, M., and Wozniak, M. (2020). Advances in Intelligent Systems and Computing, Springer International Publishing.
- Chi, L., Jiang, B., and Mu, Y. (2020). Advances in Neural Information Processing Systems, Curran Associates, Inc.. Available online: https://proceedings.neurips.cc/paper/2020/hash/2fd5d41ec6cfab47e32164d5624269b1-Abstract.html.
- Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv.
Cited by
Liu, X., Li, W., Miao, S., Liu, F., Han, K., & Bezabih, T. T. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108564 · Cited by 51
Mubonanyikuzo, V., Yan, H., Komolafe, T. E., Zhou, L., Wu, T., & Wang, N. (2024) · Journal of Medical Internet Research · doi:10.2196/62647 · Cited by 43
“%) from 4 studies [23,24,27,30] that were unclear.”
Odusami, M., Damaševičius, R., Belousovienė, E., & Maskeliūnas, R. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e34402 · Cited by 34
“In AD research, multiscale fusion approaches that combine MRI and PET data have been developed to provide a comprehensive understanding of the pathophysiology of AD [23,24].”
BackgroundSelf-citationALSA-3: Customized CNN model through ablation study for Alzheimer's disease classification
Assaduzzaman, M., Dutta, M., Saha, A., & Paul, S. G. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101584 · Cited by 23
ConvADD: Exploring a Novel CNN Architecture for Alzheimer's Disease Detection
Alsubaie, M. G., Luo, S., & Shaukat, K. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150431 · Cited by 21
“Moreover, the integration of multimodal neuroimaging data [37], including structural MRI, functional MRI, and positron emission tomography (PET), presents an exciting opportunity to enhance the sensitivity and specificity of AD detection models.”
Metadata
- Authors
- Odusami, M., Maskeliūnas, R., & Damaševičius, R.
- Affiliations
- Kaunas University of Technology (LT)
- Vytautas Magnus University (LT)
- Corresponding author
- Damaševičius, Robertas
- Venue
- Journal of Personalized Medicine
- Publisher
- MDPI AG
- Published
- 2023-10-14
- Volume
- 13
- Issue
- 10
- Pages
- 1496
- ISSN
- 2075-4426 (ISSN-L)
- PMC
- PMC10608760
- OpenAlex
- W4387642613
- Cited by
- 42
- References
- 39
- Citations by year
- 2026: 11 · 2025: 21 · 2024: 10
- FWCI
- 8.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Personalized Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- KTUePubl (Repository of Kaunas University of Technology) (submittedVersion, other-oa)
- Vytautas Magnus University (submittedVersion, cc-by)
- Funders
- National Institute on Aging (P01AG003991, P30AG066444, P01AG026276)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Engineering › Media Technology › Advanced Image Fusion Techniques
- Keywords
- multimodal neuroimaging, Alzheimer's disease diagnosis, cross-modal fusion, MRI-PET fusion, convolutional neural networks, instance normalization, transposed convolution, feature extraction, ADNI, OASIS, multimodal data integration, fusion quality evaluation, SSIM, FSIM, entropy, brain MRI, brain PET, whole-brain atlas
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer’s Disease Diagnosis: Enhancing Data Integration and Feature Extraction. https://app.cochat.ai/papers/10.3390/jpm13101496
- The paper
- Odusami, M., Maskeliūnas, R., & Damaševičius, R. (2023). Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer’s Disease Diagnosis: Enhancing Data Integration and Feature Extraction. Journal of Personalized Medicine. https://doi.org/10.3390/jpm13101496
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.