The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Medical image fusion: A survey of the state of the art
Open accessAbstract
Medical image fusion is the process of registering and combining multiple images from single or multiple imaging modalities to improve the imaging quality and reduce randomness and redundancy in order to increase the clinical applicability of medical images for diagnosis and assessment of medical problems. Multi-modal medical image fusion algorithms and devices have shown notable achievements in improving clinical accuracy of decisions based on medical images. This review article provides a factual listing of methods and summarizes the broad scientific challenges faced in the field of medical image fusion. We characterize the medical image fusion research based on (1) the widely used image fusion methods, (2) imaging modalities, and (3) imaging of organs that are under study. This review concludes that even though there exists several open ended technological and scientific challenges, the fusion of medical images has proved to be useful for advancing the clinical reliability of using medical imaging for medical diagnostics and analysis, and is a scientific discipline that has the potential to significantly grow in the coming years.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain
Bhatnagar, G., Wu, Q. M. J., & Liu, Z. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2244870 · Cited by 471
Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform
Yang, L., Guo, B. L., & Ni, W. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.02.025 · Cited by 379
Grosu, A. L., Weber, W. A., Franz, M., Stärk, S., Piert, M., Thamm, R., Gumprecht, H., Schwaiger, M., Molls, M., & Nieder, C. (2005) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2005.01.056 · Cited by 373
(2000) · Lecture Notes in Computer Science · doi:10.1007/b12345 · Cited by 331
MRI and PET image fusion by combining IHS and retina-inspired models
Daneshvar, S., & Ghassemian, H. (2010) · Information Fusion · doi:10.1016/j.inffus.2009.05.003 · Cited by 296
(2006) · Lecture Notes in Computer Science · doi:10.1007/11878773 · Cited by 263
Multimodal medical image fusion based on IHS and PCA
He, C., Liu, Q., Li, H., & Wang, H. (2010) · Procedia Engineering · doi:10.1016/j.proeng.2010.11.045 · Cited by 252
Medical image fusion by wavelet transform modulus maxima
Guihong, Q., Dali, Z., & Pingfan, Y. (2001) · Optics Express · doi:10.1364/oe.9.000184 · Cited by 252
Variability of gross tumor volume delineation in head-and-neck cancer using CT and PET/CT fusion
Riegel, A. C., Berson, A. M., Destian, S., Ng, T., Tena, L. B., Mitnick, R. J., & Wong, P. S. (2006) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2006.01.014 · Cited by 242
Feature-Based Fusion of Medical Imaging Data
Calhoun, V. D., & Adali, T. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2008.923773 · Cited by 225
Cited by
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhang, J., Zhang, Y., Xu, S., Lin, Z., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00572 · Cited by 948
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Yin, M., Liu, X., Liu, Y., & Chen, X. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2838778 · Cited by 594
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
Wei, Q., Dobigeon, N., & Tourneret, J.-Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2458572 · Cited by 474
A Review on a Deep Learning Perspective in Brain Cancer Classification
Tandel, G. S., Biswas, M., Kakde, O. G., Tiwari, A., Suri, H. S., Turk, M., Laird, J., Asare, C., Ankrah, A. A., Khanna, N. N., et al. (2019) · Cancers · doi:10.3390/cancers11010111 · Cited by 466
Azam, M. A., Khan, K. B., Salahuddin, S., Rehman, E., Khan, S. A., Khan, M. A., Kadry, S., & Gandomi, A. H. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105253 · Cited by 449
Deep Learning-Based Image Segmentation on Multimodal Medical Imaging
Guo, Z., Li, X., Huang, H., Guo, N., & Li, Q. (2019) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2018.2890359 · Cited by 440
DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhu, Y., Zhang, J., Xu, S., Zhang, Y., Zhang, K., Meng, D., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00742 · Cited by 431
Visible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
A medical image fusion method based on convolutional neural networks
Liu, Y., Chen, X., Cheng, J., & Peng, H. (2017) · 2017 20th International Conference on Information Fusion (Fusion) · doi:10.23919/icif.2017.8009769 · Cited by 391
An overview of multi-modal medical image fusion
Du, J., Li, W., Lu, K., & Xiao, B. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.160 · Cited by 366
Machine learning and deep learning approach for medical image analysis: diagnosis to detection
Rana, M., & Bhushan, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14305-w · Cited by 365
Image Fusion Techniques: A Survey
Kaur, H., Koundal, D., & Kadyan, V. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09540-7 · Cited by 361
Reinforcement learning for intelligent healthcare applications: A survey
Coronato, A., Naeem, M., De Pietro, G., & Paragliola, G. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101964 · Cited by 320
Multi-focus image fusion: A Survey of the state of the art
Liu, Y., Wang, L., Cheng, J., Li, C., & Chen, X. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.013 · Cited by 320
Medical Image Fusion via Convolutional Sparsity Based Morphological Component Analysis
Liu, Y., Chen, X., Ward, R. K., & Wang, Z. J. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2895749 · Cited by 315
EMFusion: An unsupervised enhanced medical image fusion network
Xu, H., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.001 · Cited by 315
Multimodal medical image fusion review: Theoretical background and recent advances
Hermessi, H., Mourali, O., & Zagrouba, E. (2021) · Signal Processing · doi:10.1016/j.sigpro.2021.108036 · Cited by 301
A survey on region based image fusion methods
Meher, B., Agrawal, S., Panda, R., & Abraham, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.07.010 · Cited by 283
A survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Why Not a Single Image? Combining Visualizations to Facilitate Fieldwork and On-Screen Mapping
Kokalj, Ž., & Somrak, M. (2019) · Remote Sensing · doi:10.3390/rs11070747 · Cited by 274
A review of multimodal medical image fusion techniques
Huang, B., Yang, F., Yin, M., Mo, X., & Zhong, C. (2020) · Computational and Mathematical Methods in Medicine · doi:10.1155/2020/8279342 · Cited by 220
“However, spatial domain technology produces spectral distortion and spatial distortion of fused images [2].”
BackgroundA survey of methods for 3D histology reconstruction
Pichat, J., Iglesias, J. E., Yousry, T., Ourselin, S., & Modat, M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.02.004 · Cited by 207
“…term “fusion” is also commonly used but it should be distinguished from “data fusion” in the sense of creating a single composite image from di ff erent sources via numerical fusion operators, extensively reviewed by Bloch (1996), and more recently by James and Dasarathy (2014) for medical images.”
BackgroundAn artificial agent for robust image registration
Liao, R., Miao, S., De Tournemire, P., Grbic, S., Kamen, A., Mansi, T., & Comaniciu, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11230 · Cited by 199
Li, J., & Wang, Q. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.10.018 · Cited by 77
Radiogenomics for Precision Medicine With a Big Data Analytics Perspective
Panayides, A. S., Pattichis, M. S., Leandrou, S., Pitris, C., Constantinidou, A., & Pattichis, C. S. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2879381 · Cited by 66
A Review of Keypoints’ Detection and Feature Description in Image Registration
Liu, C., Xu, J., & Wang, F. (2021) · Scientific Programming · doi:10.1155/2021/8509164 · Cited by 47
Deep Learning in Multimodal Medical Image Analysis
Xu, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32962-4_18 · Cited by 32
Metadata
- Authors
- James, A. P., & Dasarathy, B. V.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2014-09
- Volume
- 19
- Pages
- 4-19
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2066667210
- Cited by
- 967
- References
- 87
- FWCI
- 95.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.