The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Multi-Focus Image Fusion: Algorithms, Evaluation, and a Library
Abstract
Image fusion is a process that integrates similar types of images collected from heterogeneous sources into one image in which the information is more definite and certain. Hence, the resultant image is anticipated as more explanatory and enlightening both for human and machine perception. Different image combination methods have been presented to consolidate significant data from a collection of images into one image. As a result of its applications and advantages in variety of fields such as remote sensing, surveillance, and medical imaging, it is significant to comprehend image fusion algorithms and have a comparative study on them. This paper presents a review of the present state-of-the-art and well-known image fusion techniques. The performance of each algorithm is assessed qualitatively and quantitatively on two benchmark multi-focus image datasets. We also produce a multi-focus image fusion dataset by collecting the widely used test images in different studies. The quantitative evaluation of fusion results is performed using a set of image fusion quality assessment metrics. The performance is also evaluated using different statistical measures. Another contribution of this paper is the proposal of a multi-focus image fusion library, to the best of our knowledge, no such library exists so far. The library provides implementation of numerous state-of-the-art image fusion algorithms and is made available publicly at project website.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Greed is Good: Algorithmic Results for Sparse Approximation
Tropp, J. A. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.834793 · Cited by 3,635
Objective image fusion performance measure
Xydeas, C. S., & Petrović, V. (2000) · Electronics Letters · doi:10.1049/el:20000267 · Cited by 1,996
Sparse Representation for Computer Vision and Pattern Recognition
Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T. S., & Yan, S. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2044470 · Cited by 1,847
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Multisensor Image Fusion Using the Wavelet Transform
Li, H., Manjunath, B. S., & Mitra, S. K. (1995) · Graphical Models and Image Processing · doi:10.1006/gmip.1995.1022 · Cited by 1,574
Multi-sensor image fusion using the wavelet transform
Li, H., Manjunath, B. S., & Mitra, S. K. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413273 · Cited by 1,513
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Information measure for performance of image fusion
Qu, G., Zhang, D., & Yan, P. (2002) · Electronics Letters · doi:10.1049/el:20020212 · Cited by 1,427
Multiresolution-based image fusion with additive wavelet decomposition
Nunez, J., Otazu, X., Fors, O., Prades, A., Pala, V., & Arbiol, R. (1999) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.763274 · Cited by 1,125
A new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
Multifocus Image Fusion and Restoration With Sparse Representation
Yang, B., & Li, S. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2026612 · Cited by 749
Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., & Wu, W. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.109 · Cited by 717
Multifocus image fusion using the nonsubsampled contourlet transform
Zhang, Q., & Guo, B.-L. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.01.012 · Cited by 683
Performance comparison of different multi-resolution transforms for image fusion
Li, S., Yang, B., & Hu, J. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.03.002 · Cited by 586
Image fusion based on pixel significance using cross bilateral filter
Shreyamsha Kumar, B. K. (2015) · Signal, Image and Video Processing · doi:10.1007/s11760-013-0556-9 · Cited by 567
Multi-focus image fusion using dictionary-based sparse representation
Nejati, M., Samavi, S., & Shirani, S. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.10.004 · Cited by 544
A new automated quality assessment algorithm for image fusion
Chen, Y., & Blum, R. S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2007.12.002 · Cited by 516
Comments on ‘Information measure for performance of image fusion’
Hossny, M., Nahavandi, S., & Creighton, D. (2008) · Electronics Letters · doi:10.1049/el:20081754 · Cited by 505
Multi-focus image fusion with dense SIFT
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.004 · Cited by 493
A novel similarity based quality metric for image fusion
Yang, C., Zhang, J.-Q., Wang, X.-R., & Liu, X. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.09.001 · Cited by 468
Combination of images with diverse focuses using the spatial frequency
Li, S., Kwok, J. T., & Wang, Y. (2001) · Information Fusion · doi:10.1016/s1566-2535(01)00038-0 · Cited by 461
Multifocus image fusion using region segmentation and spatial frequency
Li, S., & Yang, B. (2008) · Image and Vision Computing · doi:10.1016/j.imavis.2007.10.012 · Cited by 440
Pixel-level Image Fusion using Wavelets and Principal Component Analysis
Naidu, V., & Raol, J. (2008) · Defence Science Journal · doi:10.14429/dsj.58.1653 · Cited by 423
Multi-scale weighted gradient-based fusion for multi-focus images
Zhou, Z., Li, S., & Wang, B. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.11.005 · Cited by 392
Image sequence fusion using a shift-invariant wavelet transform
Rockinger, O. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1997.632093 · Cited by 387
The original Borda count and partial voting
Emerson, P. (2013) · Social Choice and Welfare · doi:10.1007/s00355-011-0603-9 · Cited by 361
Shreyamsha Kumar, B. K. (2013) · Signal, Image and Video Processing · doi:10.1007/s11760-012-0361-x · Cited by 345
Pixel-based and region-based image fusion schemes using ICA bases
Mitianoudis, N., & Stathaki, T. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.001 · Cited by 343
Remote Sensing Image Fusion With Deep Convolutional Neural Network
Shao, Z., & Cai, J. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2805923 · Cited by 331
Image and Video Matting: A Survey
Wang, J., & Cohen, M. F. (2007) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000019 · Cited by 329
Image matting for fusion of multi-focus images in dynamic scenes
Li, S., Kang, X., Hu, J., & Yang, B. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.07.001 · Cited by 313
QU, X.-B., YAN, J.-W., XIAO, H.-Z., & ZHU, Z.-Q. (2008) · Acta Automatica Sinica · doi:10.1016/s1874-1029(08)60174-3 · Cited by 299
A human perception inspired quality metric for image fusion based on regional information
Chen, H., & Varshney, P. K. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.10.001 · Cited by 286
A new metric based on extended spatial frequency and its application to DWT based fusion algorithms
Zheng, Y., Essock, E. A., Hansen, B. C., & Haun, A. M. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.04.003 · Cited by 285
Quadtree-based multi-focus image fusion using a weighted focus-measure
Bai, X., Zhang, Y., Zhou, F., & Xue, B. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.003 · Cited by 277
Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure
Zhang, Y., Bai, X., & Wang, T. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.09.006 · Cited by 276
Multi-focus image fusion for visual sensor networks in DCT domain
Haghighat, M., Aghagolzadeh, A., & Seyedarabi, H. (2011) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2011.04.016 · Cited by 245
Generalized Random Walks for Fusion of Multi-Exposure Images
Shen, R., Cheng, I., Shi, J., & Basu, A. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2150235 · Cited by 235
Image fusion metric based on mutual information and Tsallis entropy
Cvejic, N., Canagarajah, C. N., & Bull, D. R. (2006) · Electronics Letters · doi:10.1049/el:20060693 · Cited by 230
FuseGAN: Learning to Fuse Multi-Focus Image via Conditional Generative Adversarial Network
Guo, X., Nie, R., Cao, J., Zhou, D., Mei, L., & He, K. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2895292 · Cited by 227
Multifocus image fusion by combining curvelet and wavelet transform
Shutao Li, A., & Yang, B. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.02.002 · Cited by 224
Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain
Paul, S., Sevcenco, I. S., & Agathoklis, P. (2016) · Journal of Circuits Systems and Computers · doi:10.1142/s0218126616501231 · Cited by 211
Durrant-Whyte, H. F., & Henderson, T. C. (2016) · Springer handbooks · doi:10.1007/978-3-319-32552-1_35 · Cited by 199
Guided filter-based multi-focus image fusion through focus region detection
Qiu, X., Li, M., Zhang, L., & Yuan, X. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.12.004 · Cited by 186
Performance evaluation of image fusion techniques
Wang, Q., Shen, Y., & Jin, J. (2008) · Elsevier eBooks · doi:10.1016/b978-0-12-372529-5.00017-2 · Cited by 181
Adaptive multi-focus image fusion using a wavelet-based statistical sharpness measure
Tian, J., & Chen, L. (2012) · Signal Processing · doi:10.1016/j.sigpro.2012.01.027 · Cited by 179
Multi-Focus Image Fusion Based on Spatial Frequency in Discrete Cosine Transform Domain
Cao, L., Jin, L., Tao, H., et al. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2354534 · Cited by 174
Dense SIFT for ghost-free multi-exposure fusion
Liu, Y., & Wang, Z. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.06.021 · Cited by 168
Multifocus image fusion based on robust principal component analysis
Wan, T., Zhu, C., & Qin, Z. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.03.003 · Cited by 164
Durrant-Whyte, H. F., & Henderson, T. C. (2008) · Springer eBooks · doi:10.1007/978-3-540-30301-5_26 · Cited by 162
Contrast-based image fusion using the discrete wavelet transform
Pu, T., & Ni, G. (2000) · Optical Engineering · doi:10.1117/1.1303728 · Cited by 161
Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain
Zhao, W., Lu, H., & Wang, D. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2760100 · Cited by 148
Borsoi, R. A., Imbiriba, T., & Bermudez, J. C. M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928895 · Cited by 132
Multi-focus image fusion using Content Adaptive Blurring
Farid, M. S., Mahmood, A., & Al-Maadeed, S. A. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.01.009 · Cited by 107
Self-citationSegmentation-Driven Image Fusion Based on Alpha-Stable Modeling of Wavelet Coefficients
Wan, T. R., Canagarajah, N. C., & Achim, A. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2017640 · Cited by 97
A novel image fusion metric based on multi-scale analysis
Wang, P.-W., & Liu, B. (2008) · International Conference on Signal Processing · doi:10.1109/icosp.2008.4697288 · Cited by 95
Intelligent Detail Enhancement for Exposure Fusion
Kou, F., Wei, Z., Chen, W., et al. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2743988 · Cited by 94
High quality multi-focus image fusion using self-similarity and depth information
Guo, D., Yan, J., & Qu, X. (2014) · Optics Communications · doi:10.1016/j.optcom.2014.10.031 · Cited by 93
Pseudo-Multiple-Exposure-Based Tone Fusion With Local Region Adjustment
Wang, T.-H., Chiu, C.-W., Wu, W.-C., Wang, J.-W., Lin, C.-Y., Chiu, C., & Liou, J.-J. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2403612 · Cited by 91
A novel multi-focus image fusion approach based on image decomposition
Liu, Z., Chai, Y., Yin, H., Zhou, J., & Zhu, Z. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.09.007 · Cited by 91
Hu, H., Wu, J., Li, B. H., Guo, Q., & Zheng, J. Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2711422 · Cited by 88
A feature-based metric for the quantitative evaluation of pixel-level image fusion
Liu, Z., Forsyth, D. S., & Laganière, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.04.003 · Cited by 82
Multi-Focus Image Fusion by Hessian Matrix Based Decomposition
Xiao, B., Ou, G., Tang, H., Bi, X., & Li, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2928516 · Cited by 82
Threshold-optimized decision-level fusion and its application to biometrics
Tao, Q., & Veldhuis, R. N. J. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2008.09.036 · Cited by 81
Multimodality medical image fusion based on new features in NSST domain
Ganasala, P., & Kumar, V. (2014) · Biomedical Engineering Letters · doi:10.1007/s13534-014-0161-z · Cited by 64
Naji, M. A., & Aghagolzadeh, A. (2018) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.22044/jadm.2017.5169.1624 · Cited by 64
Variational Models for Fusion and Denoising of Multifocus Images
Wang, W., Shui, P., & Feng, X. (2008) · IEEE Signal Processing Letters · doi:10.1109/lsp.2007.911148 · Cited by 62
Multi-focus image fusion based on joint sparse representation and optimum theory
Ma, X., Hu, S., Liu, S., Fang, J., & Xu, S. (2019) · Signal Processing Image Communication · doi:10.1016/j.image.2019.06.002 · Cited by 58
Multi-focus image fusion using wavelet-domain statistics
Tian, J., & Chen, L. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5651791 · Cited by 42
Intrinsic Image Decomposition-Based Grey and Pseudo-Color Medical Image Fusion
Du, J., Li, W., & Tan, H. (2019) · IEEE Access · doi:10.1109/access.2019.2900483 · Cited by 35
Multi-Focus Image Fusion Method for Vision Sensor Systems via Dictionary Learning with Guided Filter
Li, Q., Yang, X., Wu, W., Liu, K., & Jeon, G. (2018) · Sensors · doi:10.3390/s18072143 · Cited by 31
Multiple-Exposure Image Fusion for HDR Image Synthesis Using Learned Analysis Transformations
Merianos, I., & Mitianoudis, N. (2019) · Journal of Imaging · doi:10.3390/jimaging5030032 · Cited by 24
Ghosting-free DCT based multi-exposure image fusion
Martorell, O., Sbert, C., & Buades, A. (2019) · Signal Processing Image Communication · doi:10.1016/j.image.2019.07.020 · Cited by 24
Image fusion algorithm based on orientation information motivated Pulse Coupled Neural Networks
Qu, X., Hu, C., & Yan, J. (2008) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2008.4593305 · Cited by 23
Image Degradation for Quality Assessment of Pan-Sharpening Methods
Dou, W. (2018) · Remote Sensing · doi:10.3390/rs10010154 · Cited by 22
From Majority Rule to Inclusive Politics
Emerson, P. (2016) · Springer eBooks · doi:10.1007/978-3-319-23500-4 · Cited by 20
An Image Fusion Method Based on Image Segmentation for High-Resolution Remotely-Sensed Imagery
Li, H., Jing, L., Tang, Y., & Wang, L. (2018) · Remote Sensing · doi:10.3390/rs10050790 · Cited by 16
Transcranial Ultrasound and Magnetic Resonance Image Fusion With Virtual Navigator
Laganà, M. M., Preti, M. G., Forzoni, L., D'Onofrio, S., Beni, S. D., Barberio, A., Cecconi, P., & Baselli, G. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2244871 · Cited by 15
Intelligent Problem Solving. Methodologies and Approaches
Logananthara, R., Ali, M., & Palm, G. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45049-1 · Cited by 12
Multi-Focus Fusion Technique on Low-Cost Camera Images for Canola Phenotyping
Cao, T., Dinh, A., Wahid, K. A., Panjvani, K., & Vail, S. L. (2018) · Sensors · doi:10.3390/s18061887 · Cited by 10
Efficient colour image compression using fusion approach
Rahman, M. A., Lin, S. C.-F., Wong, C. Y., Jiang, G., Liu, S., & Kwok, N. M. (2015) · The Imaging Science Journal · doi:10.1179/1743131x15y.0000000030 · Cited by 8
Spatial domain decision based image fusion using superimposition
Abhyankar, M., Khaparde, A., & Deshmukh, V. (2016) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2016.7550766 · Cited by 7
Research works printed but not linked: 2
- Adelson, 1984, Pyramid methods in image processing, RCA Eng., 29, 33
- Naidu, 2013, A Novel Image Fusion Technique using DCT based Laplacian Pyramid, Int. J. Inven. Eng. Sci. (IJIES), 1, 1
Metadata
- Authors
- Zafar, R., Farid, M. S., & Khan, M. H.
- Venue
- Journal of Imaging
- Publisher
- MDPI AG
- Published
- 2020-07-02
- Volume
- 6
- Issue
- 7
- Pages
- 60
- ISSN
- 2313-433X
- Cited by
- 29
- References
- 87
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
