The DOI matches its Crossref record; 216 of the 216 references it cites were found in a registry or an index.
Infrared and visible image fusion methods and applications: A survey
Abstract
Abstract Infrared images can distinguish targets from their backgrounds based on the radiation difference, which works well in all-weather and all-day/night conditions. By contrast, visible images can provide texture details with high spatial resolution and definition in a manner consistent with the human visual system. Therefore, it is desirable to fuse these two types of images, which can combine the advantages of thermal radiation information in infrared images and detailed texture information in visible images. In this work, we comprehensively survey the existing methods and applications for the fusion of infrared and visible images. First, infrared and visible image fusion methods are reviewed in detail. Meanwhile, image registration, as a prerequisite of image fusion, is briefly introduced. Second, we provide an overview of the main applications of infrared and visible image fusion. Third, the evaluation metrics of fusion performance are discussed and summarized. Fourth, we select eighteen representative methods and nine assessment metrics to conduct qualitative and quantitative experiments, which can provide an objective performance reference for different fusion methods and thus support relative engineering with credible and solid evidence. Finally, we conclude with the current status of infrared and visible image fusion and deliver insightful discussions and prospects for future work. This survey can serve as a reference for researchers in infrared and visible image fusion and related fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,564
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Scale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
(1981) · Cited by 11,963
Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit
Tropp, J. A., & Gilbert, A. C. (2007) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.909108 · Cited by 9,653
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
Self-citationImage registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
The Fourier Transform and Its Applications
Bracewell, R., & Kahn, P. B. (1966) · American Journal of Physics · doi:10.1119/1.1973431 · Cited by 5,737
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
A survey of image registration techniques
Brown, L. G. (1992) · ACM Computing Surveys · doi:10.1145/146370.146374 · Cited by 4,057
The contourlet transform: an efficient directional multiresolution image representation
Do, M. N., & Vetterli, M. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859376 · Cited by 3,952
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Alignment by Maximization of Mutual Information
Viola, P., & Wells III, W. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958904918 · Cited by 2,610
Fast Discrete Curvelet Transforms
Candès, E., Demanet, L., Donoho, D., & Ying, L. (2006) · Multiscale Modeling & Simulation · doi:10.1137/05064182x · Cited by 2,573
The dual-tree complex wavelet transform
Selesnick, I. W., Baraniuk, R. G., & Kingsbury, N. C. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1550194 · Cited by 2,475
Image quality measures and their performance
Eskicioglu, A. M., & Fisher, P. S. (1995) · IEEE Transactions on Communications · doi:10.1109/26.477498 · Cited by 2,117
The Nonsubsampled Contourlet Transform: Theory, Design, and Applications
Da Cunha, A. L., Zhou, J., & Do, M. N. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.877507 · Cited by 2,035
Proceedings IEEE International Conference on Acoustics Speech and Signal Processing
Zheng, F., McLaughlin, S., & Mulgrew, B. (1991) · Cited by 1,905
Sparse Representation for Computer Vision and Pattern Recognition
Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T. S., & Yan, S. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2044470 · Cited by 1,847
Self-citationAn FFT-based technique for translation, rotation, and scale-invariant image registration
Reddy, B. S., & Chatterji, B. N. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.506761 · Cited by 1,836
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Zeiler, M. D., Krishnan, D., Taylor, G. W., & Fergus, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539957 · Cited by 1,666
In-fibre Bragg grating sensors
Rao, Y.-J. (1997) · Measurement Science and Technology · doi:10.1088/0957-0233/8/4/002 · Cited by 1,606
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587
Proceedings of the IEEE International Conference on Image Processing
Calway, A. D. (1996) · The Institute of Electrical and Electronics Engineers · Cited by 1,578
Edge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360666 · Cited by 1,443
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Information measure for performance of image fusion
Qu, G., Zhang, D., & Yan, P. (2002) · Electronics Letters · doi:10.1049/el:20020212 · Cited by 1,427
Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit
Tropp, J. A., Gilbert, A. C., & Strauss, M. J. (2006) · Signal Processing · doi:10.1016/j.sigpro.2005.05.030 · Cited by 1,347
Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges
Candès, E. J., & Donoho, D. L. (2000) · Cited by 1,330
A wavelet-based image fusion tutorial
Pajares, G., & Manuel de la Cruz, J. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.03.010 · Cited by 1,328
Multi-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationA Survey of Sparse Representation: Algorithms and Applications
Zhang, Z., Xu, Y., Yang, J., Li, X., & Zhang, D. (2015) · IEEE Access · doi:10.1109/access.2015.2430359 · Cited by 1,092
A new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
The steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
A filter bank for the directional decomposition of images: theory and design
Bamberger, R. H., & Smith, M. J. T. (1992) · IEEE Transactions on Signal Processing · doi:10.1109/78.127960 · Cited by 885
A new quality metric for image fusion
Piella, G., & Heijmans, H. (2004) · Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429) · doi:10.1109/icip.2003.1247209 · Cited by 838
A general framework for multiresolution image fusion: from pixels to regions
Piella, G. (2003) · Information Fusion · doi:10.1016/s1566-2535(03)00046-0 · Cited by 799
Ma, J., Zhou, Z., Wang, B., & Zong, H. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.02.005 · Cited by 773
Self-citationAssessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
Comparison of texture features based on Gabor filters
Grigorescu, S. E., Petkov, N., & Kruizinga, P. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.804262 · Cited by 742
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Zhang, Z., & Blum, R. S. (1999) · Proceedings of the IEEE · doi:10.1109/5.775414 · Cited by 726
Optimally Sparse Multidimensional Representation Using Shearlets
Guo, K., & Labate, D. (2007) · SIAM Journal on Mathematical Analysis · doi:10.1137/060649781 · Cited by 700
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
Cui, G., Feng, H., Xu, Z., Li, Q., & Chen, Y. (2015) · Optics Communications · doi:10.1016/j.optcom.2014.12.032 · Cited by 612
Performance comparison of different multi-resolution transforms for image fusion
Li, S., Yang, B., & Hu, J. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.03.002 · Cited by 586
Recent advances in visual and infrared face recognition—a review
Kong, S. G., Heo, J., Abidi, B. R., Paik, J., & Abidi, M. A. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.04.001 · Cited by 586
Image fusion based on pixel significance using cross bilateral filter
Shreyamsha Kumar, B. K. (2015) · Signal, Image and Video Processing · doi:10.1007/s11760-013-0556-9 · Cited by 567
Robust Point Matching via Vector Field Consensus
Ma, J., Zhao, J., Tian, J., Yuille, A. L., & Tu, Z. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2307478 · Cited by 566
Self-citationCheng, Z., Yang, Q., & Sheng, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.55 · Cited by 557
The correlation ratio as a new similarity measure for multimodal image registration
Roche, A., Malandain, G., Pennec, X., & Ayache, N. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0056301 · Cited by 542
A new automated quality assessment algorithm for image fusion
Chen, Y., & Blum, R. S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2007.12.002 · Cited by 516
A new image quality metric for image fusion: The sum of the correlations of differences
Aslantas, V., & Bendes, E. (2015) · AEU - International Journal of Electronics and Communications · doi:10.1016/j.aeue.2015.09.004 · Cited by 507
Comments on ‘Information measure for performance of image fusion’
Hossny, M., Nahavandi, S., & Creighton, D. (2008) · Electronics Letters · doi:10.1049/el:20081754 · Cited by 505
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Infrared and visible image fusion with convolutional neural networks
Liu, Y., Chen, X., Cheng, J., Peng, H., & Wang, Z. (2018) · International Journal of Wavelets, Multiresolution and Information Processing · doi:10.1142/s0219691318500182 · Cited by 479
Zhou, Z., Wang, B., Li, S., & Dong, M. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.11.003 · Cited by 475
Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming
Ma, J., Zhou, H., Zhao, J., Gao, Y., Jiang, J., & Tian, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2441954 · Cited by 474
Self-citationA non-reference image fusion metric based on mutual information of image features
Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2011.07.012 · Cited by 473
Two-scale image fusion of visible and infrared images using saliency detection
Bavirisetti, D. P., & Dhuli, R. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2016.01.009 · Cited by 459
Fourier Transform and Its Applications
Aliev, F. G., & Lara, A. (2023) · Mathematical Methods for Physics · doi:10.1201/9781003410881-8 · Cited by 457
Image Fusion. Algorithms and Applications
(2009) · Sensor Review · doi:10.1108/sr.2009.08729cae.001 · Cited by 417
Image fusion techniques for remote sensing applications
Simone, G., Farina, A., Morabito, F. C., Serpico, S. B., & Bruzzone, L. (2002) · Information Fusion · doi:10.1016/s1566-2535(01)00056-2 · Cited by 413
A novel multi-modality image fusion method based on image decomposition and sparse representation
Zhu, Z., Yin, H., Chai, Y., Li, Y., & Qi, G. (2018) · Information Sciences · doi:10.1016/j.ins.2017.09.010 · Cited by 408
A medical image fusion method based on convolutional neural networks
Liu, Y., Chen, X., Cheng, J., & Peng, H. (2017) · 2017 20th International Conference on Information Fusion (Fusion) · doi:10.23919/icif.2017.8009769 · Cited by 391
Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion
Li, S., Yin, H., & Fang, L. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217493 · Cited by 385
Approaches to Multisensor Data Fusion in Target Tracking: A Survey
Smith, D., & Singh, S. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.183 · Cited by 379
Pixel-level image fusion with simultaneous orthogonal matching pursuit
Yang, B., & Li, S. (2012) · Information Fusion · doi:10.1016/j.inffus.2010.04.001 · Cited by 377
Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network
Palsson, F., Sveinsson, J. R., & Ulfarsson, M. O. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2668299 · Cited by 364
Simultaneous image fusion and denoising with adaptive sparse representation
Liu, Y., & Wang, Z. (2015) · IET Image Processing · doi:10.1049/iet-ipr.2014.0311 · Cited by 351
Shreyamsha Kumar, B. K. (2013) · Signal, Image and Video Processing · doi:10.1007/s11760-012-0361-x · Cited by 345
Pixel-based and region-based image fusion schemes using ICA bases
Mitianoudis, N., & Stathaki, T. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.001 · Cited by 343
Pedestrian Detection at Day/Night Time with Visible and FIR Cameras: A Comparison
González, A., Fang, Z., Socarras, Y., Serrat, J., Vázquez, D., Xu, J., & López, A. (2016) · Sensors · doi:10.3390/s16060820 · Cited by 322
QU, X.-B., YAN, J.-W., XIAO, H.-Z., & ZHU, Z.-Q. (2008) · Acta Automatica Sinica · doi:10.1016/s1874-1029(08)60174-3 · Cited by 299
A new metric based on extended spatial frequency and its application to DWT based fusion algorithms
Zheng, Y., Essock, E. A., Hansen, B. C., & Haun, A. M. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.04.003 · Cited by 285
Ma, J., Qiu, W., Zhao, J., Ma, Y., Yuille, A. L., & Tu, Z. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2388434 · Cited by 280
Self-citationA survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Infrared and visible image fusion method based on saliency detection in sparse domain
Liu, C. H., Qi, Y., & Ding, W. R. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.04.018 · Cited by 275
Gao, Y., Ma, J., & Yuille, A. L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2675341 · Cited by 254
Self-citationARRSI: Automatic Registration of Remote-Sensing Images
Wong, A., & Clausi, D. A. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.892601 · Cited by 236
Zhang, Y., Zhang, L., Bai, X., & Zhang, L. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.05.007 · Cited by 236
Non-rigid visible and infrared face registration via regularized Gaussian fields criterion
Ma, J., Zhao, J., Ma, Y., & Tian, J. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.09.005 · Cited by 223
Self-citationMultiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition
Kong, S. G., Heo, J., Boughorbel, F., Zheng, Y., Abidi, B. R., Koschan, A., Yi, M., & Abidi, M. A. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-6655-0 · Cited by 218
Region-Based Multimodal Image Fusion Using ICA Bases
Cvejic, N., Bull, D., & Canagarajah, N. (2007) · IEEE Sensors Journal · doi:10.1109/jsen.2007.894926 · Cited by 218
Image Matching by Normalized Cross-Correlation
Zhao, F., Huang, Q., & Gao, W. (2006) · 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings · doi:10.1109/icassp.2006.1660446 · Cited by 215
Computational versus Psychophysical Bottom-Up Image Saliency: A Comparative Evaluation Study
Toet, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.53 · Cited by 214
Joint patch clustering-based dictionary learning for multimodal image fusion
Kim, M., Han, D. K., & Ko, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.03.003 · Cited by 196
Graph Regularized Non-Negative Low-Rank Matrix Factorization for Image Clustering
Li, X., Cui, G., & Dong, Y. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2585355 · Cited by 196
Dogra, A., Goyal, B., & Agrawal, S. (2017) · IEEE Access · doi:10.1109/access.2017.2735865 · Cited by 196
Regularized vector field learning with sparse approximation for mismatch removal
Ma, J., Zhao, J., Tian, J., Bai, X., & Tu, Z. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.017 · Cited by 193
Self-citationImage Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network
Du, C., & Gao, S. (2017) · IEEE Access · doi:10.1109/access.2017.2735019 · Cited by 190
Zhang, X., Ma, Y., Fan, F., Zhang, Y., & Huang, J. (2017) · Journal of the Optical Society of America A · doi:10.1364/josaa.34.001400 · Cited by 186
Self-citationObjective image fusion performance characterisation
Petrovic, V., & Xydeas, C. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.175 · Cited by 184
Dictionary learning method for joint sparse representation-based image fusion
Zhang, Q., Fu, Y., Li, H., & Zou, J. (2013) · Optical Engineering · doi:10.1117/1.oe.52.5.057006 · Cited by 182
Singh, R., Vatsa, M., & Noore, A. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2007.06.022 · Cited by 182
Fusion method for infrared and visible images by using non-negative sparse representation
Wang, J., Peng, J., Feng, X., He, G., & Fan, J. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.09.019 · Cited by 181
Face recognition by fusing thermal infrared and visible imagery
Bebis, G., Gyaourova, A., Singh, S., & Pavlidis, I. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2006.01.017 · Cited by 180
Proceedings 2002 International Conference On Image Processing
(2002) · Proceedings International Conference on Image Processing ICIP-02 · doi:10.1109/icip.2002.1037942 · Cited by 180
Image fusion by using steerable pyramid
Liu, Z., Tsukada, K., Hanasaki, K., Ho, Y. K., & Dai, Y. P. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(01)00047-2 · Cited by 178
IMAGE FUSION AND IMAGE QUALITY ASSESSMENT OF FUSED IMAGES
Han, Z., Tang, X., Gao, X., & Hu, F. (2013) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsarchives-xl-7-w1-33-2013 · Cited by 176
Robust Estimation of Nonrigid Transformation for Point Set Registration
Ma, J., Zhao, J., Tian, J., Tu, Z., & Yuille, A. L. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.279 · Cited by 176
Self-citationNovel fusion method for visible light and infrared images based on NSST–SF–PCNN
Kong, W., Zhang, L., & Yang, L. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.04.003 · Cited by 173
Kong, W., Lei, Y., & Zhao, H. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.07.019 · Cited by 173
The multiscale directional bilateral filter and its application to multisensor image fusion
Hu, J., & Li, S. (2012) · Information Fusion · doi:10.1016/j.inffus.2011.01.002 · Cited by 163
Region level based multi-focus image fusion using quaternion wavelet and normalized cut
Liu, Y., Jin, J., Wang, Q., et al. (2013) · Signal Processing · doi:10.1016/j.sigpro.2013.10.010 · Cited by 161
Subjective tests for image fusion evaluation and objective metric validation
Petrovic, V. S. (2005) · Information Fusion · doi:10.1016/j.inffus.2005.05.001 · Cited by 159
Infrared and visible images fusion based on RPCA and NSCT
Fu, Z., Wang, X., Xu, J., Zhou, N., & Zhao, Y. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2016.05.012 · Cited by 159
Fast saliency-aware multi-modality image fusion
Han, J., Pauwels, E., & de Zeeuw, P. M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.015 · Cited by 148
Gan, W., Wu, X., Wu, W., Yang, X., Ren, C., He, X., & Liu, K. (2015) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.07.003 · Cited by 145
Ma, J., Jiang, J., Liu, C., & Li, Y. (2017) · Information Sciences · doi:10.1016/j.ins.2017.07.010 · Cited by 141
Self-citationInfrared image enhancement through saliency feature analysis based on multi-scale decomposition
Zhao, J., Chen, Y., Feng, H., Xu, Z., & Li, Q. (2013) · Infrared Physics & Technology · doi:10.1016/j.infrared.2013.11.008 · Cited by 134
Fusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition
Heo, J., Kong, S. G., Abidi, B. R., & Abidi, M. A. (2005) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.351 · Cited by 133
Infrared and visible image fusion for face recognition
Singh, S., Gyaourova, A., Bebis, G. N., & Pavlidis, I. T. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.543549 · Cited by 132
Infrared and visible image fusion scheme based on NSCT and low-level visual features
Li, H., Qiu, H., Yu, Z., & Zhang, Y. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2016.02.005 · Cited by 124
Mendoza, F. A., Lu, R., & Cen, H. (2012) · Postharvest Biology and Technology · doi:10.1016/j.postharvbio.2012.05.012 · Cited by 121
Infrared and visible image fusion using total variation model
Ma, Y., Chen, J., Chen, C., Fan, F., & Ma, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.03.009 · Cited by 119
Self-citationRigid point feature registration using mutual information
Rangarajan, A., Chui, H., & Duncan, J. S. (1999) · Medical Image Analysis · doi:10.1016/s1361-8415(99)80034-6 · Cited by 118
Implementation and Comparative Study of Image Fusion Algorithms
Krishnamoorthy, S., & Soman, K. P. (2010) · International Journal of Computer Applications · doi:10.5120/1357-1832 · Cited by 117
Proceedings of the ... Scandinavian Conference on Image Analysis
Bildanalys, S. S. F. A. (1980) · Medical Entomology and Zoology · Cited by 116
Infrared and visible image fusion using fuzzy logic and population-based optimization
Saeedi, J., & Karim Faez, A. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2011.11.020 · Cited by 114
Zhang, B., Lu, X., Pei, H., et al. (2015) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.10.004 · Cited by 113
Fusion tracking in color and infrared images using joint sparse representation
Liu, H., & Sun, F. (2012) · Science China Information Sciences · doi:10.1007/s11432-011-4536-9 · Cited by 112
Chipman, L. J., Orr, T. M., & Graham, L. N. (1995) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.217576 · Cited by 110
Eckhorn, R., Reitboeck, H. J., Arndt, M., et al. (1989) · Cited by 105
Vanmali, A. V., & Gadre, V. M. (2017) · Sadhana · doi:10.1007/s12046-017-0673-1 · Cited by 105
A comparison of criterion functions for fusion of multi-focus noisy images
Aslantaş, V., & Kurban, R. (2009) · Optics Communications · doi:10.1016/j.optcom.2009.05.021 · Cited by 103
Comparison of Fusion Methods for Thermo-Visual Surveillance Tracking
Conaire, C. Ó., O'Connor, N. E., Cooke, E., & Smeaton, A. F. (2006) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2006.301618 · Cited by 101
Yang, Y., Que, Y., Huang, S., & Lin, P. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2658098 · Cited by 101
Zhao, J., Zhou, Q., Chen, Y., Feng, H., Xu, Z., & Li, Q. (2012) · Infrared Physics & Technology · doi:10.1016/j.infrared.2012.11.003 · Cited by 95
A region-based multiresolution image fusion algorithm
Piella, G. (2003) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2002.1021002 · Cited by 93
Fusion of visible and infrared images using global entropy and gradient constrained regularization
Zhao, J., Cui, G., Gong, X., Zang, Y., Tao, S., & Wang, D. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.01.012 · Cited by 91
Hu, H., Wu, J., Li, B. H., Guo, Q., & Zheng, J. Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2711422 · Cited by 88
An improved fusion algorithm for infrared and visible images based on multi-scale transform
Li, H., Liu, L., Huang, W., et al. (2015) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.11.002 · Cited by 86
Image fusion using multiscale edge‐preserving decomposition based on weighted least squares filter
Jiang, Y., & Wang, M. (2014) · IET Image Processing · doi:10.1049/iet-ipr.2013.0429 · Cited by 85
One color contrast enhanced infrared and visible image fusion method
Yin, S., Cao, L., Ling, Y., et al. (2009) · Infrared Physics & Technology · doi:10.1016/j.infrared.2009.10.007 · Cited by 84
A feature-based metric for the quantitative evaluation of pixel-level image fusion
Liu, Z., Forsyth, D. S., & Laganière, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.04.003 · Cited by 82
Mutual information based registration of multimodal stereo videos for person tracking
Krotosky, S. J., & Trivedi, M. M. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.008 · Cited by 82
The infrared and visible image fusion algorithm based on target separation and sparse representation
Lu, X., Zhang, B., Zhao, Y., He, L., & Pei, H. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.09.007 · Cited by 79
Zheng, Y., Essock, E. A., & Hansen, B. C. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.523966 · Cited by 78
Finite asymmetric generalized Gaussian mixture models learning for infrared object detection
Elguebaly, T., & Bouguila, N. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.07.007 · Cited by 77
Fusion of visual and IR images for concealed weapon detection
Xue, Z., Blum, R. S., & Li, Y. (2003) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2002.1020949 · Cited by 75
Visual attention guided image fusion with sparse representation
Yang, B., & Shutao Li, A. (2014) · Optik · doi:10.1016/j.ijleo.2014.04.036 · Cited by 73
Can recent innovations in harmonic analysis `explain' key findings in natural image statistics?
Donoho, D. L., & Flesia, A. G. (2001) · Network Computation in Neural Systems · doi:10.1080/net.12.3.371.393 · Cited by 72
Li, H., Ding, W., Cao, X., et al. (2017) · Remote Sensing · doi:10.3390/rs9050441 · Cited by 70
A fast fusion scheme for infrared and visible light images in NSCT domain
Zhao, K., Guo, Y., & Wang, Y. (2015) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.07.026 · Cited by 68
Visible and infrared image registration in man-made environments employing hybrid visual features
Han, J., Pauwels, E., & de Zeeuw, P. M. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.03.022 · Cited by 67
Sparse representation with learned multiscale dictionary for image fusion
Yin, H. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.07.003 · Cited by 67
Kong, W., Wang, B., & Yang, L. (2015) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.02.008 · Cited by 66
Hossny, M., Nahavandi, S., Creighton, D., & Bhatti, A. (2010) · Electronics Letters · doi:10.1049/el.2010.1778 · Cited by 65
Fusion of infrared and visible images based on focus measure operators in the curvelet domain
Shao, Z., Liu, J., & Qimin, C. (2012) · Applied Optics · doi:10.1364/ao.51.001910 · Cited by 63
Efficient image fusion with approximate sparse representation
Bin, Y., Yang, C., & Huang, G. (2016) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s0219691316500247 · Cited by 62
Eslami, M., & Mohammadzadeh, A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2489838 · Cited by 60
Cai, J., Cheng, Q., Peng, M., & Song, Y. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.01.026 · Cited by 59
Kanmani, M., & Venkateswaran, N. (2016) · Quantitative InfraRed Thermography Journal · doi:10.1080/17686733.2016.1229328 · Cited by 56
A novel fusion scheme for visible and infrared images based on compressive sensing
Liu, Z., Yin, H., Fang, B., & Chai, Y. (2014) · Optics Communications · doi:10.1016/j.optcom.2014.07.093 · Cited by 55
Zhu, P., Ma, X., & Huang, Z. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.01.013 · Cited by 54
Infrared-Visual Image Registration Based on Corners and Hausdorff Distance
Hrkać, T., Kalafatić, Z., & Krapac, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-73040-8_39 · Cited by 52
Infrared and visible image fusion with spectral graph wavelet transform
Yan, X., Qin, H., Li, J., Zhou, H., & Zong, J. (2015) · Journal of the Optical Society of America A · doi:10.1364/josaa.32.001643 · Cited by 52
Liu, Z., Feng, Y., Chen, H., et al. (2017) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2017.05.007 · Cited by 50
Color guided thermal image super resolution
Chen, X., Zhai, G., Wang, J., Hu, C., & Chen, Y. (2016) · Visual Communications and Image Processing · doi:10.1109/vcip.2016.7805509 · Cited by 47
Image Fusion and Super-Resolution with Convolutional Neural Network
Zhong, J., Yang, B. F., Li, Y., Zhong, F., & Chen, Z. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-3005-5_7 · Cited by 43
Visible and infrared image registration using trajectories and composite foreground images
Bilodeau, G.-A., Torabi, A., & Morin, F. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2010.08.002 · Cited by 42
Airborne Infrared and Visible Image Fusion Combined with Region Segmentation
Zuo, Y., Liu, J., Bai, G., Wang, X., & Sun, M. (2017) · Sensors · doi:10.3390/s17051127 · Cited by 39
Infrared and visible image fusion using multiscale directional nonlocal means filter
Yan, X., Qin, H., Li, J., Zhou, H., Zong, J., & Zeng, Q. (2015) · Applied Optics · doi:10.1364/ao.54.004299 · Cited by 38
Proceedings of International Conference on Computer Vision and Image Processing
Raman, B., Kumar, S., Roy, P. P., & Sen, D. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-2104-6 · Cited by 34
Infrared and visible image fusion based on total variation and augmented Lagrangian
Guo, H., Ma, Y., Mei, X., et al. (2017) · Journal of the Optical Society of America A · doi:10.1364/josaa.34.001961 · Cited by 33
Self-citationRabatel, G., & Labbé, S. (2016) · Precision Agriculture · doi:10.1007/s11119-016-9437-x · Cited by 31
Fuzzy image fusion based on modified Self-Generating Neural Network
Jiang, H. X., & Tian, Y. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.01.052 · Cited by 30
Edge-preserving image decomposition using L1 fidelity with L0 gradient
Shen, C.-T., Chang, F.-J., Hung, Y., & Pei, S. (2012) · SIGGRAPH Asia Technical Briefs · doi:10.1145/2407746.2407752 · Cited by 28
AN IMAGE FUSION FRAMEWORK BASED ON HUMAN VISUAL SYSTEM IN FRAMELET DOMAIN
Bhatnagar, G., & Wu, Q. M. J. (2011) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s0219691311004444 · Cited by 28
Synergetic Classification of Long-Wave Infrared Hyperspectral and Visible Images
Lu, X., Zhang, J., Li, T., & Zhang, G. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2442594 · Cited by 26
Isolation of a new laccase isoform from the white-rot fungiPycnoporus cinnabarinusstrain ss3
Otterbein, L. R., Record, É., Chéreau, D., Herpoël‐Gimbert, I., Asther, M., & Moukha, S. (2000) · Canadian Journal of Microbiology · doi:10.1139/w00-039 · Cited by 25
Infrared‐visible video fusion based on motion‐compensated wavelet transforms
Xu, L., Du, J., & Zhang, Z. (2014) · IET Image Processing · doi:10.1049/iet-ipr.2014.0245 · Cited by 23
Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN
Zhao, C., Shao, G., Ma, L., et al. (2014) · Optik · doi:10.1016/j.ijleo.2014.08.024 · Cited by 23
Image fusion algorithm based on orientation information motivated Pulse Coupled Neural Networks
Qu, X., Hu, C., & Yan, J. (2008) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2008.4593305 · Cited by 23
MATLAB - A Ubiquitous Tool for the Practical Engineer
Ionescu, C. M. (2011) · InTech eBooks · doi:10.5772/820 · Cited by 23
INT3-Horus framework for multispectrum activity interpretation in intelligent environments
Fernández‐Caballero, A., Castillo, J. C., López, M. T., Serrano-Cuerda, J., & Sokolova, M. V. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.06.058 · Cited by 21
Visible and infrared image registration based on visual salient features
Wu, F., Wang, B., Yi, X., Li, M., Hao, J., Qin, H., & Zhou, H. (2015) · Journal of Electronic Imaging · doi:10.1117/1.jei.24.5.053017 · Cited by 19
Neagoe, V.-E., Ropot, A.-D., & Mugioiu, A.-C. (2007) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2007.4425327 · Cited by 18
Thermal effects on the pointing of the 32-m MERLIN radio telescope at Cambridge
Bayley, A. M., Davis, R. J., Haggis, J. S., & Kärcher, H. (1994) · Cited by 17
Cited by
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationU2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Self-citationMa, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationRFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhang, J., Zhang, Y., Xu, S., Lin, Z., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00572 · Cited by 948
Metadata
- Authors
- Ma, J., Ma, Y., & Li, C.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 45
- Pages
- 153-178
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2809795042
- Cited by
- 1,732
- References
- 216
- FWCI
- 92.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.