The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index.
Deep learning for pixel-level image fusion: Recent advances and future prospects
Abstract
Abstract By integrating the information contained in multiple images of the same scene into one composite image, pixel-level image fusion is recognized as having high significance in a variety of fields including medical imaging, digital photography, remote sensing, video surveillance, etc. In recent years, deep learning (DL) has achieved great success in a number of computer vision and image processing problems. The application of DL techniques in the field of pixel-level image fusion has also emerged as an active topic in the last three years. This survey paper presents a systematic review of the DL-based pixel-level image fusion literature. Specifically, we first summarize the main difficulties that exist in conventional image fusion research and discuss the advantages that DL can offer to address each of these problems. Then, the recent achievements in DL-based image fusion are reviewed in detail. More than a dozen recently proposed image fusion methods based on DL techniques including convolutional neural networks (CNNs), convolutional sparse representation (CSR) and stacked autoencoders (SAEs) are introduced. At last, by summarizing the existing DL-based image fusion methods into several generic frameworks and presenting a potential DL-based framework for developing objective evaluation metrics, we put forward some prospects for the future study on this topic. The key issues and challenges that exist in each framework are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Objective image fusion performance measure
Xydeas, C. S., & Petrović, V. (2000) · Electronics Letters · doi:10.1049/el:20000267 · Cited by 1,996
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Zeiler, M. D., Krishnan, D., Taylor, G. W., & Fergus, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539957 · Cited by 1,666
Multisensor Image Fusion Using the Wavelet Transform
Li, H., Manjunath, B. S., & Mitra, S. K. (1995) · Graphical Models and Image Processing · doi:10.1006/gmip.1995.1022 · Cited by 1,574
Multi-sensor image fusion using the wavelet transform
Li, H., Manjunath, B. S., & Mitra, S. K. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413273 · Cited by 1,513
Edge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360666 · Cited by 1,443
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Self-citationInformation measure for performance of image fusion
Qu, G., Zhang, D., & Yan, P. (2002) · Electronics Letters · doi:10.1049/el:20020212 · Cited by 1,427
Lucien Wald, A., Ranchin, T., & Mangolini, M. (1997) · HAL · Cited by 1,362
A wavelet-based image fusion tutorial
Pajares, G., & Manuel de la Cruz, J. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.03.010 · Cited by 1,328
Multi-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Self-citationA Critical Comparison Among Pansharpening Algorithms
Vivone, G., Alparone, L., Chanussot, J., Dalla Mura, M., Garzelli, A., Licciardi, G. A., Restaino, R., & Wald, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2361734 · Cited by 1,303
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm
Yuhas, R. H., Goetz, A. F. H., & Boardman, J. W. (1992) · NASA Technical Reports Server (NASA) · Cited by 1,259
Image Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · Cited by 1,237
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Multiresolution-based image fusion with additive wavelet decomposition
Nunez, J., Otazu, X., Fors, O., Prades, A., Pala, V., & Arbiol, R. (1999) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.763274 · Cited by 1,125
A new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
Self-citationMedical image fusion: A survey of the state of the art
James, A. P., & Dasarathy, B. V. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.12.002 · Cited by 967
A new look at IHS-like image fusion methods
Tu, T., Su, S.-C., Shyu, H.-C., & Huang, P. S. (2001) · Information Fusion · doi:10.1016/s1566-2535(01)00036-7 · Cited by 904
Multispectral and Panchromatic Data Fusion Assessment Without Reference
Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., Nencini, F., & Selva, M. (2008) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.74.2.193 · Cited by 892
A review of remote sensing image fusion methods
Ghassemian, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.03.003 · Cited by 849
A new quality metric for image fusion
Piella, G., & Heijmans, H. (2004) · Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429) · doi:10.1109/icip.2003.1247209 · Cited by 838
Pixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
A general framework for multiresolution image fusion: from pixels to regions
Piella, G. (2003) · Information Fusion · doi:10.1016/s1566-2535(03)00046-0 · Cited by 799
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Multifocus Image Fusion and Restoration With Sparse Representation
Yang, B., & Li, S. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2026612 · Cited by 749
Zhang, Z., & Blum, R. S. (1999) · Proceedings of the IEEE · doi:10.1109/5.775414 · Cited by 726
Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., & Wu, W. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.109 · Cited by 717
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
Multifocus image fusion using the nonsubsampled contourlet transform
Zhang, Q., & Guo, B.-L. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.01.012 · Cited by 683
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Gradient-Based Multiresolution Image Fusion
Petrovic, V. S., & Xydeas, C. S. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.823821 · Cited by 575
Proceedings of the International Joint Conference on Neural Networks (IJCNN) 2005
(2005) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1556327 · Cited by 553
Image fusion: Advances in the state of the art
Ardeshir Goshtasby, A., & Nikolov, S. (2007) · Information Fusion · doi:10.1016/j.inffus.2006.04.001 · Cited by 549
Multi-focus image fusion using dictionary-based sparse representation
Nejati, M., Samavi, S., & Shirani, S. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.10.004 · Cited by 544
A new automated quality assessment algorithm for image fusion
Chen, Y., & Blum, R. S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2007.12.002 · Cited by 516
Comments on ‘Information measure for performance of image fusion’
Hossny, M., Nahavandi, S., & Creighton, D. (2008) · Electronics Letters · doi:10.1049/el:20081754 · Cited by 505
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Self-citationMulti-focus image fusion with dense SIFT
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.004 · Cited by 493
Self-citationBoosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network
Wei, Y., Yuan, Q., Shen, H., & Zhang, L. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2736020 · Cited by 478
Zhou, Z., Wang, B., Li, S., & Dong, M. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.11.003 · Cited by 475
A novel similarity based quality metric for image fusion
Yang, C., Zhang, J.-Q., Wang, X.-R., & Liu, X. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.09.001 · Cited by 468
Self-citationCombination of images with diverse focuses using the spatial frequency
Li, S., Kwok, J. T., & Wang, Y. (2001) · Information Fusion · doi:10.1016/s1566-2535(01)00038-0 · Cited by 461
An Adaptive IHS Pan-Sharpening Method
Rahmani, S., Strait, M., Merkurjev, D., Moeller, M., & Wittman, T. (2010) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2046715 · Cited by 452
A New Pan-Sharpening Method Using a Compressed Sensing Technique
Li, S., & Yang, B. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2067219 · Cited by 444
Multifocus image fusion using region segmentation and spatial frequency
Li, S., & Yang, B. (2008) · Image and Vision Computing · doi:10.1016/j.imavis.2007.10.012 · Cited by 440
A Sparse Image Fusion Algorithm With Application to Pan-Sharpening
Zhu, X. X., & Bamler, R. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2213604 · Cited by 438
Quality of High Resolution Synthesised Images: Is there a Simple Criterion
Lucien Wald, A. (2000) · Cited by 419
Efficient Algorithms for Convolutional Sparse Representations
Wohlberg, B. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2495260 · Cited by 413
A medical image fusion method based on convolutional neural networks
Liu, Y., Chen, X., Cheng, J., & Peng, H. (2017) · 2017 20th International Conference on Information Fusion (Fusion) · doi:10.23919/icif.2017.8009769 · Cited by 391
Self-citationGroup-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion
Li, S., Yin, H., & Fang, L. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217493 · Cited by 385
Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform
Yang, L., Guo, B. L., & Ni, W. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.02.025 · Cited by 379
Pixel-level image fusion with simultaneous orthogonal matching pursuit
Yang, B., & Li, S. (2012) · Information Fusion · doi:10.1016/j.inffus.2010.04.001 · Cited by 377
A New Pansharpening Algorithm Based on Total Variation
Palsson, F., Sveinsson, J. R., & Ulfarsson, M. O. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2013.2257669 · Cited by 373
An overview of multi-modal medical image fusion
Du, J., Li, W., Lu, K., & Xiao, B. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.160 · Cited by 366
Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network
Palsson, F., Sveinsson, J. R., & Ulfarsson, M. O. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2668299 · Cited by 364
Simultaneous image fusion and denoising with adaptive sparse representation
Liu, Y., & Wang, Z. (2015) · IET Image Processing · doi:10.1049/iet-ipr.2014.0311 · Cited by 351
Self-citationConvolutional Sparse Coding for Image Super-Resolution
Gu, S., Zuo, W., Xie, Q., Meng, D., Feng, X., & Zhang, L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.212 · Cited by 347
A New Pan-Sharpening Method With Deep Neural Networks
Huang, W., Xiao, L., Wei, Z., Liu, H., & Tang, S. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2376034 · Cited by 334
Fast Convolutional Sparse Coding
Bristow, H., Eriksson, A., & Lucey, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.57 · Cited by 329
Image matting for fusion of multi-focus images in dynamic scenes
Li, S., Kang, X., Hu, J., & Yang, B. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.07.001 · Cited by 313
QU, X.-B., YAN, J.-W., XIAO, H.-Z., & ZHU, Z.-Q. (2008) · Acta Automatica Sinica · doi:10.1016/s1874-1029(08)60174-3 · Cited by 299
Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries
Li, S., Yin, H., & Fang, L. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2230332 · Cited by 299
Multifocus image fusion using artificial neural networks
Li, S., Kwok, J. T., & Wang, Y. (2002) · Pattern Recognition Letters · doi:10.1016/s0167-8655(02)00029-6 · Cited by 288
A human perception inspired quality metric for image fusion based on regional information
Chen, H., & Varshney, P. K. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.10.001 · Cited by 286
A new metric based on extended spatial frequency and its application to DWT based fusion algorithms
Zheng, Y., Essock, E. A., Hansen, B. C., & Haun, A. M. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.04.003 · Cited by 285
A survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Quadtree-based multi-focus image fusion using a weighted focus-measure
Bai, X., Zhang, Y., Zhou, F., & Xue, B. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.003 · Cited by 277
Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure
Zhang, Y., Bai, X., & Wang, T. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.09.006 · Cited by 276
Fast multi-exposure image fusion with median filter and recursive filter
Li, S., & Kang, X. (2012) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2012.6227469 · Cited by 247
Fast and flexible convolutional sparse coding
Heide, F., Heidrich, W., & Wetzstein, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299149 · Cited by 245
Generalized Random Walks for Fusion of Multi-Exposure Images
Shen, R., Cheng, I., Shi, J., & Basu, A. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2150235 · Cited by 235
Bidirectional recurrent convolutional networks for multi-frame super-resolution
Huang, Y., Wang, W., & Wang, L. (2015) · neural information processing systems · Cited by 222
Multifocus image fusion by combining curvelet and wavelet transform
Li, S., & Yang, B. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.02.002 · Cited by 219
Zhao, J., & Liu, Z. (2007) · Cited by 219
Fusion of multi-focus images using differential evolution algorithm
Aslantas, V., & Kurban, R. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.011 · Cited by 218
Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure
De, I., & Chanda, B. (2013) · Information Fusion · doi:10.1016/j.inffus.2012.01.007 · Cited by 203
Convolutional Neural Networks Analyzed via Convolutional Sparse CodingPreprint
PapyanVardan, RomanoYaniv, & EladMichael (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08194 · Cited by 200
Joint patch clustering-based dictionary learning for multimodal image fusion
Kim, M., Han, D. K., & Ko, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.03.003 · Cited by 196
A region-based multi-sensor image fusion scheme using pulse-coupled neural network
Li, M., Cai, W., & Tan, Z. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.05.004 · Cited by 195
Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network
Du, C., & Gao, S. (2017) · IEEE Access · doi:10.1109/access.2017.2735019 · Cited by 190
A Variational Approach for Pan-Sharpening
Fang, F., Li, F., Shen, C., & Zhang, G. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2258355 · Cited by 171
Dense SIFT for ghost-free multi-exposure fusion
Liu, Y., & Wang, Z. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.06.021 · Cited by 166
Self-citationFusing Images With Different Focuses Using Support Vector Machines
Li, S., Kwok, J. T.-Y., Tsang, I. W.-H., & Wang, Y. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.837780 · Cited by 166
Image Features Extraction and Fusion Based on Joint Sparse Representation
Yu, N., Qiu, T., Bi, F., & Wang, A. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2112332 · Cited by 163
The multiscale directional bilateral filter and its application to multisensor image fusion
Hu, J., & Li, S. (2012) · Information Fusion · doi:10.1016/j.inffus.2011.01.002 · Cited by 163
Multi‐focus image fusion based on non‐subsampled shearlet transform
Guorong, G., Luping, X., & Dongzhu, F. (2013) · IET Image Processing · doi:10.1049/iet-ipr.2012.0558 · Cited by 163
Learning to Compare Image Patches via Convolutional Neural Networks
Zagoruyko, S., & Nikos Komodakis, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.03641 · Cited by 159
Remote Sensing Image Fusion with Convolutional Neural Network
Zhong, J., Yang, B. F., Huang, G., Zhong, F., & Chen, Z. (2016) · Sensing and Imaging · doi:10.1007/s11220-016-0135-6 · Cited by 139
Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images
Jiang, C., Zhang, H., Shen, H., & Zhang, L. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2283236 · Cited by 132
Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion
Shutao Li, A., & Yang, B. (2010) · IEEE Sensors Journal · doi:10.1109/jsen.2010.2041924 · Cited by 113
Video Superresolution via Motion Compensation and Deep Residual Learning
Li, D., & Wang, Z. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2017.2671360 · Cited by 101
Self-citationFusion of Multispectral and Panchromatic Images Using a Restoration-Based Method
Li, Z., & Leung, H. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.2005639 · Cited by 100
Multi-focus image fusion based on the neighbor distance
Zhao, H., Shang, Z., Tang, Y. Y., & Fang, B. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.09.012 · Cited by 100
Statistical comparison of image fusion algorithms: Recommendations
Liu, Z., Blasch, E., & John, V. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.12.007 · Cited by 100
High quality multi-focus image fusion using self-similarity and depth information
Guo, D., Yan, J., & Qu, X. (2014) · Optics Communications · doi:10.1016/j.optcom.2014.10.031 · Cited by 93
MAP Estimation for Multiresolution Fusion in Remotely Sensed Images Using an IGMRF Prior Model
Joshi, M. V., & Jalobeanu, A. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2030323 · Cited by 76
A residual convolutional neural network for pan-shaprening
Rao, Y., He, L., & Zhu, J. (2017) · International Workshop on Remote Sensing with Intelligent Processing (RSIP) · doi:10.1109/rsip.2017.7958807 · Cited by 74
A new pansharpening method using multi resolution analysis framework and deep neural networks
Azarang, A., & Ghassemian, H. (2017) · doi:10.1109/pria.2017.7983017 · Cited by 66
Hossny, M., Nahavandi, S., Creighton, D., & Bhatti, A. (2010) · Electronics Letters · doi:10.1049/el.2010.1778 · Cited by 65
Detecting anomalous structures by convolutional sparse models
Carrera, D., Boracchi, G., Foi, A., & Wohlberg, B. E. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280790 · Cited by 61
Exposure fusion based on sparse representation using approximate K-SVD
Wang, J., Liu, H., & He, N. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.12.042 · Cited by 43
Image Fusion and Super-Resolution with Convolutional Neural Network
Zhong, J., Yang, B. F., Li, Y., Zhong, F., & Chen, Z. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-3005-5_7 · Cited by 43
Multifocus Image Fusion Based on Extreme Learning Machine and Human Visual System
Yang, Y., Yang, M., Huang, S., Que, Y., Ding, M., & Sun, J. (2017) · IEEE Access · doi:10.1109/access.2017.2696119 · Cited by 43
Multi-focus image fusion and super-resolution with convolutional neural network
Yang, B. F., Zhong, J., Li, Y., & Chen, Z. (2017) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s0219691317500370 · Cited by 42
Research works printed but not linked: 12
- Zhang, 2016, Robust multi-focus image fusion using multi-task sparse representation and spatial context, IEEE Trans. Image Process., 25, 2045, 10.1109/TIP.2016.2524212 · doi:10.1109/tip.2016.2524212
- Goshtasby, 2005, Fusion of multi-exposure images, Image Vision Comput., 23, 611, 10.1016/j.imavis.2005.02.004 · doi:10.1016/j.imavis.2005.02.004
- Kong, 2008, Multi-focus image fusion using spatial frequency and genetic algorithm, Int. J. Comput. Sci. Network Secur., 8, 220
- Zhang, 2012, Gradient-directed multiexposure composition, IEEE Trans. Image Process., 21, 2318, 10.1109/TIP.2011.2170079 · doi:10.1109/tip.2011.2170079
- Shahdoosti, 2016, Combining the spectral pca and spatial pca fusion methods by an optimal filter, Inf. Fusion, 27, 150, 10.1016/j.inffus.2015.06.006 · doi:10.1016/j.inffus.2015.06.006
- Amolins, 2007, Wavelet based image fusion techniques: an introduction, review and comparison, ISPRS J. Photogramm. Remote Sens., 62, 249, 10.1016/j.isprsjprs.2007.05.009 · doi:10.1016/j.isprsjprs.2007.05.009
- Shah, 2008, An efficient pan-sharpening method via a combined adaptive pca approach and contourlets, IEEE Trans. Geosci. Remote Sens., 46, 1323, 10.1109/TGRS.2008.916211 · doi:10.1109/tgrs.2008.916211
- Xu, 2011, An image fusion approach based on markov random fields, IEEE Trans. Geosci. Remote Sens., 49, 5116, 10.1109/TGRS.2011.2158607 · doi:10.1109/tgrs.2011.2158607
- Ghahremani, 2016, A compressed-sensing-based pan-sharpening method for spectral distortion reduction, IEEE Trans. Geosci. Remote Sens., 54, 2194, 10.1109/TGRS.2015.2497309 · doi:10.1109/tgrs.2015.2497309
- Wang, 2005, A nonlinear correlation measure for multivariable data set, Physica D, 200, 287
- Cvejic, 2005, A similarity metric for assessment of image fusion algorithms, Int. J. Signal Process., 2, 178
- Alparone, 2004, A global quality measurement of pan-sharpened multispectral imagery, IEEE Geosci. Remote Sens. Lett., 1, 313, 10.1109/LGRS.2004.836784 · doi:10.1109/lgrs.2004.836784
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Self-citationFusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
IFCNN: A general image fusion framework based on convolutional neural network
Zhang, Y., Liu, Y., Sun, P., Yan, H., Zhao, X., & Zhang, L. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.011 · Cited by 1,550
Self-citation
Metadata
- Authors
- Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2018-07
- Volume
- 42
- Pages
- 158-173
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2767512561
- Cited by
- 736
- References
- 120
- FWCI
- 43.87
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- National Natural Science Foundation of China (61501164, 81571760, 61701160)
- Fundamental Research Funds for the Central Universities (JZ2016HGPA0731, JZ2016HGBZ1025, JZ2017HGTA0176)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.