The DOI matches its Crossref record; 175 of the 175 references it cites were found in a registry or an index.
Visible and Infrared Image Fusion Using Deep Learning
Abstract
Visible and infrared image fusion (VIF) has attracted a lot of interest in recent years due to its application in many tasks, such as object detection, object tracking, scene segmentation, and crowd counting. In addition to conventional VIF methods, an increasing number of deep learning-based VIF methods have been proposed in the last five years. Different types of methods, such as CNN-based, autoencoder-based, GAN-based, and transformer-based methods, have been proposed. Deep learning-based methods have undoubtedly become dominant methods for the VIF task. However, while much progress has been made, the field will benefit from a systematic review of these deep learning-based methods. In this paper we present a comprehensive review of deep learning-based VIF methods. We discuss motivation, taxonomy, recent development characteristics, datasets, and performance evaluation methods in detail. We also discuss future prospects of the VIF field. This paper can serve as a reference for VIF researchers and those interested in entering this fast-developing field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Image quality measures and their performance
Eskicioglu, A. M., & Fisher, P. S. (1995) · IEEE Transactions on Communications · doi:10.1109/26.477498 · Cited by 2,117
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
IFCNN: A general image fusion framework based on convolutional neural network
Zhang, Y., Liu, Y., Sun, P., Yan, H., Zhao, X., & Zhang, L. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.011 · Cited by 1,550
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Ma, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationLiu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
Multispectral pedestrian detection: Benchmark dataset and baseline
Hwang, S., Park, J., Kim, N., Choi, Y., & Kweon, I. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298706 · Cited by 1,249
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
Tang, L., Yuan, J., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.004 · Cited by 1,136
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Medical image fusion: A survey of the state of the art
James, A. P., & Dasarathy, B. V. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.12.002 · Cited by 967
LLVIP: A Visible-infrared Paired Dataset for Low-light Vision
Jia, X., Zhu, C., Li, M., Tang, W., & Zhou, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00389 · Cited by 896
A review of remote sensing image fusion methods
Ghassemian, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.03.003 · Cited by 849
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Li, H., Wu, X.-J., & Durrani, T. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3005230 · Cited by 798
SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
Zhang, H., & Ma, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01501-8 · Cited by 747
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., & Wu, W. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.109 · Cited by 717
MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693
MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion
Li, H., Wu, X.-J., & Kittler, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2975984 · Cited by 627
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Zhang, H., Xu, H., Xiao, Y., Guo, X., & Ma, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6975 · Cited by 589
FusionDN: A Unified Densely Connected Network for Image Fusion
Xu, H., Ma, J., Le, Z., Jiang, J., & Guo, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6936 · Cited by 587
Recent advances in visual and infrared face recognition—a review
Kong, S. G., Heo, J., Abidi, B. R., Paik, J., & Abidi, M. A. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.04.001 · Cited by 586
RGB-T object tracking: Benchmark and baseline
Li, C., Liang, X., Lu, Y., Zhao, N., & Tang, J. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106977 · Cited by 581
Infrared and Visible Image Fusion using a Deep Learning Framework
Li, H., Wu, X.-J., & Kittler, J. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546006 · Cited by 534
Comments on ‘Information measure for performance of image fusion’
Hossny, M., Nahavandi, S., & Creighton, D. (2008) · Electronics Letters · doi:10.1049/el:20081754 · Cited by 505
SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
Tang, L., Deng, Y., Ma, Y., Huang, J., & Ma, J. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.106082 · Cited by 488
YDTR: Infrared and Visible Image Fusion via Y-Shape Dynamic Transformer
Tang, W., He, F., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3192661 · Cited by 485
Merging Thermal And Visual Images By A Contrast Pyramid
Toet, A., van Ruyven, L. J., & Valeton, J. M. (1989) · Optical Engineering · doi:10.1117/12.7977034 · Cited by 484
STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection
Ma, J., Tang, L., Xu, M., Zhang, H., & Xiao, G. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3075747 · Cited by 483
Infrared and visible image fusion with convolutional neural networks
Liu, Y., Chen, X., Cheng, J., Peng, H., & Wang, Z. (2018) · International Journal of Wavelets, Multiresolution and Information Processing · doi:10.1142/s0219691318500182 · Cited by 479
Infrared and visible image fusion via detail preserving adversarial learning
Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.005 · Cited by 456
MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer
Tang, W., He, F., Liu, Y., & Duan, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3193288 · Cited by 442
Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion
Liu, J., Fan, X., Jiang, J., Liu, R., & Luo, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3056725 · Cited by 431
Background-subtraction using contour-based fusion of thermal and visible imagery
Davis, J. W., & Sharma, V. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.06.010 · Cited by 418
Li, J., Huo, H., Li, C., Wang, R., & Feng, Q. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2997127 · Cited by 415
Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking
Li, C., Cheng, H., Hu, S., Liu, X., Tang, J., & Lin, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2614135 · Cited by 391
Infrared and visible image fusion with ResNet and zero-phase component analysis
Li, H., Wu, X.-J., & Durrani, T. S. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.103039 · Cited by 360
DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
Zhao, Z., Xu, S., Zhang, C., Liu, J., Zhang, J., & Li, P. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/135 · Cited by 341
Pedestrian Detection at Day/Night Time with Visible and FIR Cameras: A Comparison
González, A., Fang, Z., Socarras, Y., Serrat, J., Vázquez, D., Xu, J., & López, A. (2016) · Sensors · doi:10.3390/s16060820 · Cited by 322
Wang, D., Liu, J., Fan, X., & Liu, R. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/487 · Cited by 318
Petro, A. B., Sbert, C., & Morel, J.-M. (2014) · Image Processing On Line · doi:10.5201/ipol.2014.107 · Cited by 317
LasHeR: A Large-Scale High-Diversity Benchmark for RGBT Tracking
Li, C., Xue, W., Jia, Y., Qu, Z., Luo, B., Tang, J., & Sun, D. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3130533 · Cited by 307
Classification Saliency-Based Rule for Visible and Infrared Image Fusion
Xu, H., Zhang, H., & Ma, J. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3100986 · Cited by 294
MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
Xu, H., Ma, J., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2999855 · Cited by 282
Self-citationVisible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline
Zhang, P., Zhao, J., Wang, D., Lu, H., & Ruan, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00868 · Cited by 278
Weakly Aligned Cross-Modal Learning for Multispectral Pedestrian Detection
Zhang, L., Zhu, X., Chen, X., Yang, X., Lei, Z., & Liu, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00523 · Cited by 271
RGBT Salient Object Detection: A Large-Scale Dataset and Benchmark
Tu, Z., Ma, Y., Li, Z., Li, C., Xu, J., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171688 · Cited by 260
VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion
Hou, R., Zhou, D., Nie, R., Liu, D., Xiong, L., Guo, Y., & Yu, C. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2965304 · Cited by 257
Jian, L., Yang, X., Liu, Z., Jeon, G., Gao, M., & Chisholm, D. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3022438 · Cited by 251
VIFB: A Visible and Infrared Image Fusion Benchmark
Zhang, X., Ye, P., & Xiao, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00060 · Cited by 250
Self-citationEfficient and Model-Based Infrared and Visible Image Fusion via Algorithm Unrolling
Zhao, Z., Xu, S., Zhang, J., Liang, C., Zhang, C., & Liu, J. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3075745 · Cited by 242
Zhang, Y., Zhang, L., Bai, X., & Zhang, L. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.05.007 · Cited by 236
RXDNFuse: A aggregated residual dense network for infrared and visible image fusion
Long, Y., Jia, H., Zhong, Y., Jiang, Y., & Jia, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.11.009 · Cited by 233
Zhang, H., Yuan, J., Tian, X., & Ma, J. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3119954 · Cited by 215
Object fusion tracking based on visible and infrared images: A comprehensive review
Zhang, X., Ye, P., Leung, H., Gong, K., & Xiao, G. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.05.002 · Cited by 208
Self-citationDeep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study
Zhang, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3078906 · Cited by 206
Self-citationVs, V., Jose Valanarasu, J. M., Oza, P., & Patel, V. M. (2022) · 2022 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip46576.2022.9897280 · Cited by 205
Quality-Aware Feature Aggregation Network for Robust RGBT Tracking
Zhu, Y., Li, C., Tang, J., & Luo, B. (2021) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.2980735 · Cited by 188
DRF: Disentangled Representation for Visible and Infrared Image Fusion
Xu, H., Wang, X., & Ma, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3056645 · Cited by 187
RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion
Xu, H., Ma, J., Yuan, J., Le, Z., & Liu, W. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01906 · Cited by 187
Unsupervised Deep Image Fusion With Structure Tensor Representations
Jung, H., Kim, Y., Jang, H., Ha, N., & Sohn, K. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2966075 · Cited by 186
Li, H., Cen, Y., Liu, Y., Chen, X., & Yu, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3069339 · Cited by 186
Multi-scale Guided Image and Video Fusion: A Fast and Efficient Approach
Bavirisetti, D. P., Xiao, G., Zhao, J., Dhuli, R., & Liu, G. (2019) · Circuits, Systems, and Signal Processing · doi:10.1007/s00034-019-01131-z · Cited by 185
Zhou, H., Wu, W., Zhang, Y., Ma, J., & Ling, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3129609 · Cited by 185
Benchmarking and comparing multi-exposure image fusion algorithms
Zhang, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.005 · Cited by 180
Self-citationQu, L., Liu, S., Wang, M., & Song, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20109 · Cited by 179
Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network
Yang, Y., Liu, J., Huang, S., Wan, W., Wen, W., & Guan, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3054584 · Cited by 176
CGTF: Convolution-Guided Transformer for Infrared and Visible Image Fusion
Li, J., Zhu, J., Li, C., Chen, X., & Yang, B. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3175055 · Cited by 171
UNFusion: A Unified Multi-Scale Densely Connected Network for Infrared and Visible Image Fusion
Wang, Z., Wang, J., Wu, Y., Xu, J., & Zhang, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3109895 · Cited by 169
Self-citationAn autonomous drone for search and rescue in forests using airborne optical sectioning
Schedl, D. C., Kurmi, I., & Bimber, O. (2021) · Science Robotics · doi:10.1126/scirobotics.abg1188 · Cited by 168
A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion
Liu, R., Liu, J., Jiang, Z., Fan, X., & Luo, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3043125 · Cited by 165
SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
Wang, Z., Chen, Y., Shao, W., Li, H., & Zhang, L. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3191664 · Cited by 162
Xu, H., Gong, M., Tian, X. S., Huang, J., & Ma, J. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103407 · Cited by 151
TCCFusion: An infrared and visible image fusion method based on transformer and cross correlation
Tang, W., He, F., & Liu, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2022.109295 · Cited by 148
Edge-Aware Guidance Fusion Network for RGB–Thermal Scene Parsing
Zhou, W., Dong, S., Xu, C., & Qian, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20269 · Cited by 146
Image fusion based on generative adversarial network consistent with perception
Fu, Y., Wu, X., & Durrani, T. S. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.019 · Cited by 132
Coupled GAN With Relativistic Discriminators for Infrared and Visible Images Fusion
Li, Q., Lu, L., Li, Z., Wu, W., Liu, Z., Jeon, G., & Yang, X. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2921803 · Cited by 127
Infrared and Visible Image Fusion Techniques Based on Deep Learning: A Review
Sun, C., Zhang, C., & Xiong, N. N. (2020) · Electronics · doi:10.3390/electronics9122162 · Cited by 119
Xu, H., Liang, P., Yu, W., Jiang, J., & Ma, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/549 · Cited by 112
Zhang, X., Ye, P., Peng, S., Liu, J., & Xiao, G. (2020) · Signal Processing Image Communication · doi:10.1016/j.image.2019.115756 · Cited by 112
Self-citationLi, J., Huo, H., Liu, K., & Li, C. (2020) · Information Sciences · doi:10.1016/j.ins.2020.04.035 · Cited by 101
A Dual-Branch Network for Infrared and Visible Image Fusion
Fu, Y., & Wu, X. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412293 · Cited by 101
Self-supervised feature adaption for infrared and visible image fusion
Zhao, F., Zhao, W., Yao, L., & Liu, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.002 · Cited by 101
Gao, Y., Ma, S., & Liu, J. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3206807 · Cited by 100
Multigrained Attention Network for Infrared and Visible Image Fusion
Li, J., Huo, H., Li, C., Wang, R.-H., Sui, C., & Liu, Z. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3029360 · Cited by 97
SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion
Liu, J., Wu, Y., Huang, Z., Liu, R., & Fan, X. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3109818 · Cited by 93
Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion
Liu, R., Liu, Z., Liu, J., & Fan, X. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475299 · Cited by 87
Wang, Z., Wu, Y., Wang, J., Xu, J., & Shao, W. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3139654 · Cited by 85
Yan, Y., Ren, J., Zhao, H., Sun, G., Wang, Z., Zheng, J., Marshall, S., & Soraghan, J. J. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9529-6 · Cited by 83
Zero-Learning Fast Medical Image Fusion
Lahoud, F., & Susstrunk, S. E. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011178 · Cited by 82
Deep Visible and Thermal Image Fusion for Enhanced Pedestrian Visibility
Shopovska, I., Jovanov, L., & Philips, W. R. (2019) · Sensors · doi:10.3390/s19173727 · Cited by 82
Xiao, W., Zhang, Y., Wang, H., Li, F., & Jin, H. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3149101 · Cited by 79
Unified gradient- and intensity-discriminator generative adversarial network for image fusion
Zhou, H., Hou, J., Zhang, Y., Ma, J., & Ling, H. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.07.016 · Cited by 73
Hou, J., Zhang, D., Wu, W., et al. (2021) · Entropy · doi:10.3390/e23030376 · Cited by 72
RGB-T SLAM: A flexible SLAM framework by combining appearance and thermal information
Chen, L. F., Sun, L., Yang, T., Fan, L., Huang, K., & Xuanyuan, Z. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989668 · Cited by 71
UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion
Le, Z., Huang, J., Xu, H., Fan, F., Ma, Y., Mei, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.07.013 · Cited by 71
IFSepR: A General Framework for Image Fusion Based on Separate Representation Learning
Luo, X., Gao, Y., Wang, A., Zhang, Z., & Wu, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3129354 · Cited by 69
Visible and infrared image registration in man-made environments employing hybrid visual features
Han, J., Pauwels, E., & de Zeeuw, P. M. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.03.022 · Cited by 67
DNDT: Infrared and Visible Image Fusion Via DenseNet and Dual-Transformer
Zhao, H., & Nie, R. (2021) · International Conference on Information Technology and Biomedical Engineering (ICITBE) · doi:10.1109/icitbe54178.2021.00025 · Cited by 64
Infrared and Visible Image Fusion Based on Deep Decomposition Network and Saliency Analysis
Jian, L., Rayhana, R., Ma, L., Wu, S., Liu, Z., & Jiang, H. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3096088 · Cited by 62
Infrared and visible image fusion via parallel scene and texture learning
Xu, M., Tang, L., Zhang, H., & Ma, J. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108929 · Cited by 59
Zhou, H., Sun, M., Ren, X., et al. (2021) · Remote Sensing · doi:10.3390/rs13183656 · Cited by 55
Zhang, X., Ye, P., Qiao, D., Zhao, J., Peng, S., & Xiao, G. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011253 · Cited by 54
Self-citationA new thermal infrared and visible spectrum images-based pedestrian detection system
Lahmyed, R., Ansari, M. E., & Ellahyani, A. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6974-5 · Cited by 53
CLF-Net: Contrastive Learning for Infrared and Visible Image Fusion Network
Zhu, Z., Yang, X., Lu, R., Shen, T., Xie, X., & Zhang, T. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3203000 · Cited by 49
Zhou, Q., Ye, S., Wen, M., Huang, Z., Ding, M., & Zhang, X. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07635-1 · Cited by 47
Self-citationTransfuse: A Unified Transformer-Based Image Fusion Framework Using Self-Supervised LearningPreprint
Qu, L., Liu, S., Wang, M., Li, S., Yin, S., Qiao, Q., & Song, Z. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4130858 · Cited by 46
UNIFusion: A Lightweight Unified Image Fusion Network
Cheng, C., Wu, X., Xu, T., & Chen, G. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3109379 · Cited by 44
Triple-discriminator generative adversarial network for infrared and visible image fusion
Song, A., Duan, H., Pei, H., & Ding, L. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.02.025 · Cited by 44
Non-rigid infrared and visible image registration by enhanced affine transformation
Min, C., Gu, Y., Li, Y., & Feng, Y. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107377 · Cited by 43
IPLF: A Novel Image Pair Learning Fusion Network for Infrared and Visible Image
Zhu, D., Zhan, W., Jiang, Y., Xu, X., & Guo, R. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3161733 · Cited by 43
IR-MSDNet: Infrared and Visible Image Fusion Based On Infrared Features and Multiscale Dense Network
Raza, A., Liu, J., Liu, Y., Liu, J., Zeng, L., Chen, X., Huo, H., & Fang, T. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3065121 · Cited by 41
Learning Specific and General Realm Feature Representations for Image Fusion
Zhao, F., & Zhao, W. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3016123 · Cited by 40
MAFusion: Multiscale Attention Network for Infrared and Visible Image Fusion
Li, X., Chen, H., Li, Y., & Peng, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3181898 · Cited by 40
Infrared and visible image fusion with supervised convolutional neural network
An, W., & Wang, H. (2020) · Optik · doi:10.1016/j.ijleo.2020.165120 · Cited by 37
DGLT-Fusion: A decoupled global–local infrared and visible image fusion transformer
Yang, X., Huo, H., Wang, R.-H., Li, C., Liu, X., & Li, J. (2022) · Infrared Physics & Technology · doi:10.1016/j.infrared.2022.104522 · Cited by 37
MFST: Multi-Modal Feature Self-Adaptive Transformer for Infrared and Visible Image Fusion
Liu, X., Gao, H., Miao, Q., et al. (2022) · Remote Sensing · doi:10.3390/rs14133233 · Cited by 36
Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network
Xu, D., Wang, Y., Xu, S., Zhu, K., Zhang, N., & Zhang, X. (2020) · Applied Sciences · doi:10.3390/app10020554 · Cited by 35
Self-citationInfrared and Visible Image Fusion through Details Preservation
Liu, Y., Dong, L., Ji, Y., & Xu, W. (2019) · Sensors · doi:10.3390/s19204556 · Cited by 34
Xu, D., Zhang, N., Zhang, Y., Li, Z., Zhao, Z., & Wang, Y. (2022) · Infrared Physics & Technology · doi:10.1016/j.infrared.2022.104242 · Cited by 30
LBP-BEGAN: A generative adversarial network architecture for infrared and visible image fusion
Xu, J., Shi, X., Qin, S., Lu, K., Wang, H., & Ma, J. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.103144 · Cited by 29
An unsupervised multi‐focus image fusion method based on Transformer and U‐Net
Jin, X., Xi, X., Zhou, D. X., Ren, X., Yang, J., & Jiang, Q. (2022) · IET Image Processing · doi:10.1049/ipr2.12668 · Cited by 29
Improving the Performance of Image Fusion Based on Visual Saliency Weight Map Combined With CNN
Yan, L., Cao, J., Rizvi, S., et al. (2020) · IEEE Access · doi:10.1109/access.2020.2982712 · Cited by 28
Multi-focus Image Fusion: A BenchmarkPreprint
Zhang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.01116 · Cited by 28
Self-citationFusion of Infrared-Visible Images in UE-IoT for Fault Point Detection Based on GAN
Liao, B., Du, Y., & Yin, X. (2020) · IEEE Access · doi:10.1109/access.2020.2990539 · Cited by 28
Siamese Cross-Domain Tracker Design for Seamless Tracking of Targets in RGB and Thermal Videos
Chandrakanth, V., Murthy, V. S. N., & Channappayya, S. S. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3151307 · Cited by 28
Learn to Search a Lightweight Architecture for Target-Aware Infrared and Visible Image Fusion
Liu, J., Wu, Y., Wu, G., Liu, R., & Fan, X. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3180672 · Cited by 28
Su, W., Huang, Y., Li, Q., et al. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3177717 · Cited by 28
Wang, M., Liu, X., & Jin, H. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.02.011 · Cited by 26
A light-weight, efficient, and general cross-modal image fusion network
Fang, A., Zhao, X., Yang, J., Qin, B., & Zhang, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.044 · Cited by 26
MMF: A Multi-scale MobileNet based fusion method for infrared and visible image
Liu, Y., Miao, C., Ji, J., & Li, X. (2021) · Infrared Physics & Technology · doi:10.1016/j.infrared.2021.103894 · Cited by 25
Ding, Z., Li, H., Zhou, D., et al. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03952-z · Cited by 25
Infrared and visible image fusion based on dilated residual attention network
Mustafa, H. T., Yang, J., Mustafa, H., & Zareapoor, M. (2020) · Optik · doi:10.1016/j.ijleo.2020.165409 · Cited by 23
Unsupervised densely attention network for infrared and visible image fusion
Li, Y., Wang, J., Miao, Z., & Wang, J. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09301-x · Cited by 22
FLGC-Fusion GAN: An Enhanced Fusion GAN Model by Importing Fully Learnable Group Convolution
Cao, Y., Sun, C., Tang, X., & Liu, R. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/6384831 · Cited by 22
Infrared-Visible Image Fusion Based on Convolutional Neural Networks (CNN)
Ren, X., Meng, F., Hu, T., Liu, Z., & Wang, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02698-1_26 · Cited by 21
Infrared and visible fusion imaging via double-layer fusion denoising neural network
Li, Z., Wu, H. Y., Cheng, L., Luo, S., & Chen, M. (2022) · Digital Signal Processing · doi:10.1016/j.dsp.2022.103433 · Cited by 21
Can thermal and visible image fusion improves ear recognition?
Ariffin, S. M. Z. S. Z., Jamil, N., & Rahman, P. N. M. A. (2017) · doi:10.1109/icitech.2017.8079945 · Cited by 20
DenseNetFuse: a study of deep unsupervised DenseNet to infrared and visual image fusion
Pan, Y., Pi, D., Khan, I. A., Khan, Z. U., Chen, J., & Han, M. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02820-3 · Cited by 19
Chen, C., Sun, C., Sun, Y., & Zhu, J. (2022) · Signal Processing Image Communication · doi:10.1016/j.image.2022.116722 · Cited by 17
Peng, Y., Liu, G., Xu, X., Bavirisetti, D. P., Gu, X., & Zhang, X. (2022) · Optik · doi:10.1016/j.ijleo.2022.169599 · Cited by 17
Self-citationA Multilevel Hybrid Transmission Network for Infrared and Visible Image Fusion
Li, Q., Han, G., Liu, P., Yang, H., Chen, D., Sun, X., Wu, J., & Liu, D. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3186048 · Cited by 17
Özer, S., Ege, M., & Özkanoğlu, M. A. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108712 · Cited by 16
Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network
Cui, Y., Du, H., & Mei, W. (2019) · IEEE Access · doi:10.1109/access.2019.2959034 · Cited by 15
Non-linear and selective fusion of cross-modal images
Fang, A., Zhao, X., Yang, J., Zhang, Y., & Zheng, X. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108042 · Cited by 15
Advanced Driving Assistance Based on the Fusion of Infrared and Visible Images
Gu, Y., Wang, X., Zhang, C., & Li, B. (2021) · Entropy · doi:10.3390/e23020239 · Cited by 14
TPFusion: Texture Preserving Fusion of Infrared and Visible Images via Dense Networks
Yang, Z., & Zeng, S. (2022) · Entropy · doi:10.3390/e24020294 · Cited by 11
Multiscale channel attention network for infrared and visible image fusion
Zhu, J., Dou, Q., Jian, L., et al. (2020) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6155 · Cited by 10
Debiased Subjective Assessment of Real-World Image Enhancement
Cao, P., Wang, Z., & Ma, K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00077 · Cited by 10
Luo, X., Wang, A., Zhang, Z., Xiang, X., & Wu, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3105250 · Cited by 10
VMDM-fusion: a saliency feature representation method for infrared and visible image fusion
Yang, Y., Liu, J., Huang, S., Lu, H., & Wen, W.-Y. (2021) · Signal Image and Video Processing · doi:10.1007/s11760-021-01852-2 · Cited by 9
Two-Level Consistency Metric for Infrared and Visible Image Fusion
Lin, X., Zhou, G., Tu, X., Huang, Y., & Ding, X. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3203115 · Cited by 9
Li, J., Huo, H., Liu, K., Li, C., Li, S., & Yang, X. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00322 · Cited by 8
Multimodal Sensor Fusion Using Symmetric Skip Autoencoder Via an Adversarial Regulariser
Bhagat, S., Joshi, S. D., Lall, B., et al. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3035633 · Cited by 7
Infrared and visible image fusion based on Laplacian pyramid and generative adversarial network
Wang, J., Ke, C., Wu, M., Liu, M., & Zeng, C. (2021) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2021.05.010 · Cited by 7
IBPNet: a multi-resolution and multi-modal image fusion network via iterative back-projection
Liu, C., Yang, B. F., Zhang, X., & Pang, L. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03375-w · Cited by 7
Self-citationBlur Regional Features Based Infrared And Visible Image Fusion Using An Improved C3Net Model
Zhao, X., Liu, G., Tang, L. L., et al. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1820/1/012169 · Cited by 6
Effective method for fusing infrared and visible images
Fu, Y., Wu, X., & Kittler, J. (2021) · Journal of Electronic Imaging · doi:10.1117/1.jei.30.3.033013 · Cited by 5
Visible And Infrared Image Fusion Using Encoder-Decoder Network
Ataman, F. C., & Akar, G. B. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506740 · Cited by 5
Cross Attention-guided Dense Network for Images FusionPreprint
Shen, Z., Wang, J., Pan, Z., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11393 · Cited by 5
An Approach for Fusion of Thermal and Visible Images
Patel, H., Prajapati, K., Chudasama, V. M., et al. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-7219-7_19 · Cited by 2
Wang, J., Li, Y., & Miao, Z. (2021) · International Conference on Image and Graphics Processing (ICIGP) · doi:10.1145/3447587.3447603 · Cited by 2
Metadata
- Authors
- Zhang, X., & Demiris, Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-08
- Volume
- 45
- Issue
- 8
- Pages
- 10535-10554
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4362014679
- Cited by
- 392
- References
- 175
- FWCI
- 43.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.