The DOI matches its Crossref record; 216 of the 216 references it cites were found in a registry or an index.
Infrared and visible image fusion methods and applications: A survey
Abstract
Abstract Infrared images can distinguish targets from their backgrounds based on the radiation difference, which works well in all-weather and all-day/night conditions. By contrast, visible images can provide texture details with high spatial resolution and definition in a manner consistent with the human visual system. Therefore, it is desirable to fuse these two types of images, which can combine the advantages of thermal radiation information in infrared images and detailed texture information in visible images. In this work, we comprehensively survey the existing methods and applications for the fusion of infrared and visible images. First, infrared and visible image fusion methods are reviewed in detail. Meanwhile, image registration, as a prerequisite of image fusion, is briefly introduced. Second, we provide an overview of the main applications of infrared and visible image fusion. Third, the evaluation metrics of fusion performance are discussed and summarized. Fourth, we select eighteen representative methods and nine assessment metrics to conduct qualitative and quantitative experiments, which can provide an objective performance reference for different fusion methods and thus support relative engineering with credible and solid evidence. Finally, we conclude with the current status of infrared and visible image fusion and deliver insightful discussions and prospects for future work. This survey can serve as a reference for researchers in infrared and visible image fusion and related fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,564
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Scale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
(1981) · Cited by 11,963
Cited by
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationU2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Self-citationMa, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationRFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhang, J., Zhang, Y., Xu, S., Lin, Z., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00572 · Cited by 948
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Self-citationArtificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Self-citationZhang, H., Xu, H., Xiao, Y., Guo, X., & Ma, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6975 · Cited by 589
Self-citationIllumination-aware faster R-CNN for robust multispectral pedestrian detection
Li, C., Song, D., Tong, R., & Tang, M. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.005 · Cited by 533
Self-citationA review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Self-citationDIVFusion: Darkness-free infrared and visible image fusion
Tang, L., Xiang, X., Zhang, H., Gong, M., & Ma, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.10.034 · Cited by 509
Self-citationLRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images
Li, H., Xu, T., Wu, X.-J., Lu, J., & Kittler, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3268209 · Cited by 493
SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
Tang, L., Deng, Y., Ma, Y., Huang, J., & Ma, J. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.106082 · Cited by 488
Self-citationYDTR: Infrared and Visible Image Fusion via Y-Shape Dynamic Transformer
Tang, W., He, F., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3192661 · Cited by 485
STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection
Ma, J., Tang, L., Xu, M., Zhang, H., & Xiao, G. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3075747 · Cited by 483
Self-citationPan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion
Ma, J., Yu, W., Chen, C., Liang, P., Guo, X., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.04.006 · Cited by 471
Self-citationInfrared and visible image fusion via detail preserving adversarial learning
Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.005 · Cited by 456
Self-citationInfrared and visible image fusion based on target-enhanced multiscale transform decomposition
Chen, J., Li, X., Luo, L., Mei, X., & Ma, J. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.066 · Cited by 453
Self-citationDDFM: Denoising Diffusion Model for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhu, Y., Zhang, J., Xu, S., Zhang, Y., Zhang, K., Meng, D., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00742 · Cited by 431
Li, J., Huo, H., Li, C., Wang, R., & Feng, Q. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2997127 · Cited by 415
Self-citationVisible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
Zhang, H., Le, Z., Shao, Z., Xu, H., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.08.022 · Cited by 366
Self-citationImage Fusion Techniques: A Survey
Kaur, H., Koundal, D., & Kadyan, V. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09540-7 · Cited by 361
Cross-modality interactive attention network for multispectral pedestrian detection
Zhang, L., Liu, Z., Zhang, S., Yang, X., Qiao, H., Huang, K., & Hussain, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.015 · Cited by 320
Multi-focus image fusion: A Survey of the state of the art
Liu, Y., Wang, L., Cheng, J., Li, C., & Chen, X. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.013 · Cited by 320
Self-citationMultimodal medical image fusion review: Theoretical background and recent advances
Hermessi, H., Mourali, O., & Zagrouba, E. (2021) · Signal Processing · doi:10.1016/j.sigpro.2021.108036 · Cited by 301
Classification Saliency-Based Rule for Visible and Infrared Image Fusion
Xu, H., Zhang, H., & Ma, J. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3100986 · Cited by 294
Self-citationDif-Fusion: Toward High Color Fidelity in Infrared and Visible Image Fusion With Diffusion Models
Yue, J., Fang, L., Xia, S., Deng, Y., & Ma, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3322046 · Cited by 304
Self-citationComputer vision applications in construction safety assurance
Fang, W., Ding, L., Love, P. E. D., Luo, H., Li, H., Peña-Mora, F., Zhong, B., & Zhou, C. (2020) · Automation in Construction · doi:10.1016/j.autcon.2019.103013 · Cited by 288
MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion
Xu, H., Yuan, J., & Ma, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3283682 · Cited by 288
Self-citationSpectral-Spatial Attention Networks for Hyperspectral Image Classification
Mei, X., Pan, E., Ma, Y., Dai, X., Huang, J., Fan, F., Du, Q., Zheng, H., & Ma, J. (2019) · Remote Sensing · doi:10.3390/rs11080963 · Cited by 285
Self-citationGuided Locality Preserving Feature Matching for Remote Sensing Image Registration
Ma, J., Jiang, J., Zhou, H., Zhao, J., & Guo, X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2820040 · Cited by 283
Self-citationMEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
Xu, H., Ma, J., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2999855 · Cited by 282
Self-citationCurrent advances and future perspectives of image fusion: A comprehensive review
Karim, S., Tong, G., Li, J., Qadir, A., Farooq, U., & Yu, Y. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.019 · Cited by 275
VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion
Hou, R., Zhou, D., Nie, R., Liu, D., Xiong, L., Guo, Y., & Yu, C. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2965304 · Cited by 257
Davari, N., Akbarizadeh, G., & Mashhour, E. (2021) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2020.3046161 · Cited by 106
Li, H.-C., Deng, Z.-Y., & Chiang, H.-H. (2020) · Sensors · doi:10.3390/s20216114 · Cited by 54
Degradation-Resistant Unfolding Network for Heterogeneous Image Fusion
He, C., Li, K., Xu, G., Zhang, Y., Hu, R., Guo, Z., & Li, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01159 · Cited by 37
Metadata
- Authors
- Ma, J., Ma, Y., & Li, C.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 45
- Pages
- 153-178
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2809795042
- Cited by
- 1,732
- References
- 216
- FWCI
- 92.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.