The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
FusionGAN: A generative adversarial network for infrared and visible image fusion
Abstract
Abstract Infrared images can distinguish targets from their backgrounds on the basis of difference in thermal radiation, which works well at all day/night time and under all weather conditions. By contrast, visible images can provide texture details with high spatial resolution and definition in a manner consistent with the human visual system. This paper proposes a novel method to fuse these two types of information using a generative adversarial network, termed as FusionGAN. Our method establishes an adversarial game between a generator and a discriminator, where the generator aims to generate a fused image with major infrared intensities together with additional visible gradients, and the discriminator aims to force the fused image to have more details existing in visible images. This enables that the final fused image simultaneously keeps the thermal radiation in an infrared image and the textures in a visible image. In addition, our FusionGAN is an end-to-end model, avoiding manually designing complicated activity level measurements and fusion rules as in traditional methods. Experiments on public datasets demonstrate the superiority of our strategy over state-of-the-arts, where our results look like sharpened infrared images with clear highlighted targets and abundant details. Moreover, we also generalize our FusionGAN to fuse images with different resolutions, say a low-resolution infrared image and a high-resolution visible image. Extensive results demonstrate that our strategy can generate clear and clean fused images which do not suffer from noise caused by upsampling of infrared information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
2013 IEEE International Conference on Computer Vision
(2013) · doi:10.1109/iccv19984.2013 · Cited by 4,183
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Image quality measures and their performance
Eskicioglu, A. M., & Fisher, P. S. (1995) · IEEE Transactions on Communications · doi:10.1109/26.477498 · Cited by 2,117
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationIn-fibre Bragg grating sensors
Rao, Y.-J. (1997) · Measurement Science and Technology · doi:10.1088/0957-0233/8/4/002 · Cited by 1,606
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
A wavelet-based image fusion tutorial
Pajares, G., & Manuel de la Cruz, J. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.03.010 · Cited by 1,328
Multi-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationA new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
Pixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
A general framework for multiresolution image fusion: from pixels to regions
Piella, G. (2003) · Information Fusion · doi:10.1016/s1566-2535(03)00046-0 · Cited by 799
Remote sensing image fusion using the curvelet transform
Nencini, F., Garzelli, A., Baronti, S., & Alparone, L. (2007) · Information Fusion · doi:10.1016/j.inffus.2006.02.001 · Cited by 788
Ma, J., Zhou, Z., Wang, B., & Zong, H. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.02.005 · Cited by 773
Self-citationAssessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Zhang, Z., & Blum, R. S. (1999) · Proceedings of the IEEE · doi:10.1109/5.775414 · Cited by 726
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
What do we need to build explainable AI systems for the medical domain?
Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636
Performance comparison of different multi-resolution transforms for image fusion
Li, S., Yang, B., & Hu, J. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.03.002 · Cited by 586
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Infrared and visible image fusion with convolutional neural networks
Liu, Y., Chen, X., Cheng, J., Peng, H., & Wang, Z. (2018) · International Journal of Wavelets, Multiresolution and Information Processing · doi:10.1142/s0219691318500182 · Cited by 479
Two-scale image fusion of visible and infrared images using saliency detection
Bavirisetti, D. P., & Dhuli, R. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2016.01.009 · Cited by 459
Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion
Li, S., Yin, H., & Fang, L. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217493 · Cited by 385
A survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Dogra, A., Goyal, B., & Agrawal, S. (2017) · IEEE Access · doi:10.1109/access.2017.2735865 · Cited by 196
Zhang, X., Ma, Y., Fan, F., Zhang, Y., & Huang, J. (2017) · Journal of the Optical Society of America A · doi:10.1364/josaa.34.001400 · Cited by 186
Fusion method for infrared and visible images by using non-negative sparse representation
Wang, J., Peng, J., Feng, X., He, G., & Fan, J. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.09.019 · Cited by 181
IMAGE FUSION AND IMAGE QUALITY ASSESSMENT OF FUSED IMAGES
Han, Z., Tang, X., Gao, X., & Hu, F. (2013) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsarchives-xl-7-w1-33-2013 · Cited by 176
Novel fusion method for visible light and infrared images based on NSST–SF–PCNN
Kong, W., Zhang, L., & Yang, L. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.04.003 · Cited by 173
Kong, W., Lei, Y., & Zhao, H. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.07.019 · Cited by 173
SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework
Chen, C., Li, Y., Liu, W., & Huang, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2456415 · Cited by 159
Infrared image enhancement through saliency feature analysis based on multi-scale decomposition
Zhao, J., Chen, Y., Feng, H., Xu, Z., & Li, Q. (2013) · Infrared Physics & Technology · doi:10.1016/j.infrared.2013.11.008 · Cited by 134
SIRF: Simultaneous Satellite Image Registration and Fusion in A Unified Framework
Chen, C., Member, S., Li, Y., Liu, W., & Huang, J. (2016) · Cited by 132
Infrared and visible image fusion using total variation model
Ma, Y., Chen, J., Chen, C., Fan, F., & Ma, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.03.009 · Cited by 119
Self-citationFusion of visible and infrared images using global entropy and gradient constrained regularization
Zhao, J., Cui, G., Gong, X., Zang, Y., Tao, S., & Wang, D. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.01.012 · Cited by 91
2009 Chinese Conference on Pattern Recognition
(2009) · doi:10.1109/ccpr15547.2009 · Cited by 80
Visual attention guided image fusion with sparse representation
Yang, B., & Shutao Li, A. (2014) · Optik · doi:10.1016/j.ijleo.2014.04.036 · Cited by 73
Image Fusion and Super-Resolution with Convolutional Neural Network
Zhong, J., Yang, B. F., Li, Y., Zhong, F., & Chen, Z. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-3005-5_7 · Cited by 43
Cited by
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Self-citationSwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Self-citationMa, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationLiu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
Metadata
- Authors
- Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2019-08
- Volume
- 48
- Pages
- 11-26
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2912147220
- Cited by
- 2,267
- References
- 48
- FWCI
- 73.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.