The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Infrared and visible image fusion via detail preserving adversarial learning
Abstract
Abstract TargefTablets can be detected easily from the background of infrared images due to their significantly discriminative thermal radiations, while visible images contain textural details with high spatial resolution which are beneficial to the enhancement of target recognition. Therefore, fused images with abundant detail information and effective target areas are desirable. In this paper, we propose an end-to-end model for infrared and visible image fusion based on detail preserving adversarial learning. It is able to overcome the limitations of the manual and complicated design of activity-level measurement and fusion rules in traditional fusion methods. Considering the specific information of infrared and visible images, we design two loss functions including the detail loss and target edge-enhancement loss to improve the quality of detail information and sharpen the edge of infrared targets under the framework of generative adversarial network. Our approach enables the fused image to simultaneously retain the thermal radiation with sharpening infrared target boundaries in the infrared image and the abundant textural details in the visible image. Experiments conducted on publicly available datasets demonstrate the superiority of our strategy over the state-of-the-art methods in both objective metrics and visual impressions. In particular, our results look like enhanced infrared images with clearly highlighted and edge-sharpened targets as well as abundant detail information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
2008 IEEE Conference on Computer Vision and Pattern Recognition
(2008) · doi:10.1109/cvpr12618.2008 · Cited by 4,212
2013 IEEE International Conference on Computer Vision
(2013) · doi:10.1109/iccv19984.2013 · Cited by 4,183
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationImage quality measures and their performance
Eskicioglu, A. M., & Fisher, P. S. (1995) · IEEE Transactions on Communications · doi:10.1109/26.477498 · Cited by 2,117
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationIn-fibre Bragg grating sensors
Rao, Y.-J. (1997) · Measurement Science and Technology · doi:10.1088/0957-0233/8/4/002 · Cited by 1,606
Multisensor Image Fusion Using the Wavelet Transform
Li, H., Manjunath, B. S., & Mitra, S. K. (1995) · Graphical Models and Image Processing · doi:10.1006/gmip.1995.1022 · Cited by 1,574
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
Multi-sensor image fusion using the wavelet transform
Li, H., Manjunath, B. S., & Mitra, S. K. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413273 · Cited by 1,513
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
Li, C., & Wand, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_43 · Cited by 1,421
A wavelet-based image fusion tutorial
Pajares, G., & Manuel de la Cruz, J. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.03.010 · Cited by 1,328
Multi-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 1,156
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationA new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
DRAW: A Recurrent Neural Network For Image Generation
Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., & Wierstra, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04623 · Cited by 841
Pixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
International Conference on Pattern Recognition
(1971) · Computer · doi:10.1109/c-m.1971.216793 · Cited by 814
Ma, J., Zhou, Z., Wang, B., & Zong, H. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.02.005 · Cited by 773
Self-citationAssessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Zhang, Z., & Blum, R. S. (1999) · Proceedings of the IEEE · doi:10.1109/5.775414 · Cited by 726
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
Cui, G., Feng, H., Xu, Z., Li, Q., & Chen, Y. (2015) · Optics Communications · doi:10.1016/j.optcom.2014.12.032 · Cited by 612
Ma, J., Zhao, J., Jiang, J., Zhou, H., & Guo, X. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1117-z · Cited by 601
Self-citationPerformance comparison of different multi-resolution transforms for image fusion
Li, S., Yang, B., & Hu, J. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.03.002 · Cited by 586
Infrared and Visible Image Fusion using a Deep Learning Framework
Li, H., Wu, X.-J., & Kittler, J. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546006 · Cited by 534
Two-scale image fusion of visible and infrared images using saliency detection
Bavirisetti, D. P., & Dhuli, R. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2016.01.009 · Cited by 459
CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion
Han, J., Chen, H., Liu, N., Yan, C., & Li, X. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2761775 · Cited by 423
Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion
Li, S., Yin, H., & Fang, L. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217493 · Cited by 385
Image Fusion Technique using Multi-resolution Singular Value Decomposition
Naidu, V. P. S. (2011) · Defence Science Journal · doi:10.14429/dsj.61.705 · Cited by 327
Yoo, D., Kim, N., Park, S., Paek, A. S., & Kweon, I. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_31 · Cited by 290
Infrared and visible image fusion method based on saliency detection in sparse domain
Liu, C. H., Qi, Y., & Ding, W. R. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.04.018 · Cited by 275
LMR: Learning a Two-Class Classifier for Mismatch Removal
Ma, J., Jiang, X., Jiang, J., Zhao, J., & Guo, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2906490 · Cited by 204
Self-citationZhang, X., Ma, Y., Fan, F., Zhang, Y., & Huang, J. (2017) · Journal of the Optical Society of America A · doi:10.1364/josaa.34.001400 · Cited by 186
Fusion method for infrared and visible images by using non-negative sparse representation
Wang, J., Peng, J., Feng, X., He, G., & Fan, J. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.09.019 · Cited by 181
IMAGE FUSION AND IMAGE QUALITY ASSESSMENT OF FUSED IMAGES
Han, Z., Tang, X., Gao, X., & Hu, F. (2013) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsarchives-xl-7-w1-33-2013 · Cited by 176
Novel fusion method for visible light and infrared images based on NSST–SF–PCNN
Kong, W., Zhang, L., & Yang, L. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.04.003 · Cited by 173
Kong, W., Lei, Y., & Zhao, H. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.07.019 · Cited by 173
Region level based multi-focus image fusion using quaternion wavelet and normalized cut
Liu, Y., Jin, J., Wang, Q., et al. (2013) · Signal Processing · doi:10.1016/j.sigpro.2013.10.010 · Cited by 161
Infrared image enhancement through saliency feature analysis based on multi-scale decomposition
Zhao, J., Chen, Y., Feng, H., Xu, Z., & Li, Q. (2013) · Infrared Physics & Technology · doi:10.1016/j.infrared.2013.11.008 · Cited by 134
Multilevel Depth and Image Fusion for Human Activity Detection
Ni, B., Pei, Y., Moulin, P., & Yan, S. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2276433 · Cited by 113
Xiao, J., Stolkin, R., Gao, Y., & Leonardis, A. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2740952 · Cited by 78
Visual attention guided image fusion with sparse representation
Yang, B., & Shutao Li, A. (2014) · Optik · doi:10.1016/j.ijleo.2014.04.036 · Cited by 73
Cited by
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Self-citationMa, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationRFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
Self-citationTang, L., Yuan, J., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.004 · Cited by 1,136
Self-citation
Metadata
- Authors
- Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 54
- Pages
- 85-98
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W2963134949
- Cited by
- 456
- References
- 63
- FWCI
- 33.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.