The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks
Abstract
Infrared and visible image fusion aims to describe the same scene from different aspects by combining complementary information of multi-modality images. The existing Generative adversarial networks (GAN) based infrared and visible image fusion methods cannot perceive the most discriminative regions, and hence fail to highlight the typical parts existing in infrared and visible images. To this end, we integrate multi-scale attention mechanism into both generator and discriminator of GAN to fuse infrared and visible images (AttentionFGAN). The multi-scale attention mechanism aims to not only capture comprehensive spatial information to help generator focus on the foreground target information of infrared image and background detail information of visible image, but also constrain the discriminators focus more on the attention regions rather than the whole input image. The generator of AttentionFGAN consists of two multi-scale attention networks and an image fusion network. Two multi-scale attention networks capture the attention maps of infrared and visible images respectively, so that the fusion network can reconstruct the fused image by paying more attention to the typical regions of source images. Besides, two discriminators are adopted to force the fused result keep more intensity and texture information from infrared and visible image respectively. Moreover, to keep more information of attention region from source images, an attention loss function is designed. Finally, the ablation experiments illustrate the effectiveness of the key parts of our method, and extensive qualitative and quantitative experiments on three public datasets demonstrate the advantages and effectiveness of AttentionFGAN compared with the other state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 1×
“Therefore,Gulrajani et al. improved the WGAN with a gradient penalty [33] as follows: where the first two terms denote the Wasserstein distance estimation and the last term stands for gradient penalty factor, ˜ x represents the uniformly sampled along straight lines connecting pairs of the generated…”
Background(2017) · International Conference on Machine Learning · Cited by 6,382
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Self-citationFusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationListen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationA general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Information measure for performance of image fusion
Qu, G., Zhang, D., & Yan, P. (2002) · Electronics Letters · doi:10.1049/el:20020212 · Cited by 1,427
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,129
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationPixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
Remote sensing image fusion using the curvelet transform
Nencini, F., Garzelli, A., Baronti, S., & Alparone, L. (2007) · Information Fusion · doi:10.1016/j.inffus.2006.02.001 · Cited by 788
Assessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
An Attentive Survey of Attention Models
Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3465055 · Cited by 689
GANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621
Cui, G., Feng, H., Xu, Z., Li, Q., & Chen, Y. (2015) · Optics Communications · doi:10.1016/j.optcom.2014.12.032 · Cited by 612
Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM
Ma, Y., Peng, H., & Cambria, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12048 · Cited by 592
Infrared and Visible Image Fusion using a Deep Learning Framework
Li, H., Wu, X.-J., & Kittler, J. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546006 · Cited by 534
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Infrared and visible image fusion with convolutional neural networks
Liu, Y., Chen, X., Cheng, J., Peng, H., & Wang, Z. (2018) · International Journal of Wavelets, Multiresolution and Information Processing · doi:10.1142/s0219691318500182 · Cited by 479
A novel multi-modality image fusion method based on image decomposition and sparse representation
Zhu, Z., Yin, H., Chai, Y., Li, Y., & Qi, G. (2018) · Information Sciences · doi:10.1016/j.ins.2017.09.010 · Cited by 408
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J. (2024) · TIB Data Manager · doi:10.57702/uhdmfu1r · Cited by 357
Pixel-based and region-based image fusion schemes using ICA bases
Mitianoudis, N., & Stathaki, T. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.001 · Cited by 343
Image Fusion Technique using Multi-resolution Singular Value Decomposition
Naidu, V. P. S. (2011) · Defence Science Journal · doi:10.14429/dsj.61.705 · Cited by 327
Infrared and visible image fusion method based on saliency detection in sparse domain
Liu, C. H., Qi, Y., & Ding, W. R. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.04.018 · Cited by 275
FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping
Li, L., Bao, J., Yang, H., Chen, D., & Wen, F. (2019) · arXiv · doi:10.48550/arxiv.1912.13457 · Cited by 236
Targeted Sentiment Classification with Attentional Encoder Network
Song, Y., Wang, J., Jiang, T., Liu, Z., & Rao, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_9 · Cited by 235
FuseGAN: Learning to Fuse Multi-Focus Image via Conditional Generative Adversarial Network
Guo, X., Nie, R., Cao, J., Zhou, D., Mei, L., & He, K. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2895292 · Cited by 227
Chipman, L. J., Orr, T. M., & Graham, L. N. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1995.537627 · Cited by 208
Zhang, X., Ma, Y., Fan, F., Zhang, Y., & Huang, J. (2017) · Journal of the Optical Society of America A · doi:10.1364/josaa.34.001400 · Cited by 186
Attentional Encoder Network for Targeted Sentiment Classification
Song, Y., Wang, J., Jiang, T., Liu, Z., & Rao, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09314 · Cited by 185
Spatio-Temporal Attention Networks for Action Recognition and Detection
Li, J., Liu, X., Zhang, W., Zhang, M., Song, J., & Sebe, N. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2965434 · Cited by 174
Self-citationSurvey on the attention based RNN model and its applications in computer visionPreprint
Wang, F., & Tax, D. M. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06823 · Cited by 163
Fast saliency-aware multi-modality image fusion
Han, J., Pauwels, E., & de Zeeuw, P. M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.015 · Cited by 148
Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain
Zhao, W., Lu, H., & Wang, D. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2760100 · Cited by 148
Coupled GAN With Relativistic Discriminators for Infrared and Visible Images Fusion
Li, Q., Lu, L., Li, Z., Wu, W., Liu, Z., Jeon, G., & Yang, X. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2921803 · Cited by 127
Xu, H., Liang, P., Yu, W., Jiang, J., & Ma, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/549 · Cited by 112
Hu, H., Wu, J., Li, B. H., Guo, Q., & Zheng, J. Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2711422 · Cited by 88
Zheng, Y., Essock, E. A., & Hansen, B. C. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.523966 · Cited by 78
Cited by
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
Tang, L., Yuan, J., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.004 · Cited by 1,136
Infrared and Visible Image Fusion via Decoupling Network
Wang, X., Guan, Z., Yu, S., Cao, J., & Li, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3216413 · Cited by 969
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Metadata
- Authors
- Li, J., Huo, H., Li, C., Wang, R., & Feng, Q.
- Venue
- IEEE Transactions on Multimedia
- Published
- 2021
- Volume
- 23
- Pages
- 1383-1396
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W3030921250
- Cited by
- 415
- References
- 49
- FWCI
- 18.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.