The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion
Abstract
In this paper, we proposed a new end-to-end model, termed as dual-discriminator conditional generative adversarial network (DDcGAN), for fusing infrared and visible images of different resolutions. Our method establishes an adversarial game between a generator and two discriminators. The generator aims to generate a real-like fused image based on a specifically designed content loss to fool the two discriminators, while the two discriminators aim to distinguish the structure differences between the fused image and two source images, respectively, in addition to the content loss. Consequently, the fused image is forced to simultaneously keep the thermal radiation in the infrared image and the texture details in the visible image. Moreover, to fuse source images of different resolutions, e.g., a low-resolution infrared image and a high-resolution visible image, our DDcGAN constrains the downsampled fused image to have similar property with the infrared image. This can avoid causing thermal radiation information blurring or visible texture detail loss, which typically happens in traditional methods. In addition, we also apply our DDcGAN to fusing multi-modality medical images of different resolutions, e.g., a low-resolution positron emission tomography image and a high-resolution magnetic resonance image. The qualitative and quantitative experiments on publicly available datasets demonstrate the superiority of our DDcGAN over the state-of-the-art, in terms of both visual effect and quantitative metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationImage quality measures and their performance
Eskicioglu, A. M., & Fisher, P. S. (1995) · IEEE Transactions on Communications · doi:10.1109/26.477498 · Cited by 2,117
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Beck, A., & Teboulle, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2028250 · Cited by 2,004
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationNIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
Adaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126474 · Cited by 1,217
Image De-Raining Using a Conditional Generative Adversarial Network
Zhang, H., Sindagi, V., & Patel, V. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2920407 · Cited by 1,214
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationA new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
Ma, J., Zhou, Z., Wang, B., & Zong, H. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.02.005 · Cited by 773
Self-citationAssessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Infrared and Visible Image Fusion using a Deep Learning Framework
Li, H., Wu, X.-J., & Kittler, J. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546006 · Cited by 534
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Tian, J., Leng, Y., Zhao, Z., Xia, Y., Sang, Y., Hao, P., Zhan, J., Li, M., & Liu, H. (2015) · Nano Energy · doi:10.1016/j.nanoen.2014.10.025 · Cited by 478
Zhou, Z., Wang, B., Li, S., & Dong, M. (2016) · Information Fusion · doi:10.1016/j.inffus.2015.11.003 · Cited by 475
Infrared and visible image fusion via detail preserving adversarial learning
Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.005 · Cited by 456
Self-citationA medical image fusion method based on convolutional neural networks
Liu, Y., Chen, X., Cheng, J., & Peng, H. (2017) · 2017 20th International Conference on Information Fusion (Fusion) · doi:10.23919/icif.2017.8009769 · Cited by 391
Simultaneous image fusion and denoising with adaptive sparse representation
Liu, Y., & Wang, Z. (2015) · IET Image Processing · doi:10.1049/iet-ipr.2014.0311 · Cited by 351
Shreyamsha Kumar, B. K. (2013) · Signal, Image and Video Processing · doi:10.1007/s11760-012-0361-x · Cited by 345
Singh, R., & Khare, A. (2014) · Information Fusion · doi:10.1016/j.inffus.2012.09.005 · Cited by 332
Image Super-Resolution With Sparse Neighbor Embedding
Gao, X., Zhang, K., Tao, D., & Li, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190080 · Cited by 313
MRI and PET image fusion by combining IHS and retina-inspired models
Daneshvar, S., & Ghassemian, H. (2010) · Information Fusion · doi:10.1016/j.inffus.2009.05.003 · Cited by 296
A survey of infrared and visual image fusion methods
Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280
Multimodal medical image fusion based on IHS and PCA
He, C., Liu, Q., Li, H., & Wang, H. (2010) · Procedia Engineering · doi:10.1016/j.proeng.2010.11.045 · Cited by 252
Dogra, A., Goyal, B., & Agrawal, S. (2017) · IEEE Access · doi:10.1109/access.2017.2735865 · Cited by 196
Bhateja, V., Patel, H., Krishn, A., Sahu, A., & Lay-Ekuakille, A. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2015.2465935 · Cited by 192
Coupled GAN With Relativistic Discriminators for Infrared and Visible Images Fusion
Li, Q., Lu, L., Li, Z., Wu, W., Liu, Z., Jeon, G., & Yang, X. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2921803 · Cited by 127
Infrared and visible image fusion using total variation model
Ma, Y., Chen, J., Chen, C., Fan, F., & Ma, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.03.009 · Cited by 119
Self-citationImplementation of high‐order variational models made easy for image processing
Lu, W., Duan, J., Qiu, Z., Pan, Z., Liu, R. W., & Bai, L. (2016) · Mathematical Methods in the Applied Sciences · doi:10.1002/mma.3858 · Cited by 118
Xu, H., Liang, P., Yu, W., Jiang, J., & Ma, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/549 · Cited by 112
Self-citationHu, H., Wu, J., Li, B. H., Guo, Q., & Zheng, J. Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2711422 · Cited by 88
Wen, L., Xie, Y., Zhou, H., et al. (2018) · Optik · doi:10.1016/j.ijleo.2018.06.123 · Cited by 85
Efficient image fusion with approximate sparse representation
Bin, Y., Yang, C., & Huang, G. (2016) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s0219691316500247 · Cited by 62
Eslami, M., & Mohammadzadeh, A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2489838 · Cited by 60
Fusing Infrared and Visible Images of Different Resolutions via Total Variation Model
Du, Q., Xu, H., Ma, Y., et al. (2018) · Sensors · doi:10.3390/s18113827 · Cited by 53
Self-citationPotential of PET-MRI for imaging of non-oncologic musculoskeletal disease
Kogan, F., Fan, A. P., & Gold, G. E. (2016) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims.2016.12.16 · Cited by 38
Matthews, R., & Choi, M. (2016) · Diagnostics · doi:10.3390/diagnostics6030035 · Cited by 33
Self-adapting weighted operators for multiscale gradient fusion
López-Molina, C., Montero, J., Bustince, H., et al. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.03.004 · Cited by 19
Cited by
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Self-citationSwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Self-citationLiu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
Self-citation
Metadata
- Authors
- Ma, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 4980-4995
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3011768656
- Cited by
- 1,343
- References
- 50
- FWCI
- 67.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.