The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion
Abstract
Abstract Pan-sharpening in remote sensing image fusion refers to obtaining multi-spectral images of high-resolution by fusing panchromatic images and multi-spectral images of low-resolution. Recently, convolution neural network (CNN)-based pan-sharpening methods have achieved the state-of-the-art performance. Even though, two problems still remain. On the one hand, the existing CNN-based strategies require supervision, where the low-resolution multi-spectral image is obtained by simply blurring and down-sampling the high-resolution one. On the other hand, they typically ignore rich spatial information of panchromatic images. To address these issues, we propose a novel unsupervised framework for pan-sharpening based on a generative adversarial network, termed as Pan-GAN, which does not rely on the so-called ground-truth during network training. In our method, the generator separately establishes the adversarial games with the spectral discriminator and the spatial discriminator, so as to preserve the rich spectral information of multi-spectral images and the spatial information of panchromatic images. Extensive experiments are conducted to demonstrate the effectiveness of the proposed Pan-GAN compared with other state-of-the-art pan-sharpening approaches. Our Pan-GAN has shown promising performance in terms of qualitative visual effects and quantitative evaluation metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
(2016) · Cited by 31,590
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Proceedings European Conference on Computer Vision 2002
Heyden, A., Sparr, G., Nielsen, M., & Johansen, P. (2002) · Lund University Publications (Lund University) · Cited by 5,153
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationArjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationProceedings of the IEEE International Conference on Image Processing
Calway, A. D. (1996) · The Institute of Electrical and Electronics Engineers · Cited by 1,578
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Lucien Wald, A., Ranchin, T., & Mangolini, M. (1997) · HAL · Cited by 1,362
Ma, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationMulti-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Mask R-CNNPreprint
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv (Cornell University) · Cited by 1,252
Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data
Aiazzi, B., Baronti, S., & Selva, M. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.901007 · Cited by 1,223
Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion
Yokoya, N., Yairi, T., & Iwasaki, A. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2161320 · Cited by 1,180
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Image Fusion With Convolutional Sparse Representation
Liu, Y., Chen, X., Ward, R. K., & Jane Wang, Z. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2618776 · Cited by 986
A wavelet transform method to merge Landsat TM and SPOT panchromatic data
Zhou, J., Civco, D. L., & Silander, J. A. (1998) · International Journal of Remote Sensing · doi:10.1080/014311698215973 · Cited by 979
MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery
Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2006) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.72.5.591 · Cited by 918
A new look at IHS-like image fusion methods
Tu, T., Su, S.-C., Shyu, H.-C., & Huang, P. S. (2001) · Information Fusion · doi:10.1016/s1566-2535(01)00036-7 · Cited by 904
Multispectral and Panchromatic Data Fusion Assessment Without Reference
Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., Nencini, F., & Selva, M. (2008) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.74.2.193 · Cited by 892
Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest
Alparone, L., Wald, L., Chanussot, J., Thomas, C., Gamba, P., & Bruce, L. M. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.904923 · Cited by 886
A review of remote sensing image fusion methods
Ghassemian, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.03.003 · Cited by 849
DRAW: A Recurrent Neural Network For Image Generation
Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., & Wierstra, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04623 · Cited by 841
PanNet: A Deep Network Architecture for Pan-Sharpening
Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.193 · Cited by 802
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Thomas, C., Ranchin, T., Wald, L., & Chanussot, J. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.912448 · Cited by 632
A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement
Choi, J., Yu, K., & Kim, Y. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2051674 · Cited by 580
Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images
Garzelli, A., Nencini, F., & Capobianco, L. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.907604 · Cited by 570
Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming
Ma, J., Zhou, H., Zhao, J., Gao, Y., Jiang, J., & Tian, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2441954 · Cited by 474
Self-citationA Variational Model for P+XS Image Fusion
Ballester, C., Caselles, V., Igual, L., Verdera, J., & Rougé, B. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-6852-x · Cited by 464
Infrared and visible image fusion via detail preserving adversarial learning
Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.005 · Cited by 456
Self-citationHe, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Remote sensing image fusion based on two-stream fusion network
Liu, X., Liu, Q., & Wang, Y. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.010 · Cited by 395
Shao, Z., Cai, J., Fu, P., Hu, L., & Liu, T. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111425 · Cited by 234
A Variational Pan-Sharpening With Local Gradient Constraints
Fu, X., Lin, Z., Huang, Y., & Ding, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01051 · Cited by 214
On the Performance Evaluation of Pan-Sharpening Techniques
Du, Q., Younan, N. H., King, R., & Shah, V. P. (2007) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2007.896328 · Cited by 208
Pan-Sharpening Using an Efficient Bidirectional Pyramid Network
Zhang, Y., Liu, C., Sun, M., & Ou, Y. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2900419 · Cited by 176
SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework
Chen, C., Li, Y., Liu, W., & Huang, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2456415 · Cited by 159
Self-citationHigh-Quality Facial Photo-Sketch Synthesis Using Multi-Adversarial Networks
Wang, L., Sindagi, V. A., & Patel, V. M. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00022 · Cited by 159
Detecting Deceptive Reviews Using Generative Adversarial Networks
Aghakhani, H., Machiry, A., Nilizadeh, S., Kruegel, C., & Vigna, G. (2018) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2018.00022 · Cited by 132
SIRF: Simultaneous Satellite Image Registration and Fusion in A Unified Framework
Chen, C., Member, S., Li, Y., Liu, W., & Huang, J. (2016) · Cited by 132
Self-citationPsgan: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
Liu, X., Wang, Y., & Liu, Q. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451049 · Cited by 119
Kwan, C., Budavari, B., Bovik, A. C., et al. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2737820 · Cited by 115
A Super-Resolution and Fusion Approach to Enhancing Hyperspectral Images
Kwan, C., Choi, J. H., Chan, S. H., Zhou, J., & Budavari, B. (2018) · Remote Sensing · doi:10.3390/rs10091416 · Cited by 83
Remote-sensing image fusion based on curvelets and ICA
Ghahremani, M., & Ghassemian, H. (2015) · International Journal of Remote Sensing · doi:10.1080/01431161.2015.1071897 · Cited by 76
Residual Encoder–Decoder Conditional Generative Adversarial Network for Pansharpening
Shao, Z., Lu, Z., Ran, M., Fang, L., Zhou, J., & Zhang, Y. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2949745 · Cited by 73
Cited by
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Self-citationImage fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Self-citationSDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
Zhang, H., & Ma, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01501-8 · Cited by 747
Self-citationDeep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Self-citation
Metadata
- Authors
- Ma, J., Yu, W., Chen, C., Liang, P., Guo, X., & Jiang, J.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 62
- Pages
- 110-120
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W3023991509
- Cited by
- 471
- References
- 58
- FWCI
- 36.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.