The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Multispectral and Hyperspectral Image Fusion by MS/HS Fusion Net
Open accessAbstract
Hyperspectral imaging can help better understand the characteristics of different materials, compared with traditional image systems. However, only high-resolution multispectral (HrMS) and low-resolution hyperspectral (LrHS) images can generally be captured at video rate in practice. In this paper, we propose a model-based deep learning approach for merging an HrMS and LrHS images to generate a high-resolution hyperspectral (HrHS) image. In specific, we construct a novel MS/HS fusion model which takes the observation models of low-resolution images and the low-rankness knowledge along the spectral mode of HrHS image into consideration. Then we design an iterative algorithm to solve the model by exploiting the proximal gradient method. And then, by unfolding the designed algorithm, we construct a deep network, called MS/HS Fusion Net, with learning the proximal operators and model parameters by convolutional neural networks. Experimental results on simulated and real data substantiate the superiority of our method both visually and quantitatively as compared with state-of-the-art methods along this line of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203
The contourlet transform: an efficient directional multiresolution image representation
Do, M. N., & Vetterli, M. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859376 · Cited by 3,952
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,282
Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data
Aiazzi, B., Baronti, S., & Selva, M. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.901007 · Cited by 1,223
A guide to convolution arithmetic for deep learning
Dumoulin, V., & Visin, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07285 · Cited by 1,172
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Liu, J. G. (2000) · International Journal of Remote Sensing · doi:10.1080/014311600750037499 · Cited by 965
Hyperspectral Pansharpening: A Review
Loncan, L., de Almeida, L. B., Bioucas-Dias, J. M., Briottet, X., Chanussot, J., Dobigeon, N., Fabre, S., Liao, W., Licciardi, G. A., Simoes, M., et al. (2015) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2015.2440094 · Cited by 824
Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature
Yokoya, N., Grohnfeldt, C., & Chanussot, J. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2637824 · Cited by 712
The Laplacian Pyramid as a Compact Image Code
BURT, P. J., & ADELSON, E. H. (1987) · Readings in Computer Vision · doi:10.1016/b978-0-08-051581-6.50065-9 · Cited by 555
The Undecimated Wavelet Decomposition and its Reconstruction
Starck, J.-L., Fadili, J., & Murtagh, F. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.887733 · Cited by 530
Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions
Wald, L. (2002) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 520
Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network
Wei, Y., Yuan, Q., Shen, H., & Zhang, L. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2736020 · Cited by 478
Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
Wei, Q., Dobigeon, N., & Tourneret, J.-Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2458572 · Cited by 474
Hyperspectral Super-Resolution by Coupled Spectral Unmixing
Lanaras, C., Baltsavias, E., & Schindler, K. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.409 · Cited by 424
Target-Adaptive CNN-Based Pansharpening
Scarpa, G., Vitale, S., & Cozzolino, D. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2817393 · Cited by 383
A New Pansharpening Algorithm Based on Total Variation
Palsson, F., Sveinsson, J. R., & Ulfarsson, M. O. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2013.2257669 · Cited by 373
High-resolution hyperspectral imaging via matrix factorization
Kawakami, R., Matsushita, Y., Wright, J., Ben-Ezra, M., Tai, Y.-W., & Ikeuchi, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995457 · Cited by 370
Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network
Palsson, F., Sveinsson, J. R., & Ulfarsson, M. O. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2668299 · Cited by 364
A New Pan-Sharpening Method With Deep Neural Networks
Huang, W., Xiao, L., Wei, Z., Liu, H., & Tang, S. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2376034 · Cited by 334
Remote Sensing Image Fusion With Deep Convolutional Neural Network
Shao, Z., & Cai, J. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2805923 · Cited by 331
Proximal Dehaze-Net: A Prior Learning-Based Deep Network for Single Image Dehazing
Yang, D., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_43 · Cited by 315
Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution
Akhtar, N., Shafait, F., & Mian, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_5 · Cited by 284
MAP Estimation for Hyperspectral Image Resolution Enhancement Using an Auxiliary Sensor
Hardie, R. C., Eismann, M. T., & Wilson, G. L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.829779 · Cited by 274
Tarabalka, Y., Chanussot, J., & Benediktsson, J. A. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2037132 · Cited by 274
Hyper-Sharpening: A First Approach on SIM-GA Data
Selva, M., Aiazzi, B., Butera, F., Chiarantini, L., & Baronti, S. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2440092 · Cited by 256
Spatial and Spectral Image Fusion Using Sparse Matrix Factorization
Huang, B., Song, H., Cui, H., Peng, J., & Xu, Z. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2253612 · Cited by 231
Self-citationBayesian and regularization methods for hyperparameter estimation in image restoration
Molina, R., Katsaggelos, A. K., & Mateos, J. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.743857 · Cited by 206
Learning Fully Convolutional Networks for Iterative Non-blind Deconvolution
Zhang, J., Pan, J., Lai, W.-S., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.737 · Cited by 190
Tracking via object reflectance using a hyperspectral video camera
Nguyen, H. V., Banerjee, A., & Chellappa, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543780 · Cited by 179
ADMM-Net: A Deep Learning Approach for Compressive Sensing MRIPreprint
Yang, Y., Sun, J., Li, H.-B., & Xu, Z.-B. (2017) · arXiv.org · doi:10.48550/arxiv.1705.06869 · Cited by 139
Self-citationHyperspectral imagery super-resolution by sparse representation and spectral regularization
Zhao, Y., Yang, J., Zhang, Q., Song, L., Cheng, Y., & Pan, Q. (2011) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/1687-6180-2011-87 · Cited by 93
Hyperspectral Face Recognition using 3D-DCT and Partial Least Squares
Uzair, M., Mahmood, A., & Mian, A. S. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.57 · Cited by 89
Fusion of satellite images in urban area: Assessing the quality of resulting images
Zeng, Y., Huang, W., Liu, M., Zhang, H., & Zou, B. (2010) · International Conference on Geoinformatics · doi:10.1109/geoinformatics.2010.5568105 · Cited by 87
Fusion of Hyperspectral and Multispectral Images Using Spectral Unmixing and Sparse Coding
Nezhad, Z. H., Karami, A., Heylen, R., & Scheunders, P. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2528339 · Cited by 85
A residual convolutional neural network for pan-shaprening
Rao, Y., He, L., & Zhu, J. (2017) · International Workshop on Remote Sensing with Intelligent Processing (RSIP) · doi:10.1109/rsip.2017.7958807 · Cited by 74
Molina, R., Vega, M., Mateos, J., & Katsaggelos, A. K. (2007) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2007.03.006 · Cited by 61
Deep residual learning for remote sensed imagery pansharpening
Wei, Y., & Yuan, Q. (2017) · International Workshop on Remote Sensing with Intelligent Processing (RSIP) · doi:10.1109/rsip.2017.7958794 · Cited by 39
Zhang, Y., Wang, Y., Liu, Y., Zhang, C., He, M., & Mei, S. (2015) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326172 · Cited by 19
Cited by
Deep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
A Model-Driven Deep Neural Network for Single Image Rain Removal
Wang, H., Xie, Q., Zhao, Q., & Meng, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00317 · Cited by 449
Self-citationLearning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery
Jiang, J., Sun, H., Liu, X., & Ma, J. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2996075 · Cited by 302
SSR-NET: Spatial–Spectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion
Zhang, X., Huang, W., Wang, Q., & Li, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3018732 · Cited by 292
LRR-Net: An Interpretable Deep Unfolding Network for Hyperspectral Anomaly Detection
Li, C., Zhang, B., Hong, D., Yao, J., & Chanussot, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3279834 · Cited by 270
Metadata
- Authors
- Xie, Q., Zhou, M., Zhao, Q., Meng, D., Zuo, W., & Xu, Z.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1585-1594
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963284277
- Cited by
- 302
- References
- 47
- FWCI
- 62.80
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.