Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 1,152

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Pansharpening by Convolutional Neural Networks

Open access
Masi, Giuseppe, Cozzolino, Davide, Verdoliva, Luisa, Scarpa, Giuseppe·2016·Remote Sensing
DOI 10.3390/rs8070594
Open this paper in CoChat — free account

Abstract

A new pansharpening method is proposed, based on convolutional neural networks. We adapt a simple and effective three-layer architecture recently proposed for super-resolution to the pansharpening problem. Moreover, to improve performance without increasing complexity, we augment the input by including several maps of nonlinear radiometric indices typical of remote sensing. Experiments on three representative datasets show the proposed method to provide very promising results, largely competitive with the current state of the art in terms of both full-reference and no-reference metrics, and also at a visual inspection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/rs8070594

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 45

  1. Gaetano, 2015, Marker controlled watershed based segmentation of multi-resolution remote sensing images, IEEE Trans. Geosci. Remote Sens., 53, 1987, 10.1109/TGRS.2014.2367129 · DOI
  2. Vivone, 2015, A critical comparison among pansharpening algorithms, IEEE Trans. Geosci. Remote Sens., 53, 2565, 10.1109/TGRS.2014.2361734 · DOI · Paper page
  3. Shettigara, 1992, A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set, Photogramm. Eng. Remote Sens., 58, 561
  4. Tu, 2001, A new look at IHS-like image fusion methods, Inf. Fusion, 2, 177, 10.1016/S1566-2535(01)00036-7 · DOI
  5. Tu, 2004, A fast intensity hue-saturation fusion technique with spectral adjustment for IKONOS imagery, IEEE Geosci. Remote Sens. Lett., 1, 309, 10.1109/LGRS.2004.834804 · DOI · Paper page
  6. Chavez, 1989, Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis, Photogramm. Eng. Remote Sens., 55, 339
  7. Gillespie, 1987, Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques, Remote Sens. Environ., 22, 343, 10.1016/0034-4257(87)90088-5 · DOI · Paper page
  8. Aiazzi, 2007, Improving component substitution pansharpening through multivariate regression of MS + Pan data, IEEE Trans. Geosci. Remote Sens., 45, 3230, 10.1109/TGRS.2007.901007 · DOI · Paper page
  9. Choi, 2011, A new adaptive component-substitution-based satellite image fusion by using partial replacement, IEEE Trans. Geosci. Remote Sens., 49, 295, 10.1109/TGRS.2010.2051674 · DOI · Paper page
  10. Chavez, 1991, Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic, Photogramm. Eng. Remote Sens., 57, 295
  11. Yocky, 1996, Multiresolution wavelet decomposition image merger of Landsat Thematic Mapper and SPOT panchromatic data, Photogramm. Eng. Remote Sens., 62, 1067
  12. Aiazzi, 2002, Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis, IEEE Trans. Geosci. Remote Sens., 40, 2300, 10.1109/TGRS.2002.803623 · DOI · Paper page
  13. Alparone, 2007, Remote sensing image fusion using the curvelet transform, Inf. Fusion, 8, 143, 10.1016/j.inffus.2006.02.001 · DOI · Paper page
  14. Ranchin, 2000, Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation, Photogramm. Eng. Remote Sens., 66, 49
  15. Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., and Selva, M. (2003, January 22–23). An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas. Proceedings of the 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, Berlin, Germany.
  16. Liu, 2000, Smoothing filter based intensity modulation: A spectral preserve image fusion technique for improving spatial details, Int. J. Remote Sens., 21, 3461, 10.1080/014311600750037499 · DOI · Paper page
  17. Khan, 2008, Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique, IEEE Geosci. Remote Sens. Lett., 5, 98, 10.1109/LGRS.2007.909934 · DOI
  18. Nunez, 1999, Multiresolution-based image fusion with additive wavelet decomposition, IEEE Trans. Geosci. Remote Sens., 37, 1204, 10.1109/36.763274 · DOI · Paper page
  19. Otazu, 2005, Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods, IEEE Trans. Geosci. Remote Sens., 43, 2376, 10.1109/TGRS.2005.856106 · DOI · Paper page
  20. Vivone, 2014, Contrast and error-based fusion schemes for multispectral image pansharpening, IEEE Geosci. Remote Sens. Lett., 11, 930, 10.1109/LGRS.2013.2281996 · DOI
  21. Aiazzi, 2006, MTF-tailored multiscale fusion of high-resolution MS and Pan imagery, Photogramm. Eng. Remote Sens., 72, 591, 10.14358/PERS.72.5.591 · DOI · Paper page
  22. Alparone, 2007, Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest, IEEE Trans. Geosci. Remote Sens., 45, 3012, 10.1109/TGRS.2007.904923 · DOI · Paper page
  23. Lee, 2010, Fast and efficient panchromatic sharpening, IEEE Trans. Geosci. Remote Sens., 48, 155, 10.1109/TGRS.2009.2028613 · DOI
  24. Garzelli, 2008, Optimal MMSE pan sharpening of very high resolution multispectral images, IEEE Trans. Geosci. Remote Sens., 46, 228, 10.1109/TGRS.2007.907604 · DOI · Paper page
  25. Garzelli, 2015, Pansharpening of multispectral images based on nonlocal parameter optimization, IEEE Trans. Geosci. Remote Sens., 53, 2096, 10.1109/TGRS.2014.2354471 · DOI
  26. Fasbender, 2008, Bayesian data fusion for adaptable image pansharpening, IEEE Trans. Geosci. Remote Sens., 46, 1847, 10.1109/TGRS.2008.917131 · DOI · Paper page
  27. Palsson, 2014, A new pansharpening algorithm based on total variation, IEEE Geosci. Remote Sens. Lett., 11, 318, 10.1109/LGRS.2013.2257669 · DOI · Paper page
  28. Li, 2011, A new pan-sharpening method using a compressed sensing technique, IEEE Trans. Geosci. Remote Sens., 49, 738, 10.1109/TGRS.2010.2067219 · DOI · Paper page
  29. Li, 2013, Remote sensing image fusion via sparse representations over learned dictionaries, IEEE Trans. Geosci. Remote Sens., 51, 4779, 10.1109/TGRS.2012.2230332 · DOI · Paper page
  30. Zhu, 2013, A sparse image fusion algorithm with application to pan-sharpening, IEEE Trans. Geosci. Remote Sens., 51, 2827, 10.1109/TGRS.2012.2213604 · DOI · Paper page
  31. Cheng, 2014, Sparse representation based pansharpening using trained dictionary, IEEE Geosci. Remote Sens. Lett., 11, 293, 10.1109/LGRS.2013.2256875 · DOI
  32. Huang, 2015, A new pan-sharpening method with deep neural networks, IEEE Geosci. Remote Sens. Lett., 12, 1037, 10.1109/LGRS.2014.2376034 · DOI · Paper page
  33. Wang, H., Chen, S., Xu, F., and Jin, Y.Q. (2015, January 26–31). Application of deep learning algorithms to MSTAR data. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium, Milan, Italy. · DOI
  34. Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. Land Use Classification in Remote Sensing Images by Convolutional Neural Networks. Available online: http://arxiv.org/abs/1508.00092. · arXiv
  35. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Advances in Neural Information Processing Systems, Curran Associates, Inc.
  36. Ouyang, W., and Wang, X. (2013, January 3–6). Joint deep learning for pedestrian detection. Proceedings fo the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia. · DOI · Paper page
  37. Wald, 1997, Fusion of satellite images of different spatial resolution: Assessing the quality of resulting images, Photogramm. Eng. Remote Sens., 63, 691
  38. Nouri, 2014, High spatial resolution worldview-2 imagery for mapping NDVI and Its relationship to temporal urban landscape evapotranspiration factors, Remote Sens., 6, 580, 10.3390/rs6010580 · DOI
  39. Alparone, 2008, Multispectral and panchromatic data fusion assessment without reference, Photogramm. Eng. Remote Sens., 74, 193, 10.14358/PERS.74.2.193 · DOI · Paper page
  40. Yuhas, R.H., Goetz, A.F.H., and Boardman, J.W. (1992). Summaries of the Third Annual JPL Airborne Geoscience Workshop, AVIRIS Workshop.
  41. Zhou, 1998, A wavelet transform method to merge Landsat TM and SPOT panchromatic data, Int. J. Remote Sens., 19, 743, 10.1080/014311698215973 · DOI
  42. Wang, 2002, A universal image quality index, IEEE Signal Process. Lett., 9, 81, 10.1109/97.995823 · DOI · Paper page
  43. Alparone, 2004, A global quality measurement of pan-sharpened multispectral imagery, IEEE Geosci. Remote Sens. Lett., 1, 313, 10.1109/LGRS.2004.836784 · DOI
  44. Gaetano, R., Scarpa, G., and Poggi, G. (2009, January 12–17). Recursive texture fragmentation and reconstruction segmentation algorithm applied to VHR images. Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa. · DOI
  45. Gaetano, R., Masi, G., Scarpa, G., and Poggi, G. (2012, January 22–27). A marker-controlled watershed segmentation: Edge, mark and fill. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany. · DOI

Cited by

See all 1,152

Metadata

Authors
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G.
Venue
Remote Sensing
Publisher
MDPI AG
Published
2016-07-14
Volume
8
Issue
7
Pages
594
ISSN
2072-4292 (ISSN-L)
DOI
10.3390/rs8070594
OpenAlex
W2462592242
Cited by
1,152
References
4
FWCI
56.55
Type
journal article
Language
en
Open access
gold
Licence
creativecommons.org/licenses/by/4.0/ (vor)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.