The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Super-resolution of Sentinel-2 images: Learning a globally applicable deep neural network
Open accessAbstract
The Sentinel-2 satellite mission delivers multi-spectral imagery with 13 spectral bands, acquired at three different spatial resolutions. The aim of this research is to super-resolve the lower-resolution (20 m and 60 m Ground Sampling Distance – GSD) bands to 10 m GSD, so as to obtain a complete data cube at the maximal sensor resolution. We employ a state-of-the-art convolutional neural network (CNN) to perform end-to-end upsampling, which is trained with data at lower resolution, i.e., from 40 → 20 m, respectively 360 → 60 m GSD. In this way, one has access to a virtually infinite amount of training data, by downsampling real Sentinel-2 images. We use data sampled globally over a wide range of geographical locations, to obtain a network that generalises across different climate zones and land-cover types, and can super-resolve arbitrary Sentinel-2 images without the need of retraining. In quantitative evaluations (at lower scale, where ground truth is available), our network, which we call DSen2, outperforms the best competing approach by almost 50% in RMSE, while better preserving the spectral characteristics. It also delivers visually convincing results at the full 10 m GSD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Example-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 1×
“The literature on self-similarity in image analysis supports such an assumption ( e.g ., Shechtman and Irani, 2007; Glasner et al., 2009), at least over a certain scale range.”
ResultIncorporating Nesterov Momentum into Adam
Dozat, T. (2016) · Cited by 1,595
NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results
Timofte, R., Agustsson, E., Gool, L. V., Yang, M.-H., Zhang, L., Lim, B., Son, S., Kim, H., Nah, S., Lee, K. M., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.149 · Cited by 1,441
A Critical Comparison Among Pansharpening Algorithms
Vivone, G., Alparone, L., Chanussot, J., Dalla Mura, M., Garzelli, A., Licciardi, G. A., Restaino, R., & Wald, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2361734 · Cited by 1,303
Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm
Yuhas, R. H., Goetz, A. F. H., & Boardman, J. W. (1992) · NASA Technical Reports Server (NASA) · Cited by 1,259
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
First Experience with Sentinel-2 Data for Crop and Tree Species Classifications in Central Europe
Immitzer, M., Vuolo, F., & Atzberger, C. (2016) · Remote Sensing · doi:10.3390/rs8030166 · Cited by 948
The statistics of natural images
Ruderman, D. (1994) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/5/4/006 · Cited by 941
Du, Y., Zhang, Y., Ling, F., Wang, Q., Li, W., & Li, X. (2016) · Remote Sensing · doi:10.3390/rs8040354 · Cited by 885
PanNet: A Deep Network Architecture for Pan-Sharpening
Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.193 · Cited by 802
A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement
Choi, J., Yu, K., & Kim, Y. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2051674 · Cited by 580
Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images
Garzelli, A., Nencini, F., & Capobianco, L. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.907604 · Cited by 570
First Experiences in Mapping Lake Water Quality Parameters with Sentinel-2 MSI Imagery
Toming, K., Kutser, T., Laas, A., Sepp, M., Paavel, B., & Nõges, T. (2016) · Remote Sensing · doi:10.3390/rs8080640 · Cited by 556
Modelling the Power Spectra of Natural Images: Statistics and Information
van der Schaaf, A., & van Hateren, J. H. (1996) · Vision Research · doi:10.1016/0042-6989(96)00002-8 · Cited by 528
On Advances in Statistical Modeling of Natural Images
Srivastava, A., Lee, A. B., Simoncelli, E. P., & Zhu, S.-C. (2003) · Journal of Mathematical Imaging and Vision · doi:10.1023/a:1021889010444 · Cited by 485
Using Sentinel-2 Data for Retrieving LAI and Leaf and Canopy Chlorophyll Content of a Potato Crop
Clevers, J., Kooistra, L., & Van den Brande, M. (2017) · Remote Sensing · doi:10.3390/rs9050405 · Cited by 339
Castillo, J. A. A., Apan, A. A., Maraseni, T. N., & Salmo, S. G. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.10.016 · Cited by 299
Assessment of the Added-Value of Sentinel-2 for Detecting Built-up Areas
Pesaresi, M., Corbane, C., Julea, A., Florczyk, A., Syrris, V., & Soille, P. (2016) · Remote Sensing · doi:10.3390/rs8040299 · Cited by 200
Delloye, C., Weiss, M., & Defourny, P. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.06.037 · Cited by 188
Super-Resolving Multiresolution Images With Band-Independent Geometry of Multispectral Pixels
Brodu, N. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2694881 · Cited by 146
Fast and Efficient Panchromatic Sharpening
Lee, J.-H., & Lee, C. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2028613 · Cited by 133
Landsat Super-Resolution Enhancement Using Convolution Neural Networks and Sentinel-2 for Training
Pouliot, D., Latifovic, R., Pasher, J., & Duffe, J. (2018) · Remote Sensing · doi:10.3390/rs10030394 · Cited by 105
Fasbender, D., Tuia, D., Bogaert, P., & Kanevski, M. (2008) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2008.2000739 · Cited by 46
PANSHARPENING ON THE NARROW VNIR AND SWIR SPECTRAL BANDS OF SENTINEL-2
Vaiopoulos, A. D., & Karantzalos, K. G. (2016) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xli-b7-723-2016 · Cited by 42
Resolution enhancement of ASTER shortwave and thermal infrared bands based on spectral similarity
Tonooka, H. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.580166 · Cited by 19
Paris, C., Bioucas‐Dias, J. M., & Bruzzone, L. (2017) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2017.8127525 · Cited by 12
Self-citation
Research works printed but not linked: 10
- Gasparovic, 2018, The effect of fusing Sentinel-2 bands on land-cover classification, Int. J. Remote Sens., 39, 822, 10.1080/01431161.2017.1392640 · DOI
- Lanaras, C., Bioucas-Dias, J., Baltsavias, E., Schindler, K., 2017. Super-resolution of multispectral multiresolution images from a single sensor. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1505–1513. · doi:10.1109/cvprw.2017.194
- Mura, 2018, Exploiting the capabilities of the Sentinel-2 multi spectral instrument for predicting growing stock volume in forest ecosystems, Int. J. Appl. Earth Obs. Geoinf., 66, 126, 10.1016/j.jag.2017.11.013 · DOI
- Park, 2017, Sharpening the VNIR and SWIR bands of Sentinel-2A imagery through modified selected and synthesized band schemes, Remote Sens., 9, 1080, 10.3390/rs9101080 · doi:10.3390/rs9101080
- Paul, 2016, Glacier remote sensing using Sentinel-2. Part II: mapping glacier extents and surface facies, and comparison to Landsat 8, Remote Sens., 8, 10.3390/rs8070575 · doi:10.3390/rs8070575
- Picaro, G., Addesso, P., Restaino, R., Vivone, G., Picone, D., Dalla Mura, M., 2016. Thermal sharpening of VIIRS data. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 7260–7263. · doi:10.1109/igarss.2016.7730893
- Scarpa, 2018, Target-adaptive cnn-based pansharpening, IEEE Trans. Geosci. Remote Sens., 1
- Sirguey, 2008, Improving MODIS spatial resolution for snow mapping using wavelet fusion and ARSIS concept, IEEE Geosci. Remote Sens. Lett., 5, 78, 10.1109/LGRS.2007.908884 · doi:10.1109/lgrs.2007.908884
- Trishchenko, A.P., Luo, Y., Khlopenkov, K.V., 2006. A method for downscaling MODIS land channels to 250-m spatial resolution using adaptive regression and normalization. In: Proc. SPIE. Vol. 6366, pp. 636607–636607–8. · doi:10.1117/12.689157
- Wang, 2016, Fusion of Sentinel-2 images, Remote Sens. Environ., 187, 241, 10.1016/j.rse.2016.10.030 · doi:10.1016/j.rse.2016.10.030
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion
Meraner, A., Ebel, P., Zhu, X. X., & Schmitt, M. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.05.013 · Cited by 512
Vali, A., Comai, S., & Matteucci, M. (2020) · Remote Sensing · doi:10.3390/rs12152495 · Cited by 455
Peng, D., Bruzzone, L., Zhang, Y., Guan, H., Ding, H., & Huang, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3011913 · Cited by 441
Vivone, G., Dalla Mura, M., Garzelli, A., Restaino, R., Scarpa, G., Ulfarsson, M. O., Alparone, L., & Chanussot, J. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.3019315 · Cited by 359
Metadata
- Authors
- Lanaras, C., Bioucas-Dias, J., Galliani, S., Baltsavias, E., & Schindler, K.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 146
- Pages
- 305-319
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W2794252992
- Cited by
- 371
- References
- 37
- FWCI
- 15.70
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- Swiss National Science Foundation (No. 200021_162998)
- Fundação para a Ciência e a Tecnologia (UID/EEA/50008/2013)
- Portuguese Ministry of Science, Technology and Higher Education (ERANETMED/0001/2014)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.