The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion
Open accessAbstract
Optical remote sensing imagery is at the core of many Earth observation activities. The regular, consistent and global-scale nature of the satellite data is exploited in many applications, such as cropland monitoring, climate change assessment, land-cover and land-use classification, and disaster assessment. However, one main problem severely affects the temporal and spatial availability of surface observations, namely cloud cover. The task of removing clouds from optical images has been subject of studies since decades. The advent of the Big Data era in satellite remote sensing opens new possibilities for tackling the problem using powerful data-driven deep learning methods. In this paper, a deep residual neural network architecture is designed to remove clouds from multispectral Sentinel-2 imagery. SAR-optical data fusion is used to exploit the synergistic properties of the two imaging systems to guide the image reconstruction. Additionally, a novel cloud-adaptive loss is proposed to maximize the retainment of original information. The network is trained and tested on a globally sampled dataset comprising real cloudy and cloud-free images. The proposed setup allows to remove even optically thick clouds by reconstructing an optical representation of the underlying land surface structure.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 2×
“The deep learning model used as backbone for this work is based on the popular ResNet architecture (He et al., 2016a).”
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services
Drusch, M., Del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.11.026 · Cited by 4,815
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Kruse, F. A., Lefkoff, A. B., Boardman, J. W., Heidebrecht, K. B., Shapiro, A. T., Barloon, P. J., & Goetz, A. F. H. (1993) · Remote Sensing of Environment · doi:10.1016/0034-4257(93)90013-n · Cited by 3,164
Torres, R., Snoeij, P., Geudtner, D., Bibby, D., Davidson, M., Attema, E., Potin, P., Rommen, B., Floury, N., Brown, M., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.05.028 · Cited by 2,235
Spatial and Temporal Distribution of Clouds Observed by MODIS Onboard the Terra and Aqua Satellites
King, M. D., Platnick, S., Menzel, W. P., Ackerman, S. A., & Hubanks, P. A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2227333 · Cited by 843
Missing Information Reconstruction of Remote Sensing Data: A Technical Review
Shen, H., Li, X., Cheng, Q., Zeng, C., Yang, G., Li, H., & Zhang, L. (2015) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2015.2441912 · Cited by 575
Zhang, Q., Yuan, Q., Zeng, C., Li, X., & Wei, Y. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2810208 · Cited by 410
Schmitt, M., Hughes, L. H., Qiu, C., & Zhu, X. X. (2019) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iv-2-w7-153-2019 · Cited by 372
Self-citationSuper-resolution of Sentinel-2 images: Learning a globally applicable deep neural network
Lanaras, C., Bioucas-Dias, J., Galliani, S., Baltsavias, E., & Schindler, K. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.09.018 · Cited by 371
Li, X., Shen, H., Zhang, L., Zhang, H., Yuan, Q., & Yang, G. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2307354 · Cited by 299
Cloud Removal From Multitemporal Satellite Images Using Information Cloning
Lin, C.-H., Tsai, P.-H., Lai, K.-H., & Chen, J.-Y. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2197682 · Cited by 259
Cloud removal in remote sensing images using nonnegative matrix factorization and error correction
Li, X., Wang, L., Cheng, Q., Wu, P., Gan, W., & Fang, L. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.12.013 · Cited by 207
Singh, P., & Komodakis, N. (2018) · IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2018.8519033 · Cited by 204
Cheng, Q., Shen, H., Zhang, L., Yuan, Q., & Zeng, C. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.02.015 · Cited by 197
Grohnfeldt, C., Schmitt, M., & Zhu, X. (2018) · IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2018.8519215 · Cited by 189
Self-citationFilmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets
Enomoto, K., Sakurada, K., Wang, W., Fukui, H., Matsuoka, M., Nakamura, R., & Kawaguchi, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.197 · Cited by 185
Fuentes Reyes, M., Auer, S., Merkle, N., Henry, C., & Schmitt, M. (2019) · Remote Sensing · doi:10.3390/rs11172067 · Cited by 168
Self-citationMulti-Temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation
He, W. P., & Yokoya, N. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7100389 · Cited by 116
Nonlocal Tensor Completion for Multitemporal Remotely Sensed Images’ Inpainting
Ji, T.-Y., Yokoya, N., Zhu, X. X., & Huang, T.-Z. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2790262 · Cited by 99
Self-citationThin Cloud Removal Based on Signal Transmission Principles and Spectral Mixture Analysis
Xu, M., Pickering, M. R., Plaza, A., & Jia, X. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2486780 · Cited by 93
SAR TO OPTICAL IMAGE SYNTHESIS FOR CLOUD REMOVAL WITH GENERATIVE ADVERSARIAL NETWORKS
Castro, J. D. B., Happ, P. N., Oliveira, D. A. B., & Feitosa, R. Q. (2018) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-1-5-2018 · Cited by 91
Li, X., Shen, H., Zhang, L., & Li, H. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.03.009 · Cited by 85
AGGREGATING CLOUD-FREE SENTINEL-2 IMAGES WITH GOOGLE EARTH ENGINE
Schmitt, M., Hughes, L. H., Qiu, C., & Zhu, X. X. (2019) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-2-w7-145-2019 · Cited by 77
Self-citationContext-Aware Semantic Inpainting
Li, H., Li, G., Lin, L., Yu, H., & Yu, Y. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2865036 · Cited by 54
Fan, M., Yang, X., Zhou, C., & Li, Z. (2017) · Sensors · doi:10.3390/s17092130 · Cited by 38
Hu, G., Li, X., & Liang, D. (2015) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.9.095053 · Cited by 35
Cited by
Deep learning in multimodal remote sensing data fusion: A comprehensive review
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102926 · Cited by 630
Bentivoglio, R., Isufi, E., Jonkman, S. N., & Taormina, R. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-4345-2022 · Cited by 453
Google Earth Engine and Artificial Intelligence (AI): A Comprehensive Review
Yang, L., Driscol, J., Sarigai, S., Wu, Q., Chen, H., & Lippitt, C. D. (2022) · Remote Sensing · doi:10.3390/rs14143253 · Cited by 264
Metadata
- Authors
- Meraner, A., Ebel, P., Zhu, X. X., & Schmitt, M.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2020-08
- Volume
- 166
- Pages
- 333-346
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W3038579873
- Cited by
- 512
- References
- 36
- FWCI
- 19.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.