The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Open accessAbstract
Scene understanding of high resolution aerial images is of great importance for the task of automated monitoring in various remote sensing applications. Due to the large within-class and small between-class variance in pixel values of objects of interest, this remains a challenging task. In recent years, deep convolutional neural networks have started being used in remote sensing applications and demonstrate state of the art performance for pixel level classification of objects. Here we present a novel deep learning architecture, \resuneta, that combines ideas from various state of the art modules used in computer vision for semantic segmentation tasks. We analyse the performance of several flavours of the Generalized Dice loss for semantic segmentation, and we introduce a novel variant loss function for semantic segmentation of objects that has better convergence properties and behaves well even under the presence of highly imbalanced classes. The performance of our modeling framework is evaluated on the ISPRS 2D Potsdam dataset. Results show state-of-the-art performance with an average F1 score of 92.9% over all classes for our best model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Research works printed but not linked: 56
- Abraham, N., Khan, N.M., 2018. A novel focal tversky loss function with improved attention u-net for lesion segmentation. CoRR abs/1810.07842. http://arxiv.org/abs/1810.07842. · arXiv
- Audebert, 2018, Beyond rgb: Very high resolution urban remote sensing with multimodal deep networks, ISPRS J. Photogramm. Remote Sens., 140, 20, 10.1016/j.isprsjprs.2017.11.011 · DOI · Paper page
- Audebert, 2017, Segment-before-detect: vehicle detection and classification through semantic segmentation of aerial images, Remote Sens., 9, 10.3390/rs9040368 · DOI · Paper page
- Audebert, N., Saux, B.L., Lefèvre, S., 2016. Semantic segmentation of earth observation data using multimodal and multi-scale deep networks. CoRR abs/1609.06846. http://arxiv.org/abs/1609.06846. · arXiv
- Bertasius, G., Shi, J., Torresani, L., 2015. Semantic segmentation with boundary neural fields. CoRR abs/1511.02674. http://arxiv.org/abs/1511.02674. · arXiv
- Blaschke, 2014, Geographic object-based image analysis–towards a new paradigm, ISPRS J. Photogramm. Remote Sens., 87, 180, 10.1016/j.isprsjprs.2013.09.014 · DOI · Paper page
- Borgefors, 1986, Distance transformations in digital images, Comput. Vision Graph. Image Process., 34, 344, 10.1016/S0734-189X(86)80047-0 · DOI · Paper page
- Chen, L., Papandreou, G., Schroff, F., Adam, H., 2017. Rethinking atrous convolution for semantic image segmentation. CoRR abs/1706.05587. http://arxiv.org/abs/1706.05587. · arXiv
- Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., Zhang, Z., 2015. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274. · arXiv
- Cheng, 2017, Automatic road detection and centerline extraction via cascaded end-to-end convolutional neural network, IEEE Trans. Geosci. Remote Sens., 55, 3322, 10.1109/TGRS.2017.2669341 · DOI · Paper page
- Comaniciu, 2002, Mean shift: a robust approach toward feature space analysis, IEEE Trans. Pattern Anal. Mach. Intell., 24, 603, 10.1109/34.1000236 · DOI · Paper page
- Dice, L.R., 1945. Measures of the amount of ecologic association between species. Ecology 26, 297–302. doi:https://doi.org/10.2307/1932409. · DOI · Paper page
- Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., Pal, C., 2016. The importance of skip connections in biomedical image segmentation. CoRR abs/1608.04117. http://arxiv.org/abs/1608.04117. · DOI · Paper page
- Goldblatt, 2018, Using landsat and nighttime lights for supervised pixel-based image classification of urban land cover, Remote Sens. Environ., 205, 253, 10.1016/j.rse.2017.11.026 · DOI · Paper page
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y., 2014. Generative adversarial nets. In: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q. (Eds.), Advances in Neural Information Processing Systems, vol. 27. Curran Associates, Inc., pp. 2672–2680. http://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf.
- Gu, 2019, A survey on deep learning-driven remote sensing image scene understanding: Scene classification, scene retrieval and scene-guided object detection, Appl. Sci., 9, 10.3390/app9102110 · DOI
- He, K., Girshick, R.B., Dollár, P., 2018. Rethinking imagenet pre-training. CoRR abs/1811.08883. http://arxiv.org/abs/1811.08883. · arXiv
- He, K., Zhang, X., Ren, S., Sun, J., 2014. Spatial pyramid pooling in deep convolutional networks for visual recognition. CoRR abs/1406.4729. http://arxiv.org/abs/1406.4729. · arXiv
- Jaderberg, M., Simonyan, K., Zisserman, A., Kavukcuoglu, K., 2015. Spatial transformer networks. CoRR abs/1506.02025. http://arxiv.org/abs/1506.02025. · arXiv
- Kervadec, H., Bouchtiba, J., Desrosiers, C., Ric Granger, Dolz, J., Ayed, I.B., 2018. Boundary loss for highly unbalanced segmentation arXiv:1812.07032. · arXiv
- Lambert, 2016, Cropland mapping over sahelian and sudanian agrosystems: a knowledge-based approach using proba-v time series at 100-m, Remote Sens., 8, 232, 10.3390/rs8030232 · DOI
- Längkvist, 2016, Classification and segmentation of satellite orthoimagery using convolutional neural networks, Remote Sens., 8, 329, 10.3390/rs8040329 · DOI · Paper page
- Li, 2015, Robust rooftop extraction from visible band images using higher order crf, IEEE Trans. Geosci. Remote Sens., 53, 4483, 10.1109/TGRS.2015.2400462 · DOI
- Li, S., Jiao, J., Han, Y., Weissman, T., 2016. Demystifying resnet. CoRR abs/1611.01186. http://arxiv.org/abs/1611.01186. · arXiv
- Li, 2014, Object-based land-cover mapping with high resolution aerial photography at a county scale in midwestern usa, Remote Sens., 6, 11372, 10.3390/rs61111372 · doi:10.3390/rs61111372
- Liu, 2018, Semantic labeling in very high resolution images via a self-cascaded convolutional neural network, ISPRS J. Photogramm. Remote Sens., 145, 78, 10.1016/j.isprsjprs.2017.12.007 · DOI · Paper page
- Liu, 2017, Hourglass-shapenetwork based semantic segmentation for high resolution aerial imagery, Remote Sens., 9
- Liu, Y., Piramanayagam, S., Monteiro, S.T., Saber, E., 2017b. Dense semantic labeling of very-high-resolution aerial imagery and lidar with fully-convolutional neural networks and higher-order crfs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Honolulu, USA. · DOI
- Lu, 2017, Joint dictionary learning for multispectral change detection, IEEE Trans. Cybernetics, 47, 884, 10.1109/TCYB.2016.2531179 · DOI · Paper page
- Marmanis, 2018, Classification with an edge: Improving semantic image segmentation with boundary detection, ISPRS J. Photogramm. Remote Sens., 135, 158, 10.1016/j.isprsjprs.2017.11.009 · DOI · Paper page
- Marmanis, D., Wegner, J.D., Galliani, S., Schindler, K., Datcu, M., Stilla, U., 2016. Semantic segmentation of aerial images with an ensemble of cnns. · DOI · Paper page
- Matikainen, 2011, Segment-based land cover mapping of a suburban areacomparison of high-resolution remotely sensed datasets using classification trees and test field points, Remote Sens., 3, 1777, 10.3390/rs3081777 · DOI
- Myint, 2011, Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery, Remote Sens. Environ., 115, 1145, 10.1016/j.rse.2010.12.017 · DOI · Paper page
- Novikov, A.A., Major, D., Lenis, D., Hladuvka, J., Wimmer, M., Bühler, K., 2017. Fully convolutional architectures for multi-class segmentation in chest radiographs. CoRR abs/1701.08816. http://arxiv.org/abs/1701.08816. · arXiv
- Odena, 2016, Deconvolution and checkerboard artifacts, Distill, 10.23915/distill.00003 · DOI · Paper page
- Paisitkriangkrai, 2016, Semantic labeling of aerial and satellite imagery, IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens., 9, 2868, 10.1109/JSTARS.2016.2582921 · DOI
- Pan, 2018, Semantic labeling of high resolution aerial imagery and lidar data with fine segmentation network, Remote Sens., 10, 10.3390/rs10050743 · DOI
- Pan, 2018, High-resolution aerial imagery semantic labeling with dense pyramid network, Sensors, 18
- Penatti, O.A., Nogueira, K., dos Santos, J.A., 2015. Do deep features generalize from everyday objects to remote sensing and aerial scenes domains? In: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 44–51. doi.ieeecomputersociety.org/10.1109/CVPRW.2015.7301382, doi:https://doi.org/10.1109/CVPRW.2015.7301382. · DOI · Paper page
- Piramanayagam, 2018, Supervised classification of multisensor remotely sensed images using a deep learning framework, Remote Sens., 10
- Ruder, S., 2017. An overview of multi-task learning in deep neural networks. CoRR abs/1706.05098. http://arxiv.org/abs/1706.05098. · arXiv
- Sergeev, A., Balso, M.D., 2018. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799. · arXiv
- Sherrah, J., 2016. Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery. CoRR abs/1606.02585. http://arxiv.org/abs/1606.02585. · arXiv
- Sørensen, 1948, A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons, Biol. Skr., 5, 1
- Taghanaki, S.A., Abhishek, K., Cohen, J.P., Cohen-Adad, J., Hamarneh, G., 2019. Deep semantic segmentation of natural and medical images: a review arXiv:1910.07655. · arXiv
- Vadivel, A., Sural, Shamik, Majumdar, A.K., 2005. Human color perception in the hsv space and its application in histogram generation for image retrieval. doi:https://doi.org/10.1117/12.586823. · doi:10.1117/12.586823
- Vincent, 1991, Watersheds in digital spaces: an efficient algorithm based on immersion simulations, IEEE Trans. Pattern Anal. Mach. Intell., 583, 10.1109/34.87344 · DOI · Paper page
- Volpi, 2017, Dense semantic labeling of subdecimeter resolution images with convolutional neural networks, IEEE Trans. Geosci. Remote Sens., 55, 881, 10.1109/TGRS.2016.2616585 · DOI · Paper page
- Waldner, 2017, National-scale cropland mapping based on spectral-temporal features and outdated land cover information, PloS One, 12, 10.1371/journal.pone.0181911 · DOI
- Wen, 2017, Semantic classification of urban trees using very high resolution satellite imagery, IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens., 10, 1413, 10.1109/JSTARS.2016.2645798 · DOI
- Xie, S.M., Jean, N., Burke, M., Lobell, D.B., Ermon, S., 2015. Transfer learning from deep features for remote sensing and poverty mapping. CoRR abs/1510.00098. http://arxiv.org/abs/1510.00098. · arXiv
- Yang, 2018, Building extraction in very high resolution imagery by dense-attention networks, Remote Sens., 10, 10.3390/rs10111768 · DOI
- Zhang, H., Dana, K., Shi, J., Zhang, Z., Wang, X., Tyagi, A., Agrawal, A., 2018. Context encoding for semantic segmentation. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). · DOI · Paper page
- Zhang, 2011, Mapping urbanization dynamics at regional and global scales using multi-temporal dmsp/ols nighttime light data, Remote Sens. Environ., 115, 2320, 10.1016/j.rse.2011.04.032 · DOI · Paper page
- Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J., 2017a. Pyramid scene parsing network. In: CVPR. · DOI · Paper page
- Zhao, 2017, Contextually guided very-high-resolution imagery classification with semantic segments, ISPRS J. Photogramm. Remote Sens., 132, 48, 10.1016/j.isprsjprs.2017.08.011 · DOI
Cited by
TransAttUnet: Multi-Level Attention-Guided U-Net With Transformer for Medical Image Segmentation
Chen, B., Liu, Y., Zhang, Z., Lu, G., & Kong, A. W. K. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3309626 · Cited by 459
Sharp U-Net: Depthwise convolutional network for biomedical image segmentation
Zunair, H., & Ben Hamza, A. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104699 · Cited by 394
Zhang, C., Jiang, W., Zhang, Y., Wang, W., Zhao, Q., & Wang, C. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3144894 · Cited by 325
Remote sensing image segmentation advances: A meta-analysis
Kotaridis, I., & Lazaridou, M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.01.020 · Cited by 312
Semantic segmentation using Vision Transformers: A survey
Thisanke, H., Deshan, C., Chamith, K., Seneviratne, S., Vidanaarachchi, R., & Herath, D. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106669 · Cited by 288
Metadata
- Authors
- Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 162
- Pages
- 94-114
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W3007268491
- Cited by
- 2,153
- References
- 31
- FWCI
- 98.19
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data. https://app.cochat.ai/papers/10.1016/j.isprsjprs.2020.01.013
- The paper
- Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020). ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data. ISPRS Journal of Photogrammetry and Remote Sensing. https://doi.org/10.1016/j.isprsjprs.2020.01.013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.