Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
A new convolution neural network (CNN) architecture for semantic segmentation of high resolution aerial imagery is proposed in this paper. The proposed architecture follows an hourglass-shaped network (HSN) design being structured into encoding and decoding stages. By taking advantage of recent advances in CNN designs, we use the composed inception module to replace common convolutional layers, providing the network with multi-scale receptive areas with rich context. Additionally, in order to reduce spatial ambiguities in the up-sampling stage, skip connections with residual units are also employed to feed forward encoding-stage information directly to the decoder. Moreover, overlap inference is employed to alleviate boundary effects occurring when high resolution images are inferred from small-sized patches. Finally, we also propose a post-processing method based on weighted belief propagation to visually enhance the classification results. Extensive experiments based on the Vaihingen and Potsdam datasets demonstrate that the proposed architectures outperform three reference state-of-the-art network designs both numerically and visually.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“We employ the weighted belief propagation algorithm (WBP) [40,41] to iteratively minimize the energy function E .”
MethodStacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634 · cited 1×
“Inspired by the hourglass-shaped network introduced for human pose estimation [36] and image depth estimation [35], we propose a network that features (i) multi-scale inference by using inception modules [34] replacing simple convolutional layers and (ii) forwarding information from the encoding layers directly to dec…”
MethodStriving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862 · cited 1×
“To address this problem, the loss for each pixel is weighted based on the median frequency balancing [21,37] technique.”
MethodOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 2×
“For instance, replacing the fully-connected layer in the network with convolutional layers can lead to more efficient algorithms by avoiding overlapping computations [22,29].”
BackgroundMethodLearning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Research works printed but not linked: 31
- Rees, W.G. (2013). Physical Principles of Remote Sensing, Cambridge University Press. · DOI · Paper page
- Wang, 2016, Salient band selection for hyperspectral image classification via manifold ranking, IEEE Trans. Neural Netw. Learn. Syst., 27, 1279, 10.1109/TNNLS.2015.2477537 · DOI · Paper page
- Yuan, 2016, Hyperspectral anomaly detection by graph pixel selection, IEEE Trans. Cybern., 46, 3123, 10.1109/TCYB.2015.2497711 · DOI · Paper page
- Oliva, 2001, Modeling the shape of the scene: A holistic representation of the spatial envelope, Int. J. Comput. Vis., 42, 145, 10.1023/A:1011139631724 · DOI · Paper page
- Huang, J., Kumar, S.R., Mitra, M., Zhu, W.J., and Zabih, R. (1997, January 17–19). Image indexing using color correlograms. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Stehling, R.O., Nascimento, M.A., and Falcão, A.X. (2002, January 4–9). A Compact and Efficient Image Retrieval Approach Based on Border/Interior Pixel Classification. Proceedings of the International Conference on Information and Knowledge Management (CIKM), McLean, VA, USA. · DOI · Paper page
- Avila, 2013, Pooling in image representation: The visual codeword point of view, Comput. Vis. Image Underst., 117, 453, 10.1016/j.cviu.2012.09.007 · DOI · Paper page
- Agrawal, 2005, Automatic subspace clustering of high dimensional data, Data Min. Knowl. Discov., 11, 5, 10.1007/s10618-005-1396-1 · DOI · Paper page
- Lu, 2011, A survey of multilinear subspace learning for tensor data, Pattern Recognit., 44, 1540, 10.1016/j.patcog.2011.01.004 · DOI · Paper page
- Peng, 2017, Constructing the L2-graph for robust subspace learning and subspace clustering, IEEE Trans. Cybern., 47, 1053, 10.1109/TCYB.2016.2536752 · DOI · Paper page
- Tokarczyk, 2015, Features, Color Spaces, and Boosting: New Insights on Semantic Classification of Remote Sensing Images, IEEE Trans. Geosci. Remote Sens., 53, 280, 10.1109/TGRS.2014.2321423 · DOI
- Cheriyadat, 2014, Unsupervised feature learning for aerial scene classification, IEEE Trans. Geosci. Remote Sens., 52, 439, 10.1109/TGRS.2013.2241444 · DOI · Paper page
- Sun, 2012, Automatic Target Detection in High-Resolution Remote Sensing Images Using Spatial Sparse Coding Bag-of-Words Model, IEEE Geosci. Remote Sens. Lett., 9, 109, 10.1109/LGRS.2011.2161569 · DOI · Paper page
- Razavian, A.S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014, January 23–28). CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA. · DOI · Paper page
- Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA. · DOI · Paper page
- Paisitkriangkrai, S., Sherrah, J., Janney, P., and Hengel, V.D. (2015, January 7–12). Effective semantic pixel labeling with convolutional networks and conditional random fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA. · DOI · Paper page
- Kampffmeyer, M., Salberg, A.B., and Jenssen, R. (July, January 26). Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA.
- Volpi, 2017, Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks, IEEE Trans. Geosci. Remote Sens., 55, 1, 10.1109/TGRS.2016.2616585 · DOI · Paper page
- Zeiler, M.D., Taylor, G.W., and Fergus, R. (2011, January 6–13). Adaptive deconvolutional networks for mid and high level feature learning. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain. · DOI · Paper page
- Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11–13). Deep Sparse Rectifier Neural Networks. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), Fort Lauderdale, FL, USA.
- Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16–21). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the International Conference on Machine Learning (ICML), Atlanta, GA, USA.
- Saxe, A., Koh, P.W., Chen, Z., Bhand, M., Suresh, B., and Ng, A.Y. (July, January 28). On random weights and unsupervised feature learning. Proceedings of the International conference on machine learning (ICML), Bellevue, WA, USA.
- Lee, C.Y., Gallagher, P.W., and Tu, Z. (2016, January 9–11). Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), Cadiz, Spain.
- Pinheiro, P., and Collobert, R. (2014, January 21–26). Recurrent convolutional neural networks for scene parsing. Proceedings of the International Conference on Machine Learning (ICML), Beijing, China.
- Simonyan, K., and Zisserman, A. (2015, January 7–9). Very deep convolutional networks for large-scale image recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
- Ioffe, S., and Szegedy, C. (2015, January 7–9). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the International Conference on Machine Learning (ICML), San Diego, CA, USA.
- Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA. · DOI · Paper page
- Chen, W., Fu, Z., Yang, D., and Deng, J. (2016, January 5–10). Single-image depth perception in the wild. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Barcelona, Spain.
- Tieleman, 2012, Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude, Neural Netw. Mach. Learn., 4, 26
- He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–13). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Los Alamitos, CA, USA. · DOI · Paper page
- Murphy, K.P., Weiss, Y., and Jordan, M.I. (August, January 30). Loopy belief propagation for approximate inference: An empirical study. Proceedings of the Conference on Uncertainty in artificial intelligence (UAI), Stockholm, Sweden.
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Self-citationResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,153
Land-cover classification with high-resolution remote sensing images using transferable deep models
Tong, X.-Y., Xia, G.-S., Lu, Q., Shen, H., Li, S., You, S., & Zhang, L. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111322 · Cited by 978
A review of deep learning methods for semantic segmentation of remote sensing imagery
Yuan, X., Shi, J., & Gu, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114417 · Cited by 766
Sun, A. Y., & Scanlon, B. R. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab1b7d · Cited by 551
Metadata
- Authors
- Liu, Y., Minh Nguyen, D., Deligiannis, N., Ding, W., & Munteanu, A.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2017-05-25
- Volume
- 9
- Issue
- 6
- Pages
- 522
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W2618943282
- Cited by
- 142
- References
- 10
- FWCI
- 15.54
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Fonds Wetenschappelijk Onderzoek (G084117)
- Brussels Institute for Research and Innovation (Innoviris) (3DLicornea)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery. https://app.cochat.ai/papers/10.3390/rs9060522
- The paper
- Liu, Y., Minh Nguyen, D., Deligiannis, N., Ding, W., & Munteanu, A. (2017). Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery. Remote Sensing. https://doi.org/10.3390/rs9060522
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.