Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery
Abstract
Urban land-use mapping is a significant yet challenging task in the field of remote sensing. Although numerous classification methods have been developed for obtaining land-use information in urban areas, the accuracy and efficiency of these methods are insufficient to meet the requirements of real-world applications such as urban planning and land management. In recent years, deep learning techniques, especially deep convolutional neural networks (DCNN), have achieved an astonishing level of performance in image classification. However, the traditional DCNN methods do not focus on multispectral remote sensing images with more than three channels, and they are limited by their training samples. In addition, these methods uniformly decompose large images into small processing units, which chop up the land-use patterns and produce land-use maps with obvious “blocks”. In this study, a semi-transfer deep convolutional neural network (STDCNN) approach is proposed to overcome these weaknesses. The proposed STDCNN has three parts: one part involves a transferred DCNN with deep architecture; another part is designed to analyze multispectral images; and the final part fuses the first two parts into a classification layer. Moreover, a skeleton-based decomposing method using street block data is devised to maintain the integrity of the land-use patterns. In two case studies, the proposed method is used to generate urban land-use maps from a WorldView-3 image of a 143 km2 area of Hong Kong and a WorldView-2 image of a 25 km2 area of Shenzhen. The results show that the proposed STDCNN obtains an overall accuracy (OA) of 91.25% and a Kappa coefficient (Kappa) of 0.903 for Hong Kong land-use classification, and an OA of 80% and a Kappa of 0.780 for Shenzhen land-use classification. In addition, due to the proposed skeleton-based decomposition method, the proposed method can produce better land-use maps for real-world urban applications.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The accuracy and efficiency of numerous proposed methods for urban LULC classification cannot always meet the needs of urban management and analysis in practice, and the area scope processed by these techniques is often small.
“Although numerous methods have been proposed for urban LULC classification, the accuracy and efficiency of these methods cannot always meet the needs of urban management and analysis in practice (Huang et al., 2018), and the area scope processed by these techniques is often small.”
From Deep learning in remote sensing applications: A meta-analysis and review (2019) · cites this paper as Huang et al., 2018
For object-based image classification, a patch-based strategy is a generally accepted method, which integrates CNNs with OBIA.
“For object-based image classification, a patch-based strategy is a generally accepted method (Huang et al., 2018;Fu et al., 2018), which integrates CNNs with OBIA.”
From Deep learning in remote sensing applications: A meta-analysis and review (2019) · cites this paper as Huang et al., 2018
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · see citing works
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · see citing works
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 4,749 · see citing works
Haralock, R. M., & Shapiro, L. G. (1991) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 3,942 · see citing works
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,735 · see citing works
Accessibility evaluation of land-use and transport strategies: Review and research directions
Geurs, K. T., & van Wee, B. (2004) · Journal of Transport Geography · doi:10.1016/j.jtrangeo.2003.10.005 · Cited by 3,353 · see citing works
2017 IEEE International Conference on Computer Vision (ICCV)
(2017) · doi:10.1109/iccv37128.2017 · Cited by 3,129 · see citing works
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206757 · Cited by 2,895 · see citing works
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588 · see citing works
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,229 · see citing works
Chen, X., Zhao, H., Li, P., & Yin, Z. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.11.016 · Cited by 1,735 · see citing works
Geographic Object-Based Image Analysis – Towards a new paradigm
Blaschke, T., Hay, G. J., Kelly, M., Lang, S., Hofmann, P., Addink, E. A., Feitosa, R. Q., van der Meer, F. D., van der Werff, H. M. A., Coillie, F. V., et al. (2013) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2013.09.014 · Cited by 1,648 · see citing works
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · see citing works
Hu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,199 · see citing works
van Gemert, J. C., Veenman, C. J., Smeulders, A. W. M., & Geusebroek, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.132 · Cited by 736 · see citing works
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 730 · see citing works
Urban Economic Theory: Land Use and City Size.
Parr, J. B., & Fujita, M. (1990) · The Economic Journal · doi:10.2307/2233705 · Cited by 712 · see citing works
Scene Classification Using a Hybrid Generative/Discriminative Approach
Bosch, A., Zisserman, A., & Muñoz, X. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70716 · Cited by 682 · see citing works
Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks
Marmanis, D., Datcu, M. P., Esch, T., & Stilla, U. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2499239 · Cited by 652 · see citing works
Land Use Classification in Remote Sensing Images by Convolutional Neural NetworksPreprint
Castelluccio, M., Poggi, G., Sansone, C., & Verdoliva, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00092 · Cited by 560 · see citing works
Saliency-Guided Unsupervised Feature Learning for Scene Classification
Zhang, F., Du, B., & Zhang, L. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2357078 · Cited by 542 · see citing works
Scene Classification via a Gradient Boosting Random Convolutional Network Framework
Zhang, F., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2488681 · Cited by 426 · see citing works
Unsupervised Feature Learning for Aerial Scene Classification
Cheriyadat, A. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241444 · Cited by 418 · see citing works
Zhao, B., Zhong, Y., Xia, G.-S., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2496185 · Cited by 361 · see citing works
Self-citationCheng, G., Han, J., Guo, L., Liu, Z., Bu, S., & Ren, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2393857 · Cited by 305 · see citing works
Spatial pyramid co-occurrence for image classification
Yang, Y., & Newsam, S. D. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126403 · Cited by 304 · see citing works
Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation
Liénou, M., Maı̂tre, H., & Datcu, M. (2009) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2009.2023536 · Cited by 265 · see citing works
Zhong, Y., Zhu, Q., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2435801 · Cited by 244 · see citing works
Feature Coding in Image Classification: A Comprehensive Study
Huang, Y., Wu, Z., Wang, L., & Tan, T. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.113 · Cited by 242 · see citing works
Pyramid of Spatial Relatons for Scene-Level Land Use Classification
Chen, S., & Tian, Y. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2351395 · Cited by 211 · see citing works
Quelhas, P., Monay, F., Odobez, J., Gática-Pérez, D., & Tuytelaars, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1155 · Cited by 186 · see citing works
Zhao, L., Tang, P. T. P., & Huo, L. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2339842 · Cited by 174 · see citing works
Hu, F., Xia, G.-S., Wang, Z., Huang, X., Zhang, L., & Sun, H. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2444405 · Cited by 164 · see citing works
Zhang, X., & Du, S. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.07.017 · Cited by 162 · see citing works
Zhao, B., Zhong, Y., & Zhang, L. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.03.004 · Cited by 149 · see citing works
Self-citationKernel Slow Feature Analysis for Scene Change Detection
Wu, C., Zhang, L., & Du, B. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2642125 · Cited by 147 · see citing works
Learning bayesian classifiers for scene classification with a visual grammar
Aksoy, S., Koperski, K., Tusk, C., Marchisio, G., & Tilton, J. C. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.839547 · Cited by 144 · see citing works
Huang, X., Liu, H., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2380779 · Cited by 136 · see citing works
Automated urban land-use classification with remote sensing
Hu, S., & Wang, L. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.714510 · Cited by 130 · see citing works
Transfer Learning With Fully Pretrained Deep Convolution Networks for Land-Use Classification
Zhao, B., Huang, B., & Zhong, Y. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2691013 · Cited by 123 · see citing works
Self-citationVoltersen, M., Berger, C. R., Hese, S., et al. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.08.024 · Cited by 115 · see citing works
Pasero, E. G. A., Morabito, F. C., Esposito, A. A., et al. (2016) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-33747-0 · Cited by 111 · see citing works
The Fisher Kernel Coding Framework for High Spatial Resolution Scene Classification
Zhao, B., Zhong, Y., Zhang, L., & Huang, B. (2016) · Remote Sensing · doi:10.3390/rs8020157 · Cited by 110 · see citing works
Self-citationZheng, X., Sun, X., Fu, K., et al. (2012) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2012.2216499 · Cited by 87 · see citing works
Wu, S.-S., Qiu, X., Usery, E. L., et al. (2008) · Annals of the Association of American Geographers · doi:10.1080/00045600802459028 · Cited by 81 · see citing works
From land cover-graphs to urban structure types
Walde, I., Hese, S., Berger, C. R., & Schmullius, C. (2014) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2013.865189 · Cited by 72 · see citing works
A Comparative Study of Bag-of-Words and Bag-of-Topics Models of EO Image Patches
Bahmanyar, R., Cui, S., & Datcu, M. P. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2402391 · Cited by 62 · see citing works
Zhao, B., Zhong, Y., & Zhang, L. (2013) · Remote Sensing Letters · doi:10.1080/2150704x.2013.858843 · Cited by 48 · see citing works
Self-citationSemantic Annotation of Satellite Images Using Author–Genre–Topic Model
Wang, L., Li, H., Liu, G., et al. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2250978 · Cited by 35 · see citing works
Aerial Scene Classification with Convolutional Neural Networks
Jia, S., Liu, H., & Sun, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25393-0_29 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456 · see citing works
- Authors
- Huang, B., Zhao, B., & Song, Y.
- Affiliations
- Chinese University of Hong Kong (HK)
- Corresponding author
- Zhao, Bei
- Venue
- Remote Sensing of Environment
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 214
- Pages
- 73-86
- ISSN
- 0034-4257 (ISSN-L)
- OpenAlex
- W2803946774
- Cited by
- 591
- References
- 54
- Citations by year
- 2026: 32 · 2025: 60 · 2024: 84 · 2023: 82 · 2022: 101 · 2021: 81 · 2020: 91 · 2019: 53 · 2018: 7
- FWCI
- 43.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Remote Sensing of Environment (publishedVersion)
- The HKU Scholars Hub (University of Hong Kong) (submittedVersion)
- Funders
- National Key R&D Program of China (2017YFB0503605)
- Hong Kong Research Grants Council (14606315)
- Topics
- Physical Sciences › Engineering › Media Technology › Remote-Sensing Image Classification
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Remote Sensing and Land Use
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- urban land use mapping, deep convolutional neural networks, multispectral imagery, high-resolution imagery, WorldView-3, WorldView-2, land use classification, Hong Kong, Shenzhen
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
