Convolutional neural networks for large-scale remote-sensing image classification
Open accessAbstract
We propose an end-to-end framework for the dense, pixelwise classification of satellite imagery with convolutional neural networks (CNNs). In our framework, CNNs are directly trained to produce classification maps out of the input images. We first devise a fully convolutional architecture and demonstrate its relevance to the dense classification problem. We then address the issue of imperfect training data through a two-step training approach: CNNs are first initialized by using a large amount of possibly inaccurate reference data, and then refined on a small amount of accurately labeled data. To complete our framework, we design a multiscale neuron module that alleviates the common tradeoff between recognition and precise localization. A series of experiments show that our networks consider a large amount of context to provide fine-grained classification maps.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CNN has received the greatest attention at all times among deep learning models used in LULC classification.
“Regarding the DL model used in LULC classification, CNN has been received the greatest attention at all times (Maggiori et al., 2017).”
From Deep learning in remote sensing applications: A meta-analysis and review (2019) · cites this paper as Maggiori et al., 2017
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537 · see citing works
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287 · see citing works
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · see citing works
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · see citing works
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754 · see citing works
Multi-column deep neural networks for image classification
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,760 · see citing works
A survey of image classification methods and techniques for improving classification performance
Lu, D., & Weng, Q. (2007) · International Journal of Remote Sensing · doi:10.1080/01431160600746456 · Cited by 3,424 · see citing works
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679 · see citing works
Kernel-based methods for hyperspectral image classification
Camps‐Valls, G., & Bruzzone, L. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2005.846154 · Cited by 1,457 · see citing works
Advances in Spectral-Spatial Classification of Hyperspectral Images
Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197589 · Cited by 1,288 · see citing works
Self-citationSpectral-spatial classification of hyperspectral data based on deep belief network
Chen, Y., Zhao, X., & Jia, X. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2388577 · Cited by 1,259 · cited 1× · see citing works
“Alternatively, a spectral-spatial approach has been taken by convolving in the 1-D flattened spectrum vector of a group of adjacent pixels [17], [18].”
Zhao, W., & Du, S. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543748 · Cited by 1,217 · see citing works
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K. G., Doulamis, A. D., & Doulamis, N. D. (2015) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,045 · see citing works
SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images
Tarabalka, Y., Fauvel, M., Chanussot, J., & Benediktsson, J. A. (2010) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2047711 · Cited by 749 · see citing works
Self-citationMachine learning for aerial image labeling
Hinton, G. E., & Mnih, V. (2013) · TSpace (University of Toronto) · Cited by 722 · see citing works
Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C., & Pan, C. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2309695 · Cited by 619 · see citing works
The application of artificial neural networks to the analysis of remotely sensed data
Mas, J., & Flores, J. J. (2007) · International Journal of Remote Sensing · doi:10.1080/01431160701352154 · Cited by 617 · see citing works
What is a good evaluation measure for semantic segmentation?
Csurka, G., Larlus, D., & Perronnin, F. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.32 · Cited by 536 · see citing works
Spectral–spatial classification of hyperspectral images using deep convolutional neural networks
Yue, J., Zhao, W., Mao, S., & Liu, H. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1047045 · Cited by 525 · see citing works
Learning multiscale and deep representations for classifying remotely sensed imagery
Zhao, W., & Du, S. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.01.004 · Cited by 398 · see citing works
Multiview Deep Learning for Land-Use Classification
Luus, F., Salmon, B. P., van den Bergh, F., & Maharaj, B. T. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2483680 · Cited by 257 · see citing works
Convolutional Neural Network Based Automatic Object Detection on Aerial Images
Ševo, I., & Avramović, A. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2542358 · Cited by 229 · see citing works
Classification of hyperspectral image based on deep belief networks
Li, T., Zhang, J., & Zhang, Y. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026039 · Cited by 217 · see citing works
Zhao, W., Guo, Z., Yue, J., Zhang, X., & Luo, L. (2015) · International Journal of Remote Sensing · doi:10.1080/2150704x.2015.1062157 · Cited by 194 · see citing works
Wang, J., Song, J., Chen, M., & Yang, Z. (2015) · International Journal of Remote Sensing · doi:10.1080/01431161.2015.1054049 · Cited by 178 · see citing works
Neural maps in remote sensing image analysis
Villmann, T., Merényi, E., & Hammer, B. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00021-2 · Cited by 168 · see citing works
Michel, J., Youssefi, D., & Grizonnet, M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2330857 · Cited by 153 · see citing works
Hyperspectral Image Classification with Convolutional Neural Networks
Slavkovikj, V., Verstockt, S., Neve, W. D., et al. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806306 · Cited by 117 · see citing works
A comparison of texture measures for the per-field classification of Mediterranean land cover
Lloyd, C. D., Berberoğlu, S., Curran, P. J., & Atkinson, P. M. (2004) · International Journal of Remote Sensing · doi:10.1080/0143116042000192321 · Cited by 88 · see citing works
A Scalable Tile-Based Framework for Region-Merging Segmentation
Lassalle, P., Inglada, J., Michel, J., et al. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2422848 · Cited by 53 · see citing works
Deep Model for Classification of Hyperspectral image using Restricted Boltzmann Machine
Midhun, M. E., Nair, S. R., Prabhakar, V. T. N., et al. (2014) · doi:10.1145/2660859.2660946 · Cited by 48 · see citing works
Graph-cut-based model for spectral-spatial classification of hyperspectral images
Tarabalka, Y., & Rana, A. (2014) · doi:10.1109/igarss.2014.6947216 · Cited by 45 · see citing works
Self-citationSegmentation of remote-sensing images by incremental neural network
Kurnaz, M. N., Dokur, Z., & Ölmez, T. (2004) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.10.004 · Cited by 31 · see citing works
Basaeed, E., Bhaskar, H., Hill, P., et al. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1159745 · Cited by 31 · see citing works
Morphological Attribute Profiles With Partial Reconstruction
Liao, W., Mura, M. D., Chanussot, J., et al. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2488280 · Cited by 30 · see citing works
Information fusion in tree classifiers
Kumar, A., & Majumder, K. L. (2001) · International Journal of Remote Sensing · doi:10.1080/01431160051060327 · Cited by 12 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456 · see citing works
A survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821 · see citing works
On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID
Long, Y., Xia, G.-S., Li, S., Yang, W., Yang, M. Y., Zhu, X. X., Zhang, L., & Li, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3070368 · Cited by 250 · see citing works
Benchmarking and scaling of deep learning models for land cover image classification
Papoutsis, I., Bountos, N. I., Zavras, A., Michail, D., & Tryfonopoulos, C. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.11.012 · Cited by 86 · see citing works
“The work of Maggiori et al. (2016) has been one of the early works on LC classification with high-resolution RS images using transferable deep models.”
BackgroundKhoshboresh Masouleh, M., & Shah-Hosseini, R. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.009 · Cited by 51 · see citing works
- Authors
- Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- Université Paris-Sud (FR)
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2017-02
- Volume
- 55
- Issue
- 2
- Pages
- 645-657
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2538244214
- Cited by
- 1,114
- References
- 39
- Citations by year
- 2026: 50 · 2025: 80 · 2024: 96 · 2023: 110 · 2022: 129 · 2021: 139 · 2020: 169 · 2019: 172 · 2018: 124 · 2017: 45
- FWCI
- 122.86
- Type
- journal article
- Language
- en
- Open access
- green
- inria.hal.science
- Locations
- IEEE Transactions on Geoscience and Remote Sensing (publishedVersion)
- HAL (submittedVersion, other-oa)
- Funders
- Centre National d’Etudes Spatiales
- Topics
- Physical Sciences › Engineering › Media Technology › Remote-Sensing Image Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Remote Sensing and Land Use
- Keywords
- convolutional neural networks, satellite image classification, fully convolutional network, two-stage training, context modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review