The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
Open accessAbstract
This paper introduces the use of single-layer and deep convolutional networks for remote sensing data analysis. Direct application to multi- and hyperspectral imagery of supervised (shallow or deep) convolutional networks is very challenging given the high input data dimensionality and the relatively small amount of available labeled data. Therefore, we propose the use of greedy layerwise unsupervised pretraining coupled with a highly efficient algorithm for unsupervised learning of sparse features. The algorithm is rooted on sparse representations and enforces both population and lifetime sparsity of the extracted features, simultaneously. We successfully illustrate the expressive power of the extracted representations in several scenarios: classification of aerial scenes, as well as land-use classification in very high resolution or land-cover classification from multi- and hyperspectral images. The proposed algorithm clearly outperforms standard principal component analysis (PCA) and its kernel counterpart (kPCA), as well as current state-of-the-art algorithms of aerial classification, while being extremely computationally efficient at learning representations of data. Results show that single-layer convolutional networks can extract powerful discriminative features only when the receptive field accounts for neighboring pixels and are preferred when the classification requires high resolution and detailed results. However, deep architectures significantly outperform single-layer variants, capturing increasing levels of abstraction and complexity throughout the feature hierarchy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“Therefore, we introduce the use of deep convolutional networks for remote sensing data analysis [39] trained by means of an unsupervised learning method seeking sparse feature representations.”
Method(2014) · Cited by 33,419
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Remote Sensing and Image Interpretation
Wright, J., Lillesand, T. M., & Kiefer, R. W. (1980) · The Geographical Journal · doi:10.2307/634969 · Cited by 7,238
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services
Drusch, M., Del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.11.026 · Cited by 4,815
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Remote sensing and image interpretation
Cook, E. A. (1995) · Preventive Veterinary Medicine · doi:10.1016/0167-5877(95)90036-5 · Cited by 3,307
Bag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Landsat-8: Science and product vision for terrestrial global change research
Roy, D. P., Wulder, M. A., Loveland, T. R., C.E., W., Allen, R. G., Anderson, M. C., Helder, D., Irons, J. R., Johnson, D. M., Kennedy, R., et al. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.02.001 · Cited by 2,659
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction
Masci, J., Meier, U., Cireşan, D., & Schmidhuber, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_7 · Cited by 1,955
Nonlinear Dimensionality Reduction
(2007) · Information Science and Statistics · doi:10.1007/978-0-387-39351-3 · Cited by 1,517
Kernel-based methods for hyperspectral image classification
Camps-Valls, G., & Bruzzone, L. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2005.846154 · Cited by 1,453
Self-citationLeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
Resilience and Vulnerability: Complementary or Conflicting Concepts?
Miller, F., Osbahr, H., Boyd, E., Thomalla, F., Bharwani, S., Ziervogel, G., Walker, B., Birkmann, J., van der Leeuw, S., Rockström, J., et al. (2010) · Ecology and Society · doi:10.5751/es-03378-150311 · Cited by 983
LeCun, Y., Bottou, L., Orr, G. B., & Müller, K. R. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8_2 · Cited by 919
(2002) · Springer Series in Statistics · doi:10.1007/b98835 · Cited by 919
The Global Monitoring for Environment and Security (GMES) Sentinel-3 mission
Donlon, C., Berruti, B., Buongiorno, A., Ferreira, M.-H., Féménias, P., Frerick, J., Goryl, P., Klein, U., Laur, H., Mavrocordatos, C., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.07.024 · Cited by 844
Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods
Camps-Valls, G., Tuia, D., Bruzzone, L., & Benediktsson, J. A. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2279179 · Cited by 781
Self-citationQuantitative Remote Sensing of Land Surfaces
Liang, S. (2003) · Wiley eBooks · doi:10.1002/047172372x · Cited by 691
Compressive Coded Aperture Spectral Imaging: An Introduction
Arce, G. R., Brady, D. J., Carin, L., Arguello, H., & Kittle, D. S. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2278763 · Cited by 661
Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C.-L., & Pan, C.-H. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2309695 · Cited by 622
Learning Convolutional Feature Hierarchies for Visual Recognition
Kavukcuoglu, K., Sermanet, P., Boureau, Y.-L., Gregor, K., Mathieu, M., & LeCun, Y. (2010) · neural information processing systems · Cited by 604
(2003) · Statistics in Musicology · doi:10.1201/9780203496947.ch8 · Cited by 577
(2011) · Cited by 514
A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing
Ma, W.-K., Bioucas-Dias, J. M., Chan, T.-H., Gillis, N., Gader, P., Plaza, A. J., Ambikapathi, A., & Chi, C.-Y. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2279731 · Cited by 456
Quantitative remote sensing of land surfaces
Hogg, J. (2004) · The Photogrammetric Record · doi:10.1111/j.0031-868x.2004.295_1.x · Cited by 429
Unsupervised Feature Learning for Aerial Scene Classification
Cheriyadat, A. M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241444 · Cited by 421
Signal processing for hyperspectral image exploitation
Shaw, G., & Manolakis, D. (2002) · IEEE Signal Processing Magazine · doi:10.1109/79.974715 · Cited by 417
Kernel Methods for Remote Sensing Data Analysis
(2009) · Wiley eBooks · doi:10.1002/9780470748992 · Cited by 401
Learning to Label Aerial Images from Noisy Data
Mnih, V., & Hinton, G. E. (2012) · International Conference on Machine Learning · Cited by 399
Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation
Dai, D., & Yang, W. (2011) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2055033 · Cited by 362
Gradient-based learning applied to document recognition
LeCun, Y. (2024) · doi:10.57702/yobif9bg · Cited by 313
Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries
Li, S., Yin, H., & Fang, L. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2230332 · Cited by 299
Ngiam, J., Chen, Z., Bhaskar, S. A., Koh, P. W., & Ng, A. Y. (2011) · neural information processing systems · Cited by 297
Schaul, T., Zhang, S., & LeCun, Y. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.1106 · Cited by 266
Characterizing the sparseness of neural codes
Willmore, B. D. B., & Tolhurst, D. J. (2001) · Network Computation in Neural Systems · doi:10.1088/0954-898x/12/3/302 · Cited by 263
Semisupervised Image Classification With Laplacian Support Vector Machines
Gomez-Chova, L., Camps-Valls, G., Munoz-Mari, J., & Calpe, J. (2008) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2008.916070 · Cited by 257
Self-citationCharacterizing the sparseness of neural codes
Willmore, B., & Tolhurst, D. J. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.3.255.270 · Cited by 229
Sun, H., Sun, X., Wang, H., Li, Y., & Li, X. (2012) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2011.2161569 · Cited by 219
Stuffler, T., Kaufmann, C., Hofer, S., Förster, K. P., Schreier, G., Mueller, A., Eckardt, A., Bach, H., Penné, B., Benz, U., et al. (2007) · Acta Astronautica · doi:10.1016/j.actaastro.2007.01.033 · Cited by 200
Sparsity and Structure in Hyperspectral Imaging : Sensing, Reconstruction, and Target Detection
Willett, R. M., Duarte, M. F., Davenport, M. A., & Baraniuk, R. G. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2279507 · Cited by 200
A study of cloud classification with neural networks using spectral and textural features
Tian, B., Shaikh, M. A., Azimi-Sadjadi, M. R., Haar, T. H. V., & Reinke, D. L. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.737500 · Cited by 167
Improved Manifold Coordinate Representations of Large-Scale Hyperspectral Scenes
Bachmann, C. M., Ainsworth, T. L., & Fusina, R. A. (2006) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2006.881801 · Cited by 163
Ghosh, S., Bruzzone, L., Patra, S., Bovolo, F., & Ghosh, A. K. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2006.888861 · Cited by 151
Remote Sensing Image Processing
Camps‐Valls, G., Tuia, D., Gómez‐Chova, L., Jiménez, S., & Malo, J. (2012) · Synthesis lectures on image, video, and multimedia processing · doi:10.1007/978-3-031-02247-0 · Cited by 142
Self-citationIterative Gaussianization: From ICA to Random Rotations
Laparra, V., Camps‐Valls, G., & Malo, J. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2106511 · Cited by 125
Self-citationMean Map Kernel Methods for Semisupervised Cloud Classification
Gómez‐Chova, L., Camps‐Valls, G., Bruzzone, L., & Calpe‐Maravilla, J. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2026425 · Cited by 124
Self-citationBaraldi, A., & Parmiggiani, F. (1995) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.1995.8746011 · Cited by 114
Arenas‐García, J., Petersen, K. B., Camps‐Valls, G., & Hansen, L. K. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2250591 · Cited by 103
Self-citationWang, Z., Nasrabadi, N. M., & Huang, T. S. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2285049 · Cited by 89
Member, S., Petersen, K. B., Petersen, T., Camps-valls, G., Member, S., & Hansen, L. K. (2013) · Cited by 86
Self-citationBaraldi, A., & Parmiggiani, F. (1995) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.377930 · Cited by 84
FLEX: ESA's Earth Explorer 8 candidate mission
Kraft, S., Bello, U. D., Bouvet, M., Drusch, M., & Moreno, J. (2012) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2012.6352020 · Cited by 46
Meta-Parameter Free Unsupervised Sparse Feature Learning
Romero, A., Radeva, P. I., & Gatta, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366129 · Cited by 44
Self-citationWhited, D. C., Kimball, J. S., Lorang, M. S., & Stanford, J. A. (2011) · River Research and Applications · doi:10.1002/rra.1585 · Cited by 36
Arctic sea ice, cloud, water, and lead classification using neural networks and 1.6-μm data
McIntire, T. J., & Simpson, J. (2002) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2002.803728 · Cited by 36
Data-Driven Compressive Sampling and Learning Sparse Coding for Hyperspectral Image Classification
Yang, S., Jin, H., Wang, M., et al. (2013) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2013.2268847 · Cited by 33
An automatic cloud-masking system using backpro neural nets for AVHRR scenes
Arriaza, J. A. T., Guindos-Rojas, F., López, M. M. P., & Garbín, M. C. (2003) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2003.809930 · Cited by 24
Research works printed but not linked: 10
- 10.1109/LGRS.2013.2243402 · doi:10.1109/lgrs.2013.2243402
- vaduva, 0, Deep learning in very high resolution remote sensing image information mining communication concept, Proc IEEE 20th EUSIPCO, 2506
- 10.1109/IGARSS.2009.5416882 · doi:10.1109/igarss.2009.5416882
- 10.1109/TGRS.2007.905312 · DOI
- 10.1109/LGRS.2010.2062484 · doi:10.1109/lgrs.2010.2062484
- 10.1109/WHISPERS.2009.5288997 · doi:10.1109/whispers.2009.5288997
- hill, 2010, Merits and limits of ecosystem protection for conserving wild salmon in a northern coastal British Columbia river, Ecol Soc, 15, 1, 10.5751/ES-03541-150220 · DOI
- longbotham, 0, Prelaunch assessment of worldview-3 information content, Proc WHISPERS, 479
- 10.1016/j.rse.2011.07.021 · doi:10.1016/j.rse.2011.07.021
- bengio, 0, Greedy layerwise training of deep networks, Proc NIPS, 153
Cited by
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
Metadata
- Authors
- Romero, A., Gatta, C., & Camps-Valls, G.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2016-03
- Volume
- 54
- Issue
- 3
- Pages
- 1349-1362
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2179290474
- Cited by
- 729
- References
- 69
- FWCI
- 109.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.