The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Towards better exploiting convolutional neural networks for remote sensing scene classification
Open accessAbstract
We present an analysis of three possible strategies for exploiting the power of existing convolutional neural networks (ConvNets or CNNs) in different scenarios from the ones they were trained: full training, fine tuning, and using ConvNets as feature extractors. In many applications, especially including remote sensing, it is not feasible to fully design and train a new ConvNet, as this usually requires a considerable amount of labeled data and demands high computational costs. Therefore, it is important to understand how to better use existing ConvNets. We perform experiments with six popular ConvNets using three remote sensing datasets. We also compare ConvNets in each strategy with existing descriptors and with state-of-the-art baselines. Results point that fine tuning tends to be the best performing strategy. In fact, using the features from the fine-tuned ConvNet with linear SVM obtains the best results. We also achieved state-of-the-art results for the three datasets used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 9×
“GoogLeNet, presented in [30], is the ConvNet architecture that won the ILSVRC-2014 competition (classification and detection tracks) while VGG ConvNets, presented in [29], won the localization and classification tracks of the same competition.”
BackgroundMethodInfluentialDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · International Conference on Machine Learning · Cited by 13,995
(2016) · Cited by 11,679
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 2×
“Bag of visual words (BoVW) and their variations [5, 6, 8, 61, 62, 63, 9] are considered mid-level representations, since these methods create a codebook of visual discriminating patches (visual words), and then, compute statistics (using the codebook) about the visual word occurrences in the test image.”
BackgroundMethodModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Swain, M. J., & Ballard, D. H. (1991) · International Journal of Computer Vision · doi:10.1007/bf00130487 · Cited by 5,623
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Bag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Vlfeat: an open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874249 · Cited by 2,664
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588 · cited 2×
“Bag of visual words ( BoVW ) and their variations [5, 6, 8, 61, 62, 63, 9] are considered mid-level representations, since these methods create a codebook of visual discriminating patches (visual words), and then, compute statistics (using the codebook) about the visual word occurrences in the test…”
BackgroundMethod(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Evaluating Color Descriptors for Object and Scene Recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.154 · Cited by 1,783
Image indexing using color correlograms
Huang, J., Kumar, S. R., Mitra, M., Zhu, W.-J., & Zabih, R. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609412 · Cited by 1,646
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Hu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,195
Neural Codes for Image Retrieval
Babenko, A., Slesarev, A., Chigorin, A., & Lempitsky, V. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_38 · Cited by 1,192
Exploring Strategies for Training Deep Neural Networks
Larochelle, H., Bengio, Y., Louradour, J., & Lamblin, P. (2009) · doi:10.1145/1577069.1577070 · Cited by 1,095
Learning mid-level features for recognition
Boureau, Y.-L., Bach, F., LeCun, Y., & Ponce, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539963 · Cited by 1,052
Deep supervised learning for hyperspectral data classification through convolutional neural networks
Makantasis, K., Karantzalos, K., Doulamis, A., & Doulamis, N. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7326945 · Cited by 1,011
Handbook of Pattern Recognition and Computer Vision
Chen, C. H., & Wang, P. S. P. (2005) · WORLD SCIENTIFIC eBooks · doi:10.1142/5711 · Cited by 968
van Gemert, J. C., Veenman, C. J., Smeulders, A. W. M., & Geusebroek, J.-M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.132 · Cited by 737
Review of oil spill remote sensing
Fingas, M., & Brown, C. (2014) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2014.03.059 · Cited by 723
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 705
Self-citationA Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification
Tuia, D., Volpi, M., Copa, L., Kanevski, M., & Munoz-Mari, J. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2139193 · Cited by 558
Saliency-Guided Unsupervised Feature Learning for Scene Classification
Zhang, F., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2357078 · Cited by 542
Spectral–spatial classification of hyperspectral images using deep convolutional neural networks
Yue, J., Zhao, W., Mao, S., & Liu, H. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1047045 · Cited by 525
A Detailed Review of Feature Extraction in Image Processing Systems
Kumar, G., & Bhatia, P. K. (2014) · 2014 Fourth International Conference on Advanced Computing & Communication Technologies · doi:10.1109/acct.2014.74 · Cited by 489
Transfer Learning from Deep Features for Remote Sensing and Poverty Mapping
Xie, M., Jean, N., Burke, M., Lobell, D., & Ermon, S. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9906 · Cited by 455
Unsupervised Feature Learning for Aerial Scene Classification
Cheriyadat, A. M. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2241444 · Cited by 421
Evaluation of GIST descriptors for web-scale image search
Douze, M., Jégou, H., Sandhawalia, H., Amsaleg, L., & Schmid, C. (2009) · Proceedings of the ACM International Conference on Image and Video Retrieval · doi:10.1145/1646396.1646421 · Cited by 394
Geographic Image Retrieval Using Local Invariant Features
Yang, Y., & Newsam, S. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2205158 · Cited by 351
A compact and efficient image retrieval approach based on border/interior pixel classification
Stehling, R. O., Nascimento, M. A., & Falcão, A. X. (2002) · Proceedings of the eleventh international conference on Information and knowledge management · doi:10.1145/584792.584812 · Cited by 302
Tayyebi, A., Tayyebi, A., Pijanowski, B. C., et al. (2010) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2010.10.007 · Cited by 275
STRUCTURAL HIGH-RESOLUTION SATELLITE IMAGE INDEXING
Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Xia, G.-S., Yang, W. T., Gousseau, Y., Sun, H., High, E. A. S., et al. (2010) · Cited by 256
Pooling in image representation: The visual codeword point of view
Avila, S., Thome, N., Cord, M., Valle, E., & de A. Araújo, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.09.007 · Cited by 224
Comparative study of global color and texture descriptors for web image retrieval
Penatti, O. A. B., Valle, E., & Torres, R. D. S. (2012) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.11.002 · Cited by 192
Self-citationDeep learning-based tree classification using mobile LiDAR data
Guan, H., Yu, Y., Ji, Z., Li, J., & Zhang, Q. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1088668 · Cited by 183
Bag-of-Words Representation in Image Annotation: A Review
Tsai, C.-F. (2012) · ISRN Artificial Intelligence · doi:10.5402/2012/376804 · Cited by 180
Comparing SIFT descriptors and gabor texture features for classification of remote sensed imagery
Yang, Y., & Newsam, S. (2008) · 2008 15th IEEE International Conference on Image Processing · doi:10.1109/icip.2008.4712139 · Cited by 166
Empowering Visual Categorization With the GPU
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2091400 · Cited by 103
dos Santos, J. A., Penatti, O. A. B., & Torres, R. D. S. (2010) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0002843402030208 · Cited by 95
Self-citationVisual word spatial arrangement for image retrieval and classification
Penatti, O. A. B., Silva, F. B., Junior, E. A. D. V., Gouet-Brunet, V., & Torres, R. D. S. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.08.012 · Cited by 84
Self-citationFashion apparel detection: The role of deep convolutional neural network and pose-dependent priors
Hara, K., Jagadeesh, V., & Piramuthu, R. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477611 · Cited by 56
Improving Spatial Feature Representation from Aerial Scenes by Using Convolutional Networks
Nogueira, K., Miranda, W. O., & Santos, J. A. D. (2015) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2015.39 · Cited by 51
Self-citationGabor-Filtering-Based Completed Local Binary Patterns for Land-Use Scene Classification
Chen, C., Zhou, L., Guo, J., et al. (2015) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm.2015.23 · Cited by 47
Fine-grained plant classification using convolutional neural networks for feature extraction
Suenderhauf, N., McCool, C., Upcroft, B., & Pérez, T. (2014) · QUT ePrints (Queensland University of Technology) · Cited by 47
Fine-grained bird species recognition via hierarchical subset learning
Ge, Z., McCool, C., Sanderson, C., et al. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7350861 · Cited by 27
Representation Learning for Contextual Object and Region Detection in Remote Sensing
Fırat, O., Can, G., & Vural, F. T. Y. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.637 · Cited by 26
Comparison of local descriptors for automatic remote sensing image registration
Bouchiha, R., & Besbes, K. (2013) · Signal Image and Video Processing · doi:10.1007/s11760-013-0460-3 · Cited by 25
Rank Aggregation for Pattern Classifier Selection in Remote Sensing Images
Faria, F. A., Pedronette, D. C. G., dos Santos, J. A., Rocha, A. D. R., & Torres, R. D. S. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2303813 · Cited by 17
Bag-of-Visual-Words, its Detectors and Descriptors; A Survey in Detail
Faraji, M., & Shanbehzadeh, J. (2015) · Cited by 2
Cited by
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification
Helber, P., Bischke, B., Dengel, A., & Borth, D. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2918242 · Cited by 1,951
“As shown in previous work [6], [15], [17], [19], deep CNNs have been shown to outperform non-deep learning approaches in land use and land cover image classification.”
BackgroundMethodResultInfluentialGoogle Earth Engine for geo-big data applications: A meta-analysis and systematic review
Tamiminia, H., Salehi, B., Mahdianpari, M., Quackenbush, L., Adeli, S., & Brisco, B. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.04.001 · Cited by 1,363
Cheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
Metadata
- Authors
- Nogueira, K., Penatti, O. A. B., & dos Santos, J. A.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2017-01
- Volume
- 61
- Pages
- 539-556
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W2253590344
- Cited by
- 902
- References
- 68
- FWCI
- 115.63
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.