The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis
Open accessAbstract
Remote-sensing image scene classification can provide significant value, ranging from forest fire monitoring to land-use and land-cover classification. Beginning with the first aerial photographs of the early 20th century to the satellite imagery of today, the amount of remote-sensing data has increased geometrically with a higher resolution. The need to analyze these modern digital data motivated research to accelerate remote-sensing image classification. Fortunately, great advances have been made by the computer vision community to classify natural images or photographs taken with an ordinary camera. Natural image datasets can range up to millions of samples and are, therefore, amenable to deep-learning techniques. Many fields of science, remote sensing included, were able to exploit the success of natural image classification by convolutional neural network models using a technique commonly called transfer learning. We provide a systematic review of transfer learning application for scene classification using different datasets and different deep-learning models. We evaluate how the specialization of convolutional neural network models affects the transfer learning process by splitting original models in different points. As expected, we find the choice of hyperparameters used to train the model has a significant influence on the final performance of the models. Curiously, we find transfer learning from models trained on larger, more generic natural images datasets outperformed transfer learning from models trained directly on smaller remotely sensed datasets. Nonetheless, results show that transfer learning provides a powerful tool for remote-sensing scene classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
(2010) · Cited by 14,134
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
(2010) · Cited by 8,261
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 6,249
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277 · cited 1×
“Using medical image data, Tajbakhsh et al. [66] found that fine ‐ tuning achieved results comparable to or better than results from training a CNN model with randomly initialized weights.”
ResultBag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926
AID: A benchmark data set for performance evaluation of aerial scene classification
Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., & Lu, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2685945 · Cited by 2,372
Deep Learning of Representations for Unsupervised and Transfer Learning.
Bengio, Y. (2011) · Cited by 1,670
Hu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,195
Remote sensing techniques to assess active fire characteristics and post-fire effects
Lentile, L. B., Holden, Z. A., Smith, A. M. S., Falkowski, M. J., Hudak, A. T., Morgan, P., Lewis, S. A., Gessler, P. E., & Benson, N. C. (2006) · International Journal of Wildland Fire · doi:10.1071/wf05097 · Cited by 969
Olah, C., Mordvintsev, A., & Schubert, L. (2017) · Distill · doi:10.23915/distill.00007 · Cited by 880
The Building Blocks of Interpretability
Olah, C., Satyanarayan, A., Johnson, I., Carter, S., Schubert, L., Ye, K., & Mordvintsev, A. (2018) · Distill · doi:10.23915/distill.00010 · Cited by 591
Hyperspectral Image Classification With Deep Learning Models
Yang, X., Ye, Y., Li, X., Lau, R. Y. K., Zhang, X., & Huang, X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2815613 · Cited by 576
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571 · cited 4×
“Described by Zhou et al. [2], PatternNet is a large ‐ scale high ‐ resolution remote ‐ sensing dataset.”
BackgroundMethodInfluentialThe Marginal Value of Adaptive Gradient Methods in Machine Learning
Wilson, A., Roelofs, R., Stern, M., Srebro, N., & Recht, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08292 · Cited by 522
Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks
Weinstein, B. G., Marconi, S., Bohlman, S., Zare, A., & White, E. (2019) · Remote Sensing · doi:10.3390/rs11111309 · Cited by 382
Going deeper in the automated identification of Herbarium specimens
Carranza-Rojas, J., Goeau, H., Bonnet, P., Mata-Montero, E., & Joly, A. (2017) · BMC Evolutionary Biology · doi:10.1186/s12862-017-1014-z · Cited by 247
Deep Transfer Learning for Few-Shot SAR Image Classification
Rostami, M., Kolouri, S., Eaton, E., & Kim, K. (2019) · Remote Sensing · doi:10.3390/rs11111374 · Cited by 247
Learning Many Related Tasks at the Same Time with Backpropagation
Caruana, R. (1994) · Cited by 242
End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images
Chen, Z., Zhang, T., & Ouyang, C. (2018) · Remote Sensing · doi:10.3390/rs10010139 · Cited by 190
Scott, G. J., Klaric, M. N., Davis, C. H., & Shyu, C. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2088404 · Cited by 102
Xu, R., Tao, Y., Lu, Z., & Zhong, Y. (2018) · Remote Sensing · doi:10.3390/rs10101602 · Cited by 79
Daldegan, G. A., Roberts, D. A., & Ribeiro, F. D. F. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111340 · Cited by 70
Convolutional neural networks as aid in core lithofacies classification
de Lima, R. P., Suriamin, F., Marfurt, K. J., & Pranter, M. J. (2019) · Interpretation · doi:10.1190/int-2018-0245.1 · Cited by 68
Self-citationImproved color texture descriptors for remote sensing image retrieval
Shao, Z., Zhou, W., Zhang, L., & Hou, J. (2014) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.8.083584 · Cited by 55
Retrieval of Remote Sensing Images with Pattern Spectra Descriptors
Bosilj, P., Aptoula, E., Lefèvre, S., & Ewa Kijak, C. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5120228 · Cited by 53
Fine-tuning and visualization of convolutional neural networks
Yin, X., Chen, W., Wu, X., et al. (2017) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea.2017.8283041 · Cited by 48
Wang, J., Shen, L., Qiao, W., Dai, Y., & Li, Z. (2019) · Remote Sensing · doi:10.3390/rs11131617 · Cited by 33
Dual-tree complex wavelet transform applied on color descriptors for remote-sensed images retrieval
Sebai, H., Kourgli, A., & Serir, A. (2015) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.9.095994 · Cited by 17
Progress and Challenges in Deep Learning Analysis of Geoscience Images
de Lima, R. P., Marfurt, K. J., Duarte, D., & Bonar, A. (2019) · EAGE Annual Conference & Exhibition · doi:10.3997/2214-4609.201901607 · Cited by 16
Self-citationJump-starting neural network training for seismic problems
Huot, F., Biondi, B., & Beroza, G. C. (2018) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/segam2018-2998567.1 · Cited by 15
Duarte-Coronado, D., Tellez, J., de Lima, R. P., Marfurt, K. J., & Slatt, R. M. (2019) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/segam2019-3216898.1 · Cited by 7
Self-citationde Lima, R. P., Lin, Y., & Marfurt, K. J. (2019) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/segam2019-3215401.1 · Cited by 6
Self-citation
Cited by
Review on Convolutional Neural Networks (CNN) in vegetation remote sensing
Kattenborn, T., Leitloff, J., Schiefer, F., & Hinz, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.12.010 · Cited by 1,805
A comparison between VGG16, VGG19 and ResNet50 architecture frameworks for Image Classification
Mascarenhas, S., & Agarwal, M. (2021) · 2021 International Conference on Disruptive Technologies for Multi-Disciplinary Research and Applications (CENTCON) · doi:10.1109/centcon52345.2021.9687944 · Cited by 542
Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future Prospects
Ahmad, M., Shabbir, S., Roy, S. K., Hong, D., Wu, X., Yao, J., Khan, A. M., Mazzara, M., Distefano, S., & Chanussot, J. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3133021 · Cited by 438
Transfer learning in environmental remote sensing
Ma, Y., Chen, S., Ermon, S., & Lobell, D. B. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113924 · Cited by 425
Amini, S., Saber, M., Rabiei-Dastjerdi, H., & Homayouni, S. (2022) · Remote Sensing · doi:10.3390/rs14112654 · Cited by 338
Metadata
- Authors
- Pires de Lima, R., & Marfurt, K.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2019-12-25
- Volume
- 12
- Issue
- 1
- Pages
- 86
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W2996836954
- Cited by
- 276
- References
- 49
- FWCI
- 22.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.