The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Deep learning based multi-temporal crop classification
Abstract
This study aims to develop a deep learning based classification framework for remotely sensed time series. The experiment was carried out in Yolo County, California, which has a very diverse irrigated agricultural system dominated by economic crops. For the challenging task of classifying summer crops using Landsat Enhanced Vegetation Index (EVI) time series, two types of deep learning models were designed: one is based on Long Short-Term Memory (LSTM), and the other is based on one-dimensional convolutional (Conv1D) layers. Three widely-used classifiers were also tested for comparison, including a gradient boosting machine called XGBoost, Random Forest, and Support Vector Machine. Although LSTM is widely used for sequential data representation, in this study its accuracy (82.41%) and F1 score (0.67) were the lowest among all the classifiers. Among non-deep-learning classifiers, XGBoost achieved the best result with 84.17% accuracy and an F1 score of 0.69. The highest accuracy (85.54%) and F1 score (0.73) were achieved by the Conv1D-based model, which mainly consists of a stack of Conv1D layers and an inception module. The behavior of the Conv1D-based model was inspected by visualizing the activation on different layers. The model employs EVI time series by examining shapes at various scales in a hierarchical manner. Lower Conv1D layers of the optimized model capture small scale temporal variations, while upper layers focus on overall seasonal patterns. Conv1D layers were used as an embedded multi-level feature extractor in the classification model which automatically extracts features from input time series during training. The automated feature extraction reduces the dependency on manual feature engineering and pre-defined equations of crop growing cycles. This study shows that the Conv1D-based deep learning framework provides an effective and efficient method of time series representation in multi-temporal classification tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Overview of the radiometric and biophysical performance of the MODIS vegetation indices
Huete, A., Didan, K., Miura, T., Rodriguez, E. P., Gao, X., & Ferreira, L. G. (2002) · Remote Sensing of Environment · doi:10.1016/s0034-4257(02)00096-2 · Cited by 9,869
(2012) · Cited by 8,009
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1603.02754 · Cited by 7,104
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
The Handbook of brain theory and neural networks
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4484 · Cited by 3,870
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Monitoring vegetation phenology using MODIS
Zhang, X., Friedl, M. A., Schaaf, C. B., Strahler, A. H., Hodges, J. C. F., Gao, F., Reed, B. C., & Huete, A. (2003) · Remote Sensing of Environment · doi:10.1016/s0034-4257(02)00135-9 · Cited by 2,567
Chen, J., Jönsson, P., Tamura, M., Gu, Z., Matsushita, B., & Eklundh, L. (2004) · Remote Sensing of Environment · doi:10.1016/j.rse.2004.03.014 · Cited by 2,351
Deep Convolutional Neural Networks for Hyperspectral Image Classification
Hu, W., Huang, Y., Wei, L., Zhang, F., & Li, H. (2015) · Journal of Sensors · doi:10.1155/2015/258619 · Cited by 1,941
TIMESAT—a program for analyzing time-series of satellite sensor data
Jönsson, P., & Eklundh, L. (2004) · Computers & Geosciences · doi:10.1016/j.cageo.2004.05.006 · Cited by 1,878
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,786
Graph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Measuring phenological variability from satellite imagery
Reed, B. C., Brown, J. F., VanderZee, D., Loveland, T. R., Merchant, J. W., & Ohlen, D. O. (1994) · Journal of Vegetation Science · doi:10.2307/3235884 · Cited by 1,473
Support vector machines for histogram-based image classification
Chapelle, O., Haffner, P., & Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788646 · Cited by 1,468
Remote sensing imagery in vegetation mapping: a review
Xie, Y., Sha, Z., & Yu, M. (2008) · Journal of Plant Ecology · doi:10.1093/jpe/rtm005 · Cited by 1,395
Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
Li, Y., Zhang, H., & Shen, Q. (2017) · Remote Sensing · doi:10.3390/rs9010067 · Cited by 1,320
Recurrent neural networks and robust time series prediction
Connor, J. T., Martin, R. D., & Atlas, L. E. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279188 · Cited by 1,316
Zhao, W., & Du, S. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543748 · Cited by 1,212
Hu, F., Xia, G.-S., Hu, J., & Zhang, L. (2015) · Remote Sensing · doi:10.3390/rs71114680 · Cited by 1,195
Mapping paddy rice agriculture in southern China using multi-temporal MODIS images
Xiao, X., Boles, S., Liu, J., Zhuang, D., Frolking, S., Li, C., Salas, W., & Moore, B. (2005) · Remote Sensing of Environment · doi:10.1016/j.rse.2004.12.009 · Cited by 1,062
Deep learning based feature selection for remote sensing scene classification
Zou, Q., Ni, L., Zhang, T., & Wang, Q. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2475299 · Cited by 956
A crop phenology detection method using time-series MODIS data
Sakamoto, T., Yokozawa, M., Toritani, H., Shibayama, M., Ishitsuka, N., & OHNO, H. (2005) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.03.008 · Cited by 929
Mapping paddy rice agriculture in South and Southeast Asia using multi-temporal MODIS images
Xiao, X., Boles, S., Frolking, S., Li, C., Babu, J. Y., Salas, W., & Moore, B. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.10.004 · Cited by 777
Wardlow, B. D., & Egbert, S. L. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.07.019 · Cited by 768
The epistemology of a rule-based expert system —a framework for explanation
Clancey, W. J. (1983) · Artificial Intelligence · doi:10.1016/0004-3702(83)90008-5 · Cited by 712
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?
Penatti, O. A. B., Nogueira, K., & dos Santos, J. A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301382 · Cited by 705
Lawrence, R. L., Wood, S. D., & Sheley, R. L. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.10.014 · Cited by 701
Classification with an edge: Improving semantic image segmentation with boundary detection
Marmanis, D., Schindler, K., Wegner, J. D., Galliani, S., Datcu, M., & Stilla, U. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.009 · Cited by 670
Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks
Audebert, N., Le Saux, B., & Lefèvre, S. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.011 · Cited by 655
Reconstructing cloudfree NDVI composites using Fourier analysis of time series
Roerink, G. J., Menenti, M., & Verhoef, W. (2000) · International Journal of Remote Sensing · doi:10.1080/014311600209814 · Cited by 644
Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks
Chen, X., Xiang, S., Liu, C.-L., & Pan, C.-H. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2309695 · Cited by 622
Green leaf phenology at Landsat resolution: Scaling from the field to the satellite
FISHER, J., MUSTARD, J., & VADEBONCOEUR, M. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.10.022 · Cited by 547
Spectral–spatial classification of hyperspectral images using deep convolutional neural networks
Yue, J., Zhao, W., Mao, S., & Liu, H. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1047045 · Cited by 525
Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks
Volpi, M., & Tuia, D. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2616585 · Cited by 436
Deep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images
Li, W., Fu, H., Yu, L., & Cracknell, A. (2016) · Remote Sensing · doi:10.3390/rs9010022 · Cited by 427
A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery
Rogan, J., Franklin, J., & Roberts, D. A. (2002) · Remote Sensing of Environment · doi:10.1016/s0034-4257(01)00296-6 · Cited by 402
Galford, G. L., Mustard, J. F., Melillo, J., Gendrin, A., Cerri, C. C., & Cerri, C. E. P. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.05.017 · Cited by 396
Dong, J., Xiao, X., Kou, W., Qin, Y., Zhang, G., Li, L., Jin, C., Zhou, Y., Wang, J., Biradar, C., et al. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.01.004 · Cited by 391
LLOYD, D. (1990) · International Journal of Remote Sensing · doi:10.1080/01431169008955174 · Cited by 388
Zhong, L., Gong, P., & Biging, G. S. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.08.023 · Cited by 372
Self-citationA Two-Step Filtering approach for detecting maize and soybean phenology with time-series MODIS data
Sakamoto, T., Wardlow, B. D., Gitelson, A. A., Verma, S. B., Suyker, A. E., & Arkebauer, T. J. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.04.019 · Cited by 340
Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
Lyu, H., Lu, H., & Mou, L. (2016) · Remote Sensing · doi:10.3390/rs8060506 · Cited by 334
Friedl, M. A., Brodley, C. E., & Strahler, A. H. (1999) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.752215 · Cited by 311
Cross-scalar satellite phenology from ground, Landsat, and MODIS data
Fisher, J. I., & Mustard, J. F. (2007) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.01.004 · Cited by 309
Zhang, G., Xiao, X., Dong, J., Kou, W., Jin, C., Qin, Y., Zhou, Y., Wang, J., Menarguez, M. A., & Biradar, C. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.05.011 · Cited by 303
Mou, L., Ghamisi, P., & Zhu, X. X. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2748160 · Cited by 294
Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders
Rußwurm, M., & Körner, M. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7040129 · Cited by 286
Marcos, D., Volpi, M., Kellenberger, B., & Tuia, D. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.021 · Cited by 282
Kandasamy, S., Baret, F., Verger, A., Neveux, P., & Weiss, M. (2013) · Biogeosciences · doi:10.5194/bg-10-4055-2013 · Cited by 263
Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders
Rußwurm, M. (2018) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 261
MODIS-based corn grain yield estimation model incorporating crop phenology information
Sakamoto, T., Gitelson, A. A., & Arkebauer, T. J. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2012.12.017 · Cited by 254
Phenologically-tuned MODIS NDVI-based production anomaly estimates for Zimbabwe
Funk, C. C., & Budde, M. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2008.08.015 · Cited by 252
Shao, Y., Lunetta, R. S., Wheeler, B., Iiames, J. S., & Campbell, J. B. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.12.023 · Cited by 237
Automated mapping of soybean and corn using phenology
Zhong, L., Hu, L., Yu, L., Gong, P., & Biging, G. S. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.05.014 · Cited by 228
Self-citationRuBwurm, M., & Korner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.193 · Cited by 225
Monitoring Maize (Zea mays L.) Phenology with Remote Sensing
Viña, A., Gitelson, A. A., Rundquist, D. C., Keydan, G., Leavitt, B., & Schepers, J. (2004) · Agronomy Journal · doi:10.2134/agronj2004.1139 · Cited by 222
High-Resolution Aerial Image Labeling With Convolutional Neural Networks
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2740362 · Cited by 187
Carrão, H., Gonçalves, P., & Caetano, M. (2008) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.07.002 · Cited by 184
Pattern Recognition and Neural Networks
Theodoridis, S., & Koutroumbas, K. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44673-7_8 · Cited by 174
Li, W., Fu, H., Yu, L., Gong, P., Feng, D., Li, C., & Clinton, N. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1246775 · Cited by 174
The response of African land surface phenology to large scale climate oscillations
Brown, M. E., de Beurs, K. M., & Vrieling, A. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.05.005 · Cited by 165
Do we need hundreds of classifiers to solve real world classification problems?
Fernández-Delgado, M., García, E. C., Ameneiro, S. B., & Amorim, D. G. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 157
Walker, J. J., de Beurs, K. M., & Wynne, R. H. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.01.007 · Cited by 156
Siachalou, S., Mallinis, G., & Tsakiri–Strati, M. (2015) · Remote Sensing · doi:10.3390/rs70403633 · Cited by 150
Near real-time prediction of U.S. corn yields based on time-series MODIS data
Sakamoto, T., Gitelson, A. A., & Arkebauer, T. J. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.03.008 · Cited by 144
Comparison of phenology trends by land cover class: a case study in the Great Basin, USA
Bradley, B. A., & Mustard, J. F. (2007) · Global Change Biology · doi:10.1111/j.1365-2486.2007.01479.x · Cited by 121
Guidici, D., & Clark, M. L. (2017) · Remote Sensing · doi:10.3390/rs9060629 · Cited by 115
Na, X., Zhang, S., Li, X., Yu, H., & Liu, C. (2010) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.76.7.833 · Cited by 105
Xin, Q., Broich, M., Zhu, P., & Gong, P. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.02.003 · Cited by 97
Land surface phenology along urban to rural gradients in the U.S. Great Plains
Walker, J. J., de Beurs, K. M., & Henebry, G. M. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.04.019 · Cited by 83
Circumpolar vegetation dynamics product for global change study
Gonsamo, A., & Chen, J. M. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.04.022 · Cited by 71
Lyu, H., Lu, H., Mou, L., Li, W., Wright, J., Li, X., Li, X., Zhu, X., Wang, J., Yu, L., et al. (2018) · Remote Sensing · doi:10.3390/rs10030471 · Cited by 70
Crop Phenology Estimation Using a Multitemporal Model and a Kalman Filtering Strategy
Vicente-Guijalba, F., Martinez-Marín, T., & Lopez-Sanchez, J. M. (2013) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2013.2286214 · Cited by 68
Incremental Dual-memory LSTM in Land Cover Prediction
Jia, X., Khandelwal, A., Nayak, G., Gerber, J., Carlson, K. M., West, P. C., & Kumar, V. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098112 · Cited by 64
Rapid corn and soybean mapping in US Corn Belt and neighboring areas
Zhong, L., Yu, L., Li, X., Hu, L., & Gong, P. (2016) · Scientific Reports · doi:10.1038/srep36240 · Cited by 61
Self-citationDannenberg, M. P., Song, C., Hwang, T., & Wise, E. K. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2014.11.026 · Cited by 55
Wan, X., Zhao, C., Wang, Y., & Liu, W. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.08.021 · Cited by 40
(2014) · doi:10.5555/2627435.2697065
Cited by
Review on Convolutional Neural Networks (CNN) in vegetation remote sensing
Kattenborn, T., Leitloff, J., Schiefer, F., & Hinz, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.12.010 · Cited by 1,805
Machine Learning in Agriculture: A Comprehensive Updated Review
Benos, L., Tagarakis, A. C., Dolias, G., Berruto, R., Kateris, D., & Bochtis, D. (2021) · Sensors · doi:10.3390/s21113758 · Cited by 900
Identification of plant leaf diseases using a nine-layer deep convolutional neural network
G., G., & J., A. P. (2019) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2019.04.011 · Cited by 867
Abdi, A. M. (2020) · GIScience & Remote Sensing · doi:10.1080/15481603.2019.1650447 · Cited by 633
Automation and digitization of agriculture using artificial intelligence and internet of things
Subeesh, A., & Mehta, C. R. (2021) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2021.11.004 · Cited by 410
Metadata
- Authors
- Zhong, L., Hu, L., & Zhou, H.
- Venue
- Remote Sensing of Environment
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 221
- Pages
- 430-443
- ISSN
- 0034-4257 (ISSN-L)
- OpenAlex
- W2903282641
- Cited by
- 1,024
- References
- 91
- FWCI
- 51.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.