The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Sentinel SAR-optical fusion for crop type mapping using deep learning and Google Earth Engine
Open accessAbstract
Abstract Accurate crop type mapping provides numerous benefits for a deeper understanding of food systems and yield prediction. Ever-increasing big data, easy access to high-resolution imagery, and cloud-based analytics platforms like Google Earth Engine have drastically improved the ability for scientists to advance data-driven agriculture with improved algorithms for crop type mapping using remote sensing, computer vision, and machine learning. Crop type mapping techniques mainly relied on standalone SAR and optical imagery, few studies investigated the potential of SAR-optical data fusion, coupled with virtual constellation, and 3-dimensional (3D) deep learning networks. To this extent, we use a deep learning approach that utilizes the denoised backscatter and texture information from multi-temporal Sentinel-1 SAR data and the spectral information from multi-temporal optical Sentinel-2 data for mapping ten different crop types, as well as water, soil and urban area. Multi-temporal Sentinel-1 data was fused with multi-temporal optical Sentinel-2 data in an effort to improve classification accuracies for crop types. We compared the results of the 3D U-Net to the state-of-the-art deep learning networks, including SegNet and 2D U-Net, as well as commonly used machine learning method such as Random Forest. The results showed (1) fusing multi-temporal SAR and optical data yields higher training overall accuracies (OA) (3D U-Net 0.992, 2D U-Net 0.943, SegNet 0.871) and testing OA (3D U-Net 0.941, 2D U-Net 0.847, SegNet 0.643) for crop type mapping compared to standalone multi-temporal SAR or optical data (2) optical data fused with denoised SAR data via a denoising convolution neural network (OA 0.912) performed better for crop type mapping compared to optical data fused with boxcar (OA 0.880), Lee (OA 0.881), and median (OA 0.887) filtered SAR data and (3) 3D convolutional neural networks perform better than 2D convolutional neural networks for crop type mapping (SAR OA 0.912, optical OA 0.937, fused OA 0.992).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Photogrammetric Engineering and Remote Sensing
Nicol, J., King, B., Quattrochi, D., Dowman, I. J., Ehlers, M., & Xiaoli, D. (2007) · UCL Discovery (University College London) · Cited by 9,325
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Ho, T. K. (2002) · Proceedings of 3rd International Conference on Document Analysis and Recognition · doi:10.1109/icdar.1995.598994 · Cited by 5,054
Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services
Drusch, M., Del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.11.026 · Cited by 4,815
2013 IEEE International Conference on Computer Vision
(2013) · doi:10.1109/iccv19984.2013 · Cited by 4,183
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Support vector machines in remote sensing: a review
Mountrakis, G., Im, J., & Ogole, C. (2011) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2010.11.001 · Cited by 3,473
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Torres, R., Snoeij, P., Geudtner, D., Bibby, D., Davidson, M., Attema, E., Potin, P., Rommen, B., Floury, N., Brown, M., et al. (2012) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.05.028 · Cited by 2,235
HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification
Roy, S. K., Krishna, G., Dubey, S. R., & Chaudhuri, B. B. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2918719 · Cited by 1,898
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data
Kussul, N., Lavreniuk, M., Skakun, S., & Shelestov, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2681128 · Cited by 1,786
Hybrid Task Cascade for Instance Segmentation
Chen, K., Pang, J., Wang, J., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Shi, J., Ouyang, W., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00511 · Cited by 1,587
Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
Li, Y., Zhang, H., & Shen, Q. (2017) · Remote Sensing · doi:10.3390/rs9010067 · Cited by 1,320
Investigation of the random forest framework for classification of hyperspectral data
Ham, J., Chen, Y., Crawford, M. M., & Ghosh, J. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.842481 · Cited by 1,276
Mask R-CNNPreprint
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv (Cornell University) · Cited by 1,252
The Cambridge Dictionary of Statistics
SRJ, & Everitt, B. S. (1999) · Journal of the American Statistical Association · doi:10.2307/2670205 · Cited by 940
Opportunities and limitations for image-based remote sensing in precision crop management
Moran, M. S., Inoue, Y., & Barnes, E. M. (1997) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00045-x · Cited by 921
Veloso, A., Mermoz, S., Bouvet, A., Le Toan, T., Planells, M., Dejoux, J.-F., & Ceschia, E. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.07.015 · Cited by 896
The Cambridge Dictionary of Statistics: Fourth Edition
Everitt, B. S., & Skrondal, A. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511779633 · Cited by 820
Khatami, R., Mountrakis, G., & Stehman, S. V. (2016) · Remote Sensing of Environment · doi:10.1016/j.rse.2016.02.028 · Cited by 599
Rubel, F., Brugger, K., Haslinger, K., & Auer, I. (2017) · Meteorologische Zeitschrift · doi:10.1127/metz/2016/0816 · Cited by 569
Satellite Based Mapping of Ground PM2.5 Concentration Using Generalized Additive Modeling
Zou, B., Chen, J., Zhai, L., Fang, X., & Zheng, Z. (2016) · Remote Sensing · doi:10.3390/rs9010001 · Cited by 450
Mahdianpari, M., Salehi, B., Rezaee, M., Mohammadimanesh, F., & Zhang, Y. (2018) · Remote Sensing · doi:10.3390/rs10071119 · Cited by 440
Sensitivity of Sentinel-1 Backscatter to Vegetation Dynamics: An Austrian Case Study
Vreugdenhil, M., Wagner, W., Bauer-Marschallinger, B., Pfeil, I., Teubner, I., Rüdiger, C., & Strauss, P. (2018) · Remote Sensing · doi:10.3390/rs10091396 · Cited by 410
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images
Ji, S., Zhang, C., Xu, A., Shi, Y., & Duan, Y. (2018) · Remote Sensing · doi:10.3390/rs10010075 · Cited by 395
Maimaitijiang, M., Ghulam, A., Sidike, P., Hartling, S., Maimaitiyiming, M., Peterson, K., Shavers, E., Fishman, J., Peterson, J., Kadam, S., et al. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.10.011 · Cited by 387
Self-citationMcNairn, H. E., Champagne, C. M., Shang, J., et al. (2008) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2008.07.006 · Cited by 368
Van Tricht, K., Gobin, A., Gilliams, S., & Piccard, I. (2018) · Remote Sensing · doi:10.3390/rs10101642 · Cited by 335
A comparison of global agricultural monitoring systems and current gaps
Fritz, S., See, L., Bayas, J. C. L., Waldner, F., Jacques, D., Becker-Reshef, I., Whitcraft, A., Baruth, B., Bonifacio, R., Crutchfield, J., et al. (2019) · Agricultural Systems · doi:10.1016/j.agsy.2018.05.010 · Cited by 319
Ndikumana, E., Ho Tong Minh, D., Baghdadi, N., Courault, D., & Hossard, L. (2018) · Remote Sensing · doi:10.3390/rs10081217 · Cited by 277
Crop type classification using a combination of optical and radar remote sensing data: a review
Orynbaikyzy, A., Gessner, U., & Conrad, C. (2019) · International Journal of Remote Sensing · doi:10.1080/01431161.2019.1569791 · Cited by 256
Amiri, N., Krzystek, P., Heurich, M., & Skidmore, A. (2019) · Remote Sensing · doi:10.3390/rs11222614 · Cited by 234
Medical image denoising using convolutional neural network: a residual learning approach
Jifara, W., Jiang, F., Rho, S., Cheng, M., & Liu, S. (2019) · The Journal of Supercomputing · doi:10.1007/s11227-017-2080-0 · Cited by 231
Dense U-net Based on Patch-Based Learning for Retinal Vessel Segmentation
Wang, C., Zhao, Z., Ren, Q., Xu, Y., & Yu, Y. (2019) · Entropy · doi:10.3390/e21020168 · Cited by 231
Satellite and In Situ Observations for Advancing Global Earth Surface Modelling: A Review
Balsamo, G., Agusti-Panareda, A., Albergel, C., Arduini, G., Beljaars, A., Bidlot, J., Blyth, E., Bousserez, N., Boussetta, S., Brown, A., et al. (2018) · Remote Sensing · doi:10.3390/rs10122038 · Cited by 222
Spatiotemporal Image Fusion in Remote Sensing
Belgiu, M., & Stein, A. (2019) · Remote Sensing · doi:10.3390/rs11070818 · Cited by 199
Forkuor, G., Conrad, C., Thiel, M., Ullmann, T., & Zoungrana, E. (2014) · Remote Sensing · doi:10.3390/rs6076472 · Cited by 183
Object Detection and Instance Segmentation in Remote Sensing Imagery Based on Precise Mask R-CNN
Su, H., Wei, S., Yan, M., Wang, C., Shi, J. T., & Zhang, X. (2019) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2019.8898573 · Cited by 170
Hu, H.-P., Wang, J.-K., & Xie, F.-L. (2018) · Entropy · doi:10.3390/e21010001 · Cited by 169
Multi-Temporal SAR Data Large-Scale Crop Mapping Based on U-Net Model
Wei, S., Zhang, H., Wang, C., Wang, Y., & Xu, L. (2019) · Remote Sensing · doi:10.3390/rs11010068 · Cited by 165
HQ-ISNet: High-Quality Instance Segmentation for Remote Sensing Imagery
Su, H., Wei, S., Liu, S., Liang, J., Wang, C., Shi, J., & Zhang, X. (2020) · Remote Sensing · doi:10.3390/rs12060989 · Cited by 146
Automated Individual Pig Localisation, Tracking and Behaviour Metric Extraction Using Deep Learning
Cowton, J., Kyriazakis, I., & Bacardit, J. (2019) · IEEE Access · doi:10.1109/access.2019.2933060 · Cited by 139
Hamwood, J., Alonso‐Caneiro, D., Read, S. A., Vincent, S. J., & Collins, M. J. (2018) · Biomedical Optics Express · doi:10.1364/boe.9.003049 · Cited by 129
Smallholder Crop Area Mapped with a Semantic Segmentation Deep Learning Method
Du, Z., Yang, J., Ou, C., & Zhang, T. (2019) · Remote Sensing · doi:10.3390/rs11070888 · Cited by 124
Waldhoff, G., Lussem, U., & Bareth, G. (2017) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2017.04.009 · Cited by 122
Buckley, C., & Carney, P. (2012) · Environmental Science & Policy · doi:10.1016/j.envsci.2012.10.002 · Cited by 116
Paheding, S., Sagan, V., Maimaitijiang, M., Maimaitiyiming, M., Shakoor, N., Burken, J. G., Mockler, T. C., & Fritschi, F. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.031 · Cited by 112
Self-citationBertoldi, G., Chiesa, S. D., Notarnicola, C., Pasolli, L., Niedrist, G., & Tappeiner, U. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.02.018 · Cited by 99
Xu, Z., Guan, K., Casler, N., Peng, B., & Wang, S. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.08.005 · Cited by 79
Evaluation of pooling operations in convolutional architectures for drug-drug interaction extraction
Suárez-Paniagua, V., & Segura-Bédmar, I. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2195-1 · Cited by 76
Stacked U-Nets for Ground Material Segmentation in Remote Sensing Imagery
Ghosh, A., Ehrlich, M., Shah, S., Davis, L. S., & Chellappa, R. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00047 · Cited by 75
Inverse-Category-Frequency Based Supervised Term Weighting Schemes for Text Categorization *
Wang, D., & Zhang, H. (2013) · doi:10.6688/jise.2013.29.2.2 · Cited by 66
Fusion of Moderate Resolution Earth Observations for Operational Crop Type Mapping
Torbick, N., Huang, X., Ziniti, B. L., Johnson, D. M., Masek, J., & Reba, M. L. (2018) · Remote Sensing · doi:10.3390/rs10071058 · Cited by 60
Robotic grasp detection based on image processing and random forest
Zhang, J., Li, M., Feng, Y., & Yang, C. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08302-9 · Cited by 47
Guo, Y., Jia, X., Paull, D. J., & Benediktsson, J. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.008 · Cited by 45
Parcel-Based Crop Classification Using Multi-Temporal TerraSAR-X Dual Polarimetric Data
Sonobe, R. (2019) · Remote Sensing · doi:10.3390/rs11101148 · Cited by 43
Gao, H., Wang, C., Wang, G., Zhu, J., Tang, Y., Shen, P., & Zhu, Z. (2018) · Sensors · doi:10.3390/s18093139 · Cited by 39
Li, J., Xi, B., Du, Q., Song, R., Li, Y., & Ren, G. (2018) · Remote Sensing · doi:10.3390/rs10122036 · Cited by 34
Instance Segmentation in Remote Sensing Imagery using Deep Convolutional Neural Networks
Potlapally, A., Chowdary, P. S. R., Shekhar, S. S. R., Mishra, N., Madhuri, C. S. V. D., & Prasad, A. V. V. (2019) · International Conference on Contemporary Computing and Informatics (IC3I) · doi:10.1109/ic3i46837.2019.9055569 · Cited by 28
A SAR-Based Index for Landscape Changes in African Savannas
Braun, A., & Hochschild, V. (2017) · Remote Sensing · doi:10.3390/rs9040359 · Cited by 22
Stratified Object-Oriented Image Classification Based on Remote Sensing Image Scene Division
Zhou, W. J., Ming, D., Xu, L. T., Bao, H., & Wang, M. (2018) · Journal of Spectroscopy · doi:10.1155/2018/3918954 · Cited by 18
Large-Scale Rice Mapping of Thailand using Sentinel-1 Multi-Temporal SAR Data
Wei, S., Zhang, H., Wang, C., et al. (2019) · SAR in Big Data Era (BIGSARDATA) · doi:10.1109/bigsardata.2019.8858438 · Cited by 10
3D CNN with Localized Residual Connections for Hyperspectral Image Classification
Dwivedi, S., Mandal, M., Yadav, S., & Vipparthi, S. K. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-4018-9_32 · Cited by 6
Cited by
Challenges and opportunities in remote sensing-based crop monitoring: a review
Wu, B., Zhang, M., Zeng, H., Tian, F., Potgieter, A. B., Qin, X., Yan, N., Chang, S., Zhao, Y., Dong, Q., et al. (2023) · National Science Review · doi:10.1093/nsr/nwac290 · Cited by 333
Deep learning techniques to classify agricultural crops through UAV imagery: a review
Bouguettaya, A., Zarzour, H., Kechida, A., & Taberkit, A. M. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07104-9 · Cited by 314
Chen, Y., Cao, R., Chen, J., Liu, L., & Matsushita, B. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.08.015 · Cited by 303
A Review of Deep Learning in Multiscale Agricultural Sensing
Wang, D., Cao, W., Zhang, F., Li, Z., Xu, S., & Wu, X. (2022) · Remote Sensing · doi:10.3390/rs14030559 · Cited by 275
Google Earth Engine and Artificial Intelligence (AI): A Comprehensive Review
Yang, L., Driscol, J., Sarigai, S., Wu, Q., Chen, H., & Lippitt, C. D. (2022) · Remote Sensing · doi:10.3390/rs14143253 · Cited by 264
Metadata
- Authors
- Adrian, J., Sagan, V., & Maimaitijiang, M.
- Venue
- ISPRS Journal of Photogrammetry and Remote Sensing
- Publisher
- Elsevier BV
- Published
- 2021-05
- Volume
- 175
- Pages
- 215-235
- ISSN
- 0924-2716 (ISSN-L)
- OpenAlex
- W3138000966
- Cited by
- 263
- References
- 76
- FWCI
- 20.56
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.