weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Selective weed treatment is a critical step in autonomous crop management as related to crop health and yield. However, a key challenge is reliable and accurate weed detection to minimize damage to surrounding plants. In this letter, we present an approach for dense semantic weed classification with multispectral images collected by a micro aerial vehicle (MAV). We use the recently developed encoder-decoder cascaded convolutional neural network, SegNet, that infers dense semantic classes while allowing any number of input image channels and class balancing with our sugar beet and weed datasets. To obtain training datasets, we established an experimental field with varying herbicide levels resulting in field plots containing only either crop or weed, enabling us to use the normalized difference vegetation index as a distinguishable feature for automatic ground truth generation. We train six models with different numbers of input channels and condition (fine tune) it to achieve ~0.8 F1-score and 0.78 area under the curve classification metrics. For the model deployment, an embedded Graphics Processing Unit (GPU) system (Jetson TX2) is tested for MAV integration. Dataset used in this letter is released to support the community and future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×
“appearance and spectra (660–790 nm) for the pre-trained model based on RGB ImageNet dataset [40].”
MethodRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 1×
“, [31] and [32]) or indoor scenes [33] that can easily be understood and”
BackgroundCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 6
- liebisch, 2017, Automatic UAV-based field inspection campaigns for weeding in row crops, Proc 6th EARSeL SIG Imaging Spectrosc Workshop
- 10.1109/ICRA.2017.7989768 · DOI
- popovic, 2017, Multiresolution mapping and informative path planning for UAV-based terrain monitoring, Proc IEEE/RSJ Int Conf Intell Robots Syst
- 10.1016/j.compag.2013.05.004 · doi:10.1016/j.compag.2013.05.004
- 10.1109/LRA.2017.2651952 · DOI
- 10.1002/rob.21508 · doi:10.1002/rob.21508
Cited by
Internet-of-Things (IoT)-Based Smart Agriculture: Toward Making the Fields Talk
Ayaz, M., Ammad-Uddin, M., Sharif, Z., Mansour, A., & Aggoune, E.-H. M. (2019) · IEEE Access · doi:10.1109/access.2019.2932609 · Cited by 1,306
Boursianis, A. D., Papadopoulou, M. S., Diamantoulakis, P., Liopa-Tsakalidi, A., Barouchas, P., Salahas, G., Karagiannidis, G., Wan, S., & Goudos, S. K. (2022) · Internet of Things · doi:10.1016/j.iot.2020.100187 · Cited by 885
From Industry 4.0 to Agriculture 4.0: Current Status, Enabling Technologies, and Research Challenges
Liu, Y., Ma, X., Shu, L., Hancke, G. P., & Abu-Mahfouz, A. M. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3003910 · Cited by 808
Crop yield prediction with deep convolutional neural networks
Nevavuori, P., Narra, N., & Lipping, T. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.104859 · Cited by 586
A survey of deep learning techniques for weed detection from images
Hasan, A. S. M. M., Sohel, F., Diepeveen, D., Laga, H., & Jones, M. G. K. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106067 · Cited by 478
Automation in Agriculture by Machine and Deep Learning Techniques: A Review of Recent Developments
Saleem, M. H., Potgieter, J., & Arif, K. M. (2021) · Precision Agriculture · doi:10.1007/s11119-021-09806-x · Cited by 434
A survey of public datasets for computer vision tasks in precision agriculture
Lu, Y., & Young, S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105760 · Cited by 382
Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review
Jiang, Y., & Li, C. (2020) · Plant Phenomics · doi:10.34133/2020/4152816 · Cited by 380
Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review
Lu, Y., Chen, D., Olaniyi, E., & Huang, Y. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107208 · Cited by 362
Deep learning techniques to classify agricultural crops through UAV imagery: a review
Bouguettaya, A., Zarzour, H., Kechida, A., & Taberkit, A. M. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07104-9 · Cited by 314
Sa, I., Popović, M., Khanna, R., Chen, Z., Lottes, P., Liebisch, F., Nieto, J., Stachniss, C., Walter, A., & Siegwart, R. (2018) · Remote Sensing · doi:10.3390/rs10091423 · Cited by 305
Self-citationReview of Weed Detection Methods Based on Computer Vision
Wu, Z., Chen, Y., Zhao, B., Kang, X., & Ding, Y. (2021) · Sensors · doi:10.3390/s21113647 · Cited by 303
A Survey on optimized implementation of deep learning models on the NVIDIA Jetson platform
Mittal, S. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.011 · Cited by 294
Lottes, P., Behley, J., Milioto, A., & Stachniss, C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2846289 · Cited by 281
A Review of Deep Learning in Multiscale Agricultural Sensing
Wang, D., Cao, W., Zhang, F., Li, Z., Xu, S., & Wu, X. (2022) · Remote Sensing · doi:10.3390/rs14030559 · Cited by 275
CNN feature based graph convolutional network for weed and crop recognition in smart farming
Jiang, H., Zhang, C., Qiao, Y., Zhang, Z., Zhang, W., & Song, C. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105450 · Cited by 268
Applications of deep learning in precision weed management: A review
Rai, N., Zhang, Y., Ram, B. G., Schumacher, L., Yellavajjala, R. K., Bajwa, S., & Sun, X. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107698 · Cited by 218
Mazzia, V., Khaliq, A., Salvetti, F., & Chiaberge, M. (2020) · IEEE Access · doi:10.1109/access.2020.2964608 · Cited by 212
“Casecaded CNN model was deployed in TX2 for semantic weed classification using multi spectral images for smart farming [32].”
MethodA Review of Embedded Machine Learning Based on Hardware, Application, and Sensing Scheme
Biglari, A., & Tang, W. (2023) · Sensors · doi:10.3390/s23042131 · Cited by 86
A blockchain and deep neural networks-based secure framework for enhanced crop protection
Hassija, V., Batra, S., Chamola, V., Anand, T., Goyal, P., Goyal, N., & Guizani, M. (2021) · Ad Hoc Networks · doi:10.1016/j.adhoc.2021.102537 · Cited by 40
Maski, P., & Thondiyath, A. (2021) · 2021 6th International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc52351.2021.9526944 · Cited by 34
Metadata
- Authors
- Sa, I., Chen, Z., Popovic, M., Khanna, R., Liebisch, F., Nieto, J., & Siegwart, R.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2018-01
- Volume
- 3
- Issue
- 1
- Pages
- 588-595
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2755766995
- Cited by
- 369
- References
- 36
- FWCI
- 23.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- European Union's Horizon 2020 Research and Innovation Programme (644227, 644128)
- Swiss State Secretariat for Education, Research and Innovation (15.0029, 15.0044)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.