The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Detection and analysis of wheat spikes using Convolutional Neural Networks
Open accessAbstract
Field phenotyping by remote sensing has received increased interest in recent years with the possibility of achieving high-throughput analysis of crop fields. Along with the various technological developments, the application of machine learning methods for image analysis has enhanced the potential for quantitative assessment of a multitude of crop traits. For wheat breeding purposes, assessing the production of wheat spikes, as the grain-bearing organ, is a useful proxy measure of grain production. Thus, being able to detect and characterize spikes from images of wheat fields is an essential component in a wheat breeding pipeline for the selection of high yielding varieties. We have applied a deep learning approach to accurately detect, count and analyze wheat spikes for yield estimation. We have tested the approach on a set of images of wheat field trial comprising 10 varieties subjected to three fertilizer treatments. The images have been captured over one season, using high definition RGB cameras mounted on a land-based imaging platform, and viewing the wheat plots from an oblique angle. A subset of in-field images has been accurately labeled by manually annotating all the spike regions. This annotated dataset, called SPIKE, is then used to train four region-based Convolutional Neural Networks (R-CNN) which take, as input, images of wheat plots, and accurately detect and count spike regions in each plot. The CNNs also output the spike density and a classification probability for each plot. Using the same R-CNN architecture, four different models were generated based on four different datasets of training and testing images captured at various growth stages. Despite the challenging field imaging conditions, e.g., variable illumination conditions, high spike occlusion, and complex background, the four R-CNN models achieve an average detection accuracy ranging from 88 to $$94\%$$ across different sets of test images. The most robust R-CNN model, which achieved the highest accuracy, is then selected to study the variation in spike production over 10 wheat varieties and three treatments. The SPIKE dataset and the trained CNN are the main contributions of this paper. With the availability of good training datasets such us the SPIKE dataset proposed in this article, deep learning techniques can achieve high accuracy in detecting and counting spikes from complex wheat field images. The proposed robust R-CNN model, which has been trained on spike images captured during different growth stages, is optimized for application to a wider variety of field scenarios. It accurately quantifies the differences in yield produced by the 10 varieties we have studied, and their respective responses to fertilizer treatment. We have also observed that the other R-CNN models exhibit more specialized performances. The data set and the R-CNN model, which we make publicly available, have the potential to greatly benefit plant breeders by facilitating the high throughput selection of high yielding varieties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Field high-throughput phenotyping: the new crop breeding frontier
Araus, J. L., & Cairns, J. E. (2014) · Trends in Plant Science · doi:10.1016/j.tplants.2013.09.008 · Cited by 1,817
Tripathi, D. K., Mishra, R. K., Singh, S., Singh, S., Vishwakarma, K., Sharma, S., Singh, V. P., Singh, P. K., Prasad, S. M., Dubey, N. K., et al. (2017) · Frontiers in Plant Science · doi:10.3389/fpls.2017.00001 · Cited by 1,176
Machine Learning for High-Throughput Stress Phenotyping in Plants
Singh, A., Ganapathysubramanian, B., Singh, A. K., & Sarkar, S. (2016) · Trends in Plant Science · doi:10.1016/j.tplants.2015.10.015 · Cited by 1,109
A scalable satellite-based crop yield mapper
Lobell, D. B., Thau, D., Seifert, C., Engle, E., & Little, B. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.04.021 · Cited by 602
Holman, F., Riche, A., Michalski, A., Castle, M., Wooster, M., & Hawkesford, M. (2016) · Remote Sensing · doi:10.3390/rs8121031 · Cited by 398
Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks
Ubbens, J. R., & Stavness, I. (2017) · Frontiers in Plant Science · doi:10.3389/fpls.2017.01190 · Cited by 371
Madec, S., Baret, F., de Solan, B., Thomas, S., Dutartre, D., Jezequel, S., Hemmerlé, M., Colombeau, G., & Comar, A. (2017) · Frontiers in Plant Science · doi:10.3389/fpls.2017.02002 · Cited by 350
Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research
Shi, Y., Thomasson, J. A., Murray, S. C., Pugh, N. A., Rooney, W. L., Shafian, S., Rajan, N., Rouze, G., Morgan, C. L. S., Neely, H. L., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159781 · Cited by 334
LeafNet: A computer vision system for automatic plant species identification
Barré, P., Stöver, B. C., Müller, K. F., & Steinhage, V. (2017) · Ecological Informatics · doi:10.1016/j.ecoinf.2017.05.005 · Cited by 306
TasselNet: counting maize tassels in the wild via local counts regression network
Lu, H., Cao, Z., Xiao, Y., Zhuang, B., & Shen, C. (2017) · Plant Methods · doi:10.1186/s13007-017-0224-0 · Cited by 268
The use of plant models in deep learning: an application to leaf counting in rosette plants
Ubbens, J., Cieslak, M., Prusinkiewicz, P., & Stavness, I. (2018) · Plant Methods · doi:10.1186/s13007-018-0273-z · Cited by 253
Novel throughput phenotyping platforms in plant genetic studies
Montes, J. M., Melchinger, A. E., & Reif, J. C. (2007) · Trends in Plant Science · doi:10.1016/j.tplants.2007.08.006 · Cited by 247
Genetic mapping of basal root gravitropism and phosphorus acquisition efficiency in common bean
Liao, H., Yan, X., Rubio, G., Beebe, S. E., Blair, M. W., & Lynch, J. P. (2004) · Functional Plant Biology · doi:10.1071/fp03255 · Cited by 208
Plant phenomics: an overview of image acquisition technologies and image data analysis algorithms
Perez-Sanz, F., Navarro, P. J., & Egea-Cortines, M. (2017) · GigaScience · doi:10.1093/gigascience/gix092 · Cited by 197
Deep phenotyping: deep learning for temporal phenotype/genotype classification
Taghavi Namin, S., Esmaeilzadeh, M., Najafi, M., Brown, T. B., & Borevitz, J. O. (2018) · Plant Methods · doi:10.1186/s13007-018-0333-4 · Cited by 195
Wheat ear counting in-field conditions: High throughput and low-cost approach using RGB images
Fernandez-Gallego, J. A., Kefauver, S. C., Gutiérrez, N. A., Nieto-Taladriz, M. T., & Araus, J. L. (2018) · Plant Methods · doi:10.1186/s13007-018-0289-4 · Cited by 173
Machine Learning for Plant Phenotyping Needs Image Processing
Tsaftaris, S. A., Minervini, M., & Scharr, H. (2016) · Trends in Plant Science · doi:10.1016/j.tplants.2016.10.002 · Cited by 171
Deep Learning for Multi-task Plant Phenotyping
Pound, M. P., Atkinson, J. A., Wells, D. M., Pridmore, T. P., & French, A. P. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.241 · Cited by 171
Automated Method to Determine Two Critical Growth Stages of Wheat: Heading and Flowering
Sadeghi‐Tehran, P., Sabermanesh, K., Virlet, N., & Hawkesford, M. J. (2017) · Frontiers in Plant Science · doi:10.3389/fpls.2017.00252 · Cited by 148
Computer vision cracks the leaf code
Wilf, P., Zhang, S., Chikkerur, S. S., Little, S. A., Wing, S. L., & Serre, T. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1524473113 · Cited by 130
Estimation of vegetation indices for high-throughput phenotyping of wheat using aerial imaging
Khan, Z., Eichi, V. R., Haefele, S. M., Garnett, T., & Miklavcic, S. J. (2018) · Plant Methods · doi:10.1186/s13007-018-0287-6 · Cited by 119
Self-citationJain, S., Aresu, L., Comazzi, S., Shi, J., Worrall, E. G., Clayton, J., Humphries, W., Hemmington, S., Davis, P. J., Murray, E., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148366 · Cited by 100
Wheat Ears Counting in Field Conditions Based on Multi-Feature Optimization and TWSVM
Zhou, C., Liang, D., Yang, X., Yang, H. F., Yue, J., & Yang, G. (2018) · Frontiers in Plant Science · doi:10.3389/fpls.2018.01024 · Cited by 89
Detecting spikes of wheat plants using neural networks with Laws texture energy
Li, Q., Cai, J., Berger, B., Okamoto, M., & Miklavcic, S. J. (2017) · Plant Methods · doi:10.1186/s13007-017-0231-1 · Cited by 81
Self-citationZhou, C., Liang, D., Yang, X., Xu, B., & Yang, G. (2018) · Remote Sensing · doi:10.3390/rs10020246 · Cited by 62 · cited 1×
“[21] proposed an image fusion method by using multi-sensor data and an improved maximum entropy segmentation algorithm to detect wheat spikes in the field.”
MethodAutomatic Counting of Wheat Spikes from Wheat Growth Images
Alharbi, N., Zhou, J., & Wang, W. (2018) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0006580403460355 · Cited by 38
Cited by
Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review
Jiang, Y., & Li, C. (2020) · Plant Phenomics · doi:10.34133/2020/4152816 · Cited by 380
A review of deep learning applications for genomic selection
Montesinos-López, O. A., Montesinos-López, A., Pérez-Rodríguez, P., Barrón-López, J. A., Martini, J. W. R., Fajardo-Flores, S. B., Gaytan-Lugo, L. S., Santana-Mancilla, P. C., & Crossa, J. (2021) · BMC Genomics · doi:10.1186/s12864-020-07319-x · Cited by 361
Plant diseases recognition on images using convolutional neural networks: A systematic review
Abade, A., Ferreira, P. A., & de Barros Vidal, F. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106125 · Cited by 342
David, E., Madec, S., Sadeghi-Tehran, P., Aasen, H., Zheng, B., Liu, S., Kirchgessner, N., Ishikawa, G., Nagasawa, K., Badhon, M. A., et al. (2020) · Plant Phenomics · doi:10.34133/2020/3521852 · Cited by 277
TasselNetv2: in-field counting of wheat spikes with context-augmented local regression networks
Xiong, H., Cao, Z., Lu, H., Madec, S., Liu, L., & Shen, C. (2019) · Plant Methods · doi:10.1186/s13007-019-0537-2 · Cited by 157
Metadata
- Authors
- Hasan, M. M., Chopin, J. P., Laga, H., & Miklavcic, S. J.
- Venue
- Plant Methods
- Published
- 2018-11-15
- Volume
- 14
- Issue
- 1
- Pages
- 100-100
- ISSN
- 1746-4811 (ISSN-L)
- OpenAlex
- W2901871634
- Cited by
- 275
- References
- 30
- FWCI
- 17.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.