The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Deep learning – Method overview and review of use for fruit detection and yield estimation
Open accessAbstract
Abstract A review of developments in the rapidly developing field of deep learning is presented. Recommendations are made for original contributions to the literature, as opposed to formulaic applications of established methods to new application areas (e.g., to new crops), including the use of standard metrics (e.g., F1 score, the harmonic mean between Precision and Recall) for model comparison involving binary classification. A recommendation for the provision and use of publically available fruit-in-orchard image sets is made, to allow method comparisons and for implementation of transfer learning for deep learning models trained on the large public generic datasets. Emphasis is placed on practical aspects for application of deep learning models for the task of fruit detection and localisation, in support of tree crop load estimation. Approaches to the extrapolation of tree image counts to orchard yield estimation are also reviewed, dealing with the issue of occluded fruit in imaging. The review is intended to assist new users of deep learning image processing techniques, and to influence the direction of the coming body of application work on fruit detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,133
Machine Learning in Agriculture: A Review
Liakos, K., Busato, P., Moshou, D., Pearson, S., & Bochtis, D. (2018) · Sensors · doi:10.3390/s18082674 · Cited by 3,441
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017) · arXiv · doi:10.48550/arxiv.1708.02002 · Cited by 1,227
DeepFruits: A Fruit Detection System Using Deep Neural Networks
Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., & McCool, C. (2016) · Sensors · doi:10.3390/s16081222 · Cited by 1,104
Deep fruit detection in orchards
Bargoti, S., & Underwood, J. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989417 · Cited by 607
Sensors and systems for fruit detection and localization: A review
Gongal, A., Amatya, S., Karkee, M., Zhang, Q., & Lewis, K. (2015) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.05.021 · Cited by 572
Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data
You, J., Li, X., Low, M., Lobell, D., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11172 · Cited by 558
2015 ASABE Annual International Meeting
(2015) · doi:10.13031/aim.2015 · Cited by 533
Deep Count: Fruit Counting Based on Deep Simulated Learning
Rahnemoonfar, M., & Sheppard, C. (2017) · Sensors · doi:10.3390/s17040905 · Cited by 520
Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards
Bargoti, S., & Underwood, J. P. (2017) · Journal of Field Robotics · doi:10.1002/rob.21699 · Cited by 495
Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C. (2019) · Precision Agriculture · doi:10.1007/s11119-019-09642-0 · Cited by 459
Self-citationCounting Apples and Oranges With Deep Learning: A Data-Driven Approach
Chen, S. W., Shivakumar, S. S., Dcunha, S., Das, J., Okon, E., Qu, C., Taylor, C. J., & Kumar, V. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2651944 · Cited by 406
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315128 · Cited by 374
Scalable, High-Quality Object Detection
Szegedy, C., Reed, S., Erhan, D., Anguelov, D., & Ioffe, S. (2014) · arXiv · doi:10.48550/arxiv.1412.1441 · Cited by 333
1993 IEEE International Conference on Robotics and Automation
(1993) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.11.673 · Cited by 332
Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry
Stein, M., Bargoti, S., & Underwood, J. (2016) · Sensors · doi:10.3390/s16111915 · Cited by 286
Proceedings of the Seventh IEEE International Conference on Computer Vision
(1999) · doi:10.1109/iccv.1999 · Cited by 268
Automated Crop Yield Estimation for Apple Orchards
Wang, Q., Nuske, S., Bergerman, M., & Singh, S. (2013) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-00065-7_50 · Cited by 224
Estimation of mango crop yield using image analysis – Segmentation method
Payne, A. B., Walsh, K. B., Subedi, P. P., & Jarvis, D. (2013) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2012.11.009 · Cited by 223
Self-citationEstimating crop yields with deep learning and remotely sensed data
Kuwata, K., & Shibasaki, R. (2015) · 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2015.7325900 · Cited by 210
On-Tree Mango Fruit Size Estimation Using RGB-D Images
Wang, Z., Walsh, K., & Verma, B. (2017) · Sensors · doi:10.3390/s17122738 · Cited by 182
Self-citationSengupta, S., & Lee, W. S. (2014) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2013.07.007 · Cited by 181
Automatic fruit recognition and counting from multiple images
Song, Y., Glasbey, C. A., Horgan, G. W., et al. (2014) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2013.12.008 · Cited by 176
Kurtulmus, F., Lee, W. S., & Vardar, A. (2011) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2011.07.001 · Cited by 172
Kestur, R., Meduri, A., & Narasipura, O. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.09.011 · Cited by 163
Machine Vision based Fruit Classification and Grading - A Review
Naik, S., & Patel, B. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017914937 · Cited by 149
Crafting GBD-Net for Object Detection
Zeng, X., Ouyang, W., Yan, J., Li, H., Xiao, T., Wang, K., Liu, Y., Zhou, Y., Yang, B., Wang, Z., et al. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2745563 · Cited by 142
Self-citationRobust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion
Liu, X., Chen, S. W., Aditya, S., Sivakumar, N., Dcunha, S., Qu, C., Taylor, C. J., Das, J., & Kumar, V. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594239 · Cited by 135
Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield
Zhou, R. F., Damerow, L., Sun, Y., & Blanke, M. (2012) · Precision Agriculture · doi:10.1007/s11119-012-9269-2 · Cited by 134
Cheng, H., Damerow, L., Sun, Y., & Blanke, M. (2017) · Journal of Imaging · doi:10.3390/jimaging3010006 · Cited by 133
Detecting greenhouse strawberries (mature and immature), using deep convolutional neural network
Habaragamuwa, H., Ogawa, Y., Suzuki, T., Shiigi, T., Ono, M., & Kondo, N. (2018) · Engineering in Agriculture Environment and Food · doi:10.1016/j.eaef.2018.03.001 · Cited by 89
Exploring the Potential of High Resolution WorldView-3 Imagery for Estimating Yield of Mango
Rahman, M. M., Robson, A. J., & Bristow, M. (2018) · Remote Sensing · doi:10.3390/rs10121866 · Cited by 82
A Feature Learning Based Approach for Automated Fruit Yield Estimation
Hung, C., Underwood, J., Nieto, J. I., et al. (2014) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-07488-7_33 · Cited by 62
Predicting County Level Corn Yields Using Deep Long Short Term Memory ModelsPreprint
Jiang, Z., Liu, C., Hendricks, N. P., Ganapathysubramanian, B., Hayes, D. J., & Sarkar, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12044 · Cited by 60
A Real-Time Detection Framework for On-Tree Mango Based on SSD Network
Liang, Q., Zhu, W. D., Long, J., Wang, Y., Sun, W. J., & Wu, W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-97589-4_36 · Cited by 57
Fruit detection, tracking, and 3D reconstruction for crop mapping and yield estimation
Moonrinta, J., Chaivivatrakul, S., Dailey, M. N., et al. (2010) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv.2010.5707436 · Cited by 52
Wettergreen, D. S., & Barfoot, T. D. (2016) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-27702-8 · Cited by 44
Texture-based fruit detection via images using the smooth patterns on the fruit
Pothen, Z. S., & Nuske, S. T. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487722 · Cited by 41
Application of Neural Networks and Image Visualization for Early Forecast of Apple Yield
Rozman, Č., Urška, C., Stanislav, T., Stajnko, D., Pažek, K., Pavlovič, M., & Marjan, V. (2012) · Erwerbs-Obstbau · doi:10.1007/s10341-012-0162-y · Cited by 26
A Survey of Computer Vision Methods for Counting Fruits and Yield Prediction
Syal, A., Garg, D., & Sharma, S. (2013) · Cited by 25
Cited by
Machine Learning Applications for Precision Agriculture: A Comprehensive Review
Sharma, A., Jain, A., Gupta, P., & Chowdary, V. (2021) · IEEE Access · doi:10.1109/access.2020.3048415 · Cited by 1,102
Cao, J., Zhang, Z., Tao, F., Zhang, L., Luo, Y., Zhang, J., Han, J., & Xie, J. (2021) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2020.108275 · Cited by 373
Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review
Lu, Y., Chen, D., Olaniyi, E., & Huang, Y. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107208 · Cited by 362
Jia, W., Tian, Y., Luo, R., Zhang, Z., Lian, J., & Zheng, Y. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105380 · Cited by 344
A review of deep learning techniques used in agriculture
Attri, I., Awasthi, L. K., Sharma, T. P., & Rathee, P. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102217 · Cited by 336
Metadata
- Authors
- Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C.
- Venue
- Computers and Electronics in Agriculture
- Publisher
- Elsevier BV
- Published
- 2019-07
- Volume
- 162
- Pages
- 219-234
- ISSN
- 0168-1699 (ISSN-L)
- OpenAlex
- W2936307272
- Cited by
- 581
- References
- 75
- FWCI
- 36.67
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.