CoChat

Real Time Pear Fruit Detection and Counting Using YOLOv4 Models and Deep SORT

Open access
Parico, Addie Ira Borja, Ahamed, Tofael · 2021 · Sensors
Cited by 200

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Abstract

This study aimed to produce a robust real-time pear fruit counter for mobile applications using only RGB data, the variants of the state-of-the-art object detection model YOLOv4, and the multiple object-tracking algorithm Deep SORT. This study also provided a systematic and pragmatic methodology for choosing the most suitable model for a desired application in agricultural sciences. In terms of accuracy, YOLOv4-CSP was observed as the optimal model, with an AP@0.50 of 98%. In terms of speed and computational cost, YOLOv4-tiny was found to be the ideal model, with a speed of more than 50 FPS and FLOPS of 6.8–14.5. If considering the balance in terms of accuracy, speed and computational cost, YOLOv4 was found to be most suitable and had the highest accuracy metrics while satisfying a real time speed of greater than or equal to 24 FPS. Between the two methods of counting with Deep SORT, the unique ID method was found to be more reliable, with an F1count of 87.85%. This was because YOLOv4 had a very low false negative in detecting pear fruits. The ROI line is more reliable because of its more restrictive nature, but due to flickering in detection it was not able to count some pears despite their being detected.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s21144803

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 24 references

Research works printed but not linked: 23

  1. Kamilaris, 2018, Deep learning in agriculture: A survey, Comput. Electron. Agric., 147, 70, 10.1016/j.compag.2018.02.016 · DOI · Paper page
  2. Kamilaris, 2018, A review of the use of convolutional neural networks in agriculture, J. Agric. Sci., 156, 312, 10.1017/S0021859618000436 · DOI · Paper page
  3. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
  4. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2020). Scaled-YOLOv4: Scaling Cross Stage Partial Network. arXiv. · DOI · Paper page
  5. Koirala, 2019, Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of ‘MangoYOLO’, Precis. Agric., 20, 1107, 10.1007/s11119-019-09642-0 · DOI · Paper page
  6. Liu, G., Nouaze, J.C., Mbouembe, P.L.T., and Kim, J.H. (2020). YOLO-tomato: A robust algorithm for tomato detection based on YOLOv3. Sensors, 20. · DOI · Paper page
  7. Lawal, 2021, Tomato detection based on modified YOLOv3 framework, Sci. Rep., 11, 1447, 10.1038/s41598-021-81216-5 · DOI · Paper page
  8. Li, G., Huang, X., Ai, J., Yi, Z., and Xie, W. (2021). Lemon-YOLO: An efficient object detection method for lemons in the natural environment. IET Image Process., 1–12. · DOI
  9. Fu, 2020, Fast and Accurate Detection of Banana Fruits in Complex Background Orchards, IEEE Access, 8, 196835, 10.1109/ACCESS.2020.3029215 · DOI
  10. Kuznetsova, 2020, Detecting Apples in Orchards Using YOLOv3 and YOLOv5 in General and Close-Up Images, Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Volume 12249, 233
  11. Kravets, A.G., Bolshakov, A.A., and Shcherbakov, M. (2021). YOLOv5 versus YOLOv3 for Apple Detection. Cyber-Physical Systems: Modelling and Intelligent Control. Studies in Systems, Decision and Control Volume 338, Springer. · doi:10.1007/978-3-030-66077-2
  12. Wu, L., Ma, J., Zhao, Y., and Liu, H. (2021). Apple Detection in Complex Scene Using the Improved YOLOv4 Model. Agronomy, 11. · DOI
  13. Itakura, 2021, Automatic pear and apple detection by videos using deep learning and a Kalman filter, OSA Contin., 4, 1688, 10.1364/OSAC.424583 · DOI
  14. Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16–21). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, Altanta, GA, USA.
  15. Misra, D. (2019). Mish: A self regularized non-monotonic neural activation function. arXiv.
  16. Huang, 2020, DC-SPP-YOLO: Dense connection and spatial pyramid pooling based YOLO for object detection, Inf. Sci., 522, 241, 10.1016/j.ins.2020.02.067 · DOI · Paper page
  17. Leal-Taixé, L., Milan, A., Reid, I., Roth, S., and Schindler, K. (2015). MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking. arXiv.
  18. Kuznetsova, A., Maleva, T., and Soloviev, V. (2020). Using YOLOv3 algorithm with pre- And post-processing for apple detection in fruit-harvesting robot. Agronomy, 10. · DOI · Paper page
  19. Cartucho, J., Ventura, R., and Veloso, M. (2018, January 1–5). Robust Object Recognition Through Symbiotic Deep Learning in Mobile Robots. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain. · DOI
  20. Sehgal, 2019, Guidelines and Benchmarks for Deployment of Deep Learning Models on Smartphones as Real-Time Apps, Mach. Learn. Knowl. Extr., 1, 450, 10.3390/make1010027 · DOI
  21. Everingham, 2010, The Pascal Visual Object Classes (VOC) Challenge, Int. J. Comput. Vis., 88, 303, 10.1007/s11263-009-0275-4 · DOI · Paper page
  22. Lee, Y., Hwang, J., Lee, S., Bae, Y., and Park, J. (2019, January 16–17). An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA. · DOI · Paper page
  23. Du, J. (2018). Understanding of object detection based on CNN family and YOLO. J. Phys. Conf. Ser., 1004. · DOI · Paper page

Cited by

Metadata

Authors
Parico, A. I. B., & Ahamed, T.
Venue
Sensors
Publisher
MDPI AG
Published
2021-07-14
Volume
21
Issue
14
Pages
4803
ISSN
1424-8220 (ISSN-L)
OpenAlex
W3177696923
Cited by
200
References
24
FWCI
18.49
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.