The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
DeepFruits: A Fruit Detection System Using Deep Neural Networks
Open accessAbstract
This paper presents a novel approach to fruit detection using deep convolutional neural networks. The aim is to build an accurate, fast and reliable fruit detection system, which is a vital element of an autonomous agricultural robotic platform; it is a key element for fruit yield estimation and automated harvesting. Recent work in deep neural networks has led to the development of a state-of-the-art object detector termed Faster Region-based CNN (Faster R-CNN). We adapt this model, through transfer learning, for the task of fruit detection using imagery obtained from two modalities: colour (RGB) and Near-Infrared (NIR). Early and late fusion methods are explored for combining the multi-modal (RGB and NIR) information. This leads to a novel multi-modal Faster R-CNN model, which achieves state-of-the-art results compared to prior work with the F1 score, which takes into account both precision and recall performances improving from 0 . 807 to 0 . 838 for the detection of sweet pepper. In addition to improved accuracy, this approach is also much quicker to deploy for new fruits, as it requires bounding box annotation rather than pixel-level annotation (annotating bounding boxes is approximately an order of magnitude quicker to perform). The model is retrained to perform the detection of seven fruits, with the entire process taking four hours to annotate and train the new model per fruit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Cited by
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,133
A comparative study of fine-tuning deep learning models for plant disease identification
Too, E. C., Yujian, L., Njuki, S., & Yingchun, L. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.03.032 · Cited by 1,487
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Apple detection during different growth stages in orchards using the improved YOLO-V3 model
Tian, Y., Yang, G., Wang, Z., Wang, H., Li, E., & Liang, Z. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.01.012 · Cited by 1,043
Friha, O., Ferrag, M. A., Shu, L., Maglaras, L., & Wang, X. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003925 · Cited by 633
Fruits and vegetables quality evaluation using computer vision: A review
Bhargava, A., & Bansal, A. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2018.06.002 · Cited by 631
Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN
Yu, Y., Zhang, K., Yang, L., & Zhang, D. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.06.001 · Cited by 630
Deep fruit detection in orchards
Bargoti, S., & Underwood, J. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989417 · Cited by 607
“Further tests need to be conducted on how to adapt a model under such variations in the dataset, however, [5] shows reasonable qualitative performance over a new dataset without any re-learning.”
BackgroundMethodInfluentialDeep learning – Method overview and review of use for fruit detection and yield estimation
Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.04.017 · Cited by 581
Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review
Tang, Y., Chen, M., Wang, C., Luo, L., Li, J., Lian, G., & Zou, X. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.00510 · Cited by 575
The digitization of agricultural industry – a systematic literature review on agriculture 4.0
Abbasi, R., Martinez, P., & Ahmad, R. (2022) · Smart Agricultural Technology · doi:10.1016/j.atech.2022.100042 · Cited by 531
Deep Count: Fruit Counting Based on Deep Simulated Learning
Rahnemoonfar, M., & Sheppard, C. (2017) · Sensors · doi:10.3390/s17040905 · Cited by 520
A review of the use of convolutional neural networks in agriculture
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · The Journal of Agricultural Science · doi:10.1017/s0021859618000436 · Cited by 514
Ngugi, L. C., Abelwahab, M., & Abo-Zahhad, M. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2020.04.004 · Cited by 492
Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C. (2019) · Precision Agriculture · doi:10.1007/s11119-019-09642-0 · Cited by 459
Faster R-CNN for multi-class fruit detection using a robotic vision system
Wan, S., & Goudos, S. (2020) · Computer Networks · doi:10.1016/j.comnet.2019.107036 · Cited by 449
Automation in Agriculture by Machine and Deep Learning Techniques: A Review of Recent Developments
Saleem, M. H., Potgieter, J., & Arif, K. M. (2021) · Precision Agriculture · doi:10.1007/s11119-021-09806-x · Cited by 434
Fruit recognition from images using deep learning
Mureşan, H., & Oltean, M. (2018) · Acta Universitatis Sapientiae, Informatica · doi:10.2478/ausi-2018-0002 · Cited by 426
YOLO-Tomato: A Robust Algorithm for Tomato Detection Based on YOLOv3
Liu, G., Nouaze, J. C., Touko Mbouembe, P. L., & Kim, J. H. (2020) · Sensors · doi:10.3390/s20072145 · Cited by 417
A Review of Convolutional Neural Network Applied to Fruit Image Processing
Naranjo-Torres, J., Mora, M., Hernández-García, R., Barrientos, R. J., Fredes, C., & Valenzuela, A. (2020) · Applied Sciences · doi:10.3390/app10103443 · Cited by 406
An in-field automatic wheat disease diagnosis system
Lu, J., Hu, J., Zhao, G., Mei, F., & Zhang, C. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.09.012 · Cited by 394
Torky, M., & Hassanein, A. E. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105476 · Cited by 390
A Survey of Deep Convolutional Neural Networks Applied for Prediction of Plant Leaf Diseases
Dhaka, V. S., Meena, S. V., Rani, G., Sinwar, D., Kavita, K., Ijaz, M. F., & Woźniak, M. (2021) · Sensors · doi:10.3390/s21144749 · Cited by 386
A survey of public datasets for computer vision tasks in precision agriculture
Lu, Y., & Young, S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105760 · Cited by 382
Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review
Jiang, Y., & Li, C. (2020) · Plant Phenomics · doi:10.34133/2020/4152816 · Cited by 380
weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming
Sa, I., Chen, Z., Popovic, M., Khanna, R., Liebisch, F., Nieto, J., & Siegwart, R. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2774979 · Cited by 369
Self-citationSantos, T. T., de Souza, L. L., dos Santos, A. A., & Avila, S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105247 · Cited by 359
Robotic kiwifruit harvesting using machine vision, convolutional neural networks, and robotic arms
Williams, H. A. M., Jones, M. H., Nejati, M., Seabright, M. J., Bell, J., Penhall, N. D., Barnett, J. J., Duke, M. D., Scarfe, A. J., Ahn, H. S., et al. (2019) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2019.03.007 · Cited by 346
Jia, W., Tian, Y., Luo, R., Zhang, Z., Lian, J., & Zheng, Y. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105380 · Cited by 344
Multi-class fruit-on-plant detection for apple in SNAP system using Faster R-CNN
Gao, F., Fu, L., Zhang, X., Majeed, Y., Li, R., Karkee, M., & Zhang, Q. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105634 · Cited by 333
Fu, L., Gao, F., Wu, J., Li, R., Karkee, M., & Zhang, Q. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105687 · Cited by 331
Machine learning in plant science and plant breeding
van Dijk, A. D. J., Kootstra, G., Kruijer, W., & de Ridder, D. (2021) · iScience · doi:10.1016/j.isci.2020.101890 · Cited by 320
Intelligent robots for fruit harvesting: recent developments and future challenges
Zhou, H., Wang, X., Au, W., Kang, H., & Chen, C. (2022) · Precision Agriculture · doi:10.1007/s11119-022-09913-3 · Cited by 316
Fan, S., Li, J., Zhang, Y., Tian, X., Wang, Q., He, X., Zhang, C., & Huang, W. (2020) · Journal of Food Engineering · doi:10.1016/j.jfoodeng.2020.110102 · Cited by 312
Tomato detection based on modified YOLOv3 framework
Lawal, M. O. (2021) · Scientific Reports · doi:10.1038/s41598-021-81216-5 · Cited by 289
Rançon, F., Bombrun, L., Keresztes, B., & Germain, C. (2018) · Remote Sensing · doi:10.3390/rs11010001 · Cited by 287
Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry
Stein, M., Bargoti, S., & Underwood, J. (2016) · Sensors · doi:10.3390/s16111915 · Cited by 286
A survey on the role of Internet of Things for adopting and promoting Agriculture 4.0
Raj, M., Gupta, S., Chamola, V., Elhence, A., Garg, T., Atiquzzaman, M., & Niyato, D. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103107 · Cited by 283
Deep learning techniques for estimation of the yield and size of citrus fruits using a UAV
Apolo-Apolo, O. E., Martínez-Guanter, J., Egea, G., Raja, P., & Pérez-Ruiz, M. (2020) · European Journal of Agronomy · doi:10.1016/j.eja.2020.126030 · Cited by 276
Apple flower detection using deep convolutional networks
Dias, P. A., Tabb, A., & Medeiros, H. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.03.010 · Cited by 265
Deep learning-based appearance features extraction for automated carp species identification
Banan, A., Nasiri, A., & Taheri-Garavand, A. (2020) · Aquacultural Engineering · doi:10.1016/j.aquaeng.2020.102053 · Cited by 262
A survey on generative adversarial networks for imbalance problems in computer vision tasks
Sampath, V., Maurtua, I., Aguilar Martín, J. J., & Gutierrez, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00414-0 · Cited by 259
Systematic review of deep learning techniques in plant disease detection
Nagaraju, M., & Chawla, P. (2020) · International Journal of System Assurance Engineering and Management · doi:10.1007/s13198-020-00972-1 · Cited by 255
Fast implementation of real-time fruit detection in apple orchards using deep learning
Kang, H., & Chen, C. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105108 · Cited by 243
Applications of deep learning in precision weed management: A review
Rai, N., Zhang, Y., Ram, B. G., Schumacher, L., Yellavajjala, R. K., Bajwa, S., & Sun, X. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107698 · Cited by 218
Gené-Mola, J., Vilaplana, V., Rosell-Polo, J. R., Morros, J.-R., Ruiz-Hidalgo, J., & Gregorio, E. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.05.016 · Cited by 169
Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion
Liu, X., Chen, S. W., Aditya, S., Sivakumar, N., Dcunha, S., Qu, C., Taylor, C. J., Das, J., & Kumar, V. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594239 · Cited by 135
Automated Landslides Detection for Mountain Cities Using Multi-Temporal Remote Sensing Imagery
Chen, Z., Zhang, Y., Ouyang, C., Zhang, F., & Ma, J. (2018) · Sensors · doi:10.3390/s18030821 · Cited by 111
Metadata
- Authors
- Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., & McCool, C.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2016-08-03
- Volume
- 16
- Issue
- 8
- Pages
- 1222
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2501369945
- Cited by
- 1,104
- References
- 27
- FWCI
- 71.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.