The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Application of consumer RGB-D cameras for fruit detection and localization in field: A critical review
Open accessAbstract
Abstract Fruit detection and localization are essential for future agronomic management of fruit crops such as yield prediction, yield mapping and automated harvesting. However, to perform robust and efficient fruit detection and localization in orchard is a challenging task under variable illumination, low-resolutions and heavy occlusion by neighboring fruits, foliage, or branches. Therefore, researches of fruit detection and localization by getting more information of objects are essential. RGB-D (Red, Green, Blue -Depth) cameras are promising sensors and widely used in fruit detection and localization given that they provide depth information and infrared information in addition to RGB information. After presenting a discussion on the advantages and disadvantages of RGB-D cameras with different depth measurement principles and application fields, this paper reviews various types of RGB-D sensor systems and image processing methods used for fruit detection and localization in the field. Finally, major challenges for the successful application of RGB-D camera-based machine vision system, and potential future directions for the research and development in this area are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeepFruits: A Fruit Detection System Using Deep Neural Networks
Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., & McCool, C. (2016) · Sensors · doi:10.3390/s16081222 · Cited by 1,104
Deep learning – Method overview and review of use for fruit detection and yield estimation
Koirala, A., Walsh, K. B., Wang, Z., & McCarthy, C. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.04.017 · Cited by 581
Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review
Tang, Y., Chen, M., Wang, C., Luo, L., Li, J., Lian, G., & Zou, X. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.00510 · Cited by 575
Sensors and systems for fruit detection and localization: A review
Gongal, A., Amatya, S., Karkee, M., Zhang, Q., & Lewis, K. (2015) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.05.021 · Cited by 572
Self-citationImage Segmentation for Fruit Detection and Yield Estimation in Apple Orchards
Bargoti, S., & Underwood, J. P. (2017) · Journal of Field Robotics · doi:10.1002/rob.21699 · Cited by 495
A review of key techniques of vision-based control for harvesting robot
Zhao, Y., Gong, L., Huang, Y., & Liu, C. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2016.06.022 · Cited by 407
Multi-class fruit-on-plant detection for apple in SNAP system using Faster R-CNN
Gao, F., Fu, L., Zhang, X., Majeed, Y., Li, R., Karkee, M., & Zhang, Q. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105634 · Cited by 333
Self-citationLow-Cost 3D Systems: Suitable Tools for Plant Phenotyping
Paulus, S., Behmann, J., Mahlein, A.-K., Plümer, L., & Kuhlmann, H. (2014) · Sensors · doi:10.3390/s140203001 · Cited by 259
Fast implementation of real-time fruit detection in apple orchards using deep learning
Kang, H., & Chen, C. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105108 · Cited by 243
Fruit detection, segmentation and 3D visualisation of environments in apple orchards
Kang, H., & Chen, C. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105302 · Cited by 223
Stajnko, D., Lakota, M., & Hočevar, M. (2004) · Computers and Electronics in Agriculture · doi:10.1016/s0168-1699(03)00086-3 · Cited by 220
Fu, L., Majeed, Y., Zhang, X., Karkee, M., & Zhang, Q. (2020) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2020.07.007 · Cited by 218
Self-citationVision-based control of robotic manipulator for citrus harvesting
Mehta, S. S., & Burks, T. F. (2014) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2014.01.003 · Cited by 215
Improved Kiwifruit Detection Using Pre-Trained VGG16 With RGB and NIR Information Fusion
Liu, Z., Wu, J., Fu, L., Majeed, Y., Feng, Y., Li, R., & Cui, Y. (2020) · IEEE Access · doi:10.1109/access.2019.2962513 · Cited by 192
Self-citationStructured Light-Based 3D Reconstruction System for Plants
Nguyen, T., Slaughter, D., Max, N., Maloof, J., & Sinha, N. (2015) · Sensors · doi:10.3390/s150818587 · Cited by 187
On-Tree Mango Fruit Size Estimation Using RGB-D Images
Wang, Z., Walsh, K., & Verma, B. (2017) · Sensors · doi:10.3390/s17122738 · Cited by 182
A comparative study of fruit detection and counting methods for yield mapping in apple orchards
Häni, N., Roy, P., & Isler, V. (2020) · Journal of Field Robotics · doi:10.1002/rob.21902 · Cited by 177
Color-, depth-, and shape-based 3D fruit detection
Lin, G., Tang, Y., Zou, X., Xiong, J., & Fang, Y. (2020) · Precision Agriculture · doi:10.1007/s11119-019-09654-w · Cited by 177
Kurtulmus, F., Lee, W. S., & Vardar, A. (2011) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2011.07.001 · Cited by 172
Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking
Tao, Y., & Zhou, J. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.09.019 · Cited by 171
Gené-Mola, J., Vilaplana, V., Rosell-Polo, J. R., Morros, J.-R., Ruiz-Hidalgo, J., & Gregorio, E. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.05.016 · Cited by 169
Passion fruit detection and counting based on multiple scale faster R-CNN using RGB-D images
Tu, S., Pang, J., Liu, H., Zhuang, N., Chen, Y., Zheng, C., Wan, H., & Xue, Y. (2020) · Precision Agriculture · doi:10.1007/s11119-020-09709-3 · Cited by 163
Comparing RGB-D Sensors for Close Range Outdoor Agricultural Phenotyping
Vit, A., & Shani, G. (2018) · Sensors · doi:10.3390/s18124413 · Cited by 162
In-field high throughput grapevine phenotyping with a consumer-grade depth camera
Milella, A., Marani, R., Petitti, A., & Reina, G. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.11.026 · Cited by 162
Technology progress in mechanical harvest of fresh market apples
Zhang, Z., Igathinathane, C., Li, J., Cen, H., Lu, Y., & Flores, P. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105606 · Cited by 159
Apple crop-load estimation with over-the-row machine vision system
Gongal, A., Silwal, A., Amatya, S., Karkee, M., Zhang, Q., & Lewis, K. (2015) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.10.022 · Cited by 157
Self-citationTime-of-Flight and Structured Light Depth Cameras
Zanuttigh, P., Marin, G., Mutto, C. D., Dominio, F., Minto, L., & Cortelazzo, G. M. (2016) · Springer eBooks · doi:10.1007/978-3-319-30973-6 · Cited by 156
Detection of red and bicoloured apples on tree with an RGB-D camera
Nguyen, T. T., Vandevoorde, K., Wouters, N., Kayacan, E., Baerdemaeker, J. G. D., & Saeys, W. (2016) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2016.01.007 · Cited by 155
Detection of passion fruits and maturity classification using Red-Green-Blue Depth images
Tu, S., Xue, Y., Zheng, C., Qi, Y., Wan, H., & Mao, L. (2018) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2018.09.004 · Cited by 145
Zhang, J., Karkee, M., Zhang, Q., Zhang, X., Majeed, Y., Fu, L., & Wang, S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105384 · Cited by 140
Self-citationZhang, J., He, L., Karkee, M., Zhang, Q., Zhang, X., & Gao, Z. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.10.029 · Cited by 137
Self-citationFruit Localization and Environment Perception for Strawberry Harvesting Robots
Ge, Y., Xiong, Y., Tenorio, G. L., & From, P. J. (2019) · IEEE Access · doi:10.1109/access.2019.2946369 · Cited by 131
3D Computer-vision system for automatically estimating heifer height and body mass
Nir, O., Parmet, Y., Werner, D., Adin, G., & Halachmi, I. (2017) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2017.11.014 · Cited by 127
Wheat Lodging Detection from UAS Imagery Using Machine Learning Algorithms
Zhang, Z., Flores, P., Igathinathane, C., Naik, D. L., Kiran, R., & Ransom, J. K. (2020) · Remote Sensing · doi:10.3390/rs12111838 · Cited by 126
A novel image processing algorithm to separate linearly clustered kiwifruits
Fu, L., Tola, E., Al-Mallahi, A. A., Li, R., & Cui, Y. (2019) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2019.04.024 · Cited by 124
Self-citationGené-Mola, J., Gregorio, E., Cheein, F. A., Guevara, J., Llorens, J., Sanz, R., Escolà, A., & Rosell-Polo, J. R. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105121 · Cited by 124
In-field citrus detection and localisation based on RGB-D image analysis
Lin, G., Tang, Y., Zou, X., Li, J., & Xiong, J. (2019) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2019.06.019 · Cited by 122
Range data acquisition using color structured lighting and stereo vision
Chen, C., Hung, Y., Chiang, C.-C., & Wu, J. (1997) · Image and Vision Computing · doi:10.1016/s0262-8856(96)01148-1 · Cited by 106
Self-citationKiwifruit detection in field images using Faster R-CNN with VGG16
Song, Z., Fu, L., Wu, J., Liu, Z., Li, R., & Cui, Y. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.12.500 · Cited by 104
Self-citationColour-agnostic shape-based 3D fruit detection for crop harvesting robots
Barnea, E., Mairon, R., & Ben‐Shahar, O. (2016) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2016.01.013 · Cited by 103
Apple fruit size estimation using a 3D machine vision system
Gongal, A., Karkee, M., & Amatya, S. (2018) · Information Processing in Agriculture · doi:10.1016/j.inpa.2018.06.002 · Cited by 102
Self-citationFan, Y., Feng, Z., Mannan, A., Khan, T. U., Shen, C., & Saeed, S. (2018) · Remote Sensing · doi:10.3390/rs10111845 · Cited by 102
OpenPTrack: Open source multi-camera calibration and people tracking for RGB-D camera networks
Munaro, M., Basso, F., & Menegatti, E. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.10.004 · Cited by 101
Font, D., Pallejà, T., Tresánchez, M., Runcan, D., Moreno, J., Martínez, D., Teixidó, M., & Palacín, J. (2014) · Sensors · doi:10.3390/s140711557 · Cited by 101
Halmetschlager-Funek, G., Suchi, M., Kampel, M., & Vincze, M. (2018) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2018.2852795 · Cited by 82
Machine vision technology for detecting the external defects of fruits — a review
Li, J. B., Huang, W., & Zhao, C. (2014) · The Imaging Science Journal · doi:10.1179/1743131x14y.0000000088 · Cited by 73
GRIBBOT – Robotic 3D vision-guided harvesting of chicken fillets
Misimi, E., Øye, E. R., Eilertsen, A., Mathiassen, J. R., Åsebø, O. B., Gjerstad, T. B., Buljo, J. O., & Skotheim, Ø. (2015) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.11.021 · Cited by 65
Deep Learning Approach for Apple Edge Detection to Remotely Monitor Apple Growth in Orchards
Wang, D., Li, C., Song, H., Xiong, H., Liu, C., & He, D. (2020) · IEEE Access · doi:10.1109/access.2020.2971524 · Cited by 59
Comparative Study of Intel R200, Kinect v2, and Primesense RGB-D Sensors Performance Outdoors
Kuan, Y. W., Ng, O.-E., & Lee, S. W. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2920976 · Cited by 58
Fast Recognition and Location of Target Fruit Based on Depth Information
Tian, Y., Duan, H., Luo, R., Zhang, Y., Jia, W., Lian, J., Zheng, Y., Ruan, C., & Li, C. (2019) · IEEE Access · doi:10.1109/access.2019.2955566 · Cited by 50
Kinect v2 Sensor-Based Mobile Terrestrial Laser Scanner for Agricultural Outdoor Applications
Rosell-Polo, J. R., Gregorio, E., Gené-Mola, J., Llorens, J., Torrent, X., Arnó, J., & Escolà, A. (2017) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2017.2663436 · Cited by 49
Salau, J., Haas, J. H., Junge, W., & Thaller, G. E. (2017) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2017.06.006 · Cited by 41
Measurement of the ripening rate on coffee branches by using 3D images in outdoor environments
Ramos, P. J., Avendaño, J., & Prieto, F. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.03.024 · Cited by 22
An automatic and rapid system for grading palm bunch using a Kinect camera
Pamornnak, B., Limsiroratana, S., Khaorapapong, T., Chongcheawchamnan, M., & Ruckelshausen, A. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.10.020 · Cited by 21
Mobile low-cost 3D camera maize crop height measurements under field conditions
Hämmerle, M., & Höfle, B. (2017) · Precision Agriculture · doi:10.1007/s11119-017-9544-3 · Cited by 20
SEGMENTATION OF APPLE POINT CLOUDS BASED ON ROI IN RGB IMAGES
Zhang, Y., Tian, Y., Zheng, C., et al. (2019) · INMATEH Agricultural Engineering · doi:10.35633/inmateh-59-23 · Cited by 12
Towards an artificial vision-robotic system for tomato identification
Luna, F., & Morales-Díaz, A. B. (2016) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2016.10.067 · Cited by 11
Cited by
A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5
Yan, B., Fan, P., Lei, X., Liu, Z., & Yang, F. (2021) · Remote Sensing · doi:10.3390/rs13091619 · Cited by 577
A detection algorithm for cherry fruits based on the improved YOLO-v4 model
Gai, R., Chen, N., & Yuan, H. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-06029-z · Cited by 388
Vision-based navigation and guidance for agricultural autonomous vehicles and robots: A review
Bai, Y., Zhang, B., Xu, N., Zhou, J., Shi, J., & Diao, Z. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107584 · Cited by 353
Intelligent robots for fruit harvesting: recent developments and future challenges
Zhou, H., Wang, X., Au, W., Kang, H., & Chen, C. (2022) · Precision Agriculture · doi:10.1007/s11119-022-09913-3 · Cited by 316
Rehman, A., Saba, T., Kashif, M., Fati, S. M., Bahaj, S. A., & Chaudhry, H. (2022) · Agronomy · doi:10.3390/agronomy12010127 · Cited by 306
Metadata
- Authors
- Fu, L., Gao, F., Wu, J., Li, R., Karkee, M., & Zhang, Q.
- Venue
- Computers and Electronics in Agriculture
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 177
- Pages
- 105687
- ISSN
- 0168-1699 (ISSN-L)
- OpenAlex
- W3048025158
- Cited by
- 331
- References
- 57
- FWCI
- 22.25
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.