xYOLO: A Model For Real-Time Object Detection In Humanoid Soccer On Low-End Hardware
Open accessAbstract
With the emergence of onboard vision processing for areas such as the internet of things (IoT), edge computing and autonomous robots, there is increasing demand for computationally efficient convolutional neural network (CNN) models to perform real-time object detection on resource constraints hardware devices. Tiny-YOLO is generally considered as one of the faster object detectors for low-end devices and is the basis for our work. Our experiments on this network have shown that Tiny-YOLO can achieve 0.14 frames per second (FPS) on the Raspberry Pi 3 B, which is too slow for soccer playing autonomous humanoid robots detecting goal and ball objects. In this paper we propose an adaptation to the YOLO CNN model named xYOLO, that can achieve object detection at a speed of 9.66 FPS on the Raspberry Pi 3 B. This is achieved by trading an acceptable amount of accuracy, making the network approximately 70 times faster than Tiny-YOLO. Greater inference speed-ups were also achieved on a desktop CPU and GPU. Additionally we contribute an annotated Darknet dataset for goal and ball detection.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
xYOLO achieved greater inference speed on desktop CPU and GPU.
“By using the normal convolutional layer and XNOR layer for training and recall, it achieved greater inference speed on desktop CPU and GPU.”
From A survey of model compression strategies for object detection (2023) · cites this paper as [150]
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
(2016) · Cited by 31,590 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies
Hochreiter, S., Bengio, Y., Informatik, F. F., Bengio, Y., Frasconi, P., & Schmidhuber, J. (2001) · Cited by 863 · see citing works
Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., & Osawa, E. (1997) · doi:10.1145/267658.267738 · Cited by 776 · see citing works
Tiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages
Li, Y., Li, J., Lin, W., & Li, J. (2018) · arXiv · doi:10.48550/arxiv.1807.11013 · Cited by 104 · see citing works
ImageTagger: An Open Source Online Platform for Collaborative Image Labeling
Fiedler, N., Bestmann, M., & Hendrich, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_13 · Cited by 84 · see citing works
A Deep Learning Approach for Object Recognition with NAO Soccer Robots
Albani, D., Youssef, A., Suriani, V., Nardi, D., & Bloisi, D. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68792-6_33 · Cited by 49 · see citing works
Ball Localization for Robocup Soccer Using Convolutional Neural Networks
Speck, D., Barros, P. V. A., Weber, C., & Wermter, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68792-6_2 · Cited by 47 · see citing works
Cruz, N., Lobos-Tsunekawa, K., & Ruíz-del-Solar, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00308-1_2 · Cited by 41 · see citing works
Humanoid Robot Detection Using Deep Learning: A Speed-Accuracy Tradeoff
Javadi, M., Azar, S. M., Azami, S., Ghidary, S. S., Sadeghnejad, S., & Baltes, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00308-1_28 · Cited by 25 · see citing works
Fast and Precise Black and White Ball Detection for RoboCup Soccer
Menashe, J., Kelle, J., Genter, K., Hanna, J. P., Liebman, E., Narvekar, S., Zhang, R., & Stone, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00308-1_4 · Cited by 24 · see citing works
Deep Learning for Semantic Segmentation on Minimal Hardware
van Dijk, S. G., & Scheunemann, M. M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_29 · Cited by 19 · see citing works
Playing Soccer Without Colors in the SPL: A Convolutional Neural Network Approach
Leiva, F., Cruz, N., Bugueno-Cordova, I. G., & Ruíz-del-Solar, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_10 · Cited by 13 · see citing works
Towards Real-Time Ball Localization Using CNNs
Speck, D., Bestmann, M., & Barros, P. V. A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_28 · Cited by 13 · see citing works
Jetson, Where Is the Ball? Using Neural Networks for Ball Detection at RoboCup 2017
Gabel, A., Heuer, T., Schiering, I., & Gerndt, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_15 · Cited by 11 · see citing works
Fast Multi-scale fHOG Feature Extraction Using Histogram Downsampling
Polceanu, M., Harrouet, F., & Buche, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27544-0_5 · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
YOLO with adaptive frame control for real-time object detection applications
Lee, J., & Hwang, K. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11480-0 · Cited by 166 · see citing works
A survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65 · see citing works
Real-Time Underwater Onboard Vision Sensing System for Robotic Gripping
Wang, Y., Tang, C., Cai, M., Yin, J., Wang, S., Cheng, L., Wang, R., & Tan, M. H. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3028400 · Cited by 63 · see citing works
Ag-YOLO: A Real-Time Low-Cost Detector for Precise Spraying With Case Study of Palms
Qin, Z., Wang, W., Dammer, K.-H., Guo, L., & Cao, Z. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2021.753603 · Cited by 41 · see citing works
Koo, Y., Kim, S., & Ha, Y.-G. (2020) · World Wide Web · doi:10.1007/s11280-020-00778-y · Cited by 28 · see citing works
Hierarchical Modified Fast R-CNN for Object Detection
Chaudhuri, A. (2021) · Informatica · doi:10.31449/inf.v45i7.3732 · Cited by 15 · see citing works
Ademola, O. A., Leier, M., & Petlenkov, E. (2021) · Sensors · doi:10.3390/s21227529 · Cited by 12 · see citing works
Feature Selection Module for CNN Based Object Detector
Ma, Y., & Zhang, S. (2021) · IEEE Access · doi:10.1109/access.2021.3073565 · Cited by 10 · see citing works
Ball Detection Using Deep Learning Implemented on an Educational Robot Based on Raspberry Pi
Keča, D., Kunović, I., Matić, J., & Kržić, A. S. (2023) · Sensors · doi:10.3390/s23084071 · Cited by 10 · see citing works
Real-Time Sound Recognition System for Human Care Robot Considering Custom Sound Events
Kim, S.-H., Nam, H., Choi, S., & Park, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3378096 · Cited by 10 · see citing works
TORSO-21 Dataset: Typical Objects in RoboCup Soccer 2021
Bestmann, M., Engelke, T., Fiedler, N., Güldenstein, J., Gutsche, J., Hagge, J., & Vahl, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98682-7_6 · Cited by 10 · see citing works
A comprehensive review of ball detection techniques in sports
Moreira, C., Ferreira, L., & Coelho, P. J. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3079 · Cited by 7 · see citing works
Ball Detection Algorithms Enhancement in Sport Robots
Esfandiarpour, M., Mirshabani, S. M., & Miandoab, E. M. (2024) · Iranian Conference on Machine Vision and Image Processing · doi:10.1109/mvip62238.2024.10491187 · Cited by 7 · see citing works
High-Precision Binary Object Detector Based on a BSF-XNOR Convolutional Layer
Wang, S., Zhang, C., Su, D., Wang, L., & Jiang, H. (2021) · IEEE Access · doi:10.1109/access.2021.3099702 · Cited by 7 · see citing works
XNOR-YOLO: The High Precision of The Ball and Goal Detecting on The Barelang-FC Robot Soccer
Susanto, S., Putra, F. A., & Analia, R. (2020) · International Conference on Applied Engineering (ICAE) · doi:10.1109/icae50557.2020.9350386 · Cited by 5 · see citing works
Towards a Real-Time, Low-Resource, End-to-End Object Detection Pipeline for Robot Soccer
Narayanaswami, S. K., Tec, M., Durugkar, I., Desai, S., Masetty, B., Narvekar, S., & Stone, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28469-4_6 · Cited by 3 · see citing works
Low-Complexity Vision-Based Food Recognition for IoT-Driven Refrigerator Inventory Systems
Taaki, Z., & Bohlooli, A. (2025) · doi:10.1109/iot69654.2025.11297620
YOLO-P1P2-CBAM: improving YOLO11 soccer ball detection using extra high-resolution heads and CBAM
Ogli, B. S. A., Ogli, A. M. M., & Nishanov, A. (2026) · doi:10.70413/zdaf-v05-i10-s40271
Soccer-DETR: A deep learning-based transformer model for soccer player and ball detection
Du, X., Yuan, X., Wang, T., Wu, J., & Gao, L. (2026) · Array · doi:10.1016/j.array.2026.101354
- Authors
- Barry, D., Shah, M., Keijsers, M., Khan, H., & Hopman, B.
- Affiliations
- University of Canterbury (NZ)
- Venue
- 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ)
- Publisher
- IEEE
- Published
- 2019-12
- Pages
- 1-6
- OpenAlex
- W2980154845
- Cited by
- 19
- References
- 24
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 3
- FWCI
- 0.81
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International Conference on Image and Vision Computing New Zealand (IVCNZ) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Smart Agriculture and AI
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- Tiny-YOLO, real-time object detection, humanoid soccer robot, Raspberry Pi, edge computing, dark web, goal detection, ball detection, annotated dataset, inference acceleration, autonomous robots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review