Deep Learning Framework for Vehicle and Pedestrian Detection in Rural Roads on an Embedded GPU
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Object detection, one of the most fundamental and challenging problems in computer vision. Nowadays some dedicated embedded systems have emerged as a powerful strategy for deliver high processing capabilities including the NVIDIA Jetson family. The aim of the present work is the recognition of objects in complex rural areas through an embedded system, as well as the verification of accuracy and processing time. For this purpose, a low power embedded Graphics Processing Unit (Jetson Nano) has been selected, which allows multiple neural networks to be run in simultaneous and a computer vision algorithm to be applied for image recognition. As well, the performance of these deep learning neural networks such as ssd-mobilenet v1 and v2, pednet, multiped and ssd-inception v2 has been tested. Moreover, it was found that the accuracy and processing time were in some cases improved when all the models suggested in the research were applied. The pednet network model provides a high performance in pedestrian recognition, however, the sdd-mobilenet v2 and ssd-inception v2 models are better at detecting other objects such as vehicles in complex scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723 · cited 1×
“…vision systems has been the automatic processing, analysis and interpretation of images [2], to be precise with some classic algorithms including: local descriptor [3], Haar like features [4], SIFT [5], Shape Contexts [6], Histogram of Gradients (HOG) [7] and Local Binary Patterns (LBP) [8].”
MethodShape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · cited 5×
“Some deep neural network architectures have been proposed in the past [9], however, we have focused our implementation on the latest architectures that are rapid and well described in [46,47].”
BackgroundMethodInfluentialDeep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“Some deep neural network architectures have been proposed in the past [9], however, we have focused our implementation on the latest architectures that are rapid and well described in [46,47].”
Method
Research works printed but not linked: 30
- Talukdar, J., Gupta, S., Rajpura, P., and Hegde, R. (2018, January 22–23). Transfer Learning for Object Detection using State-of-the-Art Deep Neural Networks. Proceedings of the 2018 5th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India. · DOI
- Mauri, A., Khemmar, R., Decoux, B., Ragot, N., Rossi, R., Trabelsi, R., Boutteau, R., Ertaud, J., and Savatier, X. (2020). Deep Learning for Real-Time 3D Multi-Object Detection, Localisation, and Tracking: Application to Smart Mobility. Sensors, 20. · DOI
- Viola, P., and Jones, M. (2001, January 8–14). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA.
- Ojala, 2002, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Trans. Pattern Anal. Mach. Intell., 24, 971, 10.1109/TPAMI.2002.1017623 · DOI · Paper page
- Feng, 2019, Computer vision algorithms and hardware implementations: A survey, Integr. VLSI J., 69, 309, 10.1016/j.vlsi.2019.07.005 · DOI · Paper page
- Nickolls, 2008, Scalable parallel programming with CUDA, ACM Queue, 6, 40, 10.1145/1365490.1365500 · DOI · Paper page
- Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E. (2014). cudnn: Efficient primitives for deep learning. arXiv.
- Zhang, 2019, Deep learning in mobile and wireless networking: A survey, IEEE Commun. Surv. Tutor., 21, 2224, 10.1109/COMST.2019.2904897 · DOI · Paper page
- HajiRassouliha, 2018, Suitability of recent hardware accelerators (DSPs, FPGAs, and GPUs) for computer vision and image processing algorithms, Signal Process. Image Commun., 68, 101, 10.1016/j.image.2018.07.007 · DOI · Paper page
- Basulto-Lantsova, A., Padilla-Medina, J., Perez-Pinal, F., and Barranco-Gutierrez, A. (2020, January 6–8). Performance comparative of OpenCV Template Matching method on Jetson TX2 and Jetson Nano developer kits. Proceedings of the 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA. · DOI
- Wang, 2016, Deep learning in object recognition, detection, and segmentation, Found. Trends Signal Process, 8, 217, 10.1561/2000000071 · DOI
- Pathak, 2018, Application of Deep Learning for Object Detection, Procedia Comput. Sci., 132, 1706, 10.1016/j.procs.2018.05.144 · DOI · Paper page
- Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., and Berg, A.C. (2016, January 8–16). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands. · DOI · Paper page
- Shafiee, M., Chywl, B., Li, F., and Wong, A. (2017). Fast YOLO: A fast you only look once system for real-time embedded object detection in video. arXiv. · DOI · Paper page
- Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24–27). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. · DOI · Paper page
- Yoneda, K., Suganuma, N., and Aldibaja, M. (2016, January 15–17). Simultaneous state recognition for multiple traffic signals on urban road. Proceedings of the 2016 11th France-Japan 9th Europe-Asia Congress on Mechatronics (MECATRONICS)/17th International Conference on Research and Education in Mechatronics (REM), Compiegne, France. · DOI
- Zhou, Y., Chen, Z., and Huang, X. (2016, January 22–25). A system-on-chip FPGA design for real-time traffic signal recognition system. Proceedings of the 2016 IEEE International Symposium on Circuits and Systems (ISCAS), Montreal, QC, Canada. · DOI
- Lee, S., Kim, J., Shin Yoon, J., Shin, S., Bailo, O., Kim, N., Lee, T., Hong, H., Han, S., and Kweon, I. (2017, January 22–29). Vpgnet: Vanishing point guided network for lane and road marking detection and recognition. Proceedings of the IEEE International Conference on Computer Vision, Venecia, Italy. · DOI · Paper page
- Ozgunalp, 2016, Multiple lane detection algorithm based on novel dense vanishing point estimation, IEEE Trans. Intell. Transp. Syst., 18, 621, 10.1109/TITS.2016.2586187 · DOI
- Krasner, G., and Katz, E. (2016, January 16–18). Automatic parking identification and vehicle guidance with road awareness. Proceedings of the 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE), Eilat, Israel. · DOI
- Sistu, G., Leang, I., and Yogamani, S. (2019). Real-time joint object detection and semantic segmentation network for automated driving. arXiv. · doi:10.5220/0007248401730180
- Barba Guamán, L. (2015). Utilización de métodos de visión artificial para pc como apoyo en la automoción. [Master’s Thesis, Polytechnic University of Madrid].
- Son, 2015, Design and implementation of real-time vehicular camera for driver assistance and traffic congestion estimation, Sensors, 15, 20204, 10.3390/s150820204 · DOI
- Seo, Y., and Rajkumar, R. (2014, January 7–10). Detection and tracking of boundary of unmarked roads. Proceedings of the 17th International Conference on Information Fusion (FUSION), Salamanca, Spain.
- Yadav, S., Patra, S., Arora, C., and Banerjee, S. (2017, January 17–20). Deep CNN with color lines model for unmarked road segmentation. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China. · DOI
- Carlino, A., Altomare, L., Darin, M., Visintainer, F., and Marchetto, A. (2015). Automotive LIDAR-Based Strategies for Obstacle Detection Application in Rural and Secondary Roads. Advanced Microsystems for Automotive Applications, Springer. Lecture Notes in Mobility. · DOI
- Yadav, 2018, Rural Road Surface Extraction Using Mobile LiDAR Point Cloud Data, Indian Soc. Remote Sens., 46, 531, 10.1007/s12524-017-0732-4 · doi:10.1007/s12524-017-0732-4
- Fawzi, A., Samulowitz, H., Turaga, D., and Frossard, P. (2016, January 25–28). Adaptive data augmentation for image classification. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA. · DOI · Paper page
- Ning, C., Zhou, H., Song, Y., and Tang, J. (2017, January 10–14). Inception Single Shot MultiBox Detector for object detection. Proceedings of the 2017 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Hong Kong, China.
- Ullah, M., Mohammed, A., and Alaya Cheikh, F. (2018). PedNet: A Spatio-Temporal Deep Convolutional Neural Network for Pedestrian Segmentation. Imaging, 4. · DOI · Paper page
Cited by
Singh, R., Sharma, R., Vaseem Akram, S., Gehlot, A., Buddhi, D., Malik, P. K., & Arya, R. (2021) · Safety Science · doi:10.1016/j.ssci.2021.105407 · Cited by 163
Smart Video Surveillance System Based on Edge Computing
Cob-Parro, A. C., Losada-Gutiérrez, C., Marrón-Romera, M., Gardel-Vicente, A., & Bravo-Muñoz, I. (2021) · Sensors · doi:10.3390/s21092958 · Cited by 84
“Apart from the rasberri pi, there are other hardware systems such as the NVIDIA Jetson Nano, which contains an internal GPU that allows the inference of networks with ease as in the case of [50].”
MethodMohan, H. M., Anitha, S., Chai, R., & Ling, S. H. (2021) · Advances in Human-Computer Interaction · doi:10.1155/2021/6483003 · Cited by 18
Deep Learning Approaches for Vehicle and Pedestrian Detection in Adverse Weather
Zaman, M., Saha, S., Zohrabi, N., & Abdelwahed, S. (2023) · 2023 IEEE Transportation Electrification Conference & Expo (ITEC) · doi:10.1109/itec55900.2023.10187020 · Cited by 13
Metadata
- Authors
- Barba-Guaman, L., Eugenio Naranjo, J., & Ortiz, A.
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2020-03-31
- Volume
- 9
- Issue
- 4
- Pages
- 589
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3014364594
- Cited by
- 82
- References
- 14
- FWCI
- 6.13
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.