CoChat

Deep Learning Framework for Vehicle and Pedestrian Detection in Rural Roads on an Embedded GPU

Open access
Barba-Guaman, Luis, Eugenio Naranjo, José, Ortiz, Anthony · 2020 · Electronics
Cited by 82

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Abstract

Object detection, one of the most fundamental and challenging problems in computer vision. Nowadays some dedicated embedded systems have emerged as a powerful strategy for deliver high processing capabilities including the NVIDIA Jetson family. The aim of the present work is the recognition of objects in complex rural areas through an embedded system, as well as the verification of accuracy and processing time. For this purpose, a low power embedded Graphics Processing Unit (Jetson Nano) has been selected, which allows multiple neural networks to be run in simultaneous and a computer vision algorithm to be applied for image recognition. As well, the performance of these deep learning neural networks such as ssd-mobilenet v1 and v2, pednet, multiped and ssd-inception v2 has been tested. Moreover, it was found that the accuracy and processing time were in some cases improved when all the models suggested in the research were applied. The pednet network model provides a high performance in pedestrian recognition, however, the sdd-mobilenet v2 and ssd-inception v2 models are better at detecting other objects such as vehicles in complex scenarios.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/electronics9040589

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 14 references

Research works printed but not linked: 30

  1. Talukdar, J., Gupta, S., Rajpura, P., and Hegde, R. (2018, January 22–23). Transfer Learning for Object Detection using State-of-the-Art Deep Neural Networks. Proceedings of the 2018 5th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India. · DOI
  2. Mauri, A., Khemmar, R., Decoux, B., Ragot, N., Rossi, R., Trabelsi, R., Boutteau, R., Ertaud, J., and Savatier, X. (2020). Deep Learning for Real-Time 3D Multi-Object Detection, Localisation, and Tracking: Application to Smart Mobility. Sensors, 20. · DOI
  3. Viola, P., and Jones, M. (2001, January 8–14). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA.
  4. Ojala, 2002, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Trans. Pattern Anal. Mach. Intell., 24, 971, 10.1109/TPAMI.2002.1017623 · DOI · Paper page
  5. Feng, 2019, Computer vision algorithms and hardware implementations: A survey, Integr. VLSI J., 69, 309, 10.1016/j.vlsi.2019.07.005 · DOI · Paper page
  6. Nickolls, 2008, Scalable parallel programming with CUDA, ACM Queue, 6, 40, 10.1145/1365490.1365500 · DOI · Paper page
  7. Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E. (2014). cudnn: Efficient primitives for deep learning. arXiv.
  8. Zhang, 2019, Deep learning in mobile and wireless networking: A survey, IEEE Commun. Surv. Tutor., 21, 2224, 10.1109/COMST.2019.2904897 · DOI · Paper page
  9. HajiRassouliha, 2018, Suitability of recent hardware accelerators (DSPs, FPGAs, and GPUs) for computer vision and image processing algorithms, Signal Process. Image Commun., 68, 101, 10.1016/j.image.2018.07.007 · DOI · Paper page
  10. Basulto-Lantsova, A., Padilla-Medina, J., Perez-Pinal, F., and Barranco-Gutierrez, A. (2020, January 6–8). Performance comparative of OpenCV Template Matching method on Jetson TX2 and Jetson Nano developer kits. Proceedings of the 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA. · DOI
  11. Wang, 2016, Deep learning in object recognition, detection, and segmentation, Found. Trends Signal Process, 8, 217, 10.1561/2000000071 · DOI
  12. Pathak, 2018, Application of Deep Learning for Object Detection, Procedia Comput. Sci., 132, 1706, 10.1016/j.procs.2018.05.144 · DOI · Paper page
  13. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., and Berg, A.C. (2016, January 8–16). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands. · DOI · Paper page
  14. Shafiee, M., Chywl, B., Li, F., and Wong, A. (2017). Fast YOLO: A fast you only look once system for real-time embedded object detection in video. arXiv. · DOI · Paper page
  15. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24–27). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. · DOI · Paper page
  16. Yoneda, K., Suganuma, N., and Aldibaja, M. (2016, January 15–17). Simultaneous state recognition for multiple traffic signals on urban road. Proceedings of the 2016 11th France-Japan 9th Europe-Asia Congress on Mechatronics (MECATRONICS)/17th International Conference on Research and Education in Mechatronics (REM), Compiegne, France. · DOI
  17. Zhou, Y., Chen, Z., and Huang, X. (2016, January 22–25). A system-on-chip FPGA design for real-time traffic signal recognition system. Proceedings of the 2016 IEEE International Symposium on Circuits and Systems (ISCAS), Montreal, QC, Canada. · DOI
  18. Lee, S., Kim, J., Shin Yoon, J., Shin, S., Bailo, O., Kim, N., Lee, T., Hong, H., Han, S., and Kweon, I. (2017, January 22–29). Vpgnet: Vanishing point guided network for lane and road marking detection and recognition. Proceedings of the IEEE International Conference on Computer Vision, Venecia, Italy. · DOI · Paper page
  19. Ozgunalp, 2016, Multiple lane detection algorithm based on novel dense vanishing point estimation, IEEE Trans. Intell. Transp. Syst., 18, 621, 10.1109/TITS.2016.2586187 · DOI
  20. Krasner, G., and Katz, E. (2016, January 16–18). Automatic parking identification and vehicle guidance with road awareness. Proceedings of the 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE), Eilat, Israel. · DOI
  21. Sistu, G., Leang, I., and Yogamani, S. (2019). Real-time joint object detection and semantic segmentation network for automated driving. arXiv. · doi:10.5220/0007248401730180
  22. Barba Guamán, L. (2015). Utilización de métodos de visión artificial para pc como apoyo en la automoción. [Master’s Thesis, Polytechnic University of Madrid].
  23. Son, 2015, Design and implementation of real-time vehicular camera for driver assistance and traffic congestion estimation, Sensors, 15, 20204, 10.3390/s150820204 · DOI
  24. Seo, Y., and Rajkumar, R. (2014, January 7–10). Detection and tracking of boundary of unmarked roads. Proceedings of the 17th International Conference on Information Fusion (FUSION), Salamanca, Spain.
  25. Yadav, S., Patra, S., Arora, C., and Banerjee, S. (2017, January 17–20). Deep CNN with color lines model for unmarked road segmentation. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China. · DOI
  26. Carlino, A., Altomare, L., Darin, M., Visintainer, F., and Marchetto, A. (2015). Automotive LIDAR-Based Strategies for Obstacle Detection Application in Rural and Secondary Roads. Advanced Microsystems for Automotive Applications, Springer. Lecture Notes in Mobility. · DOI
  27. Yadav, 2018, Rural Road Surface Extraction Using Mobile LiDAR Point Cloud Data, Indian Soc. Remote Sens., 46, 531, 10.1007/s12524-017-0732-4 · doi:10.1007/s12524-017-0732-4
  28. Fawzi, A., Samulowitz, H., Turaga, D., and Frossard, P. (2016, January 25–28). Adaptive data augmentation for image classification. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA. · DOI · Paper page
  29. Ning, C., Zhou, H., Song, Y., and Tang, J. (2017, January 10–14). Inception Single Shot MultiBox Detector for object detection. Proceedings of the 2017 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Hong Kong, China.
  30. Ullah, M., Mohammed, A., and Alaya Cheikh, F. (2018). PedNet: A Spatio-Temporal Deep Convolutional Neural Network for Pedestrian Segmentation. Imaging, 4. · DOI · Paper page

Cited by

Metadata

Authors
Barba-Guaman, L., Eugenio Naranjo, J., & Ortiz, A.
Venue
Electronics
Publisher
MDPI AG
Published
2020-03-31
Volume
9
Issue
4
Pages
589
ISSN
2079-9292 (ISSN-L)
OpenAlex
W3014364594
Cited by
82
References
14
FWCI
6.13
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.