The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Deep Learning for Large-Scale Traffic-Sign Detection and Recognition
Open accessAbstract
Automatic detection and recognition of traffic signs plays a crucial role in management of the traffic-sign inventory. It provides an accurate and timely way to manage traffic-sign inventory with a minimal human effort. In the computer vision community, the recognition and detection of traffic signs are a well-researched problem. A vast majority of existing approaches perform well on traffic signs needed for advanced driver-assistance and autonomous systems. However, this represents a relatively small number of all traffic signs (around 50 categories out of several hundred) and performance on the remaining set of traffic signs, which are required to eliminate the manual labor in traffic-sign inventory management, remains an open question. In this paper, we address the issue of detecting and recognizing a large number of traffic-sign categories suitable for automating traffic-sign inventory management. We adopt a convolutional neural network (CNN) approach, the mask R-CNN, to address the full pipeline of detection and recognition with automatic end-to-end learning. We propose several improvements that are evaluated on the detection of traffic signs and result in an improved overall performance. This approach is applied to detection of 200 traffic-sign categories represented in our novel dataset. The results are reported on highly challenging traffic-sign categories that have not yet been considered in previous works. We provide comprehensive analysis of the deep learning method for the detection of traffic signs with a large intra-category appearance variation and show below 3% error rates with the proposed approach, which is sufficient for deployment in practical applications of the traffic-sign inventory management.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition
Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.016 · Cited by 1,537
The German Traffic Sign Recognition Benchmark: A multi-class classification competition
Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033395 · Cited by 1,144
Traffic-Sign Detection and Classification in the Wild
Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., & Hu, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.232 · Cited by 1,062
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057
Detection of traffic signs in real-world images: The German traffic sign detection benchmark
Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., & Igel, C. (2013) · The 2013 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706807 · Cited by 972
Traffic sign recognition with multi-scale Convolutional Networks
Sermanet, P., & LeCun, Y. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033589 · Cited by 759
Mogelmose, A., Trivedi, M. M., & Moeslund, T. B. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2209421 · Cited by 684
Real-Time Detection and Recognition of Road Traffic Signs
Greenhalgh, J., & Mirmehdi, M. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2208909 · Cited by 384
A committee of neural networks for traffic sign classification
Ciresan, D., Meier, U., Masci, J., & Schmidhuber, J. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033458 · Cited by 378
Traffic sign recognition — How far are we from the solution?
Mathias, M., Timofte, R., Benenson, R., & Van Gool, L. (2013) · The 2013 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6707049 · Cited by 325
Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks
Jin, J., Fu, K., & Zhang, C. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2308281 · Cited by 310
An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine
Huang, Z., Yu, Y., Gu, J., & Liu, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2533424 · Cited by 281
Traffic sign detection and recognition using fully convolutional network guided proposals
Zhu, Y., Zhang, C., Zhou, D., Wang, X., Bai, X., & Liu, W. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.07.009 · Cited by 241
Using Fourier Descriptors and Spatial Models for Traffic Sign Recognition
Larsson, F., & Felsberg, M. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21227-7_23 · Cited by 200
Real-Time Traffic-Sign Recognition Using Tree Classifiers
Zaklouta, F., & Stanciulescu, B. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2225618 · Cited by 147
Multi-view traffic sign detection, recognition, and 3D localisation
Timofte, R., Zimmermann, K., & Gool, L. V. (2009) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2009.5403121 · Cited by 144
Traffic sign detection via interest region extraction
Salti, S., Petrelli, A., Tombari, F., Fioraio, N., & Stefano, L. D. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.05.017 · Cited by 132
Traffic sign segmentation and classification using statistical learning methods
Lillo-Castellano, J. M., Mora-Jiménez, I., Figuera, C., & Rojo‐Álvarez, J. L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.11.026 · Cited by 126
A novel traffic sign detection method via color segmentation and robust shape matching
Li, H., Sun, F., Liu, L., & Wang, L. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.12.111 · Cited by 124
Traffic sign detection based on convolutional neural networks
Wu, Y., Liu, Y., Li, J., Liu, H., & Hu, X. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706811 · Cited by 107
Traffic Sign Recognition Using Deep Convolutional Networks and Extreme Learning Machine
Zeng, Y., Xu, X., Fang, Y., & Zhao, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23989-7_28 · Cited by 99
Balali, V., Rad, A. A., & Golparvar‐Fard, M. (2015) · Visualization in Engineering · doi:10.1186/s40327-015-0027-1 · Cited by 88
Large scale sign detection using HOG feature variants
Overett, G., & Petersson, L. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940549 · Cited by 71
Balali, V., & Golparvar‐Fard, M. (2015) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000491 · Cited by 61
Traffic Sign Classification Using Deep Inception Based Convolutional NetworksPreprint
Haloi, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.02992 · Cited by 50
A computer vision assisted geoinformation inventory for traffic infrastructure
Segvic, S., Brkić, K., Kalafatić, Z., Stanisavljevic, V., Ševrović, M., Budimir, D., & Dadic, I. (2010) · 13th International IEEE Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2010.5624979 · Cited by 48
Traffic Sign Detection and Recognition using Features Combination and Random Forests
Ellahyani, A., Ansari, M. E., Ilyas, E. L., & Charfi, S. (2016) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2016.070193 · Cited by 45
Comparative Survey on Traffic Sign Detection and Recognition: a Review
Wali, S. B. (2015) · PRZEGLĄD ELEKTROTECHNICZNY · doi:10.15199/48.2015.12.08 · Cited by 38
Supervised Low-Rank Matrix Recovery for Traffic Sign Recognition in Image Sequences
Pei, D., Sun, F., & Liu, H. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2241760 · Cited by 26
A novel pLSA based Traffic Signs Classification SystemPreprint
Haloi, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.06643 · Cited by 21
Color fused multiple features for traffic sign recognition
Yang, X., Qu, Y., & Fang, S. (2012) · International Conference on Internet Multimedia Computing and Service · doi:10.1145/2382336.2382360 · Cited by 14
Visual Analysis in Traffic & Re-identification
Møgelmose, A. (2015) · VBN Forskningsportal (Aalborg Universitet) · doi:10.5278/vbn.phd.engsci.00026 · Cited by 5
Convolutional Neural Networks for Croatian Traffic Signs Recognition
Vukotić, V., Krapac, J., & Šegvić, S. (2014) · Proceedings of the Croatian Computer Vision Workshop · doi:10.20532/ccvw.2014.0016 · Cited by 3
Cited by
Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions
Muhammad, K., Ullah, A., Lloret, J., Ser, J. D., & de Albuquerque, V. H. C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3032227 · Cited by 659
A Cascaded R-CNN With Multiscale Attention and Imbalanced Samples for Traffic Sign Detection
Zhang, J., Xie, Z., Sun, J., Zou, X., & Wang, J. (2020) · IEEE Access · doi:10.1109/access.2020.2972338 · Cited by 315
Recent Advancements in End-to-End Autonomous Driving Using Deep Learning: A Survey
Chib, P. S., & Singh, P. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3318070 · Cited by 301
A Survey on Intelligent Internet of Things: Applications, Security, Privacy, and Future Directions
Aouedi, O., Vu, T.-H., Sacco, A., Nguyen, D. C., Piamrat, K., Marchetto, G., & Pham, Q.-V. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3430368 · Cited by 277
Efficient Federated Learning With Spike Neural Networks for Traffic Sign Recognition
Xie, K., Zhang, Z., Li, B., Kang, J., Niyato, D., Xie, S., & Wu, Y. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3178808 · Cited by 128
Metadata
- Authors
- Tabernik, D., & Skocaj, D.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2020-04
- Volume
- 21
- Issue
- 4
- Pages
- 1427-1440
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2935077499
- Cited by
- 369
- References
- 40
- FWCI
- 14.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.