Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Driving in busy highways and roads is becoming complex and challenging, as more cars are hitting the roads. Safe driving requires attentive drivers, quality perception of the environment, awareness of the situation, and critical decision making to react properly in emergency situations. This paper provides an overview on driver safety monitoring systems. We study various driver sources of inattention while providing a comprehensive taxonomy. Then, different safety systems that tackle driver inattention are reported. Furthermore, we present the new generation of driver monitoring systems within the context of Internet of Cars. Thus, we introduce the concept of integrated safety, where smart cars collect information from the driver, the car, the road, and, most importantly, the surrounding cars to build an efficient environment for the driver. We conclude by highlighting issues and emerging trends envisioned by the research community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Klauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006) · PsycEXTRA Dataset · doi:10.1037/e729262011-001 · Cited by 1,669
Driver Inattention Monitoring System for Intelligent Vehicles: A Review
Dong, Y., Hu, Z., Uchimura, K., & Murayama, N. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2092770 · Cited by 723 · cited 1×
“To detect whether a driver is fatigued or not, the following symptoms have to be recognized [24]: repeated yawning; confusion and thinking seems foggy; feeling depressed and irritable; slower reaction and responses; daydreaming; difficulty keeping eyes open; lazy steering; difficulty maintaining concentration;”
BackgroundAn overview of Internet of Vehicles
Yang, F., Wang, S., Li, J., Liu, Z., & Sun, Q. (2014) · China Communications · doi:10.1109/cc.2014.6969789 · Cited by 665 · cited 1×
“” Hence, cars are evolving from mobile nodes that can disseminate information to intelligent agents with powerful sensing, reasoning, and decision capabilities [52].”
BackgroundDriver distraction and driver inattention: Definition, relationship and taxonomy
Regan, M. A., Hallett, C., & Gordon, C. P. (2011) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.04.008 · Cited by 502 · cited 2×
“Based on the definitions provided in [4] and [5], we conclude that there are similarities between the two set of definitions: DDA-NDR is similar to secondary task distraction, while DRA is similar to drowsiness.”
BackgroundKoesdwiady, A., Soua, R., & Karray, F. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2585575 · Cited by 367 · cited 1×
“The analysis of this mixture of pertinent data can provide drivers unique insights regarding the types of roads in his trip and traffic conditions [74], [75].”
BackgroundSelf-citationLee, J. D., Young, K. L., & Regan, M. (2008) · CRC Press eBooks · doi:10.1201/9781420007497.ch3 · Cited by 305 · cited 1×
“The most accepted definition of driver distraction is ”a diversion of attention away from activities critical for safe driving toward a competing activity” [6].”
Background(2001) · Cited by 281
Jung, S., Shin, H., & Chung, W. (2014) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2012.0032 · Cited by 269 · cited 3×
“[45] real-world - nonintrusive - lack of generalization due to the limited datasets”
BackgroundMethodInfluentialGerla, M. (2012) · 2012 The 11th Annual Mediterranean Ad Hoc Networking Workshop (Med-Hoc-Net) · doi:10.1109/medhocnet.2012.6257116 · Cited by 257
Li, G., & Chung, W.-Y. (2013) · Sensors · doi:10.3390/s131216494 · Cited by 216 · cited 5×
“[31] B.-G. Lee and W.-Y. Chung, “Driver alertness monitoring using fusion of facial features and bio-signals,” IEEE Sens. J., vol. 12, no. 7, pp. 2416–2422, Jul. 2012.”
BackgroundInfluentialAutomated Detection of Driver Fatigue Based on Entropy and Complexity Measures
Zhang, C., Wang, H., & Fu, R. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2275192 · Cited by 215 · cited 1×
“A real-time driving fatigue identification based on EEG, EMG, and EOG, is designed by [46].”
MethodContext-Aware Driver Behavior Detection System in Intelligent Transportation Systems
Al-Sultan, S., Al-Bayatti, A. H., & Zedan, H. (2013) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2013.2263400 · Cited by 214 · cited 1×
“[51] introduce a driver state detection system based on a context-aware system in VANET.”
MethodDriver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals
Lee, B.-G., & Chung, W.-Y. (2012) · IEEE Sensors Journal · doi:10.1109/jsen.2012.2190505 · Cited by 195 · cited 6×
“[31] B.-G. Lee and W.-Y. Chung, “Driver alertness monitoring using fusion of facial features and bio-signals,” IEEE Sens. J., vol. 12, no. 7, pp. 2416–2422, Jul. 2012.”
BackgroundInfluentialReal-Time Detection System of Driver Distraction Using Machine Learning
Tango, F., & Botta, M. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2247760 · Cited by 192 · cited 2×
“[11] simulation - model personalization - delay of distraction detection”
MethodSteering Wheel Behavior Based Estimation of Fatigue
Krajewski, J., Sommer, D., Trutschel, U. E., Edwards, D., & Gölz, M. (2009) · International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design (Driving Assessment Conference) · doi:10.17077/drivingassessment.1311 · Cited by 184 · cited 1×
“In [26], a fatigued driving monitoring system based on a pattern of slow drifting and fast corrective”
MethodOn-Line Detection of Drowsiness Using Brain and Visual Information
Picot, A., Charbonnier, S., & Caplier, A. (2011) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2011.2164242 · Cited by 182 · cited 1×
“Besides, a system that combines EEG and visual activity to detect fatigued driving is designed in [47].”
BackgroundOnline Driver Distraction Detection Using Long Short-Term Memory
Wollmer, M., Blaschke, C., Schindl, T., Schuller, B., Farber, B., Mayer, S., & Trefflich, B. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2119483 · Cited by 178 · cited 3×
“It is claimed in [12] that the proposed LSTM framework outperforms”
BackgroundMethodInfluentialVision-based method for detecting driver drowsiness and distraction in driver monitoring system
Jo, J., Lee, S. J., Kim, J., Jung, H. G., & Park, K. R. (2011) · Optical Engineering · doi:10.1117/1.3657506 · Cited by 155 · cited 2×
“• Eye status detection In [14], a vision-based driver monitoring system is introduced.”
BackgroundUnobtrusive drowsiness detection by neural network learning of driver steering
Sayed, R. A., & Eskandarian, A. (2001) · Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering · doi:10.1243/0954407011528536 · Cited by 127 · cited 1×
“Another work employing steering wheel data to detect fatigued driving is proposed in [27].”
MethodAutomatic Accident Detection: Assistance Through Communication Technologies and Vehicles
Fogue, M., Garrido, P., Martínez, F. J., Cano, J., Calafate, C. T., & Manzoni, P. (2012) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2012.2203877 · Cited by 125 · cited 1×
“The first hour after the crash is called the golden hour where the mortality incidence is very high (about 75% of all deaths) [3].”
BackgroundPERCLOS: A Valid Psychophysiological Measure of Alertness As Assessed by Psychomotor Vigilance
(1998) · PsycEXTRA Dataset · doi:10.1037/e509282006-001 · Cited by 122
Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks
Ersal, T., Fuller, H. J. A., Tsimhoni, O., Stein, J. L., & Fathy, H. K. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2049741 · Cited by 119 · cited 1×
“[58] use a radial-basis neural network to model this aspect.”
MethodA hybrid Bayesian Network approach to detect driver cognitive distraction
Liang, Y., & Lee, J. D. (2013) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2013.10.004 · Cited by 117 · cited 2×
“[20] simulation - multimodal information - lack of generalization due to the limited datasets”
BackgroundA Multi-Modal Driver Fatigue and Distraction Assessment System
Craye, C., Rashwan, A. M., Kamel, M. S., & Karray, F. (2015) · International Journal of Intelligent Transportation Systems Research · doi:10.1007/s13177-015-0112-9 · Cited by 105 · cited 2×
“[21] simulation - multi-modal information - capability to detect specific driving distractions - lack of generalization due to the limited datasets - partially intrusive”
BackgroundSelf-citationDaza, I. G., Bergasa, L. M., Bronte, S., Yebes, J. J., Almazán, J., & Arroyo, R. (2014) · Sensors · doi:10.3390/s140101106 · Cited by 90 · cited 1×
“fusion of driver physiological and driving performance measures is introduced in [49].”
BackgroundBig-data-generated traffic flow prediction using deep learning and dempster-shafer theory
Soua, R., Koesdwiady, A. B., & Karray, F. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727607 · Cited by 82 · cited 1×
“The analysis of this mixture of pertinent data can provide drivers unique insights regarding the types of roads in his trip and traffic conditions [74], [75].”
BackgroundSelf-citationDriver inattention detection through intelligent analysis of readily available sensors
Torkkola, K., Massey, N., & Wood, C. (2005) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2004.1398919 · Cited by 72
PROUD-Public road urban driverless test: Architecture and results
Broggi, A., Cerri, P., Debattisti, S., Laghi, M. C., Medici, P., Panciroli, M., & Prioletti, A. (2014) · 2014 IEEE Intelligent Vehicles Symposium Proceedings · doi:10.1109/ivs.2014.6856478 · Cited by 67 · cited 1×
“The first test of self-driving car in open public road was held in Parma, Italy on July 2013 [67].”
BackgroundFatigue Detection using Smartphones
Hu, J. (2013) · Journal of Ergonomics · doi:10.4172/2165-7556.1000120 · Cited by 53 · cited 1×
“Another smartphonebased driver fatigue detection technique is developed in [32].”
MethodA Visual-Based Driver Distraction Recognition and Detection Using Random Forest
Ragab, A., Craye, C., Kamel, M. S., & Karray, F. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11758-4_28 · Cited by 47 · cited 2×
“[17] gather data using the system designed by authors of [18].”
BackgroundMethodSelf-citationDriver fatigue detection using steering grip force
Chieh, T. C., Mustafa, M. M., Hussain, A., Zahedi, E., & Majlis, B. Y. (2005) · IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored.2003.1459661 · Cited by 43 · cited 1×
“4) Pressure sensors: Another method to detect fatigued driving is based on pressure sensors [41].”
MethodGallahan, S. L., Golzar, G. F., Jain, A., Samay, A. E., Trerotola, T. J., Weisskopf, J. G., & Lau, N. K. C. (2013) · Systems and Information Engineering Design Symposium · doi:10.1109/sieds.2013.6549497 · Cited by 42 · cited 1×
“[13] simulation - capability to detect specific driving distractions - limited behavioral scenarios”
BackgroundAzman, A., Meng, Q., & Edirisinghe, E. A. (2010) · International Conference on Advanced Computer Theory and Engineering · doi:10.1109/icacte.2010.5579547 · Cited by 39 · cited 2×
“[16] simulation - multimodal information - lack of generalization due to the limited datasets”
BackgroundWhat Drives Distraction? Distraction as a Breakdown of Multilevel Control
Lee, J. D., Regan, M., & Young, K. L. (2008) · CRC Press eBooks · doi:10.1201/9781420007497.ch4 · Cited by 35
Huang, Q. (2017) · Chinese Journal of Communication · doi:10.1080/17544750.2017.1328452 · Cited by 33
Towards cooperative, predictive driver assistance
Sivaraman, S., & Trivedi, M. M. (2013) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2013.6728477 · Cited by 26 · cited 2×
“Cooperative and predictive driver assistance: progression improvements [56].”
BackgroundReal Time Eyes Tracking and Classification for Driver Fatigue Detection
Khan, M. I., & Mansoor, A. B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69812-8_72 · Cited by 25 · cited 3×
“Khan and Mansoor [35] design a cross-correlation function-based classifier to classify eyelid movement.”
BackgroundInfluentialFundamentals of Driver Assistance
Eskandarian, A. (2012) · Springer eBooks · doi:10.1007/978-0-85729-085-4_19 · Cited by 19 · cited 5×
“This classification is based on the study carried out by Eskandarian [2].”
BackgroundMethodInfluentialDriver fatigue surveillance via eye detection
Chang, T., & Chen, Y. (2014) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957718 · Cited by 15 · cited 1×
“In [34], the authors resort to an infrared camerabased driver fatigue surveillance system.”
BackgroundDetecting driver fatigue based on nonlinear speech processing and fuzzy SVM
Li, X., Tan, N., Wang, T., & Su, S. (2014) · doi:10.1109/icosp.2014.7015057 · Cited by 14 · cited 2×
“[36] proposes a speechbased fatigued driving monitoring system.”
BackgroundNon-intrusive Detection of Driver Distraction using Machine Learning Algorithms
Tango, F., Marco, B., Minin, L., & Roberto, M. (2010) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-606-5-157 · Cited by 14
Hirayama, T., Mase, K., & Takeda, K. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338634 · Cited by 14 · cited 2×
“[19] real-world - multimodal information - lack of generalization due to the limited datasets”
BackgroundSalvucci, D. D. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466427 · Cited by 14 · cited 1×
“Authors in [57] demonstrate that focusing only on cognition and behavior of the driver is not sufficient.”
BackgroundA model for situation and threat/impact assessment in vehicular ad-hoc networks
Golestan, K., Soua, R., Karray, F., & Kamel, M. S. (2014) · Design and Analysis of Intelligent Vehicular Networks and Applications · doi:10.1145/2656346.2656356 · Cited by 7 · cited 2×
“In [61], authors propose a holistic Attention Assist Framework (AFF) that encompasses the main aspects of integrated safety and models them using the HLIF techniques.”
BackgroundSelf-citationDriver Inattention Detection System: A PSO-Based Multiview Classification Approach
Koesdwiady, A. B., Abdelmoula, R., Karray, F., & Kamel, M. S. (2015) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2015.264 · Cited by 6 · cited 1×
“[42] simulation - capability to detect specific both driving distractions and fatigue - lack of generalization due to the limited datasets”
BackgroundSelf-citation
Cited by
Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach
Xing, Y., Lv, C., Wang, H., Cao, D., Velenis, E., & Wang, F.-Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2908425 · Cited by 399
Rotational energy harvesting for self-powered sensing
Fu, H., Mei, X., Yurchenko, D., Zhou, S., Theodossiades, S., Nakano, K., & Yeatman, E. M. (2021) · Joule · doi:10.1016/j.joule.2021.03.006 · Cited by 337
Driver Lane Change Intention Inference for Intelligent Vehicles: Framework, Survey, and Challenges
Xing, Y., Lv, C., Wang, H., Wang, H., Ai, Y., Cao, D., Velenis, E., & Wang, F.-Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2903299 · Cited by 274
Peer-to-Peer Federated Continual Learning for Naturalistic Driving Action Recognition
Yuan, L., Ma, Y., Su, L., & Wang, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00553 · Cited by 45
“While driver monitoring applications are moving towards multimodal options [16], computer vision (CV) remains the most popular methodology for driver monitoring applications due to its maturity and high-performance system designs.”
Background
Metadata
- Authors
- Koesdwiady, A., Soua, R., Karray, F., & Kamel, M. S.
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2017-06
- Volume
- 66
- Issue
- 6
- Pages
- 4550-4563
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2556398113
- Cited by
- 168
- References
- 45
- FWCI
- 12.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.