Monitoring driver cognitive load using functional near infrared spectroscopy in partially autonomous cars
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
In partially automated cars, it is vital to understand the driver state, especially the driver's cognitive load. This might indicate whether the driver is alert or distracted, and if the car can safely transfer control of driving. In order to better understand the relationship between cognitive load and the driver performance in a partially autonomous vehicle, functional near infrared spectroscopy (fNIRS) measures were employed to study the activation of the prefrontal cortex of drivers in a simulated environment. We studied a total of 14 participants while they drove a partially autonomous car and performed common secondary tasks. We observed that when participants were asked to monitor the driving of an autonomous car they had low cognitive load compared to when the same participants were asked to perform a secondary reading or video watching task on a brought in device. This observation was in line with the increased drowsy behavior observed during intervals of autonomous system monitoring in previous studies. Results demonstrate that fNIRS signals from prefrontal cortex indicate additional cognitive load during manual driving compared to autonomous. Such brain function metrics could be used with minimally intrusive and low cost sensors to enable real-time assessment of driver state in future autonomous vehicles to improve safety and efficacy of transfer of control.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Even though some experimental systems can recognize driver-activity with a driver facing camera based on head and eye-tracking [289], and prepare the driver for handover with visual and auditory cues [290] in simulation environments, a real world system with an efficient handover interaction module does not exist at the moment.”
From A Survey of Autonomous Driving: Common Practices and Emerging Technologies (2020) · cites this paper as [289]
Citations
Cites
Effects of visual and cognitive load in real and simulated motorway driving
Engström, J., Johansson, E., & Östlund, J. (2005) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2005.04.012 · Cited by 834
Distracted Driving and Risk of Road Crashes among Novice and Experienced Drivers
Klauer, S. G., Guo, F., Simons-Morton, B. G., Ouimet, M. C., Lee, S. E., & Dingus, T. A. (2014) · New England Journal of Medicine · doi:10.1056/nejmsa1204142 · Cited by 801
Optical brain monitoring for operator training and mental workload assessment
Ayaz, H., Shewokis, P. A., Bunce, S., Izzetoglu, K., Willems, B., & Onaral, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.023 · Cited by 650 · cited 1×
“Pupil dilation, gaze directions and blink rate [12, 13] provide vital information into operator workload and have been used with high levels of success in detecting difficulty levels of in vehicle and driving tasks.”
BackgroundSelf-citationAlpha frequency, cognitive load and memory performance
Klimesch, W., Schimke, H., & Pfurtscheller, G. (1993) · Brain Topography · doi:10.1007/bf01128991 · Cited by 530 · cited 1×
“Physiological measures are used with increasing reliability to assess driver state indicators such as stress, alertness and cognitive load [9].”
BackgroundSensitivity of eye-movement measures to in-vehicle task difficulty
Victor, T. W., Harbluk, J. L., & Engström, J. A. (2005) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2005.04.014 · Cited by 492
Estimating alertness from the EEG power spectrum
Jung, T.-P., Makeig, S., Stensmo, M., & Sejnowski, T. J. (1997) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.553713 · Cited by 480
Physiological workload reactions to increasing levels of task difficulty
VELTMAN, J. A., & GAILLARD, A. W. K. (1998) · Ergonomics · doi:10.1080/001401398186829 · Cited by 433 · cited 1×
“Thus it is important to identify ways to monitor drivers’ cognitive load while performing secondary activities while the car drives.”
BackgroundEstimating cognitive load using remote eye tracking in a driving simulator
Palinko, O., Kun, A. L., Shyrokov, A., & Heeman, P. (2010) · Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications - ETRA '10 · doi:10.1145/1743666.1743701 · Cited by 371
Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS
Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F., & Schultz, T. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00935 · Cited by 365
Naseer, N., & Hong, K.-S. (2013) · Neuroscience Letters · doi:10.1016/j.neulet.2013.08.021 · Cited by 301
Mehler, B., Reimer, B., & Coughlin, J. F. (2012) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812442086 · Cited by 294
Putting the Brain to Work: Neuroergonomics Past, Present, and Future
Parasuraman, R., & Wilson, G. F. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288349 · Cited by 228
Using MazeSuite and Functional Near Infrared Spectroscopy to Study Learning in Spatial Navigation
Ayaz, H., Shewokis, P. A., Curtin, A., Izzetoglu, M., Izzetoglu, K., & Onaral, B. (2011) · Journal of Visualized Experiments · doi:10.3791/3443 · Cited by 203
Self-citationClassifying driver workload using physiological and driving performance data: two field studies
Solovey, E. T., Zec, M., Garcia Perez, E. A., Reimer, B., & Mehler, B. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557068 · Cited by 182
Distraction Becomes Engagement in Automated Driving
Miller, D., Sun, A., Johns, M., Ive, H. P., Sirkin, D. M., Aich, S., & Ju, W. G. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591362 · Cited by 162
Self-citationThe impact of secondary task cognitive processing demand on driving performance
Blanco, M., Biever, W. J., Gallagher, J., & Dingus, T. A. (2006) · Accident Analysis & Prevention · doi:10.1016/j.aap.2006.02.015 · Cited by 159
Human factors and safety in the design of intelligent vehicle-highway systems (IVHS)
Hancock, P. A., & Parasuraman, R. (1992) · Journal of Safety Research · doi:10.1016/0022-4375(92)90001-p · Cited by 154
Impulsitivity, caffeine, and task difficulty: A within-subjects test of the Yerkes-Dodson law
Anderson, K. J. (1994) · Personality and Individual Differences · doi:10.1016/0191-8869(94)90226-7 · Cited by 152
Dynamic difficulty using brain metrics of workload
Afergan, D., Peck, E. M., Solovey, E. T., Jenkins, A., Hincks, S. W., Brown, E. T., Chang, R., & Jacob, R. J. K. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557230 · Cited by 148
National Phone Survey on Distracted Driving Attitudes and Behaviors: (562822012-001)
Tison, J., Chaudhary, N., & Cosgrove, L. (2011) · PsycEXTRA Dataset · doi:10.1037/e562822012-001 · Cited by 126
College students’ prevalence and perceptions of text messaging while driving
Harrison, M. A. (2011) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.03.003 · Cited by 123
Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors
Ayaz, H., Willemi, B., Bunce, S. C., Shewokis, P. A., İzzetoğlu, K., Hah, S., Deshmukh, A., & Onaral, B. (2010) · Advances in human factors and ergonomics series · doi:10.1201/ebk1439835012-c3 · Cited by 97
Self-citationTechniques in mental workload assessment.
Meshkati, N., Hancock, P. A., Rahimi, M., & Dawes, S. M. (1995) · Cited by 95
Implementation of fNIRS for Monitoring Levels of Expertise and Mental Workload
Bunce, S. C., İzzetoğlu, K., Ayaz, H., Shewokis, P. A., İzzetoğlu, M., Pourrezaei, K., & Onaral, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21852-1_2 · Cited by 81
Self-citationSchudlo, L. C., & Chau, T. T. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/1/016003 · Cited by 80
Abibullaev, B., & An, J. (2012) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2012.01.002 · Cited by 76
Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging
Ayaz, H., Cakir, M. P., İzzetoğlu, K., Curtin, A., Shewokis, P. A., Bunce, S. C., & Onaral, B. (2012) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2012.6187350 · Cited by 71
Self-citationTowards a Near Infrared Spectroscopy-Based Estimation of Operator Attentional State
Derosière, G., Dalhoumi, S., Perrey, S., Dray, G., & Ward, T. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092045 · Cited by 67
Cai, H., Lin, Y., & Mourant, R. R. (2007) · Cited by 50
Bogler, C., Mehnert, J., Steinbrink, J. M., & Haynes, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101729 · Cited by 46
(2010) · CRC Press eBooks · doi:10.1201/ebk1439835012-4 · Cited by 29
Ayaz, H., Willems, B. F., Bunce, S. C., Shewokis, P. A., İzzetoğlu, K., Hah, S., Deshmukh, A., & Onaral, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21852-1_63 · Cited by 19
Self-citationIs there an optimum workload in manual control
Verplank, W. L. (1976) · PsycEXTRA Dataset · doi:10.1037/e506152009-008 · Cited by 4
Research works printed but not linked: 1
- solovey, 2012, Brain Sensing with fNIRS in the Car, Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Presented at the AutomotiveUI
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“Recent research showed that drivers exhibit low cognitive load when monitoring automated driving compared to doing a secondary task [284].”
BackgroundA Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving
Lohani, M., Payne, B. R., & Strayer, D. L. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00057 · Cited by 348
Foy, H. J., & Chapman, P. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.06.006 · Cited by 212
Human Mental Workload: A Survey and a Novel Inclusive Definition
Longo, L., Wickens, C. D., Hancock, G., & Hancock, P. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.883321 · Cited by 222
“…deemed a promising method for the discrimination of various task conditions, each supposed to lead to different levels of experienced mental workload (Sassaroli et al., 2008; Karim et al., 2012; Durantin et al., 2014; Sibi et al., 2016; Li et al., 2019; Parshi et al., 2019; Galoyan et al., 2021).”
MethodMetahuman systems = humans + machines that learn
Lyytinen, K., Nickerson, J. V., & King, J. L. (2021) · Journal of Information Technology · doi:10.1177/0268396220915917 · Cited by 122
Metadata
- Authors
- Sibi, S., Ayaz, H., Kuhns, D. P., Sirkin, D. M., & Ju, W.
- Affiliations
- Stanford University (US)
- Drexel University (US)
- Intel (United States) (US)
- Venue
- 2016 IEEE Intelligent Vehicles Symposium (IV)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 419-425
- ISSN
- 1931-0587 (ISSN-L)
- OpenAlex
- W2507595669
- Cited by
- 56
- References
- 33
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 6 · 2023: 7 · 2022: 10 · 2021: 4 · 2020: 6 · 2019: 6 · 2018: 6 · 2017: 5
- FWCI
- 9.56
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Intelligent Vehicles Symposium (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Optical Imaging and Spectroscopy Techniques
- Keywords
- driver cognitive load, functional near-infrared spectroscopy, prefrontal cortex activation, driver state monitoring, transfer of control, secondary task, sleepiness, manual driving, brain-computer interface, driving safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.