Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users’ bodies. This paper present an unobtrusive indicator of the users’ cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person’s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research using thermal imaging found promising results in distinguishing cognitive load levels using standardized cognitive load tests [2].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [2]
Citations
Cites
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
Task-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 1×
“Different approaches have been introduced to infer cognitive states ranging from using facial expressions [65], eye movements [18] and pupil size [6, 46], skin conductance [20, 32, 56], brain signals [8, 57, 58], Electrodermal activity (EDA) [17, 41, 42], heart and respiration rate [32].”
BackgroundLicklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938
AUGMENTING HUMAN INTELLECT: A CONCEPTUAL FRAMEWORK
ENGELBART, D. C. (1962) · doi:10.21236/ad0289565 · Cited by 1,082
Studies of interference in serial verbal reactions.
Stroop, J. R. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.1.15 · Cited by 918
Thermal cameras and applications: A survey
Gade, R., & Moeslund, T. B. (2014) · Machine Vision and Applications · doi:10.1007/s00138-013-0570-5 · Cited by 780
Research works printed but not linked: 4
- Yomna Abdelrahman. 2013. Thermal imaging for interactive surfaces. Master’s thesis. Yomna Abdelrahman. 2013. Thermal imaging for interactive surfaces. Master’s thesis.
- Hosni Sarah M, 2007, International Conference on. IEEE, 220--226
- Kang J, 2006, Proceedings of Army Science Conference
- 10.5555/2062850.2062929 · doi:10.5555/2062850.2062929
Cited by
A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving
Lohani, M., Payne, B. R., & Strayer, D. L. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00057 · Cited by 348
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
Self-citationNext Steps for Human-Computer Integration
Mueller, F. F., Lopes, P., Strohmeier, P., Ju, W., Seim, C., Weigel, M., Nanayakkara, S., Obrist, M., Li, Z., Delfa, J., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376242 · Cited by 260
“Furthermore, technology has the potential to enhance our sensory system, for example, by extending the abilities of the visual sensation through wearing thermal imaging glasses [1] or by a brain-computer interface that allows accessing other people’s indicated cognitive load [26].”
BackgroundMultimodal Data Fusion in Learning Analytics: A Systematic Review
Mu, S., Cui, M., & Huang, X. (2020) · Sensors · doi:10.3390/s20236856 · Cited by 154
Multimodal data as a means to understand the learning experience
Giannakos, M. N., Sharma, K., Pappas, I. O., Kostakos, V., & Velloso, E. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.02.003 · Cited by 202
Self-citationBiofeedback for Everyday Stress Management: A Systematic Review
Yu, B., Funk, M., Hu, J., Wang, Q., & Feijs, L. (2018) · Frontiers in ICT · doi:10.3389/fict.2018.00023 · Cited by 181
Psychosocial Effects of the COVID-19 Pandemic: Large-scale Quasi-Experimental Study on Social Media
Saha, K., Torous, J., Caine, E. D., & De Choudhury, M. (2020) · Journal of Medical Internet Research · doi:10.2196/22600 · Cited by 166
Filippini, C., Perpetuini, D., Cardone, D., Chiarelli, A. M., & Merla, A. (2020) · Applied Sciences · doi:10.3390/app10082924 · Cited by 132
Cho, Y., Julier, S. J., & Bianchi-Berthouze, N. (2019) · JMIR Mental Health · doi:10.2196/10140 · Cited by 102
Dance and Choreography in HCI: A Two-Decade Retrospective
Zhou, Q., Chua, C. C., Knibbe, J., Gonçalves, J., & Velloso, E. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445804 · Cited by 97
Self-citationCha, N., Kim, A., Park, C. Y., Kang, S., Park, M., Lee, J.-G., Lee, S., & Lee, U. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411810 · Cited by 74
Luo, X., Jia, N., Ouyang, E., & Fang, Z. (2024) · Strategic Management Journal · doi:10.1002/smj.3597 · Cited by 82
A Survey on Cross‐Virtuality Analytics
Fröhler, B., Anthes, C., Pointecker, F., Friedl-Knirsch, J., Schwajda, D., Riegler, A., Tripathi, S., Holzmann, C., Brunner, M., Jodlbauer, H., et al. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14447 · Cited by 80
Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
Kosch, T., Hassib, M., Woźniak, P. W., Buschek, D., & Alt, F. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174010 · Cited by 79
An adaptive human sensor framework for human–robot collaboration
Buerkle, A., Matharu, H., Al-Yacoub, A., Lohse, N., Bamber, T., & Ferreira, P. (2021) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-021-08299-2 · Cited by 78
Tag, B., Vargo, A. W., Gupta, A., Chernyshov, G., Kunze, K. S., & Dingler, T. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300694 · Cited by 78
Self-citationEmploying Consumer Wearables to Detect Office Workers' Cognitive Load for Interruption Management
Schaule, F., Johanssen, J. O., Bruegge, B., & Loftness, V. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191764 · Cited by 77
Classifying Attention Types with Thermal Imaging and Eye Tracking
Abdelrahman, Y., Khan, A. A., Newn, J., Velloso, E., Safwat, S., Bailey, J., Bulling, A., Vetere, F., & Schmidt, A. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351227 · Cited by 68
Self-citationCombining gaze and AI planning for online human intention recognition
Singh, R., Miller, T., Newn, J., Velloso, E., Vetere, F., & Sonenberg, L. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103275 · Cited by 66
Self-citationCardone, D., Perpetuini, D., Filippini, C., Mancini, L., Nocco, S., Tritto, M., Rinella, S., Giacobbe, A., Fallica, G., Ricci, F., et al. (2022) · Sensors · doi:10.3390/s22197300 · Cited by 65
Jansen, P., Colley, M., & Rukzio, E. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534617 · Cited by 54
Between Symbols and Particles: Investigating the Complexity of Learning Chemical Equations
Hamerská, L., Matěcha, T., Tóthová, M., & Rusek, M. (2024) · Education Sciences · doi:10.3390/educsci14060570 · Cited by 52
An, P., Bakker, S., Ordanovski, S., Taconis, R., Paffen, C. L. E., & Eggen, B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300321 · Cited by 42
Sharma, K., Niforatos, E., Giannakos, M. N., & Kostakos, V. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3411811 · Cited by 52
Objective Measures of Cognitive Load Using Deep Multi-Modal Learning: A Use-Case in Aviation
Wilson, J. C., Nair, S., Scielzo, S., & Larson, E. C. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3448111 · Cited by 52
Díaz-Piedra, C., Milán, E. G., & Stasi, L. L. D. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2019.06.001 · Cited by 52
Cognitive Load Monitoring With Wearables–Lessons Learned From a Machine Learning Challenge
Gjoreski, M., Mahesh, B., Kolenik, T., Garbas, J.-U., Seuß, D., Gjoreski, H., Luštrek, M., Gams, M., & Pejović, V. (2021) · IEEE Access · doi:10.1109/access.2021.3093216 · Cited by 48
Robust cognitive load detection from wrist-band sensors
Borisov, V., Kasneci, E., & Kasneci, G. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100116 · Cited by 47
Goyal, N., & Fussell, S. R. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130917 · Cited by 46
Zhang, M., Ihme, K. A., & Drewitz, U. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.04.003 · Cited by 41
Towards a Contactless Stress Classification Using Thermal Imaging
Gioia, F., Greco, A., Callara, A. L., & Scilingo, E. P. (2022) · Sensors · doi:10.3390/s22030976 · Cited by 40
Nose Heat: Exploring Stress-induced Nasal Thermal Variability through Mobile Thermal Imaging
Cho, Y., Bianchi‐Berthouze, N., Oliveira, M., Holloway, C., & Julier, S. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925453 · Cited by 37
Hot or Not? Robust and Accurate Continuous Thermal Imaging on FLIR cameras
Malmivirta, T., Hamberg, J., Lagerspetz, E., Li, X., Peltonen, E., Flores, H., & Nurmi, P. (2019) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2019.8767423 · Cited by 36
Faces of Focus: A Study on the Facial Cues of Attentional States
Babaei, E., Srivastava, N., Newn, J., Zhou, Q., Dingler, T., & Velloso, E. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376566 · Cited by 34
Self-citationEffective Human-Robot Collaboration Through Wearable Sensors
Al-Yacoub, A., Buerkle, A., Flanagan, M., Ferreira, P., Hubbard, E., & Lohse, N. (2020) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa46521.2020.9212100 · Cited by 30
Jafarlou, S., Azimi, I., Lai, J., Wang, Y., Labbaf, S., Nguyen, B., Qureshi, H., Marcotullio, C., Borelli, J. L., Dutt, N. D., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298949 · Cited by 29
Photoplethysmogram-based Cognitive Load Assessment Using Multi-Feature Fusion Model
Zhang, X., Lyu, Y., Qu, T., Qiu, P., Luo, X., Zhang, J., Fan, S., & Shi, Y. (2019) · ACM Transactions on Applied Perception · doi:10.1145/3340962 · Cited by 28
Physiological and Affective Computing through Thermal Imaging: A SurveyPreprint
Cho, Y., & Bianchi‐Berthouze, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.10307 · Cited by 28
Farooq, M. A., Javidnia, H., & Corcoran, P. (2020) · Journal of Electronic Imaging · doi:10.1117/1.jei.29.6.063004 · Cited by 27
Real-time prediction of short-timescale fluctuations in cognitive workload
Boehm, U., Matzke, D., Gretton, M., Castro, S. C., Cooper, J. M., Skinner, M., Strayer, D. L., & Heathcote, A. (2021) · Cognitive Research Principles and Implications · doi:10.1186/s41235-021-00289-y · Cited by 27
Li, X., Zheng, C. Y., Pan, Z., Huang, Z., Niu, Y., Wang, P., & Geng, W. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2276526 · Cited by 26
Your skin resists: exploring electrodermal activity as workload indicator during manual assembly
Kosch, T., Karolus, J., Ha, H., & Schmidt, A. (2019) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/3319499.3328230 · Cited by 25
Self-citationNovel expert system to study human stress based on thermographic images
Resendiz‐Ochoa, E., Cruz-Albarrán, I. A., Garduño-Ramón, M. A., Medina, D. A. R., Osornio-Rios, R. A., & Morales-Hernandez, L. A. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115024 · Cited by 25
Captivates: A Smart Eyeglass Platform for Across-Context Physiological Measurement
Chwalek, P. C., Ramsay, D. B., & Paradiso, J. A. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478079 · Cited by 23
Eom, S., Eom, S.-Y., & Washington, P. Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47679-2_12 · Cited by 23
Natural interaction in virtual reality: impact on the cognitive load
Galais, T., Delmas, A., & Alonso, R. (2019) · Adjunct Proceedings of the 31st Conference on l'Interaction Homme-Machine · doi:10.1145/3366551.3370342 · Cited by 22
Facial thermal imaging: A systematic review with guidelines and measurement uncertainty estimation
Stanić, V., & Geršak, G. (2024) · Measurement · doi:10.1016/j.measurement.2024.115879 · Cited by 22
Kassem, K., Salah, J., Abdrabou, Y., Morsy, M., El-Gendy, R., Abdelrahman, Y., & Abdennadher, S. (2017) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3152832.3152836 · Cited by 22
Self-citationCharacter Computing: Computer Science meets Psychology
Bolock, A. E., Salah, J., Abdelrahman, Y., Herbert, C., & Abdennadher, S. (2018) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3282894.3286060 · Cited by 20
Self-citationThermalWrist: Smartphone Thermal Camera Correction Using a Wristband Sensor †
Yoshikawa, H., Uchiyama, A., & Higashino, T. (2019) · Sensors · doi:10.3390/s19183826 · Cited by 21
Thermography for Emotion Recognition Using Deep Learning in Academic Settings: A Review
Fardian, F., Mawarpury, M., Munadi, K., & Arnia, F. (2022) · IEEE Access · doi:10.1109/access.2022.3199736 · Cited by 20
Can Infrared Facial Thermography Disclose Mental Workload in Indoor Thermal Environments?
Wang, X., Li, D., Menassa, C. C., & Kamat, V. R. (2019) · doi:10.1145/3363459.3363528 · Cited by 20
Kim, G., Hwang, S., Seong, M., Yeo, D., Rus, D. L., & Kim, S. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678544 · Cited by 19
Washington, P. Y., Chrisman, B., Leblanc, É., Dunlap, K., Kline, A., Mutlu, O. C., Stockham, N., Paskov, K. M., & Wall, D. P. (2022) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2022.100056 · Cited by 19
Gaze-based interest detection on newspaper articles
Jacob, S., Ishimaru, S., Bukhari, S. S., & Dengel, A. R. (2018) · doi:10.1145/3208031.3208034 · Cited by 18
Character computing: challenges and opportunities
Bolock, A. E., Salah, J., Abdennadher, S., & Abdelrahman, Y. (2017) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3152832.3152860 · Cited by 17
Self-citationBiometrically Measured Affect for Screen-Based Drone Pilot Skill Acquisition
Dalilian, F., & Nembhard, D. A. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2208991 · Cited by 17
Jaiswal, A., Kruiper, R., Rasool, A., Nandkeolyar, A., Wall, D. P., & Washington, P. Y. (2023) · JMIR Research Protocols · doi:10.2196/52205 · Cited by 16
Cárdenas, J. J. G., Hei, X., & Tapus, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802226 · Cited by 16
Mediated Atmosphere Table (MAT): Adaptive Multimodal Media System for Stress Restoration
Zhao, N., Kodama, E. C., & Paradiso, J. A. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3190929 · Cited by 16
Exploration of Alternative Vision Modes Using Depth and Thermal Cameras
Abdelrahman, Y., Woźniak, P. W., Knierim, P., Henze, N., & Schmidt, A. (2018) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3282894.3282920 · Cited by 16
Self-citationAutomatic Frustration Detection Using Thermal Imaging
Mohamed, Y., Ballardini, G., Parreira, M. T., Lemaignan, S., & Leite, I. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889545 · Cited by 15
Agrigoroaie, R., & Tapus, A. (2019) · International Journal of Social Robotics · doi:10.1007/s12369-019-00532-z · Cited by 15
Reading Between the Heat: Co-Teaching Body Thermal Signatures for Non-intrusive Stress Detection
Xiao, Y., Sharma, H., Zhang, Z., Bergen‐Cico, D., Rahman, T., & Salekin, A. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3631441 · Cited by 14
Untangling Cost, Effort, and Load in Information Seeking and Retrieval
McGregor, M., Azzopardi, L. A., & Halvey, M. J. (2021) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446026 · Cited by 14
Human Stress Recognition from Facial Thermal-Based Signature: A Literature Survey
Arasu, D. B. L., Mohamed, A. S. A., Ruhaiyem, N. I. R., Annamalai, N., Lutfi, S. L., & Qudah, M. M. A. (2021) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2021.016985 · Cited by 14
SmokeMon: Unobtrusive Extraction of Smoking Topography Using Wearable Energy-Efficient Thermal
Alharbi, R., Shahi, S., Cruz, S., Li, L., Sen, S., Pedram, M., Romano, C., Hester, J. D., Katsaggelos, A. K., & Alshurafa, N. I. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569460 · Cited by 14
Dynamic Seat Assessment for Enabled Restlessness of Children with Learning Difficulties
Stanić, V., Žnidarič, T., Repovš, G., & Geršak, G. (2022) · Sensors · doi:10.3390/s22093170 · Cited by 13
HotFoot: Foot-Based User Identification Using Thermal Imaging
Saad, A., Izadi, K., Khan, A. A., Knierim, P., Schneegaß, S., Alt, F., & Abdelrahman, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580924 · Cited by 13
Self-citationSrivastava, N., Nawaz, S., Lodge, J. M., Velloso, E., Erfani, S., & Bailey, J. (2020) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3375462.3375514 · Cited by 13
Self-citationCruz-Albarrán, I. A., Medina, D. A. R., Alva, G. L., Trejo, B. D., Osornio-Rios, R. A., & Morales-Hernandez, L. A. (2020) · Journal of Thermal Biology · doi:10.1016/j.jtherbio.2020.102616 · Cited by 13
Stasi, L. L. D., Gianfranchi, E., Pérez-García, M., & Díaz-Piedra, C. (2022) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2022.103295 · Cited by 12
Human-centered Behavioral and Physiological Security
Alt, F., Hassib, M. E., & Distler, V. (2023) · New Security Paradigms Workshop · doi:10.1145/3633500.3633504 · Cited by 12
Characterizing Everyday Objects using Human Touch: Thermal Dissipation as a Sensing Modality
Emenike, H., Dar, F., Liyanage, M., Sharma, R. R., Zuniga, A., Hoque, M. A., Radeta, M., Nurmi, P., & Flores, H. (2021) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom50583.2021.9439120 · Cited by 12
Attention-Dependent Physiological Correlates in Sleep-Deprived Young Healthy Humans
Cesari, V., Marinari, E., Laurino, M., Gemignani, A., & Menicucci, D. (2021) · Behavioral Sciences · doi:10.3390/bs11020022 · Cited by 12
Temporal Impact on Cognitive Distraction Detection for Car Drivers using EEG
Schneiders, E., Kristensen, M. B., Svangren, M. K., & Skov, M. B. (2020) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3441000.3441013 · Cited by 12
Real-time cognitive workload assessment using non-intrusive methods: a systematic review
Basnet, N., & Zahabi, M. (2025) · Ergonomics · doi:10.1080/00140139.2025.2606779 · Cited by 11
Kim, M., Lee, J., Koh, Y., Lee, C., Lee, U., & Kim, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642778 · Cited by 11
Wireless Ranging for Contactless Cognitive Load Inference in Ubiquitous Computing
Pejović, V., Matkovič, T., & Ciglarič, M. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1913860 · Cited by 11
Jiang, W., Wang, C., Sarsenbayeva, Z., Irlitti, A., Wei, J., Knibbe, J., Dingler, T., Gonçalves, J., & Kostakos, V. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610933 · Cited by 11
Self-citationBeyond the visible: sensing with thermal imaging
Abdelrahman, Y., & Schmidt, A. (2018) · interactions · doi:10.1145/3297778 · Cited by 11
Self-citationExploring the Usage of EEG and Pupil Diameter to Detect Elicited Valence
Abdrabou, Y., Kassem, K., Salah, J., El-Gendy, R., Morsy, M., Abdelrahman, Y., & Abdennadher, S. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-73888-8_45 · Cited by 11
Self-citationApplications of Character Computing From Psychology to Computer Science
Bolock, A. E., Abdennadher, S., & Herbert, C. (2020) · Human-computer interaction series · doi:10.1007/978-3-030-15954-2_4 · Cited by 10
Using contactless sensors to estimate learning difficulty in digital learning environments
Srivastava, N. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3349312 · Cited by 10
Toward Cognitive Load Inference for Attention Management in Ubiquitous Systems
Pejović, V., Gjoreski, M., Anderson, C., David, K., & Luštrek, M. (2020) · IEEE Pervasive Computing · doi:10.1109/mprv.2020.2968909 · Cited by 10
Confidence-Aware Learning AssistantPreprint
Ishimaru, S., Maruichi, T., Dengel, A. R., & Kise, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07312 · Cited by 10
Kargarandehkordi, A., & Washington, P. Y. (2023) · medRxiv · doi:10.1101/2023.04.28.23289168 · Cited by 10
Moreno, F. C., González, J. R., Muro, J. S., & López-Alonso, R. (2025) · Cognition Technology & Work · doi:10.1007/s10111-025-00804-x · Cited by 9
An Aircraft Pilot Workload Sensing System
Alaimo, A., Esposito, A., Milazzo, A., & Orlando, C. (2021) · Lecture notes in civil engineering · doi:10.1007/978-3-030-64594-6_85 · Cited by 9
You Know Too Much: Investigating Users’ Perceptions and Privacy Concerns Towards Thermal Imaging
Sahoo, L., Miazi, N. S., Shehab, M., Alt, F., & Abdelrahman, Y. (2022) · Springer eBooks · doi:10.1007/978-3-031-09901-4_11 · Cited by 9
Self-citationMulti-modal Affect Detection Using Thermal and Optical Imaging in a Gamified Robotic Exercise
Mohamed, Y., Özgür, A. G., Lemaignan, S., & Leite, I. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01066-1 · Cited by 9
Exploring the Usage of Commercial Bio-Sensors for Multitasking Detection
Salah, J., Abdelrahman, Y., Abdrabou, Y., Kassem, K., & Abdennadher, S. (2018) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3282894.3282900 · Cited by 9
Self-citationCognitive Aid: Task Assistance Based On Mental Workload Estimation
Zhou, Q., Newn, J., Srivastava, N., Dingler, T., Gonçalves, J., & Velloso, E. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3313010 · Cited by 9
Self-citationJudged by the Cover: Investigating the Effect of Adaptive Game Interface on the Learning Experience
Salah, J., Abdelrahman, Y., Dakrouni, A., & Abdennadher, S. (2018) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3282894.3282930 · Cited by 9
Self-citationNiforatos, E., He, T., Vourvopoulos, A., & Giannakos, M. N. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2388368 · Cited by 9
Wi-Mind: Wireless Mental Effort Inference
Matkovič, T., & Pejović, V. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3274114 · Cited by 8
A Longitudinal Study of Pervasive Display Personalisation
Mikusz, M., Shaw, P., Davies, N., Nurmi, P., Clinch, S., Trotter, L., Elhart, I., Langheinrich, M., & Friday, A. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3418352 · Cited by 8
Facial infrared thermography as an index of social anxiety
Fernández, J. C., Albayay, J., Galvéz-García, G., Iborra, O., Huertas, C., Milán, E. G., & Caballo, V. E. (2023) · Anxiety Stress & Coping · doi:10.1080/10615806.2023.2199209 · Cited by 9
Mental State Analysis on Eyewear
Augereau, O., Tag, B., & Kise, K. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3274119 · Cited by 8
Cognitive performance measurements and the impact of sleep quality using wearable and mobile sensors
Visuri, A., Koskimäki, H., van Berkel, N., Alorwu, A., Peltonen, E., Abdullah, S., & Hosio, S. J. (2025) · Personal and Ubiquitous Computing · doi:10.1007/s00779-025-01847-7 · Cited by 7
Metadata
- Authors
- Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., & Vetere, F.
- Affiliations
- University of Stuttgart (DE)
- The University of Melbourne (AU)
- Osaka Prefecture University (JP)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2017-09-11
- Volume
- 1
- Issue
- 3
- Pages
- 1-20
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2755506150
- Cited by
- 154
- References
- 70
- Citations by year
- 2026: 8 · 2025: 11 · 2024: 14 · 2023: 16 · 2022: 16 · 2021: 21 · 2020: 21 · 2019: 28 · 2018: 15 · 2017: 4
- FWCI
- 22.99
- Type
- journal article
- Language
- en
- Open access
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Open access LMU (Ludwid Maxmilian's Universitat Munchen) (submittedVersion, other-oa)
- Funders
- German Research Foundation within the SimTech Cluster of Excellence (EXC 310/2)
- Amplify project which received funding from the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme (683008)
- Victorian State Government and Microsoft through their contributions to the Microsoft Research Centre for Social Natural User Interfaces
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- cognitive load, infrared thermography, unobtrusive sensing, forehead temperature, nose temperature, Stroop task, activity monitoring, thermal camera
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.