Multimodal person independent recognition of workload related biosignal patterns
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This paper presents an online multimodal person independent workload classification system using blood volume pressure, respiration measures, electrodermal activity and electroencephalography. For each modality a classifier based on linear discriminant analysis is trained. The classification results obtained on short data frames are fused using weighted majority voting. The system was trained and evaluated on a large training corpus of 152 participants, exposed to controlled and uncontrolled scenarios for inducing workload, including a driving task conducted in a realistic driving simulator. Using person dependent feature space normalization, we achieve a classification accuracy of up to 94% for discrimination of relaxed state vs. high workload.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Normalization techniques, such as establishing baselines for the sympathetic and parasympathetic nervous system responses [49], as well as relying on multiple modalities, may allow building more robust models [106].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [106]
Citations
Cites
Independent component analysis: algorithms and applications
Hyvärinen, A., & Oja, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,705
Removing electroencephalographic artifacts by blind source separation
Jung, T., Makeig, S., Humphries, C., Lee, T.-W., McKeown, M. J., Iragui, V. J., & Sejnowski, T. J. (2000) · Psychophysiology · doi:10.1017/s0048577200980259 · Cited by 3,334
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
Analysis of EEG records in an epileptic patient using wavelet transform
Adeli, H., Zhou, Z., & Dadmehr, N. (2003) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00340-0 · Cited by 1,154
Real-Time System for Monitoring Driver Vigilance
Bergasa, L. M., Nuevo, J., Sotelo, M. A., Barea, R., & Lopez, M. E. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869598 · Cited by 714
Lansdown, T. C., Brook-Carter, N., & Kersloot, T. (2004) · Ergonomics · doi:10.1080/00140130310001629775 · Cited by 172
An Intelligent Noninvasive Sensor for Driver Pulse Wave Measurement
Lin, Y., Leng, H., Yang, G., & Cai, H. (2007) · IEEE Sensors Journal · doi:10.1109/jsen.2007.894923 · Cited by 77
Multimodal Recognition of Cognitive Workload for Multitasking in the Car
Putze, F., Jarvis, J.-P., & Schultz, T. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.913 · Cited by 55
Self-citationOnline Workload Recognition from EEG Data during Cognitive Tests and Human-Machine Interaction
Heger, D., Putze, F., & Schultz, T. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16111-7_47 · Cited by 46
Self-citation
Research works printed but not linked: 4
- 10.5555/1882150.1882154 · doi:10.5555/1882150.1882154
- 10.5555/1882150.1882204 · doi:10.5555/1882150.1882204
- 10.1111/1469-8986.3720163 · doi:10.1111/1469-8986.3720163 · Paper page
- F. Kuhn . Methode zur Bewertung der Fahrerablenkung durch Fahrerinformations-Systeme . World Usability Day , 2005 . F. Kuhn. Methode zur Bewertung der Fahrerablenkung durch Fahrerinformations-Systeme. World Usability Day, 2005.
Cited by
Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS
Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F., & Schultz, T. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00935 · Cited by 365
Self-citationA Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“…82, 85, 87, 99, 106, 146, 152, 160, 169, 184, 185, 194, 201, 202, 214, 216, 217, 224, 225, 227, 240, 244, 264, 264, 266, 268] Respiration [87, 99, 106, 184, 185, 194] Temperature [1, 2, 8, 87, 184, 185, 194, 216, 217, 268] Dermal Skin Conductance (EDA) [25, 50, 51, 76, 78, 87, 99, 106, 134,…”
InfluentialHeartPy: A novel heart rate algorithm for the analysis of noisy signals
van Gent, P., Farah, H., van Nes, N., & van Arem, B. (2019) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.09.015 · Cited by 234
Putze, F., Putze, S., Sagehorn, M., Micek, C., & Solovey, E. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3490554 · Cited by 32
Self-citationAdaptive cognitive technical systems
Putze, F., & Schultz, T. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2014.06.029 · Cited by 28
Self-citationMulti-Level Driver Workload Prediction using Machine Learning and Off-the-Shelf Sensors
van Gent, P., Melman, T., Farah, H., van Nes, N., & van Arem, B. (2018) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/0361198118790372 · Cited by 23
Evaluating Typing Performance in Different Mixed Reality Manifestations using Physiological Features
Chiossi, F., Khaoudi, Y. E., Ou, C., Sidenmark, L., Zaky, A., Feuchtner, T., & Mayer, S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3698142 · Cited by 13
Mirzaeian, R., & Ghaderyan, P. (2023) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2023.01.001 · Cited by 12
Probing ECG-based mental state monitoring on short time segments
Roy, R. N., Charbonnier, S., & Campagne, A. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6611071 · Cited by 12
Improving HCI with Brain Input: Review, Trends, and Outlook
Solovey, E., & Putze, F. (2021) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000078 · Cited by 9
Self-citationAny problems? a wearable sensor-based platform for representational learning-analytics.
Pirkl, G., Hevesi, P., Lukowicz, P., Klein, P., Heisel, C., Gröber, S., Kühn, J., & Sick, B. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2968219.2971383 · Cited by 7
Чемерисова, Е. В., Atanov, M. S., Mikheev, I., & Martynova, O. (2018) · Психология Журнал Высшей школы экономики · doi:10.17323/1813-8918-2018-2-268-278 · Cited by 7
Investigating Intrusiveness of Workload Adaptation
Putze, F., & Schultz, T. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2663279 · Cited by 6
Self-citationGhaderyan, P., & Mirzaeian, R. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106679 · Cited by 5
Roy, R. N. (2015) · theses.fr (ABES) · doi:10.70675/27879331zbae8z4595zb9bazbb231ff665e9 · Cited by 6
Dummy Model Based Workload Modeling
Putze, F., Schultz, T., & Pröpper, R. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.171 · Cited by 3
Self-citationTowards Real-Time, Nonintrusive Estimation of Driver Workload in a Simulated Environment
van Gent, P., Farah, H., van Nes, N., & van Arem, B. (2017) · Data Archiving and Networked Services (DANS) · Cited by 3
Richardson, A., Beetz, M., Schultz, T., & Putze, F. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254862 · Cited by 1
Self-citationSchlick, C. M., Bruder, R., & Luczak, H. (2018) · Springer eBooks · doi:10.1007/978-3-662-56037-2_3 · Cited by 1
van Gent, P. (2021) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:2b2a4f0a-81d9-4e5a-9a6b-807a73d617d0
Kimani, E., Filipowicz, A. L. S., & Yasuda, H. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3610661.3617167
Emotional Speech Corpus: A Review
Rohilla, K., Sharma, A. S., Nilakshi, N., & Palia, N. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-91331-0_6
Saxena, A., & Singh, S. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.77563
CogniFuse and Multimodal Deformers: An Extended Study on Benchmarking and Modeling Biosignal Fusion
Richardson, A., Beetz, M., Schultz, T., & Putze, F. (2026) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2026.3691190
Self-citation
Metadata
- Authors
- Jarvis, J., Putze, F., Heger, D., & Schultz, T.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Venue
- Proceedings of the 13th international conference on multimodal interfaces
- Publisher
- ACM
- Published
- 2011-11-14
- Pages
- 205-208
- OpenAlex
- W1969273236
- Cited by
- 19
- References
- 9
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 3 · 2022: 1 · 2019: 1 · 2018: 3 · 2016: 1 · 2015: 1 · 2014: 3 · 2013: 1
- FWCI
- 2.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- workload classification, multimodal biosignals, user-independent recognition, respiration, electrodermal activity, EEG, linear discriminant analysis, driving simulator, driver workload
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.