Do speech features for detecting cognitive load depend on specific languages?
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
Speech-based cognitive load modeling recently proposed in English have enabled objective, quantitative and unobtrusive evaluation of cognitive load without extra equipment. However, no evidence indicates that these techniques could be applied to speech data in other languages without modification. In this study, a modified Stroop Test and a Reading Span Task were conducted to collect speech data in English and Chinese respectively, from which twenty non-linguistic features were extracted to investigate whether they were language dependent. Some discriminating speech features were observed language dependent, which serves as an evidence that there is a necessity to adapt speech-based cognitive load detection techniques to diverse language contexts for a higher performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, speech features such as the flow of words (e.g., tempo [42] or pauses [117,118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants' cognitive workload.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [42]
Citations
Cites
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 1×
“It is attributable to the limited capacity of the person's working memory and his or her ability to process novel information [4].”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Evidence has been found in [16] that highest performance could be achieved by maintaining the load experienced by users within an appropriate range, neither too low nor too high.”
BackgroundAn automated version of the operation span task
Unsworth, N., Heitz, R. P., Schrock, J. C., & Engle, R. W. (2005) · Behavior Research Methods · doi:10.3758/bf03192720 · Cited by 1,861 · cited 1×
“The reading span task is based on CLSE-Span [24] and RSPAN [22].”
MethodProceedings of Interspeech 2013
Lu, L., Ghoshal, A. K., & Renals, S. J. (2013) · Proceedings - International Symposium on Computer Architecture/Proceedings · Cited by 1,003
Modeling Player Experience for Content Creation
Pedersen, C., Togelius, J., & Yannakakis, G. N. (2010) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2010.2043950 · Cited by 231 · cited 1×
“These formulas are similar to those proposed in [17] to capture the spatial diversity of the placement of gaps.”
MethodAutomated stress detection using keystroke and linguistic features: An exploratory study
Vizer, L. M., Zhou, L., & Sears, A. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.07.005 · Cited by 220 · cited 2×
“[23] applied five machine learning techniques to automatically differentiate cognitive and physical stress from baseline based on keystroke and linguistic features extracted from spontaneously generated text.”
MethodA spectral/temporal method for robust fundamental frequency tracking
Zahorian, S. A., & Hu, H. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2916590 · Cited by 180 · cited 2×
“A Pitch-based Voice Activity Detector (VAD), YAAPT [31], was adopted to extract pitch of an utterance so as to distinguish voiced and unvoiced region, where unvoiced region was masked to 0 by pitch.”
MethodAssessing Cognitive Load with Physiological Sensors
Ikehara, C. S., & Crosby, M. E. (2005) · Proceedings of the 38th Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2005.103 · Cited by 150 · cited 3×
“Ikehara and Crosby [7] embedded two features of mouse pressure into their physiological sensor system, P1 and P2.”
BackgroundInterpreting Symptoms of Cognitive Load in Speech Input
Berthold, A., & Jameson, A. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_23 · Cited by 102 · cited 2×
“Cognitive load evaluation based on speech features has been broadly exploited [1, 2, 6, 15].”
Background
Research works printed but not linked: 1
- Campione , E. and Véronis , J . 2002. A large-scale multilingual study of silent pause duration . In Proceedings of the Speech Prosody 2002 Conference (Aix-en-Provence , 2002 ), 199–202. Campione, E. and Véronis, J. 2002. A large-scale multilingual study of silent pause duration. In Proceedings of the Speech Prosody 2002 Conference (Aix-en-Provence, 2002), 199–202.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“The fixation rate of an area of interest describes the number of times an object was looked at – this can be interpreted as a repeated interest in an area and relevant for the current cognitive activity [208].”
Estimating cognitive load from speech gathered in a complex real-life training exercise
Vukovic, M., Sethu, V., Parker, J., Cavedon, L., Lech, M., & Thangarajah, J. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.12.003 · Cited by 20
Human-centered Behavioral and Physiological Security
Alt, F., Hassib, M. E., & Distler, V. (2023) · New Security Paradigms Workshop · doi:10.1145/3633500.3633504 · Cited by 12
“A change in the users’ cognitive load can be measured through many of the features of speech, such as tempo [25], pauses [51], or lexical density [51].”
BackgroundBroadening the mind: how emerging neurotechnology is reshaping HCI and interactive system design
Schneegass, C., Wilson, M. L., Shaban, J., Niess, J., Chiossi, F., Mitrevska, T., & Woźniak, P. W. (2024) · i-com · doi:10.1515/icom-2024-0007 · Cited by 11
“Speech analysis can help estimate, e.g. mental workload through sentence length or complexity, tempo, 26 or pauses.”
Influence of Cognitive Load on Voice Production: A Scoping Review
Pyfrom, M., Lister, J. J., & Anand, S. (2023) · Journal of Voice · doi:10.1016/j.jvoice.2023.08.024 · Cited by 9
Metadata
- Authors
- Chen, R., Xie, T., Xie, Y., Lin, T., & Tang, N.
- Affiliations
- Sichuan University (CN)
- University of Maryland, Baltimore County (US)
- Venue
- Proceedings of the 18th ACM International Conference on Multimodal Interaction
- Publisher
- ACM
- Published
- 2016-10-31
- Pages
- 76-83
- OpenAlex
- W2546712879
- Cited by
- 8
- References
- 32
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 3 · 2022: 1 · 2020: 1 · 2018: 1
- FWCI
- 0.39
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Funders
- Science and Technology Supporting Program, Sichuan Province (2013GZX0138,2014GZ0154)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- cognitive load detection, speech features, language dependence, Chinese speech, English speech, Stroop task, reading span task, cross-lingual adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do speech features for detecting cognitive load depend on specific languages? https://app.cochat.ai/papers/10.1145/2993148.2993149
- The paper
- Chen, R., Xie, T., Xie, Y., Lin, T., & Tang, N. (2016). Do speech features for detecting cognitive load depend on specific languages? Proceedings of the 18th ACM International Conference on Multimodal Interaction. https://doi.org/10.1145/2993148.2993149
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.