Potential speech features for cognitive load measurement
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Intelligent user interfaces with an awareness of a user's experienced level of cognitive load have the potential to change the way output strategies are implemented and executed. However, current methods of measuring cognitive load are intrusive and unsuitable in real-time scenarios. Certain speech features have been shown to change under high levels of load. We present a dual-task speech based user study in which we explore three speech features: pause length, pause frequency and latency to response. These features are evaluated for their diagnostic capacity. Pause length and latency to response are shown to be useful indicators of high load versus low load speech.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, speech features such as the flow of words (e.g., tempo [42] or pauses [117,118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants' cognitive workload.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [117]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Egeth, H., & Kahneman, D. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,972
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Jacobs, S. C., Friedman, R., Parker, J. D., Tofler, G. H., Jimenez, A. H., Muller, J. E., Benson, H., & Stone, P. H. (1994) · American Heart Journal · doi:10.1016/0002-8703(94)90748-x · Cited by 178
Predicting hyperarticulate speech during human-computer error resolution
Oviatt, S., MacEachern, M., & Levow, G.-A. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00005-3 · Cited by 144
Interpreting Symptoms of Cognitive Load in Speech Input
Berthold, A., & Jameson, A. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_23 · Cited by 102
Exploiting prosodic structuring of coverbal gesticulation
Kettebekov, S. (2004) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1027933.1027953 · Cited by 28
Research works printed but not linked: 2
- The Lexile Framework for Reading; MetaMetrics Inc.; http://www.Lexile.com; Last accessed : July 2007 . The Lexile Framework for Reading; MetaMetrics Inc.; http://www.Lexile.com; Last accessed: July 2007.
- ProComp Infinity Hardware Manual; Thought Technology Ltd. , http://www.thoughttechnology.com ; page 30 . ProComp Infinity Hardware Manual; Thought Technology Ltd., http://www.thoughttechnology.com; page 30.
Cited by
Integrating cognitive load theory and concepts of human–computer interaction
Hollender, N., Hofmann, C., Deneke, M., & Schmitz, B. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.05.031 · Cited by 328
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“, tempo [42] or pauses [117, 118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants’ cognitive workload.”
Janssen, J., Kirschner, F., Erkens, G., Kirschner, P. A., & Paas, F. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9131-x · Cited by 180
Investigation of spectral centroid features for cognitive load classification
Le, P. N., Ambikairajah, E., Epps, J., Sethu, V., & Choi, E. H. C. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.005 · Cited by 87
Measuring cognitive load and cognition: metrics for technology-enhanced learning.
Martin, S. (2014) · Educational Research and Evaluation · doi:10.1080/13803611.2014.997140 · Cited by 65
Darejeh, A., Marcus, N., Mohammadi, G., & Sweller, J. (2026) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208261427867 · Cited by 58
Using language complexity to measure cognitive load for adaptive interaction design
Khawaja, M. A., Chen, F., & Marcus, N. (2010) · Proceedings of the 15th international conference on Intelligent user interfaces · doi:10.1145/1719970.1720024 · Cited by 32
Self-citationThink before you talk: an empirical study of relationship between speech pauses and cognitive load
Khawaja, M. A., Ruiz, N., & Chen, F. (2008) · Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat · doi:10.1145/1517744.1517814 · Cited by 30
Self-citationWirzberger, M., Herms, R., Bijarsari, S. E., Eibl, M., & Rey, G. D. (2018) · Cognitive Research Principles and Implications · doi:10.1186/s41235-018-0138-z · Cited by 28
Cognitive Load Estimation From Speech Commands to Simulated Aircraft
Vukovic, M., Stolar, M. N., & Lech, M. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3057492 · Cited by 27
Fillers as Signals: Evidence From a Question–Answering Paradigm
Walker, E. J., Risko, E. F., & Kingstone, A. F. (2014) · Discourse Processes · doi:10.1080/0163853x.2013.862478 · Cited by 23
Estimating cognitive load from speech gathered in a complex real-life training exercise
Vukovic, M., Sethu, V., Parker, J., Cavedon, L., Lech, M., & Thangarajah, J. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.12.003 · Cited by 21
Cognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design
Khawaja, M. A., Chen, F., Owen, C., & Hickey, G. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03655-2_54 · Cited by 21
Self-citationRuiz, N., Chen, F., & Oviatt, S. L. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374825-6.00010-1 · Cited by 21
Self-citationSymptoms of cognitive load in interactions with a dialogue system
Lopes, J., Lohan, K. S., & Hastie, H. (2018) · doi:10.1145/3279810.3279851 · Cited by 16
A non-uniform subband approach to speech-based cognitive load classification
Le, P. N., Ambikairajah, E., Choi, E. H. C., & Epps, J. (2009) · International Conference on Information, Communications & Signal Processing (ICICS) · doi:10.1109/icics.2009.5397501 · Cited by 15
Human-centered Behavioral and Physiological Security
Alt, F., Hassib, M. E., & Distler, V. (2023) · New Security Paradigms Workshop · doi:10.1145/3633500.3633504 · Cited by 12
Modelling students' effort using behavioral data
Moissa, B., Bonnin, G., Castagnos, S., & Boyer, A. E. (2019) · HAL · Cited by 11
Tomassi, N. E., Turashvili, D. M., Williams, A., Walsh, B. M., Stephen, E. P., & Stepp, C. E. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-24-00601 · Cited by 9
Do speech features for detecting cognitive load depend on specific languages?
Chen, R., Xie, T., Xie, Y., Lin, T., & Tang, N. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993149 · Cited by 8
“[28] Yin, B., Chen, F., Ruiz, N. and Ambikairajah, E. 2008.”
BackgroundInfluentialExploiting Wearable Technologies to Measure and Predict Students’ Effort
Moissa, B., Bonnin, G., & Boyer, A. E. (2019) · Springer eBooks · doi:10.1007/978-3-319-64301-4_19 · Cited by 8
Acker, B. B. V. (2020) · Ghent University Academic Bibliography (Ghent University) · Cited by 7
Le, P. N. (2012) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/15266 · Cited by 6
Haptic system to alert users before impending human errors
Kahol, K., & Saeidi, F. (2009) · IEEE International Workshop on Haptic Audio visual Environments and Games · doi:10.1109/have.2009.5356125 · Cited by 3
Autonomic Arousal During Speech Production and Sensorimotor Adaptation
Tomassi, N. E., Turashvili, D. M., Williams, A., Walsh, B. M., Stephen, E. P., & Stepp, C. E. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-25-00171 · Cited by 2
The Potential of Cognitive Circles to Measure Mental Load
Méndez, G. G., Galárraga, L. A., Quijije, R., & Nacenta, M. A. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747716 · Cited by 2
Cognitive-Load-Aware Multimodal Video Segmentation for Adaptive Consumer Media Systems
da Silva, W. F., Dong, F., Abel, A. K., & Fernando, A. (2026) · International Conference on Consumer Electronics · doi:10.1109/icce67443.2026.11449659
Maximizing students' engagement through effort-based recommendations
Moissa, B. (2021) · theses.fr (ABES) · doi:10.70675/2d6de5b4z1dfcz4480za4e2z4998f0da76ba
Metadata
- Authors
- Khawaja, M. A., Ruiz, N., & Chen, F.
- Affiliations
- UNSW Sydney (AU)
- Data61 (AU)
- ORCID
- Chen, Fang
- Venue
- Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces
- Publisher
- ACM
- Published
- 2007-11-28
- Pages
- 57-60
- OpenAlex
- W2062577035
- Cited by
- 26
- References
- 8
- Citations by year
- 2026: 2 · 2025: 3 · 2023: 2 · 2021: 2 · 2019: 2 · 2018: 3 · 2016: 1 · 2014: 1 · 2013: 1
- FWCI
- 4.97
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Australian Conference on Computer-Human Interaction (OzCHI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- cognitive load, speech features, pause duration, pause frequency, response latency, dual-task paradigm, intelligent user interfaces, user awareness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.