Using language complexity to measure cognitive load for adaptive interaction design
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
An adaptive interaction system, which is aware of the users' current cognitive load, can change its response, presentation and interaction flow to improve users' experience and their task performance. In this paper, we propose a novel speech content analysis approach for measuring users' cognitive load, based on their language and dialogue complexity. We have analysed the transcribed speech of operators working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia. The resulting patterns of language complexity show significant differences between the speech from cognitively low load and high load tasks. We also discuss the value of using this approach of cognitive load measurement for user interface evaluation and interaction design improvement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, speech features such as the flow of words (e.g., tempo [42] or pauses [117,118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants' cognitive workload.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [115]
In the citing paper
“Average word length is known to be associated with higher cognitive (Khawaja, Chen, & Marcus, 2010), conceptual complexity (Lewis & Frank, 2016), education, and social class (Hartley, Pennebaker, & Fox, 2003; Tausczik & Pennebaker, 2010).”
From World Trade Center responders in their own words: predicting PTSD symptom trajectories with AI-based language analyses of interviews (2023) · cites this paper as Khawaja, Chen, & Marcus, 2010
Citations
Cites
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 1×
“Flesch-Kincaid Grade calculates the language difficulty using average sentence lengths and average syllables per word [25].”
MethodCognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Mayer, R. E. (2001) · doi:10.1017/cbo9781139164603 · Cited by 2,304
SMOG Grading - A New Readability Formula.
McLaughlin, G. H. (1969) · The Journal of Reading · Cited by 2,081
The Technique of Clear Writing.
Gunning, R. C. (1968) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,641
Word Use in the Poetry of Suicidal and Nonsuicidal Poets
Wiltsey Stirman, S., & Pennebaker, J. W. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200107000-00001 · Cited by 547
Physiological metrics of mental workload: A review of recent progress
Kramer, A. F. (2020) · Multiple-task performance · doi:10.1201/9781003069447-14 · Cited by 459
Research works printed but not linked: 5
- 10.5555/647664.733413 · doi:10.5555/647664.733413
- Reck , P. and et el., Generating and rendering readability scores for Project Gutenberg texts , In Proc. Corpus Linguistics Conference , Birmingham, UK , 2007 , Article #120. Reck, P. and et el., Generating and rendering readability scores for Project Gutenberg texts, In Proc. Corpus Linguistics Conference, Birmingham, UK, 2007, Article #120.
- Kun-Moo Rhee and Eunil Kim, A Statistical Analysis of Text for Inferring Authenticity , Proc. 53rd Session of International Statistical Institute , Seoul , 2001 . http://isi.cbs.nl/iamamember/index.htm Kun-Moo Rhee and Eunil Kim, A Statistical Analysis of Text for Inferring Authenticity, Proc. 53rd Session of International Statistical Institute, Seoul, 2001. http://isi.cbs.nl/iamamember/index.htm
- Ure , J. Lexical density and register differentiation. Applications of Linguistics, Perren and Trim (Eds) , London : Cambridge University Press . 1971 , pp. 443 -- 452 Ure, J. Lexical density and register differentiation. Applications of Linguistics, Perren and Trim (Eds), London: Cambridge University Press. 1971, pp. 443--452
- Advanced Text Analyser , UsingEnglish , http://www.usingenglish.com ; Last accessed: Sept. 2009 Advanced Text Analyser, UsingEnglish, http://www.usingenglish.com; Last accessed: Sept. 2009
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Here, speech features such as the flow of words (e.g., tempo [42] or pauses [117, 118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants’ cognitive workload.”
Son, Y., Clouston, S. A. P., Kotov, R., Eichstaedt, J. C., Bromet, E. J., Luft, B. J., & Schwartz, H. A. (2023) · Psychological Medicine · doi:10.1017/s0033291721002294 · Cited by 42
Trust and cognitive load in the text-chat environment: the role of mouse movement
Khawaji, A., Chen, F., Zhou, J., & Marcus, N. (2014) · Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design · doi:10.1145/2686612.2686661 · Cited by 21
“An increased amount of new information has a significant impact on the way people behave, for example, people engaged in a low cognitive load task use a greater variety of words when speaking compared with people engaged in a high cognitive load task (Khawaja et al., 2010).”
BackgroundSelf-citationVizer, L. M., & Sears, A. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.03.001 · Cited by 12
“Conversely, language diversity decreases for the same reason (Khawaja and Chen 2010).”
BackgroundMethodDo speech features for detecting cognitive load depend on specific languages?
Chen, R., Xie, T., Xie, Y., Lin, T., & Tang, N. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993149 · Cited by 8
“Khawaja, Chen, and Marcus [10] proposed a novel speech content analysis approach to evaluate the current cognitive load of users based on their language and dialogue complexity.”
Background
Metadata
- Authors
- Khawaja, M. A., Chen, F., & Marcus, N.
- Affiliations
- UNSW Sydney (AU)
- Venue
- Proceedings of the 15th international conference on Intelligent user interfaces
- Publisher
- ACM
- Published
- 2010-02-07
- Pages
- 333-336
- OpenAlex
- W2139006235
- Cited by
- 32
- References
- 25
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 1 · 2022: 3 · 2021: 2 · 2020: 5 · 2019: 3 · 2017: 1 · 2016: 4 · 2015: 2 · 2014: 1 · 2013: 3 · 2012: 2
- FWCI
- 5.46
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Funders
- University of Tasmania
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- cognitive load assessment, speech content analysis, linguistic complexity, wildfire management, user interface evaluation, transcribed speech
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using language complexity to measure cognitive load for adaptive interaction design. https://app.cochat.ai/papers/10.1145/1719970.1720024
- The paper
- Khawaja, M. A., Chen, F., & Marcus, N. (2010). Using language complexity to measure cognitive load for adaptive interaction design. Proceedings of the 15th international conference on Intelligent user interfaces. https://doi.org/10.1145/1719970.1720024
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.