CoWME: a general framework to evaluate cognitive workload during multimodal interaction
The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.
Abstract
Evaluating human machine interaction in the case of multimodal systems is often a difficult task involving the monitoring of multiple sources, data fusion and results interpretation. While subtasks are highly dependent on the specific goal of the application and on the available interaction modalities, it is possible to formalize this workflow into a standard process and to consider a generic measure to estimate the ease of use of a specific application. In this work, we present CoWME, a modular software architecture describing multimodal human machine interaction evaluation, from data collection to final evaluation, in a formal way, in terms of cognitive workload. Communication protocols between modules are described in XML while data fusion is delegated to a configurable rule engine. An interface module is introduced between the monitoring modules and the rule engine to collect and summarize data streams for cognitive workload evaluation. We present a deployment example showing how this architecture is deployed by monitoring an interactive session with an Android application taking into account stressed speech detection, mydriasis and touch analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, touch input [39] -especially finger trajectories [173] -were used to measure cognitive workload.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [39]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Praat : doing phonetics by computer [Computer program]
Boersma, P. (2011) · Medical Entomology and Zoology · Cited by 4,110
Rete: A fast algorithm for the many pattern/many object pattern match problem
Forgy, C. L. (1982) · Artificial Intelligence · doi:10.1016/0004-3702(82)90020-0 · Cited by 2,634
Pupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617
English phonetics and phonology : a practical course
Roach, J. W. (1983) · Cambridge University Press eBooks · Cited by 783
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Cognitive load as a factor in the structuring of technical material.
Sweller, J., Chandler, P., Tierney, P., & Cooper, M. (1990) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.119.2.176 · Cited by 629 · cited 2×
“As an application can benefit from the possibility of multimodality, that can potentially reduce the cognitive workload [4], such evaluation of the load can be used to estimate the usability of the application.”
BackgroundMethodPupillary dilation as a measure of attention: a quantitative system analysis
Hoeks, B., & Levelt, W. J. M. (1993) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204445 · Cited by 342
Task-evoked pupillary response to mental workload in human-computer interaction
Iqbal, S. T., Zheng, X. S., & Bailey, B. P. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986094 · Cited by 317
Human-centered design meets cognitive load theory: designing interfaces that help people think
Oviatt, S. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180831 · Cited by 315
Research works printed but not linked: 2
- 10.5555/820752.821586 · doi:10.5555/820752.821586
- A. Muron and J. Pospis . The human iris structure and its usage . Physica , 39 : 87 -- 95 , 2000 . A. Muron and J. Pospis. The human iris structure and its usage. Physica, 39:87--95, 2000.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Here, speech features such as the flow of words (e.g., tempo [42] or pauses [117, 118]), but also more nuanced features such as the lexical density [115], the spectral domain [259], or the pitch contour [39] while talking were shown to be indicators of changes in participants’ cognitive workload.”
Cruz-Benito, J., García‐Peñalvo, F. J., & Therón, R. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2018.09.006 · Cited by 44
Navigating Wall-sized Displays with the Gaze: a Proposal for Cultural Heritage.
Calandra, D., Mauro, D. D., Cutugno, F., & Martino, S. D. (2016) · Advanced Visual Interfaces · Cited by 26
Self-citationCantone, F., Emanuela, M., & Marrelli, M. (2014) · Archeologia e Calcolatori · doi:10.19282/ac.25.2014.11 · Cited by 8
AutoMyDe: A Detector for Pupil Dilation in Cognitive Load Measurement
Calandra, D. M., & Cutugno, F. (2014) · Lecture notes in information systems and organisation · doi:10.1007/978-3-319-07040-7_15 · Cited by 3
Self-citation
Metadata
- Authors
- Calandra, D. M., Caso, A., Cutugno, F., Origlia, A., & Rossi, S.
- Affiliations
- University of Naples Federico II (IT)
- Venue
- Proceedings of the 15th ACM on International conference on multimodal interaction
- Publisher
- ACM
- Published
- 2013-12-09
- Pages
- 111-118
- OpenAlex
- W1994827370
- Cited by
- 7
- References
- 27
- Citations by year
- 2025: 1 · 2023: 1 · 2018: 1 · 2016: 2 · 2014: 2
- FWCI
- 1.05
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Funders
- National Aeronautics and Space Administration
- Ministero dell'Università e della Ricerca
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- usability evaluation, mental workload, modular software architecture, data fusion, rule engine, data stream monitoring, pupil dilation, Android application, interaction modalities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CoWME: a general framework to evaluate cognitive workload during multimodal interaction. https://app.cochat.ai/papers/10.1145/2522848.2522867
- The paper
- Calandra, D. M., Caso, A., Cutugno, F., Origlia, A., & Rossi, S. (2013). CoWME: a general framework to evaluate cognitive workload during multimodal interaction. Proceedings of the 15th ACM on International conference on multimodal interaction. https://doi.org/10.1145/2522848.2522867
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.