Sensing cognitive multitasking for a brain-based adaptive user interface
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Multitasking has become an integral part of work environments, even though people are not well-equipped cognitively to handle numerous concurrent tasks effectively. Systems that support such multitasking may produce better performance and less frustration. However, without understanding the user's internal processes, it is difficult to determine optimal strategies for adapting interfaces, since all multitasking activity is not identical. We describe two experiments leading toward a system that detects cognitive multitasking processes and uses this information as input to an adaptive interface. Using functional near-infrared spectroscopy sensors, we differentiate four cognitive multitasking processes. These states cannot readily be distinguished using behavioral measures such as response time, accuracy, keystrokes or screen contents. We then present our human-robot system as a proof-of-concept that uses real-time cognitive state information as input and adapts in response. This prototype system serves as a platform to study interfaces that enable better task switching, interruption management, and multitasking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×
“While adaptive user interfaces may be designed to reduce mental workload, any automation may also result in reduced situation awareness, increased user complacency and skill degradation, and these human performance areas should be evaluated in the system [28].”
BackgroundToward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334 · cited 1×
“Other physiological measures, including skin conductance, respiration, facial muscle tension and blood volume pressure, have also been used to detect cognitive or emotional states to improve machine intelligence [6, 23, 29].”
Fundamentals of physiological computing
Fairclough, S. H. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2008.10.011 · Cited by 608
McFarlane, D. C. (2002) · Human–Computer Interaction · doi:10.1207/s15327051hci1701_2 · Cited by 378
Task-evoked pupillary response to mental workload in human-computer interaction
Iqbal, S. T., Zheng, X. S., & Bailey, B. P. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986094 · Cited by 317
Predicting human interruptibility with sensors: a Wizard of Oz feasibility study
Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., & Yang, J. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642657 · Cited by 295 · cited 1×
“…systems that try to identify the cost associated with interruption based on different inputs, such as desktop activity, environment context [7, 13, 35], eye tracking [12], or other physiological measures such as heart rate variability and electromyogram [4] and handle interruptions…”
BackgroundPsychological Issues in Support of Multiple Activities
MIYATA, Y., & NORMAN, D. A. (1986) · User Centered System Design · doi:10.1201/b15703-13 · Cited by 245
Iqbal, S. T., & Bailey, B. P. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056948 · Cited by 203
Towards an index of opportunity: understanding changes in mental workload during task execution
Iqbal, S. T., Adamczyk, P. D., Zheng, X. S., & Bailey, B. P. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055016 · Cited by 196 · cited 2×
“Researchers have shown that different types of subtasks lead to different mental workload levels [15].”
BackgroundUsing fNIRS brain sensing in realistic HCI settings: experiments and guidelines
Solovey, E. T., Girouard, A., Chauncey, K., Hirshfield, L. M., Sassaroli, A., Zheng, F., Fantini, S., & Jacob, R. J. K. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622207 · Cited by 115
Self-citation
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
Dynamic difficulty using brain metrics of workload
Afergan, D., Peck, E. M., Solovey, E. T., Jenkins, A., Hincks, S. W., Brown, E. T., Chang, R., & Jacob, R. J. K. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557230 · Cited by 148
Self-citationUsing fNIRS brain sensing to evaluate information visualization interfaces
Peck, E. M. M., Yuksel, B. F., Ottley, A., Jacob, R. J. K., & Chang, R. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470723 · Cited by 113
Self-citationBrainput: enhancing interactive systems with streaming fnirs brain input
Solovey, E., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., & Jacob, R. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208372 · Cited by 86
“This paper builds on these results by using the known multitasking activities described by Koechlin et al. [14] and [29] as stimuli for creating individual sets of fNIRS training data during multitasking for each user.”
BackgroundMethodInfluentialSelf-citationAfergan, D., Shibata, T., Hincks, S. W., Peck, E. M., Yuksel, B. F., Chang, R., & Jacob, R. J. K. (2014) · Proceedings of the 27th annual ACM symposium on User interface software and technology · doi:10.1145/2642918.2647414 · Cited by 19
Self-citation
Metadata
- Authors
- Solovey, E. T., Lalooses, F., Chauncey, K., Weaver, D., Parasi, M., Scheutz, M., Sassaroli, A., Fantini, S., Schermerhorn, P., Girouard, A., & Jacob, R. J. K.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2011-05-07
- Pages
- 383-392
- OpenAlex
- W2104542435
- Cited by
- 53
- References
- 13
- FWCI
- 13.72
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sensing cognitive multitasking for a brain-based adaptive user interface. https://app.cochat.ai/papers/10.1145/1978942.1978997
- The paper
- Solovey, E. T., Lalooses, F., Chauncey, K., Weaver, D., Parasi, M., Scheutz, M., Sassaroli, A., Fantini, S., Schermerhorn, P., Girouard, A., & Jacob, R. J. K. (2011). Sensing cognitive multitasking for a brain-based adaptive user interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1978942.1978997
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.