Identifying Cognitive Assistance with Mobile Electroencephalography: A Case Study with In-Situ Projections for Manual Assembly
The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
Manual assembly at production is a mentally demanding task. With rapid prototyping and smaller production lot sizes, this results in frequent changes of assembly instructions that have to be memorized by workers. Assistive systems compensate this increase in mental workload by providing "just-in-time" assembly instructions through in-situ projections. The implementation of such systems and their benefits to reducing mental workload have previously been justified with self-perceived ratings. However, there is no evidence by objective measures if mental workload is reduced by in-situ assistance. In our work, we showcase electroencephalography (EEG) as a complementary evaluation tool to assess cognitive workload placed by two different assistive systems in an assembly task, namely paper instructions and in-situ projections. We identified the individual EEG bandwidth that varied with changes in working memory load. We show, that changes in the EEG bandwidth are found between paper instructions and in-situ projections, indicating that they reduce working memory compared to paper instructions. Our work contributes by demonstrating how design claims of cognitive demand can be validated. Moreover, it directly evaluates the use of assistive systems for delivering context-aware information. We analyze the characteristics of EEG as real-time assessment for cognitive workload to provide insights regarding the mental demand placed by assistive systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous work found a drop in frequencies of alpha (8-12 Hz) and an increase of theta (4-8 Hz) [122,129,130,135] when subjects had to raise mental capacities.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [130]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 10×
“Figure 5b shows the mean NASA-TLX scores.”
MethodInfluentialCognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“[77, 78] defined three key components of cognitive workload comprising intrinsic, germane, and extraneous cognitive workload.”
BackgroundBaddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · cited 1×
“Event-related potentials (ERPs) [69] refer to the time-domain waveform that is contingent upon the occurrence of a critical event such as the presentation of a stimulus.”
BackgroundCognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801 · cited 1×
“[77, 78] defined three key components of cognitive workload comprising intrinsic, germane, and extraneous cognitive workload.”
BackgroundN-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies.
Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005) · Human Brain Mapping · doi:10.1002/hbm.20131 · Cited by 3,560 · cited 2×
“However, the task difficulty can be manipulated by changing N [30, 33, 66].”
BackgroundMethodWorking memory, short-term memory, and general fluid intelligence: A latent-variable approach.
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.3.309 · Cited by 3,078 · cited 1×
“Given that cognitive workload impacts the individual task performance [18, 37], it follows that profit margins may suffer as a result of reduced production throughput and error-prone manufacturing.”
BackgroundA review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M., Congedo, M., Rakotomamonjy, A., & Yger, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab2f2 · Cited by 2,239
Research works printed but not linked: 3
- Charles W Anderson and Zlatko Sijercic. 1996. Classification of EEG signals from four subjects during five mental tasks. In Solving engineering problems with neural networks: proceedings of the conference on engineering applications in neural networks (EANN'96). Turkey 407--414. Charles W Anderson and Zlatko Sijercic. 1996. Classification of EEG signals from four subjects during five mental tasks. In Solving engineering problems with neural networks: proceedings of the conference on engineering applications in neural networks (EANN'96). Turkey 407--414.
- 10.1088/1741-2560/9/4/045008 · DOI · Paper page
- Bruce Mehler , Bryan Reimer , and Jeffery A Dusek . 2011. MIT AgeLab delayed digit recall task (n-back) . Cambridge, MA : Massachusetts Institute of Technology ( 2011 ). Bruce Mehler, Bryan Reimer, and Jeffery A Dusek. 2011. MIT AgeLab delayed digit recall task (n-back). Cambridge, MA: Massachusetts Institute of Technology (2011).
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
Self-citationThe Placebo Effect of Artificial Intelligence in Human–Computer Interaction
Kosch, T., Welsch, R., Chuang, L., & Schmidt, A. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3529225 · Cited by 137
Self-citationA Framework for Extended Reality System Development in Manufacturing
Gong, L., Fast–Berglund, Å., & Johansson, B. (2021) · IEEE Access · doi:10.1109/access.2021.3056752 · Cited by 114
Enabling productivity goals through construction 4.0 skills: Theories, debates, definitions
Siriwardhana, S., & Moehler, R. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.139011 · Cited by 81
NotiBike: Assessing Target Selection Techniques for Cyclist Notifications in Augmented Reality
Kosch, T., Matviienko, A., Müller, F., Bersch, J., Katins, C., Schön, D., & Mühlhäuser, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3546732 · Cited by 47
Self-citationHuman-centric assembly in smart factories
Wang, L., Gao, R. X., Krüger, J., & Váncza, J. (2025) · CIRP Annals · doi:10.1016/j.cirp.2025.04.058 · Cited by 43
Pušica, M., Kartali, A., Bojović, L., Gligorijević, I., Jovanović, J., Leva, M. C., & Mijović, B. (2024) · Brain Sciences · doi:10.3390/brainsci14020149 · Cited by 34
“…that sense, previous studies have reported signifi-cant correlation between the TL (which was qualitatively increased) and EEG frequency band-based metrics such as theta over alpha, where a positive correlation was reported [15], and alpha only where a significant negative correlation was shown [29].”
Morton, J., Zheleva, A., Acker, B. B. V., Durnez, W., Vanneste, P., Larmuseau, C., Bruyne, J. D., Raes, A., Cornillie, F., Saldien, J., et al. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103763 · Cited by 38
Manual assembly learning, disability, and instructions: an industrial experiment
Peltokorpi, J., Hoedt, S., Colman, T., Rutten, K., Aghezzaf, E., & Cottyn, J. (2023) · International Journal of Production Research · doi:10.1080/00207543.2023.2195957 · Cited by 33
Kosch, T., Schmidt, A., Thanheiser, S., & Chuang, L. L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376766 · Cited by 25
Self-citationYour skin resists: exploring electrodermal activity as workload indicator during manual assembly
Kosch, T., Karolus, J., Ha, H., & Schmidt, A. (2019) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/3319499.3328230 · Cited by 25
Self-citationInformation flow and cognition affect each other: Evidence from digital learning
Sharma, K., Mangaroska, K., van Berkel, N., Giannakos, M. N., & Kostakos, V. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102549 · Cited by 31
“Objective direct measures of the cognitive load (Peitek et al., 2018; Siegmund et al., 2014) through EEG or fMRI devices, negatively affect the interaction space and ecological validity of the study (Funk et al., 2016; Kosch et al., 2018).”
BackgroundA Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?
Deja, J. A., Mayer, S., Pucihar, K. Č., & Kljun, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3567719 · Cited by 30
SensCon: Embedding Physiological Sensing into Virtual Reality Controllers
Chiossi, F., Kosch, T., Menghini, L., Villa, S., & Mayer, S. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3604270 · Cited by 26
Self-citationLessons Learned from Designing and Evaluating CLAICA: A Continuously Learning AI Cognitive Assistant
Freire, S. K., Niforatos, E., Wang, C., Ruiz-Arenas, S., Foosherian, M., Wellsandt, S., & Bozzon, A. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584042 · Cited by 18
Who is in Control? Understanding User Agency in AR-assisted Construction Assembly
Yang, X., Sasikumar, P., Amtsberg, F., Menges, A., Sedlmair, M., & Nanayakkara, S. C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713765 · Cited by 15
Spatial Gaze Markers: Supporting Effective Task Switching in Augmented Reality
Lystbæk, M. N., Pfeuffer, K., Langlotz, T., Grønbæk, J. E. S., & Gellersen, H. W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642811 · Cited by 19
Looming Auditory Collision Warnings for Semi-Automated Driving: An ERP Study
Lahmer, M., Glatz, C., Seibold, V. C., & Chuang, L. L. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239060.3239086 · Cited by 15
Self-citationPerceptions of the Helpfulness of Unexpected Agent Assistance
Candon, K., Hsu, Z., Kim, Y., Chen, J., Tsoi, N., & Vázquez, M. (2022) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3527188.3561915 · Cited by 16
BrainCoDe: Electroencephalography-based Comprehension Detection during Reading and Listening
Schneegass, C., Kosch, T., Baumann, A., Rusu, M., Hassib, M. E., & Hußmann, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376707 · Cited by 16
Self-citationNowak, A., Knierim, P., Romanowski, A., Schmidt, A., & Kosch, T. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382890 · Cited by 10
Self-citationHasan, N., & Alkan, B. (2025) · Machines · doi:10.3390/machines13080658 · Cited by 8
Cavallo, D., Digiesi, S., Facchini, F., & Mummolo, G. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.01.169 · Cited by 8
Schneegass, C., Kosch, T., Schmidt, A., & Hußmann, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29387-1_17 · Cited by 11
“Due to advancements in both data classification software and EEG hardware quality [51], current technologies are becoming an increasingly robust tool for brain response evaluations even in real-world scenarios [39].”
Self-citationVitti, M., Cotruvo, A., & Facchini, F. (2025) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-025-02716-z · Cited by 9
“Kosch et al. (2018) relied on an EEG A further example of AR-based support, although not yet tested in an experimental setting and only positively evaluated through expert assessment, is provided by Agati et al. (2024), who developed a system to support manual printed circuit board assembly by…”
Niforatos, E., He, T., Vourvopoulos, A., & Giannakos, M. N. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2388368 · Cited by 9
“The Alpha band PSD, as captured by the TP9 electrode of BCIglass , revealed significant reductions in the Backward2 and Stroop4 tasks, indicating substantial cognitive workload (Grimes et al., 2008; Kosch et al., 2018).”
How Generative-AI-Assistance Impacts Cognitive Load During Knowledge Work: A Study Proposal
Schulz, T., Knierim, M. T., & Weinhardt, C. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-71385-9_31 · Cited by 12
Reading the mobile brain: from laboratory to real-world electroencephalography
Glatz, C., Ditz, J. C., Kosch, T., Schmidt, A., Lahmer, M., & Chuang, L. L. (2017) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3152832.3156560 · Cited by 5
Self-citationLow-Cost Real-Time Mental Load Adaptation for Augmented Reality Instructions - A Feasibility Study
Wolf, D. A., Wagner, T., & Rukzio, E. (2019) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct.2019.00015 · Cited by 5
“Furthermore, most approaches are limited to a post-hoc analysis of mental load [7].”
BackgroundTowards Motor Learning in Augmented Reality: Imitating an Avatar
Lampen, E., Liersch, M., & Lehwald, J. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-60703-6_23 · Cited by 4
Lukačević, F., Becattini, N., & Škec, S. (2025) · Journal of Mechanical Design · doi:10.1115/1.4068746 · Cited by 3
Zhang, X., & Wang, Y. (2024) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3758871.3758916 · Cited by 3
Lenssembly: Authoring Assembly Instructions in Augmented Reality Using Programming-by-Demonstration
Kosch, T., Knierim, P., Kritzler, M., Beicht, D., & Michahelles, F. (2022) · Springer eBooks · doi:10.1007/978-3-030-99235-4_8 · Cited by 3
Self-citationWorkload-Aware Systems and Interfaces for Cognitive Augmentation
Kosch, T. (2020) · Elektronische Hochschulschriften der LMU München (Ludwig-Maximilians-Universität München) · doi:10.48550/arxiv.2010.07703 · Cited by 4
Self-citationEnabling Tangible Interaction through Detection and Augmentation of Everyday ObjectsPreprint
Kosch, T., & Schmidt, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10904 · Cited by 3
Self-citationExploring the core cognitive dynamics of MR-enabled in-situ assembly visualization
Liu, T., He, W., Zheng, B., Bai, J., Zhang, X., Pang, W., He, Y., Billinghurst, M., & Wang, L. (2026) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2026.02.018 · Cited by 2
Gasca, M. R., Rodriguez, E., & Barbalho, S. C. M. (2026) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-026-18707-0 · Cited by 2
Investigating the Effect of Polarity in Auditory and Vibrotactile Displays Under Cognitive Load
Ferguson, J. I., Freeman, E., & Brewster, S. A. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479911 · Cited by 3
“This is a common protocol for inducing cognitive load in neuroimaging [34] and has been used successfully in human-computer interaction studies [22, 30].”
EasyEG: A 3D-printable Brain-Computer Interface
Auda, J., Heger, R., Kosch, T., Gruenefeld, U., & Schneegaß, S. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379350.3416189 · Cited by 2
Self-citationCripe, C. (2026) · Artificial intelligence · doi:10.5772/intechopen.1014199 · Cited by 1
Ergonomic Optimization of Assembly Workstations: Effects on Productivity and Mental Workload
Savković, M., Djapan, M., Caiazzo, C., Pušica, M., Vukićević, A. M., Marinković, D., & Komatina, N. (2026) · Safety · doi:10.3390/safety12010015 · Cited by 6
“In the study by authors [26], metrics for assessing mental workload were combined with defect rate monitoring.”
Acosta, A. I. G., Rodríguez, J., Leal, J. S., & Martínez, R. M. R. (2019) · Intelligent systems reference library · doi:10.1007/978-3-030-26488-8_18 · Cited by 1
Wolfartsberger, J., & Riedl, R. (2022) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-13064-9_22
Predicting Users’ Mental Effort in Drawing Tasks Using Gesture Recognition
Ray, S. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581754.3584104
Blattgerste, J., Krumstroh, F., & Pfeiffer, T. (2026) · Mensch und Computer (MuC) · doi:10.1145/3820253.3831407
“Kosch et al. studied tactile, auditory, and visual assembly error feedback [14], and later used a related Duplo setup to evaluate cognitive assistance with mobile electroencephalography [13].”
Behind the Care: Multimodal Physiological Sensing for Cognitive Load Prediction in SICU Nurses
Tazin, T., Yonezawa, T., Hossain, T., Oyama, S., Tag, B., & Salim, F. D. (2026) · ACM International Symposium on Wearable Computers (ISWC) · doi:10.1145/3830727.3834840
Intelligent assembly support systems for human-centric manufacturing: A survey
Augenstein, T., Ahn, H. S., & Lu, Y. (2026) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2026.10.006
Metadata
- Authors
- Kosch, T., Funk, M., Schmidt, A., & Chuang, L. L.
- Affiliations
- Ludwig-Maximilians-Universität München (DE)
- Technische Universität Darmstadt (DE)
- Max Planck Institute for Biological Cybernetics (DE)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2018-06-19
- Volume
- 2
- Issue
- EICS
- Pages
- 1-20
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2809429280
- Cited by
- 46
- References
- 86
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 4 · 2023: 6 · 2022: 7 · 2021: 3 · 2020: 8 · 2019: 4 · 2018: 1
- FWCI
- 2.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- mental workload, assistive systems, working memory load, manual assembly, assembly instructions, context-aware information, production lot size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.