Freeform pen-input as evidence of cognitive load and expertise
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
This paper presents a longitudinal study that explores the combined effect of cognitive load and expertise on the use of a scratchpad. Our results confirm that such cognitive support benefits users under high cognitive load through visual aid, perceptual motor use and helps to improve meaningful learning and successful problem solving. Indeed, we found significant changes in stroke frequency affected by cognitive load, which we believe are caused by the scratchpad essentially augmenting or extending working memory capacity. However, the discrepancy between stroke frequencies under low and high load is reduced with expertise. These results indicate that pen stroke frequency, which can be automated with electronic devices, could be used as an indicator of cognitive load, or conversely, of expertise level.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 1×
“Cognitive load (CL) refers to the capacity and resources used in working memory while solving complex tasks and during learning where novel information and processing are required [1, 2].”
BackgroundCognitive Psychology and Its Implications
Anderson, J. R. (2014) · Cited by 4,121
Cognitive Psychology and Its Implications
Rabkin, L. Y. (1987) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1987.41.1.146 · Cited by 3,187
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Cognitive load (CL) refers to the capacity and resources used in working memory while solving complex tasks and during learning where novel information and processing are required [1, 2].”
BackgroundImage And Brain: The Resolution of the Imagery Debate
Kosslyn, S. M. (1994) · doi:10.7551/mitpress/3653.001.0001 · Cited by 1,977
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Image and Brain: The Resolution of the Imagery Debate
Kosslyn, S. M. (1994) · Cited by 1,352
The structure of attentional resources.
Wickens, C. (1980) · Attention and performance · Cited by 821
Physiological metrics of mental workload: A review of recent progress
Kramer, A. F. (2020) · Multiple-task performance · doi:10.1201/9781003069447-14 · Cited by 459
When do we interact multimodally?: cognitive load and multimodal communication patterns
Oviatt, S., Coulston, R., & Lunsford, R. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027957 · Cited by 285 · cited 1×
“Four main methods are used in the literature: (a) physiological measures, such as galvanic skin response (GSR), and heart rate [4]; (b) subjective (self-report) measures, where users rank their experienced level of load [5]; (c) performance measures, which include dual-task, test scores and error rates [6]; and, (d) b…”
MethodOn the Psychophysics of Workload: Why Bother with Subjective Measures?
Gopher, D., & Braune, R. (1984) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088402600504 · Cited by 280
Assessing Cognitive Load with Physiological Sensors
Ikehara, C. S., & Crosby, M. E. (2005) · Proceedings of the 38th Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2005.103 · Cited by 150 · cited 1×
“Four main methods are used in the literature: (a) physiological measures, such as galvanic skin response (GSR), and heart rate [4]; (b) subjective (self-report) measures, where users rank their experienced level of load [5]; (c) performance measures, which include dual-task, test scores and error rates [6]; and, (d) b…”
MethodComputers as Cognitive Tools: No More Walls
Lajoie, S. P. (2000) · L. Erlbaum Associates Inc. eBooks · Cited by 148
Speech-based cognitive load monitoring system
Yin, B., Chen, F., Ruiz, N., & Ambikairajah, E. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518041 · Cited by 87 · cited 1×
“speech signals [9], linguistic or grammatical features [10], or changes in the quality of interactive digital pen input [11].”
BackgroundSelf-citationSpatial Representations and Imagery in Learning
Schwartz, D. L., & Heiser, J. (2005) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9780511816833.018 · Cited by 87 · cited 1×
“Moreover, writing and drawing can make effective use of people’s perceptual motor system, further engaging working memory, for example by encouraging multimodal cueing or encoding, and perception-action coupling [16].”
BackgroundUsing pen input features as indices of cognitive load
Ruiz, N., Taib, R., Shi, Y. (., Choi, E., & Chen, F. (2007) · Proceedings of the 9th international conference on Multimodal interfaces · doi:10.1145/1322192.1322246 · Cited by 34 · cited 1×
“speech signals [9], linguistic or grammatical features [10], or changes in the quality of interactive digital pen input [11].”
BackgroundSelf-citationCognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design
Khawaja, M. A., Chen, F., Owen, C., & Hickey, G. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03655-2_54 · Cited by 21 · cited 1×
“speech signals [9], linguistic or grammatical features [10], or changes in the quality of interactive digital pen input [11].”
BackgroundSelf-citationIdentifying expertise markers in routine work artifacts: exploring micronote taking behavior
Lutters, W. G. (2003) · Computers in Human Behavior · doi:10.1016/j.chb.2003.10.014 · Cited by 9 · cited 2×
“Notetaking itself is a type of visualisation strategy that can have a number of specific benefits in learning how to solve complex problems [13] such as planning and organisation [15].”
BackgroundDesigning Interfaces that Stimulate Ideational Super-fluency
Oviatt, S. L. (2017) · Scholarly and Research Communication · doi:10.22230/src.2017v8n2a278 · Cited by 2 · cited 3×
“In particular, pen input supports thought-organising activities such as counting, ordering, grouping, labelling and showing relationships, helping complex problem solving in high CL contexts [12].”
BackgroundInfluential
Research works printed but not linked: 1
- S. Oviatt , "Designing Interfaces that stimulate ideational superfluency," in INKE 2009 : Research Foundations for Understanding Book and Reading in the Digital Age: Implementing New Knowledge Environments . vol. 1 , 2009 . S. Oviatt, "Designing Interfaces that stimulate ideational superfluency," in INKE 2009: Research Foundations for Understanding Book and Reading in the Digital Age: Implementing New Knowledge Environments. vol. 1, 2009.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“During handwriting with a stylus, the velocity [211, 260], frequency [210], trajectory duration [209], and pressure of strokes [260] were studied as indicators for cognitive workload.”
Multimodal behavior and interaction as indicators of cognitive load
Chen, F., Ruiz, N., Choi, E., Epps, J., Khawaja, M. A., Taib, R., Yin, B., & Wang, Y. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2395123.2395127 · Cited by 141
Self-citationStuijfzand, B. G., van der Schaaf, M. F., Kirschner, F., Ravesloot, C. J., van der Gijp, A., & Vincken, K. L. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.04.015 · Cited by 32
“…body of research using indirect and direct objective measures to measure cognitive load such as EEG (Antonenko et al., 2010), skin response (Nourbakhsh et al., 2013), speech (Khawaja, Chen, & Marcus, 2014), eye movements (Chen & Epps, 2013) and human-computer interaction (Ruiz et al., 2011, 2007).”
BackgroundAutomatic cognitive load evaluation using writing features: An exploratory study
Lin, T., Xie, T., Chen, Y., & Tang, N. (2013) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2013.02.002 · Cited by 11
Wu, Z., Lin, T., & Tang, N. (2016) · International Journal of Technology and Human Interaction · doi:10.4018/ijthi.2016070102 · Cited by 8
Metadata
- Authors
- Ruiz, N., Taib, R., & Chen, F.
- Affiliations
- Data61 (AU)
- Venue
- Proceedings of the 13th international conference on multimodal interfaces
- Publisher
- ACM
- Published
- 2011-11-14
- Pages
- 185-188
- OpenAlex
- W2031195320
- Cited by
- 11
- References
- 19
- Citations by year
- 2025: 2 · 2023: 1 · 2020: 1 · 2016: 3 · 2015: 1 · 2013: 2 · 2012: 1
- FWCI
- 1.53
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Funders
- Australian Government
- Australian Research Council
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- cognitive load, expertise, Scratchpads, pen-based input, stroke frequency, working memory, cognitive support, meaningful learning, problem solving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.