Measuring the impact of subtitles on cognitive load: eye tracking and dynamic audiovisual texts
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
In educational design literature, it is often taken as fact that subtitles increase cognitive load (CL). This paper investigates this assumption experimentally by comparing various measures of CL when students watch a recorded academic lecture with or without subtitles. Since the measurement of cognitive load is by no means a simple matter, we first provide an overview of the different measurement techniques based on causality and objectivity. We measure CL by means of eye tracking (pupil dilation), electroencephalography (EEG), self-reported ratings of mental effort, frustration, comprehension effort and engagement, as well as performance measures (comprehension test).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Klimesch, W. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00056-3 · Cited by 6,889
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Paas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150
Pupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617 · cited 2×
“Measurement of the changes in the alpha and theta brain wave rhythms reflects what is happening in the participant(cid:146)s information processing situation, even if the participant is unaware of the changes or is unable to verbalize them [3], [10].”
BackgroundPaas, F., Renkl, A., & Sweller, J. (2004) · Instructional Science · doi:10.1023/b:truc.0000021806.17516.d0 · Cited by 1,054 · cited 1×
“In educational design subtitles are assumed to increase extraneous CL [11], [18], [23].”
BackgroundMayer, R. E., Heiser, J., & Lonn, S. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.1.187 · Cited by 1,029
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500412 · Cited by 921 · cited 2×
“Mental effort, in turn, can be defined as the total amount of controlled cognitive processing in which a subject is engaged [25].”
BackgroundDirect Measurement of Cognitive Load in Multimedia Learning
Brunken, R., Plass, J. L., & Leutner, D. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_7 · Cited by 896
Measurement of Cognitive Load in Instructional Research
Paas, F. G. W. C., van Merriënboer, J. J. G., & Adam, J. J. (1994) · Perceptual and Motor Skills · doi:10.2466/pms.1994.79.1.419 · Cited by 731
Instructional benefits of spoken words: A review of cognitive load factors
Kalyuga, S. (2012) · Educational Research Review · doi:10.1016/j.edurev.2011.12.002 · Cited by 93
Cited by
Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze
Krejtz, K., Duchowski, A. T., Niedzielska, A., Biele, C., & Krejtz, I. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203629 · Cited by 349
The Pupil Dilation Response to Auditory Stimuli: Current State of Knowledge
Zekveld, A. A., Koelewijn, T., & Kramer, S. E. (2018) · Trends in Hearing · doi:10.1177/2331216518777174 · Cited by 306
Duchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173856 · Cited by 228
The Low/High Index of Pupillary Activity
Duchowski, A. T., Krejtz, K., Gehrer, N. A., Bafna, T., & Bækgaard, P. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376394 · Cited by 94
Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
Kosch, T., Hassib, M., Woźniak, P. W., Buschek, D., & Alt, F. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174010 · Cited by 79
Metadata
- Authors
- Kruger, J.-L., Hefer, E., & Matthew, G.
- Venue
- Proceedings of the 2013 Conference on Eye Tracking South Africa
- Publisher
- ACM
- Published
- 2013-08-29
- Pages
- 62-66
- OpenAlex
- W2071435024
- Cited by
- 106
- References
- 10
- FWCI
- 20.52
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.