Investigating Representation of Text and Audio in Educational VR using Learning Outcomes and EEG
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
This paper reports findings from a between-subjects experiment that investigates how different learning content representations in virtual environments (VE) affect the process and outcomes of learning. Seventy-eight participants were subjected to an immersive virtual reality (VR) application, where they received identical instructional information, rendered in three different formats: as text in an overlay interface, as text embedded semantically in a virtual book, or as audio. Learning outcome measures, self-reports, and an electroencephalogram (EEG) were used to compare conditions. Results show that reading was superior to listening for the learning outcomes of retention, self-efficacy, and extraneous attention. Reading text from a virtual book was reported to be less cognitively demanding, compared to reading from an overlay interface. EEG analyses show significantly lower theta and higher alpha activation in the audio condition. The findings provide important considerations for the design of educational VR environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Klimesch, W. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00056-3 · Cited by 6,889
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801 · cited 1×
“working memory is already overloaded by visual stimuli, and presenting some information in audio should therefore reduce cognitive load and improve learning [40, 62].”
BackgroundPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · cited 3×
“To measure self-reported cognitive load we employed four measures: a mental effort item from Paas [49], aimed at assessing cognitive capacity invested during learning; an item to measure perceived concentration during learning, adapted from Salomon [56]; an intrinsic cognitive load item from Ayres [3] to measure the p…”
BackgroundMethodMerchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.07.033 · Cited by 2,109
A review of the use of virtual reality head-mounted displays in education and training
Jensen, L., & Konradsen, F. (2018) · Education and Information Technologies · doi:10.1007/s10639-017-9676-0 · Cited by 1,638 · cited 2×
“Despite the increase in scholarly interest in learning in VR, some are voicing a lack of rigorous, theory-driven empirical research to shed light on how VR influence learning [12, 21, 46].”
BackgroundHalliday, D. M., Rosenberg, J. R., Amjad, A. M., Breeze, P., Conway, B. A., & Farmer, S. F. (1995) · Progress in Biophysics and Molecular Biology · doi:10.1016/s0079-6107(96)00009-0 · Cited by 1,107
Salomon, G. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.4.647 · Cited by 1,015 · cited 3×
“To measure self-reported cognitive load we employed four measures: a mental effort item from Paas [49], aimed at assessing cognitive capacity invested during learning; an item to measure perceived concentration during learning, adapted from Salomon [56]; an intrinsic cognitive load item from Ayres [3] to measure the p…”
BackgroundMethodMayer, R. E., & Anderson, R. B. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.444 · Cited by 1,000 · cited 1×
“, building connections between corresponding elements of presented information, problem-solving) [41].”
BackgroundMemory processes, brain oscillations and EEG synchronization
Klimesch, W. (1996) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(96)00057-8 · Cited by 923 · cited 3×
“The positive relation between θ activation and mental effort has also been explicated in reviews by Klimesch [27,28].”
BackgroundTheta and gamma oscillations predict encoding and retrieval of declarative memory
Osipova, D., Takashima, A., Oostenveld, R., Fernández, G., Maris, E., & Jensen, O. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1948-06.2006 · Cited by 671 · cited 2×
“Nevertheless, increases in parietal θ have been previously associated with long-term memory encoding and retrieval [48].”
BackgroundMakransky, G., Borre‐Gude, S., & Mayer, R. E. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12375 · Cited by 532
Self-citationMeyer, O. A., Omdahl, M. K., & Makransky, G. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103603 · Cited by 515 · cited 3×
“, [34, 43,45]), two custom-made tests were developed for evaluating learning outcomes – a knowledge retention test and a knowledge transfer test.”
BackgroundMethodSelf-citationButtussi, F., & Chittaro, L. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2653117 · Cited by 501
Embodied cognition and the magical future of interaction design
Kirsh, D. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2442106.2442109 · Cited by 465 · cited 1×
“A growing body of literature in embodied interaction also considers the relations between the body, the environment and cognitive activity [14, 25].”
BackgroundCierniak, G., Scheiter, K., & Gerjets, P. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.020 · Cited by 412 · cited 1×
“…perceived concentration during learning, adapted from Salomon [56]; an intrinsic cognitive load item from Ayres [3] to measure the perceived difficulty of the subject; an extraneous cognitive load item from Cierniak et al. [11] to assess how difficult the participants experienced the instructions.”
MethodUsing subjective measures to detect variations of intrinsic cognitive load within problems
Ayres, P. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.09.001 · Cited by 381 · cited 3×
“To measure self-reported cognitive load we employed four measures: a mental effort item from Paas [49], aimed at assessing cognitive capacity invested during learning; an item to measure perceived concentration during learning, adapted from Salomon [56]; an intrinsic cognitive load item from Ayres [3] to measure the p…”
BackgroundMethodChittaro, L., & Buttussi, F. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2391853 · Cited by 373 · cited 1×
“, ability to use learned information in new contexts) [10, 34, 37].”
BackgroundMakransky, G., & Petersen, G. B. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.02.002 · Cited by 321 · cited 1×
“This highlights the importance of using multiple methods when inquiring into cognitive processes during complex tasks, such as learning in immersive technologies [34,35].”
BackgroundSelf-citationVirtual training: Making reality work?
Bertram, J., Moskaliuk, J., & Cress, U. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.032 · Cited by 137
Sjölie, D., Bodin, K., Elgh, E., Eriksson, J., Janlert, L.-E., & Nyberg, L. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753454 · Cited by 19 · cited 2×
“Following indications suggesting that the design of virtual reality environments influence learning outcomes [37] and that immersive technologies affect cognitive processing during learning [52, 59], we investigated the effectiveness of learning content representations in VR.”
Background
Cited by
Makransky, G., & Mayer, R. E. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09675-4 · Cited by 386
“While immersive environments can diminish extraneous cognitive load by shutting out potential distractions from the physical environment (Baceviciute et al., 2020), research also shows that immersive environments can increase cognitive load because”
BackgroundSelf-citationSignaling in virtual reality influences learning outcome and cognitive load
Albus, P., Vogt, A., & Seufert, T. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104154 · Cited by 319
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 200
“…as the dominant skill taught (Zou, Li, and Cao 2016; Longo, Nicoletti, and Padovano 2019; Torres-Guerrero, Neira-Tovar, and Torres-Treviño 2019; Baceviciute et al. 2020; Shi, Du, and Worthy 2020; Shi et al. 2020) followed by perceptual-motor skills with two papers (Muñoz, Pope, and Velez 2019;…”
Background
Metadata
- Authors
- Baceviciute, S., Mottelson, A., Terkildsen, T., & Makransky, G.
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-13
- OpenAlex
- W3031977835
- Cited by
- 78
- References
- 20
- FWCI
- 8.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.