The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
The Effects of Virtual Reality, Augmented Reality, and Mixed Reality as Training Enhancement Methods: A Meta-Analysis
Abstract
Objective: The objective of this meta-analysis is to explore the presently available, empirical findings on transfer of training from virtual (VR), augmented (AR), and mixed reality (MR) and determine whether such extended reality (XR)-based training is as effective as traditional training methods. Background: MR, VR, and AR have already been used as training tools in a variety of domains. However, the question of whether or not these manipulations are effective for training has not been quantitatively and conclusively answered. Evidence shows that, while extended realities can often be time-saving and cost-saving training mechanisms, their efficacy as training tools has been debated. Method: The current body of literature was examined and all qualifying articles pertaining to transfer of training from MR, VR, and AR were included in the meta-analysis. Effect sizes were calculated to determine the effects that XR-based factors, trainee-based factors, and task-based factors had on performance measures after XR-based training. Results: Results showed that training in XR does not express a different outcome than training in a nonsimulated, control environment. It is equally effective at enhancing performance. Conclusion: Across numerous studies in multiple fields, extended realities are as effective of a training mechanism as the commonly accepted methods. The value of XR then lies in providing training in circumstances, which exclude traditional methods, such as situations when danger or cost may make traditional training impossible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Azuma, R. T. (1997) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1997.6.4.355 · Cited by 10,121
Defining virtual reality: Dimensions determining telepresence
Steuer, J. (1992) · Journal of Communication · doi:10.1111/j.1460-2466.1992.tb00812.x · Cited by 5,459
A Taxonomy of Mixed Reality Visual Displays
Milgram, P., & Kishino, F. (1994) · IEICE Transactions on Information and Systems · Cited by 4,905
Encoding specificity and retrieval processes in episodic memory.
Tulving, E., & Thomson, D. M. (1973) · Psychological Review · doi:10.1037/h0020071 · Cited by 4,540
Augmented reality: a class of displays on the reality-virtuality continuum:
Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1995) · SPIE Proceedings · doi:10.1117/12.197321 · Cited by 2,367
CONTEXT‐DEPENDENT MEMORY IN TWO NATURAL ENVIRONMENTS: ON LAND AND UNDERWATER
GODDEN, D. R., & BADDELEY, A. D. (1975) · British Journal of Psychology · doi:10.1111/j.2044-8295.1975.tb01468.x · Cited by 1,686
Transfer of Training: A Meta-Analytic Review
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010) · Journal of Management · doi:10.1177/0149206309352880 · Cited by 1,477 · cited 1×
“Learner capacities vary, and inherent individual differences have been shown to affect the transfer of training, whether from real or simulated sources (Blume et al., 2010).”
BackgroundKnowledge-based augmented reality
Feiner, S., Macintyre, B., & Seligmann, D. (1993) · Communications of the ACM · doi:10.1145/159544.159587 · Cited by 972
Gavish, N., Gutiérrez, T., Webel, S., Rodríguez, J., Peveri, M., Bockholt, U., & Tecchia, F. (2015) · Interactive Learning Environments · doi:10.1080/10494820.2013.815221 · Cited by 680
Buttussi, F., & Chittaro, L. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2653117 · Cited by 501
A Virtual Reality Dance Training System Using Motion Capture Technology
Chan, J. C. P., Leung, H., Tang, J. K. T., & Komura, T. (2011) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2010.27 · Cited by 460
Heim, M. (1998) · Oxford University Press eBooks · doi:10.1093/oso/9780195104264.001.0001 · Cited by 431
An augmented reality training platform for assembly and maintenance skills
Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., & Preusche, C. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.09.013 · Cited by 402
Virtual Reality Job Interview Training in Adults with Autism Spectrum Disorder
Smith, M. J., Ginger, E. J., Wright, K., Wright, M. A., Taylor, J. L., Humm, L. B., Olsen, D. E., Bell, M. D., & Fleming, M. F. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2113-y · Cited by 401
Training in virtual environments: transfer to real world tasks and equivalence to real task training
Rose, F. D., Attree, E. A., Brooks, B. M., Parslow, D. M., & Penn, P. R. (2000) · Ergonomics · doi:10.1080/001401300184378 · Cited by 372
Design and validation of an augmented book for spatial abilities development in engineering students
Martín-Gutiérrez, J., Luís Saorín, J., Contero, M., Alcañiz, M., Pérez-López, D. C., & Ortega, M. (2010) · Computers & Graphics · doi:10.1016/j.cag.2009.11.003 · Cited by 370
Yang, Y.-R., Tsai, M.-P., Chuang, T.-Y., Sung, W.-H., & Wang, R.-Y. (2008) · Gait & Posture · doi:10.1016/j.gaitpost.2007.11.007 · Cited by 334
Perceptual issues in augmented reality:
Drascic, D., & Milgram, P. (1996) · SPIE Proceedings · doi:10.1117/12.237425 · Cited by 312
Salas, E., Bowers, C. A., & Rhodenizer, L. (1998) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0803_2 · Cited by 294
Transfer of training from virtual reality
KOZAK, J. J., HANCOCK, P. A., ARTHUR, E. J., & CHRYSLER, S. T. (1993) · Ergonomics · doi:10.1080/00140139308967941 · Cited by 240
Self-citationA Meta-Analysis of the Training Effectiveness of Virtual Reality Surgical Simulators
Haque, S. A., & Srinivasan, S. P. (2006) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2005.855529 · Cited by 188
Human Factors in Simulation and Training
(2008) · CRC Press eBooks · doi:10.1201/9781420072846 · Cited by 162
The stress and workload of virtual reality training: the effects of presence, immersion and flow
Lackey, S. J., Salcedo, J. N., Szalma, J. L., & Hancock, P. A. (2016) · Ergonomics · doi:10.1080/00140139.2015.1122234 · Cited by 127
Self-citationGerson, L. B., & Dam, J. V. (2003) · Endoscopy · doi:10.1055/s-2003-40243 · Cited by 120
Virtual reality in neurologic rehabilitation of spatial disorientation
Kober, S. E., Wood, G. M. D. O., Hofer, D., Kreuzig, W., Kiefer, M., & Neuper, C. (2013) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-10-17 · Cited by 114
Ganier, F., Hoareau, C., & Tisseau, J. (2014) · Ergonomics · doi:10.1080/00140139.2014.899628 · Cited by 103
Virtual environments and ergonomics: needs and opportunities
Wilson, J. R. (1997) · Ergonomics · doi:10.1080/001401397187603 · Cited by 102
Prasertsakul, T., Kaimuk, P., Chinjenpradit, W., Limroongreungrat, W., & Charoensuk, W. (2018) · BioMedical Engineering OnLine · doi:10.1186/s12938-018-0550-0 · Cited by 98
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.09.010 · Cited by 93
Marras, W. S., & Hancock, P. A. (2013) · Applied Ergonomics · doi:10.1016/j.apergo.2013.03.025 · Cited by 85
Self-citationLee, H. Y., Kim, Y. L., & Lee, S. M. (2015) · Journal of Physical Therapy Science · doi:10.1589/jpts.27.1883 · Cited by 73
The effects of display size on performance
Hancock, P. A., Sawyer, B. D., & Stafford, S. (2015) · Ergonomics · doi:10.1080/00140139.2014.973914 · Cited by 69
Self-citationAndersen, S. A. W., Konge, L., & Sørensen, M. S. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1465182 · Cited by 62
Ma, H., Hwang, W., Fang, J., Kuo, J.-K., Wang, C.-Y., Leong, I.-F., & Wang, T. (2011) · Clinical Rehabilitation · doi:10.1177/0269215511406757 · Cited by 60
Effects of Augmented Reality Display Settings on Human Wayfinding Performance
Goldiez, B. F., Ahmad, A. M., & Hancock, P. A. (2007) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.900665 · Cited by 48
Self-citationBier, B., Ouellet, É., & Belleville, S. (2018) · Neuropsychology · doi:10.1037/neu0000417 · Cited by 47
Keeping Up with Intelligent Technology
Hancock, P. A., & Hoffman, R. R. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.13 · Cited by 14
Self-citationProceedings Seventh International Conference on Virtual Systems and Multimedia
(2001) · International Conference on Virtual Systems and Multimedia (VSMM) · doi:10.1109/vsmm.2001.969648 · Cited by 13
Virtual Reality Training Improves Real-World Performance on a Speeded Task
Whitmer, D. E., Ullman, D. L., & Johnson, C. I. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631013 · Cited by 11
Cited by
Hamad, A., & Jia, B. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191811278 · Cited by 386
A Review of Extended Reality (XR) Technologies for Manufacturing Training
Doolani, S., Wessels, C., Kanal, V., Sevastopoulos, C., Jaiswal, A., Nambiappan, H., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies8040077 · Cited by 333
The potential of immersive virtual reality to enhance learning: A meta-analysis
Coban, M., Bolat, Y. I., & Goksu, I. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100452 · Cited by 354
Chang, H.-Y., Binali, T., Liang, J.-C., Chiou, G.-L., Cheng, K.-H., Lee, S. W.-Y., & Tsai, C.-C. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104641 · Cited by 297
Tugtekin, U., & Odabasi, H. F. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10912-0 · Cited by 55
Metadata
- Authors
- Kaplan, A. D., Cruit, J., Endsley, M., Beers, S. M., Sawyer, B. D., & Hancock, P. A.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2020-02-24
- Volume
- 63
- Issue
- 4
- Pages
- 706-726
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W3006892261
- Cited by
- 565
- References
- 40
- FWCI
- 11.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.