The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX)
Open accessAbstract
Virtual reality (VR) simulation offers significant potential for human factors training as it provides a novel approach which enables training in environments that are otherwise dangerous, impractical or expensive to simulate. While VR training has been adopted in many environments, such as heavy industry, surgery and aviation, there remains an inadequate understanding of how virtual simulations impact cognitive factors. One such factor, which needs careful consideration during the design of VR simulations, is the degree of mental or cognitive load experienced during training. This study aimed to validate a newly developed measure of workload, based on existing instruments (e.g. the NASA-TLX), but tailored to the specific demands placed on users of simulated environments. While participants completed a VR puzzle game, a series of experimental manipulations of workload were used to assess the sensitivity of the new instrument. The manipulations affected the questionnaire subscales (mental demands; physical demands; temporal demands; frustration; task complexity; situational stress; distraction; perceptual strain; task control; presence) as predicted in all cases (p s < .05), except for presence, which displayed little relationship with other aspects of task load. The scale was also found to have good convergent validity with an alternate index of task load. The findings support the sensitivity of the new instrument for assessing task load in virtual reality. Overall, this study contributes to the understanding of mental workload in simulated environments and provides a practical tool for use in both future research and applications in the field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Three papers referred to Witmer and Singer's presence questionnaire [34], and three followed the Igroup presence questionnaire (IPQ) [35], Nichols et al.'s measurements of presence [75] and an adapted form of the immersive tendencies questionnaire (ITQ) [34], one for each paper.”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [35]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“User workload in a simulation environment was evaluated using the SIM-TLX developed by Harris et al. [19] and translated by Jeong et al. [30].”
From Development and pilot evaluation of an AI-based pediatric medication safety virtual simulation program for nursing students: a quasi-experimental study in South Korea (2026) · cites this paper as Harris et al. [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
McAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Burdea, G., & Coiffet, P. (2003) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474603322955950 · Cited by 2,315
Guadagnoli, M. A., & Lee, T. D. (2004) · Journal of Motor Behavior · doi:10.3200/jmbr.36.2.212-224 · Cited by 1,534
Using Presence Questionnaires in Reality
Usoh, M., Catena, E., Arman, S., & Slater, M. (2000) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474600566989 · Cited by 980
(1999) · Cited by 944
Cognitive load theory: implications of cognitive load theory on the design of learning
Kirschner, P. A. (2002) · Learning and Instruction · doi:10.1016/s0959-4752(01)00014-7 · Cited by 917
Direct Measurement of Cognitive Load in Multimedia Learning
Brunken, R., Plass, J. L., & Leutner, D. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_7 · Cited by 896
Research works printed but not linked: 2
- Bates D, Mächler M, Bolker B, Walker S (2014) Fitting linear mixed-effects models using lme4. Retrieved from http://arxiv.org/abs/1406.5823 · arXiv
- Mestre D, Fuchs P, Berthoz A, Vercher JL (2006) Immersion et présence. In: Fuchs P, Moreau G, Berthoz A, Vercher JL (eds) Le Traite de la realite Virtuelle. Ecole Des Mines de Paris, Paris, pp 309–338
Cited by
Skulmowski, A., & Xu, K. M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09624-7 · Cited by 678
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 200
Cho, I. Y., Cho, S., Im, M. Y., Jeong, H. J., Choi, J., Choi, I. H., & Kim, H. Y. (2026) · Child Health Nursing Research · doi:10.4094/chnr.2026.016 · Cited by 1
Metadata
- Authors
- Harris, D., Wilson, M., & Vine, S.
- Affiliations
- University of Exeter (GB)
- Corresponding author
- Harris, David
- Venue
- Virtual Reality
- Published
- 2019-12-21
- Volume
- 24
- Issue
- 4
- Pages
- 557-566
- ISSN
- 1359-4338 (ISSN-L)
- 1434-9957
- OpenAlex
- W2994780247
- Cited by
- 146
- References
- 36
- Citations by year
- 2026: 18 · 2025: 40 · 2024: 25 · 2023: 24 · 2022: 21 · 2021: 14 · 2020: 4
- FWCI
- 9.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Virtual Reality (publishedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Open Research Exeter (University of Exeter) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- Royal Academy of Engineering
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Control and Systems Engineering › Simulation and Modeling Applications
- Keywords
- virtual reality simulation, mental workload, NASA-TLX, cognitive load, human factors training, scale validation, convergent validity, presence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX). https://app.cochat.ai/papers/10.1007/s10055-019-00422-9
- The paper
- Harris, D., Wilson, M., & Vine, S. (2020). Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX). Virtual Reality. https://doi.org/10.1007/s10055-019-00422-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.