CoChat

Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review

Open access

Published version of a preprint

The DOI matches its Crossref record; 108 of the 108 references it cites were found in a registry or an index.

Abstract

Background: Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)–based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility. Objective: This systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects. Methods: EBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings. Results: The search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments. Conclusions: Although it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/50282

Cites

108 of 108 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Systematic review process and results from literature searches in EBSCOhost, Scopus, and Web of Science databases.
Figure 1 Systematic review process and results from literature searches in EBSCOhost, Scopus, and Web of Science databases.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 6

  1. Kvavilashvili, L, 2004, History Philos Psychol, 6, 59
  2. Pedroli, E, 2013, Stud Health Technol Inform, 191, 38
  3. Riva, G, 2011, Stud Health Technol Inform, 163, 493
  4. Delis, DC, 2000, California Verbal Learning Test-Second Edition (CVLT-II)
  5. Wilson, BA, 2008, Rivermead Behavioural Memory Test - Third Edition
  6. D'Elia, LF, 1996, Color Trails Test

Cited by

See all 40

Metadata

Authors
Kirkham, R., Kooijman, L., Albertella, L., Myles, D., Yücel, M., & Rotaru, K.
Affiliations
  • Monash University (AU)
  • Deakin University (AU)
  • QIMR Berghofer Medical Research Institute (AU)
Corresponding author
Kirkham, Rebecca
Venue
JMIR Serious Games
Published
2024-02-26
Volume
12
Pages
e50282
ISSN
2291-9279 (ISSN-L)
OpenAlex
W4390419184
Cited by
40
References
108
Citations by year
2026: 17 · 2025: 16 · 2024: 7
FWCI
1.40
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Serious Games (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (acceptedVersion)
  • Figshare (submittedVersion, cc-by)
Funders
  • Wilson Foundation
  • Department of Science and Technology, Ministry of Science and Technology, India
  • Universiteit van Amsterdam
  • Department of Industry, Innovation and Science, Australian Government
  • National Institutes of Health
  • National Health and Medical Research Council
  • Defence Science and Technology Group
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
executive function, immersive virtual reality, neuropsychological assessment, cybersickness, ecological validity, test validation, inhibitory control, cognitive flexibility, working memory, planning, attention, user experience, head-mounted displays, psychometric properties, healthy adults, clinical populations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.