Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 108 of the 108 references it cites were found in a registry or an index.
Abstract
Background: Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)–based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility. Objective: This systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects. Methods: EBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings. Results: The search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments. Conclusions: Although it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, their accuracy in assessing functional deficits in ADHD may be limited.”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically conducted in clinical or laboratory settings, these tests often evaluate specific skills in isolation, potentially overlooking interactions between different EFs and their relevance to daily activities [4,5].”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically conducted in clinical or laboratory settings, these tests often evaluate specific skills in isolation, potentially overlooking interactions between different EFs and their relevance to daily activities [4,5].”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically conducted in clinical or laboratory settings, these tests often evaluate specific skills in isolation, potentially overlooking interactions between different EFs and their relevance to daily activities [4,5].”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recent advancements in virtual reality (VR) technology have provided promising avenues for creating immersive digital environments that simulate real-life scenarios [5].”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156 · cited 1×
“Our review methodology followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [57].”
MethodThe journal coverage of Web of Science and Scopus: A comparative analysis
Mongeon, P., & Paul-Hus, A. (2016) · Scientometrics · doi:10.1007/s11192-015-1765-5 · Cited by 5,274 · cited 1×
“To compensate for the bias toward engineering and natural science articles found through Scopus and WoS [59], EBSCOhost was searched for articles published in fields such as (clinical) psychology and medicine.”
MethodDelis-Kaplan Executive Function System
Delis, D. C., Kaplan, E., & Kramer, J. H. (2012) · PsycTESTS Dataset · doi:10.1037/t15082-000 · Cited by 2,683
Assessment and Development of Executive Function (EF) During Childhood
Anderson, P. (2002) · Child Neuropsychology · doi:10.1076/chin.8.2.71.8724 · Cited by 2,218
DEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 1×
“For example, the Multiple Errands Test (MET) [31] requires individuals to run errands in a real environment (eg, a shopping center).”
BackgroundEssentials of Psychological Testing
Urbina, S. (2014) · doi:10.1002/9781394259458 · Cited by 1,845
Snyder, H. R. (2013) · Psychological Bulletin · doi:10.1037/a0028727 · Cited by 1,667 · cited 1×
“Although traditional methods used to assess EF are popular [11,12] and well validated [13], they have been criticized for their lack of ecological validity [14,15].”
Method
Research works printed but not linked: 6
- Kvavilashvili, L, 2004, History Philos Psychol, 6, 59
- Pedroli, E, 2013, Stud Health Technol Inform, 191, 38
- Riva, G, 2011, Stud Health Technol Inform, 163, 493
- Delis, DC, 2000, California Verbal Learning Test-Second Edition (CVLT-II)
- Wilson, BA, 2008, Rivermead Behavioural Memory Test - Third Edition
- D'Elia, LF, 1996, Color Trails Test
Cited by
Jespersen, A. E., Lumbye, A., Schandorff, J. M., Damgaard, V., Glenthøj, L. B., Nordentoft, M., Mikkelsen, C., Didriksen, M., Ostrowski, S. R., Vinberg, M., et al. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.10.095 · Cited by 19
“…consider verisimilitude , i.e., designing simulations representative of daily-life situations, they often neglect the veridicality of the results, i.e., the investigation of how well the tasks predict real-world performance in these situations (Franzen and Wilhelm, 1996; Kirkham et al., 2024).”
Caporusso, E., Melillo, A., Perrottelli, A., Giuliani, L., Marzocchi, F. F., Pezzella, P., & Giordano, G. M. (2025) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2025.1543005 · Cited by 21
Romero-Ayuso, D., del Pino-González, A., Torres-Jiménez, A., Juan-González, J., Celdrán, F. J., Franchella, M. C., Ortega-López, N., Triviño-Juárez, J. M., Garach-Gómez, A., Arrabal-Fernández, L., et al. (2024) · Children · doi:10.3390/children11080986 · Cited by 20
“Recent advancements in virtual reality (VR) technology have provided promising avenues for creating immersive digital environments that simulate real-life scenarios [5].”
BackgroundHoran, W. P., Moore, R. C., Belanger, H. G., & Harvey, P. D. (2024) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgae025 · Cited by 17
Llana, T., Garcés-Arilla, S., García-Navarra, S., Méndez-López, M., Juan, M. ‐., & Méndez, M. (2025) · Virtual Reality · doi:10.1007/s10055-025-01244-8 · Cited by 7
“One of the most sig - nificant obstacles to the widespread adoption of VR is cybersickness, a common human factor that may occur in virtual environments (VEs), which can reduce the validity of assessments (Kirkham et al. 2024; Rebenitsch and Owen 2016 ).”
Metadata
- Authors
- Kirkham, R., Kooijman, L., Albertella, L., Myles, D., Yücel, M., & Rotaru, K.
- Affiliations
- Monash University (AU)
- Deakin University (AU)
- QIMR Berghofer Medical Research Institute (AU)
- Corresponding author
- Kirkham, Rebecca
- Venue
- JMIR Serious Games
- Publisher
- JMIR Publications Inc.
- Published
- 2024-02-26
- Volume
- 12
- Pages
- e50282
- ISSN
- 2291-9279 (ISSN-L)
- PMC
- PMC10928525
- OpenAlex
- W4390419184
- Cited by
- 40
- References
- 108
- Citations by year
- 2026: 17 · 2025: 16 · 2024: 7
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Serious Games (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (acceptedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Wilson Foundation
- Department of Science and Technology, Ministry of Science and Technology, India
- Universiteit van Amsterdam
- Department of Industry, Innovation and Science, Australian Government
- National Institutes of Health
- National Health and Medical Research Council
- Defence Science and Technology Group
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- executive function, immersive virtual reality, neuropsychological assessment, cybersickness, ecological validity, test validation, inhibitory control, cognitive flexibility, working memory, planning, attention, user experience, head-mounted displays, psychometric properties, healthy adults, clinical populations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
