The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
The assessment of executive functions is an integral task of neuropsychological assessment. Traditional measures of executive function are often based on hypothetical constructs that may have little relevance to real-world behaviours. In fact, some traditional tests utilised today were not originally developed for clinical use. Recently, researchers have been arguing for a new generation of "function-led" neuropsychological assessments that are developed from directly observable everyday behaviours. Although virtual environments (VEs) have been presented as potential aides in enhancing ecological validity, many were modelled on construct-driven approaches found in traditional assessments. In the current paper, we review construct-driven and function-led VE-based neuropsychological assessments of executive functions. Overall, function-led VEs best represent the sorts of tasks needed for enhanced ecological validity and prediction of real-world functioning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268 · cited 1×
“…functions aim to assess a number of constructs: selective attention, inhibitory control, planning, problem solving, and some aspects of short-term memory (Burgess & Simons, 2005; Chan, Shum, Toulopoulou, & Chen, 2008; Stuss, Shallice, Alexander, & Picton, 1995; see Diamond, 2013 for review).”
Attention to Action: Willed and Automatic Control of Behavior
Norman, D. A., & Shallice, T. (1986) · Consciousness and Self-Regulation · doi:10.1007/978-1-4757-0629-1_1 · Cited by 4,455 · cited 1×
“Norman and Shallice (1986) have proposed a model of executive functioning that emphasises a supervisory attentional system (SAS).”
BackgroundEffects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes
MILNER, B. (1963) · Archives of Neurology · doi:10.1001/archneur.1963.00460070100010 · Cited by 2,217 · cited 1×
“Nevertheless, in a single study by Milner (1963), patients with dorsolateral prefrontal lesions were found to have greater difficulty on the WCST than patients with orbitofrontal or nonfrontal lesions.”
BackgroundDEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 1×
“…Six Elements subtests of the Behavioural Assessment of Dysexecutive Syndrome; Wilson, Alderman, Burgess, Emslie, & Evans, 1996) Multiple errands paradigm for function-led assessments Shallice and Burgess (1991) developed the Multiple Errands Test (MET) as a function-led assessment of multitasking.”
MethodThe elusive nature of executive functions: a review of our current understanding.
Jurado, M. B., & Rosselli, M. (2007) · Neuropsychology Review · doi:10.1007/s11065-007-9040-z · Cited by 1,684 · cited 1×
“To address this issue, neuropsycholo-gists are increasingly emphasising the need for tasks that represent real-world functioning and tap into a number of executive domains (Chaytor & Schmit-ter-Edgecombe, 2003; Jurado & Rosselli, 2007).”
BackgroundAssessment of executive functions: Review of instruments and identification of critical issues.
CHAN, R., SHUM, D., TOULOPOULOU, T., & CHEN, E. (2008) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2007.08.010 · Cited by 1,401 · cited 1×
“According to Chan et al. (2008) most of these traditional measures assess at the impairment level and do not capture the complexity of response required in the many multistep tasks found in everyday activities.”
BackgroundVirtual reality in neuroscience research and therapy
Bohil, C. J., Alicea, B., & Biocca, F. A. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3122 · Cited by 1,108 · cited 2×
“Since VEs allow for precise presentation and control of dynamic perceptual stimuli, they can provide ecologically valid assessments that combine the control and rigour of laboratory measures with a simulation that reflects real-life situations (Bohil et al., 2011).”
BackgroundChaytor, N., & Schmitter-Edgecombe, M. (2003) · Neuropsychology Review · doi:10.1023/b:nerv.0000009483.91468.fb · Cited by 1,055 · cited 1×
“Furthermore, current verisimilitude assessments are somewhat conflicted in that while they focus on cognitive constructs (e.g., attention, executive function, memory), they are used for identifying functional abilities (Chaytor & Schmitter-Edgecombe, 2003).”
Parsons, T. D., & Rizzo, A. A. (2008) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2007.07.007 · Cited by 994
Self-citationThe ecological validity of tests of executive function
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A. (1998) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617798466037 · Cited by 932
Research works printed but not linked: 80
- 10.1080/09297040802169077 · DOI · Paper page
- 10.1111/j.1530-0277.2008.00876.x · DOI
- 10.1080/13803395.2012.740002 · DOI · Paper page
- 10.1111/j.1440-1630.2011.00963.x · DOI
- 10.5665/sleep.3398 · DOI
- 10.1080/17470210903521797 · DOI
- 10.1177/1087054706292122 · DOI · Paper page
- 10.1037/0894-4105.20.1.77 · DOI · Paper page
- 10.1016/j.jsr.2005.01.001 · DOI
- 10.5014/ajot.64.2.336 · DOI · Paper page
- 10.1080/02699050902788436 · DOI
- 10.1093/acprof:oso/9780198526544.003.0018 · DOI
- 10.1037/a0028674 · DOI · Paper page
- 10.1016/j.neuroimage.2011.06.037 · DOI · Paper page
- 10.1080/09084280903297891 · DOI
- Carelli L., 2008, Virtual Rehabilitation, 2008, 99, 10.1109/ICVR.2008.4625144 · DOI
- 10.1007/s00221-013-3471-y · DOI
- 10.1207/s15374424jccp3502_4 · DOI · Paper page
- 10.1017/S1355617712001452 · DOI
- 10.1089/cap.2006.0141 · DOI · Paper page
- 10.1080/13803395.2013.776011 · DOI
- 10.1016/j.apmr.2009.07.012 · DOI
- 10.1089/109493101750527042 · DOI · Paper page
- 10.1027/1864-1105.21.3.95 · DOI · Paper page
- Franzen M. D., 1996, Ecological validity of neuropsychological testing, 91
- Goldstein G., 1996, Ecological validity of neuropsychological testing, 75
- 10.1016/j.jneumeth.2012.07.025 · DOI
- Iriate Y., 2012, Journal of Attention Disorders, 20, 1
- 10.1111/add.12082 · DOI · Paper page
- 10.1016/j.jstrokecerebrovasdis.2013.07.013 · DOI
- 10.1016/j.schres.2009.09.015 · DOI
- 10.1080/09084282.2011.643955 · DOI · Paper page
- 10.1080/09084282.2011.643956 · DOI · Paper page
- 10.1177/1087054705280159 · DOI · Paper page
- 10.1016/j.jneumeth.2013.07.005 · DOI
- 10.1080/13803390902806550 · DOI · Paper page
- 10.1016/S0001-4575(02)00083-0 · DOI · Paper page
- 10.1016/j.jsr.2003.09.007 · DOI · Paper page
- 10.1037/0894-4105.14.4.491 · doi:10.1037/0894-4105.14.4.491 · Paper page
- 10.1089/cpb.1999.2.53 · DOI · Paper page
- 10.3758/s13421-011-0120-1 · DOI
- 10.1080/13854040601100668 · DOI · Paper page
- 10.1162/1054746011470235 · DOI · Paper page
- 10.1093/ageing/aft194 · DOI · Paper page
- 10.3109/02699051003692159 · DOI
- 10.1007/s11065-009-9120-3 · DOI · Paper page
- Montgomery C., 2011, Human Psychopharmacology: Clinical and Experimental, 26, 208, 10.1002/hup.1194 · DOI
- 10.1037/a0022929 · DOI
- 10.1080/13854046.2013.834971 · DOI · Paper page
- 10.1007/978-3-642-17824-5_13 · DOI
- 10.1016/j.jneumeth.2013.10.006 · DOI
- 10.1080/13803395.2013.824556 · DOI
- 10.1109/VAAT.2013.6786190 · DOI
- 10.1089/cpb.2007.9934 · DOI · Paper page
- 10.1080/17470919.2013.870091 · DOI · Paper page
- Pedroli E., 2013, Annual Review of Cybertherapy and Telemedicine, 191, 48
- 10.1017/S109285290002736X · DOI · Paper page
- 10.1097/DBP.0b013e3181969b22 · DOI · Paper page
- 10.1089/cpb.1998.1.151 · DOI · Paper page
- 10.1016/0010-4825(94)00040-W · DOI
- 10.1080/13854040600888776 · DOI · Paper page
- 10.1080/09602010802469074 · DOI · Paper page
- 10.1162/PRES_a_00077 · DOI · Paper page
- 10.1017/S1355617711001883 · DOI · Paper page
- 10.1016/S0028-3932(97)00015-8 · DOI · Paper page
- 10.1089/cyber.2011.0302 · DOI
- Sbordone R. J., 2008, The neuropsychology handbook, 367
- 10.1097/00001199-200210000-00003 · DOI · Paper page
- 10.1097/00001199-200210000-00002 · DOI · Paper page
- 10.1162/1054746011470271 · DOI
- 10.1080/10400435.2007.10131860 · DOI
- Schultheis M. T., 2002, Ethical issues in clinical neuropsychology, 243
- 10.1016/j.acn.2006.04.004 · DOI · Paper page
- 10.1016/0028-3932(83)90040-4 · DOI · Paper page
- 10.1111/j.1749-6632.1995.tb38140.x · DOI · Paper page
- 10.1080/09602010903080531 · DOI · Paper page
- 10.3389/fpsyg.2013.00883 · DOI
- Wald J., 2001, Studies in Health Technology Information, 81, 564
- 10.1089/109493100420232 · DOI
- Weigl E., 1927, Zeitschrift fur Psychologie, 103, 2
Cited by
Is clinical virtual reality ready for primetime?
Rizzo, A. “., & Koenig, S. T. (2017) · Neuropsychology · doi:10.1037/neu0000405 · Cited by 372
The ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00721 · Cited by 345
Rus-Calafell, M., Garety, P., Sason, E., Craig, T. J. K., & Valmaggia, L. R. (2018) · Psychological Medicine · doi:10.1017/s0033291717001945 · Cited by 307
Montana, J. I., Matamala-Gomez, M., Maisto, M., Mavrodiev, P. A., Cavalera, C. M., Diana, B., Mantovani, F., & Realdon, O. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020500 · Cited by 156
Executive functioning rating scales: Ecologically valid or construct invalid?
Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., & Miller, C. E. (2020) · Neuropsychology · doi:10.1037/neu0000681 · Cited by 115
“, 2018); technology-driven methods such as virtual reality-based executive function assessment may help to balance the internal validity gained through careful, laboratory-based control with the external/ecological validity gained through field investigations (Jaroslawska et al. 2016; Jovanovski et al., 2012; Parsons…”
Background
Metadata
- Authors
- Parsons, T. D., Carlew, A. R., Magtoto, J., & Stonecipher, K.
- Venue
- Neuropsychological Rehabilitation
- Publisher
- Informa UK Limited
- Published
- 2015-11-11
- Volume
- 27
- Issue
- 5
- Pages
- 777-807
- ISSN
- 0960-2011 (ISSN-L)
- 1464-0694
- OpenAlex
- W2277628924
- Cited by
- 137
- References
- 23
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. https://app.cochat.ai/papers/10.1080/09602011.2015.1109524
- The paper
- Parsons, T. D., Carlew, A. R., Magtoto, J., & Stonecipher, K. (2017). The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychological Rehabilitation. https://doi.org/10.1080/09602011.2015.1109524
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.