The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
The assessment of executive functions is an integral task of neuropsychological assessment. Traditional measures of executive function are often based on hypothetical constructs that may have little relevance to real-world behaviours. In fact, some traditional tests utilised today were not originally developed for clinical use. Recently, researchers have been arguing for a new generation of "function-led" neuropsychological assessments that are developed from directly observable everyday behaviours. Although virtual environments (VEs) have been presented as potential aides in enhancing ecological validity, many were modelled on construct-driven approaches found in traditional assessments. In the current paper, we review construct-driven and function-led VE-based neuropsychological assessments of executive functions. Overall, function-led VEs best represent the sorts of tasks needed for enhanced ecological validity and prediction of real-world functioning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268 · cited 1×
“…functions aim to assess a number of constructs: selective attention, inhibitory control, planning, problem solving, and some aspects of short-term memory (Burgess & Simons, 2005; Chan, Shum, Toulopoulou, & Chen, 2008; Stuss, Shallice, Alexander, & Picton, 1995; see Diamond, 2013 for review).”
Attention to Action: Willed and Automatic Control of Behavior
Norman, D. A., & Shallice, T. (1986) · Consciousness and Self-Regulation · doi:10.1007/978-1-4757-0629-1_1 · Cited by 4,455 · cited 1×
“Norman and Shallice (1986) have proposed a model of executive functioning that emphasises a supervisory attentional system (SAS).”
BackgroundEffects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes
MILNER, B. (1963) · Archives of Neurology · doi:10.1001/archneur.1963.00460070100010 · Cited by 2,217 · cited 1×
“Nevertheless, in a single study by Milner (1963), patients with dorsolateral prefrontal lesions were found to have greater difficulty on the WCST than patients with orbitofrontal or nonfrontal lesions.”
BackgroundDEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 1×
“…Six Elements subtests of the Behavioural Assessment of Dysexecutive Syndrome; Wilson, Alderman, Burgess, Emslie, & Evans, 1996) Multiple errands paradigm for function-led assessments Shallice and Burgess (1991) developed the Multiple Errands Test (MET) as a function-led assessment of multitasking.”
MethodThe elusive nature of executive functions: a review of our current understanding.
Jurado, M. B., & Rosselli, M. (2007) · Neuropsychology Review · doi:10.1007/s11065-007-9040-z · Cited by 1,684 · cited 1×
“To address this issue, neuropsycholo-gists are increasingly emphasising the need for tasks that represent real-world functioning and tap into a number of executive domains (Chaytor & Schmit-ter-Edgecombe, 2003; Jurado & Rosselli, 2007).”
BackgroundAssessment of executive functions: Review of instruments and identification of critical issues.
CHAN, R., SHUM, D., TOULOPOULOU, T., & CHEN, E. (2008) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2007.08.010 · Cited by 1,401 · cited 1×
“According to Chan et al. (2008) most of these traditional measures assess at the impairment level and do not capture the complexity of response required in the many multistep tasks found in everyday activities.”
BackgroundVirtual reality in neuroscience research and therapy
Bohil, C. J., Alicea, B., & Biocca, F. A. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3122 · Cited by 1,108 · cited 2×
“Since VEs allow for precise presentation and control of dynamic perceptual stimuli, they can provide ecologically valid assessments that combine the control and rigour of laboratory measures with a simulation that reflects real-life situations (Bohil et al., 2011).”
BackgroundChaytor, N., & Schmitter-Edgecombe, M. (2003) · Neuropsychology Review · doi:10.1023/b:nerv.0000009483.91468.fb · Cited by 1,055 · cited 1×
“Furthermore, current verisimilitude assessments are somewhat conflicted in that while they focus on cognitive constructs (e.g., attention, executive function, memory), they are used for identifying functional abilities (Chaytor & Schmitter-Edgecombe, 2003).”
Parsons, T. D., & Rizzo, A. A. (2008) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2007.07.007 · Cited by 994
Self-citationThe ecological validity of tests of executive function
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A. (1998) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617798466037 · Cited by 932
BURGESS, P. W., ALDERMAN, N., FORBES, C., COSTELLO, A., M-A.COATES, L., DAWSON, D. R., ANDERSON, N. D., GILBERT, S. J., DUMONTHEIL, I., & CHANNON, S. (2006) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617706060310 · Cited by 663
Improving the ecological validity of executive functioning assessment
CHAYTOR, N., SCHMITTEREDGECOMBE, M., & BURR, R. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2005.12.002 · Cited by 462
Ecological validity of a simplified version of the multiple errands shopping test
ALDERMAN, N., BURGESS, P. W., KNIGHT, C., & HENMAN, C. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703910046 · Cited by 337
Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007) · Child Neuropsychology · doi:10.1080/13825580600943473 · Cited by 291 · cited 2×
“For instance, various virtual classroom environments (e.g., ClinicaVR Digital Media Works; AULA) have emerged that include construct-driven Stroop (Lalonde, Henry, Drouin-Germain, Nolin, & Beau-champ, 2013) and Go/No-Go stimuli (Parsons, Bowerly, Buckwalter, & Rizzo, 2007).”
BackgroundSelf-citationThe assessment of executive functions: coming out of the office
Manchester, D., Priestley, N., & Jackson, H. (2004) · Brain Injury · doi:10.1080/02699050410001672387 · Cited by 219
Development of a simplified version of the multiple errands test for use in hospital settings
Knight, C., Alderman, N., & Burgess, P. W. (2002) · Neuropsychological Rehabilitation · doi:10.1080/09602010244000039 · Cited by 197
Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., & Narbona, J. (2014) · Child Neuropsychology · doi:10.1080/09297049.2013.792332 · Cited by 159
Bauer, R. M., Iverson, G. L., Cernich, A. N., Binder, L. M., Ruff, R. M., & Naugle, R. I. (2012) · The Clinical Neuropsychologist · doi:10.1080/13854046.2012.663001 · Cited by 154
Use of the Virtual Action Planning Supermarket for the Diagnosis of Mild Cognitive Impairment
Werner, P., Rabinowitz, S., Klinger, E., Korczyn, A. D., & Josman, N. (2009) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000204915 · Cited by 135
Impact of time on task on ADHD patient’s performances in a virtual classroom
Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., & Bouvard, M. P. (2012) · European Journal of Paediatric Neurology · doi:10.1016/j.ejpn.2012.01.006 · Cited by 100
The Effects of Acute Sleep Restriction on Adolescents' Pedestrian Safety in a Virtual Environment
Davis, A. L., Avis, K. T., & Schwebel, D. C. (2013) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2013.07.008 · Cited by 54 · cited 1×
“Neuropsychological measures of executive functions aim to assess a number of constructs: selective attention, inhibitory control, planning, problem solving, and some aspects of short-term memory (Burgess & Simons, 2005; Chan, Shum, Toulopoulou, & Chen, 2008; Stuss, Shallice, Alexander, & Picton, 1995; see Diamond, 201…”
BackgroundSauzéon, H., N'Kaoua, B., Pala, P. A., Taillade, M., Auriacombe, S., & Guitton, P. (2016) · Journal of Neuropsychology · doi:10.1111/jnp.12055 · Cited by 44
Law, A. S., Trawley, S. L., Brown, L. A., Stephens, A. N., & Logie, R. H. (2013) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.748813 · Cited by 23
Research works printed but not linked: 80
- 10.1080/09297040802169077 · DOI · Paper page
- 10.1111/j.1530-0277.2008.00876.x · DOI
- 10.1080/13803395.2012.740002 · DOI · Paper page
- 10.1111/j.1440-1630.2011.00963.x · DOI
- 10.5665/sleep.3398 · DOI
- 10.1080/17470210903521797 · DOI
- 10.1177/1087054706292122 · DOI · Paper page
- 10.1037/0894-4105.20.1.77 · DOI · Paper page
- 10.1016/j.jsr.2005.01.001 · DOI
- 10.5014/ajot.64.2.336 · DOI · Paper page
- 10.1080/02699050902788436 · DOI
- 10.1093/acprof:oso/9780198526544.003.0018 · DOI
- 10.1037/a0028674 · DOI · Paper page
- 10.1016/j.neuroimage.2011.06.037 · DOI · Paper page
- 10.1080/09084280903297891 · DOI
- Carelli L., 2008, Virtual Rehabilitation, 2008, 99, 10.1109/ICVR.2008.4625144 · DOI
- 10.1007/s00221-013-3471-y · DOI
- 10.1207/s15374424jccp3502_4 · DOI · Paper page
- 10.1017/S1355617712001452 · DOI
- 10.1089/cap.2006.0141 · DOI · Paper page
- 10.1080/13803395.2013.776011 · DOI
- 10.1016/j.apmr.2009.07.012 · DOI
- 10.1089/109493101750527042 · DOI · Paper page
- 10.1027/1864-1105.21.3.95 · DOI · Paper page
- Franzen M. D., 1996, Ecological validity of neuropsychological testing, 91
- Goldstein G., 1996, Ecological validity of neuropsychological testing, 75
- 10.1016/j.jneumeth.2012.07.025 · DOI
- Iriate Y., 2012, Journal of Attention Disorders, 20, 1
- 10.1111/add.12082 · DOI · Paper page
- 10.1016/j.jstrokecerebrovasdis.2013.07.013 · DOI
- 10.1016/j.schres.2009.09.015 · DOI
- 10.1080/09084282.2011.643955 · DOI · Paper page
- 10.1080/09084282.2011.643956 · DOI · Paper page
- 10.1177/1087054705280159 · DOI · Paper page
- 10.1016/j.jneumeth.2013.07.005 · DOI
- 10.1080/13803390902806550 · DOI · Paper page
- 10.1016/S0001-4575(02)00083-0 · DOI · Paper page
- 10.1016/j.jsr.2003.09.007 · DOI · Paper page
- 10.1037/0894-4105.14.4.491 · doi:10.1037/0894-4105.14.4.491 · Paper page
- 10.1089/cpb.1999.2.53 · DOI · Paper page
- 10.3758/s13421-011-0120-1 · DOI
- 10.1080/13854040601100668 · DOI · Paper page
- 10.1162/1054746011470235 · DOI · Paper page
- 10.1093/ageing/aft194 · DOI · Paper page
- 10.3109/02699051003692159 · DOI
- 10.1007/s11065-009-9120-3 · DOI · Paper page
- Montgomery C., 2011, Human Psychopharmacology: Clinical and Experimental, 26, 208, 10.1002/hup.1194 · DOI
- 10.1037/a0022929 · DOI
- 10.1080/13854046.2013.834971 · DOI · Paper page
- 10.1007/978-3-642-17824-5_13 · DOI
- 10.1016/j.jneumeth.2013.10.006 · DOI
- 10.1080/13803395.2013.824556 · DOI
- 10.1109/VAAT.2013.6786190 · DOI
- 10.1089/cpb.2007.9934 · DOI · Paper page
- 10.1080/17470919.2013.870091 · DOI · Paper page
- Pedroli E., 2013, Annual Review of Cybertherapy and Telemedicine, 191, 48
- 10.1017/S109285290002736X · DOI · Paper page
- 10.1097/DBP.0b013e3181969b22 · DOI · Paper page
- 10.1089/cpb.1998.1.151 · DOI · Paper page
- 10.1016/0010-4825(94)00040-W · DOI
- 10.1080/13854040600888776 · DOI · Paper page
- 10.1080/09602010802469074 · DOI · Paper page
- 10.1162/PRES_a_00077 · DOI · Paper page
- 10.1017/S1355617711001883 · DOI · Paper page
- 10.1016/S0028-3932(97)00015-8 · DOI · Paper page
- 10.1089/cyber.2011.0302 · DOI
- Sbordone R. J., 2008, The neuropsychology handbook, 367
- 10.1097/00001199-200210000-00003 · DOI · Paper page
- 10.1097/00001199-200210000-00002 · DOI · Paper page
- 10.1162/1054746011470271 · DOI
- 10.1080/10400435.2007.10131860 · DOI
- Schultheis M. T., 2002, Ethical issues in clinical neuropsychology, 243
- 10.1016/j.acn.2006.04.004 · DOI · Paper page
- 10.1016/0028-3932(83)90040-4 · DOI · Paper page
- 10.1111/j.1749-6632.1995.tb38140.x · DOI · Paper page
- 10.1080/09602010903080531 · DOI · Paper page
- 10.3389/fpsyg.2013.00883 · DOI
- Wald J., 2001, Studies in Health Technology Information, 81, 564
- 10.1089/109493100420232 · DOI
- Weigl E., 1927, Zeitschrift fur Psychologie, 103, 2
Cited by
Is clinical virtual reality ready for primetime?
Rizzo, A. “., & Koenig, S. T. (2017) · Neuropsychology · doi:10.1037/neu0000405 · Cited by 372
The ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00721 · Cited by 345
Rus-Calafell, M., Garety, P., Sason, E., Craig, T. J. K., & Valmaggia, L. R. (2018) · Psychological Medicine · doi:10.1017/s0033291717001945 · Cited by 307
Montana, J. I., Matamala-Gomez, M., Maisto, M., Mavrodiev, P. A., Cavalera, C. M., Diana, B., Mantovani, F., & Realdon, O. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020500 · Cited by 156
“Lastly, a VR system provides experimental control and dynamic presentation of stimuli in ecologically valid scenarios [18,26,27,71,101].”
BackgroundExecutive functioning rating scales: Ecologically valid or construct invalid?
Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., & Miller, C. E. (2020) · Neuropsychology · doi:10.1037/neu0000681 · Cited by 115
“, 2018); technology-driven methods such as virtual reality-based executive function assessment may help to balance the internal validity gained through careful, laboratory-based control with the external/ecological validity gained through field investigations (Jaroslawska et al. 2016; Jovanovski et al., 2012; Parsons…”
Background
Metadata
- Authors
- Parsons, T. D., Carlew, A. R., Magtoto, J., & Stonecipher, K.
- Venue
- Neuropsychological Rehabilitation
- Publisher
- Informa UK Limited
- Published
- 2015-11-11
- Volume
- 27
- Issue
- 5
- Pages
- 777-807
- ISSN
- 0960-2011 (ISSN-L)
- 1464-0694
- OpenAlex
- W2277628924
- Cited by
- 137
- References
- 23
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.