The Ecological and Construct Validity of a Newly Developed Measure of Executive Function: The Virtual Library Task
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Virtual reality (VR) assessment paradigms have the potential to address the limited ecological validity of pen and paper measures of executive function (EF) and the pragmatic and reliability issues associated with functional measures. To investigate the ecological validity and construct validity of a newly developed VR measure of EF, the Virtual Library Task (VLT); a real life analogous task—the Real Library Task (RLT); and five neuropsychological measures of EF were administered to 30 patients with traumatic brain injury (TBI) and 30 healthy Controls. Significant others for each participant also completed the Dysexecutive Questionnaire (DEX), which is a behavioral rating scale of everyday EF. Performances on the VLT and the RLT were significantly positively correlated indicating that VR performance is similar to real world performance. The TBI group performed significantly worse than the Control group on the VLT and the Modified Six Elements Test (MSET) but the other four neuropsychological measures of EF failed to differentiate the groups. Both the MSET and the VLT significantly predicted everyday EF suggesting that they are both ecologically valid tools for the assessment of EF. The VLT has the advantage over the MSET of providing objective measurement of individual components of EF. (JINS, 2012, 18, 440–450)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 6×
“Recently a VR version of the MET has been developed, but this has only been studied in nine post-stroke patients (Rand et al., 2009).”
BackgroundInfluentialAssessment of executive functions: Review of instruments and identification of critical issues.
CHAN, R., SHUM, D., TOULOPOULOU, T., & CHEN, E. (2008) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2007.08.010 · Cited by 1,401
Chaytor, N., & Schmitter-Edgecombe, M. (2003) · Neuropsychology Review · doi:10.1023/b:nerv.0000009483.91468.fb · Cited by 1,055 · cited 2×
“The DEX was chosen as the ecological comparator for the neuropsychological measures and the VLT based on the recommendation of Chaytor and Schmitter-Edgecombe (2003) that neuropsychological measures of EF should be measured against a measure of everyday executive skill rather than many different…”
BackgroundMethodThe ecological validity of tests of executive function
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A. (1998) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617798466037 · Cited by 932
BURGESS, P. W., ALDERMAN, N., FORBES, C., COSTELLO, A., M-A.COATES, L., DAWSON, D. R., ANDERSON, N. D., GILBERT, S. J., DUMONTHEIL, I., & CHANNON, S. (2006) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617706060310 · Cited by 663
Improving the ecological validity of executive functioning assessment
CHAYTOR, N., SCHMITTEREDGECOMBE, M., & BURR, R. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2005.12.002 · Cited by 462 · cited 3×
“…2003; Norris & Tate, 2000; Ord, Greve, Bianchini, & Aguerrevere, 2009), and several studies have reported either no relationship or weak to moderate relationships between performance on EF tests and measures of everyday functioning (Chaytor et al., 2006; Manchester, Priestley, & Jackson, 2004).”
BackgroundEcological validity of a simplified version of the multiple errands shopping test
ALDERMAN, N., BURGESS, P. W., KNIGHT, C., & HENMAN, C. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703910046 · Cited by 337 · cited 5×
“, 2003; Jovanovski, 2004), Brixton Test of Spatial Anticipation (Draper & Ponsford, 2008), the WCST (Alderman et al., 2003; Dawson et al., 2009; Norris & Tate, 2000; Ord et al., 2009), and the Zoo Map Test (Evans, Chua, McKenna, & Wilson, 1997; Tyson, Laws, Flowers, Mortimer, & Schulz, 2008), although the Zoo Map Test…”
BackgroundResultInfluentialThe Development of an Ecologically Valid Test for Assessing Patients with a Dysexecutive Syndrome
Wilson, B. A., Evans, J. J., Emslie, H., Alderman, N., & Burgess, P. (1998) · Neuropsychological Rehabilitation · doi:10.1080/713755570 · Cited by 285 · cited 1×
“…studies have reported adequate construct validity of the MSET between healthy controls and clinical populations including alcoholics (Moriyama et al., 2002), TBI and multiple sclerosis (Norris & Tate, 2000), schizophrenia (Wilson et al., 1998), and acquired brain injury (Wilson et al., 1998).”
BackgroundFrontal Lobe Deficits after Head Injury: Unity and Diversity of Function
Duncan Roger Johnson Michaela Swale, J. (1997) · Cognitive Neuropsychology · doi:10.1080/026432997381420 · Cited by 275 · cited 1×
“These components were drawn from a survey of theoretical models and factor analyses of EF (Busch et al., 2005; Crawford & Henry, 2005; Damasio & Anderson, 2003; Duncan et al., 1997; Stuss, 2007; Testa & Bennett, 2011).”
MethodThe assessment of executive functions: coming out of the office
Manchester, D., Priestley, N., & Jackson, H. (2004) · Brain Injury · doi:10.1080/02699050410001672387 · Cited by 219
Research works printed but not linked: 47
- Long, 1997, The practice of forensic neuropsychology: Meeting challenges in the courtroom
- 10.1111/j.2044-8260.1997.tb01414.x · DOI · Paper page
- Lezak, 2004, Neuropsychological assessment
- 10.1016/S0028-3932(01)00094-X · DOI · Paper page
- Renison, 2008, Virtual library task
- 10.1017/S1355617705050721 · DOI · Paper page
- Wilson, 1996, Behavioural assessment of the dysexecutive syndrome: Test manual
- 10.1080/09602019108402257 · DOI · Paper page
- 10.1089/109493101750527042 · DOI · Paper page
- Damasio, 2003, Clinical Neuropsychology
- 10.1037/0894-4105.22.5.618 · DOI · Paper page
- 10.1016/S0010-9452(08)70896-7 · DOI
- 10.1080/13803390902806550 · DOI · Paper page
- 10.1212/01.wnl.0000326262.67613.fe · DOI · Paper page
- Burgess, 1996, The Hayling and Brixton Tests: Test manual
- 10.5694/j.1326-5377.1986.tb112311.x · DOI · Paper page
- Jovanovski, 2004, Cognitive set shifting using functional magnetic reasonance imaging and virtual reality: A comparison between traditional and a novel ecologically valid exectuive function task
- 10.1016/S0003-9993(03)00203-X · DOI · Paper page
- 10.1017/S0033291797004790 · DOI · Paper page
- 10.1162/1054746011470235 · DOI · Paper page
- 10.1016/j.apmr.2009.07.012 · DOI
- 10.1111/j.1530-0277.2002.tb02662.x · doi:10.1111/j.1530-0277.2002.tb02662.x · Paper page
- Heaton, 2005, Wisconsin Card Sorting Test-64: Computer version 2 – research edition (WCST-64CV2)
- Stuss, 2007, The human frontal lobes: Functions and disorders, 292
- Testa, R. , Bennett, P.C. , Ponsford, J. (2011). Factor Analysis of Nineteen Executive Function Tests in a Healthy Adult Population. Manuscript accepted for publication to Archives of Clinical Neuropsychology. In Press. · DOI · Paper page
- 10.1177/0734282909333945 · DOI
- 10.1089/cpb.2006.9.342 · DOI
- 10.1080/02699050310001619855 · DOI · Paper page
- 10.1017/S1355617702860052 · DOI
- 10.1093/acprof:oso/9780198526544.003.0019 · DOI · Paper page
- 10.1080/01688639608408991 · DOI · Paper page
- 10.1080/02699050400013725 · DOI
- Katz, 2007, Validity of the Executive Function Performance Test in individuals with schizophrenia, OTJR: Occupation, Participation and Health, 27, 44
- Coakes, 2003, SPSS Analysis Without Anguish
- 10.1016/j.acn.2006.04.004 · DOI · Paper page
- 10.1016/0028-3932(68)90038-9 · DOI · Paper page
- Morris, R.G. , Kotitsa, M. , Bramham, J. , Brooks, B.M. , Rose, D. (2002). Virtual reality investigation of strategy formation, rule breaking and prospective memory in patients with focal prefrontal neurosurgical lesions. Paper presented at the International Conference of Disability, Virtual Reality & Associated Technology, Hungry.
- 10.1375/brim.10.1.3 · DOI
- Jansari, A. , Agnew, R. , Akesson, K. , Murphy, L (2004). Using virtual reality to create an ecologically valid measure of real world problems in patients with dysexecutive syndrome. Paper presented at the Symposium on Neurological Rehabilitation: A Satellite Symposium to the Joint 27th Conference of the Australian Society for the Study of Brain Impairment and the 27th Mid-year Meeting of the International Neuropsychological Society Uluru, Australia.
- Morganti, 2004, Cybertherapy: Internet and virtual reality as assessment and rehabilitation tolls for clinical psychology and neuroscience
- Matheis, R.J. (2004). Expanding the boundaries of neuropsychology: The application of VR for memory assessment. Doctoral Thesis, Fairleigh Dickinson University, New Jersey.
- 10.1080/09602010802469074 · DOI · Paper page
- 10.1080/096020100389282 · DOI · Paper page
- 10.1080/13803390490919263 · DOI · Paper page
- 10.1080/13651500701687133 · DOI
- 10.3233/RNN-2009-0511 · DOI · Paper page
- 10.1080/13803390902858874 · DOI
Cited by
Parsons, T. D. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00660 · Cited by 837
Virtual reality as a clinical tool in mental health research and practice
Bell, I. H., Nicholas, J., Alvarez-Jimenez, M., Thompson, A., & Valmaggia, L. (2020) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2020.22.2/lvalmaggia · Cited by 302
Executive functioning rating scales: Ecologically valid or construct invalid?
Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., & Miller, C. E. (2020) · Neuropsychology · doi:10.1037/neu0000681 · Cited by 115
“, 2018); technology-driven methods such as virtual reality-based executive function assessment may help to balance the internal validity gained through careful, laboratory-based control with the external/ecological validity gained through field investigations (Jaroslawska et al. 2016; Jovanovski et al., 2012; Parsons…”
BackgroundAssessment of cognitive instrumental activities of daily living: A systematic review
Romero-Ayuso, D., Castillero-Perea, Á., González, P., Navarro, E., Molina-Massó, J. P., Funes, M. J., Ariza-Vega, P., Toledano-González, A., & Triviño-Juárez, J. M. (2021) · Disability and Rehabilitation · doi:10.1080/09638288.2019.1665720 · Cited by 95
Faria, A. L., Latorre, J., Silva Cameirão, M., Bermúdez i Badia, S., & Llorens, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1233346 · Cited by 46
Metadata
- Authors
- Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K.
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2012-02-20
- Volume
- 18
- Issue
- 3
- Pages
- 440-450
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- OpenAlex
- W2168030438
- Cited by
- 93
- References
- 13
- FWCI
- 10.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Ecological and Construct Validity of a Newly Developed Measure of Executive Function: The Virtual Library Task. https://app.cochat.ai/papers/10.1017/s1355617711001883
- The paper
- Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The Ecological and Construct Validity of a Newly Developed Measure of Executive Function: The Virtual Library Task. Journal of the International Neuropsychological Society. https://doi.org/10.1017/s1355617711001883
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.