The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Ecological validity of a simplified version of the multiple errands shopping test
Open accessAbstract
Shallice and Burgess (1991) reported the utility of the Multiple Errands Test (MET) in discriminating executive deficits in three frontal lobe patients with preserved high IQ, who were otherwise unimpaired on tests of executive function. The aim of this study was to ascertain the value of a simplified version of the MET (MET–SV) for use with the range of people more routinely encountered in clinical practice. Main findings were as follows: 1) The test discriminated well between neurological patients and controls, and the group effects remained when the difference in current general cognitive functions (WAIS–R FSIQ) was taken into account. 2) The best predictors of performance in the healthy control group (n = 46) were age and the number of times participants asked for help (with more requests associated with poorer performance). 3) In the neurological group, two clear patterns of failure emerged, with performance either characterized by rule breaking or failure to achieve tasks. These two patterns were associated with different dysexecutive symptoms in everyday life. 4) The patients not only made more errors than controls, but also different ones. A scoring method that took this into account markedly increased test sensitivity. 5) Many patients passed traditional tests of executive frontal lobe function but still failed the MET–SV. This pattern was strongly associated with observed dysexecutive symptoms in everyday life. The results demonstrate the clinical utility of the test, and suggest that there are two common and independent sources of failure on multitasking tests in a general neurological population: memory dysfunction, and initiation problems. (JINS, 2003, 9, 31–44.)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, performance on tests with high 'representativeness' can be more predictive of performance on traditional tasks than are the traditional tasks themselves (Alderman et al., 2003; Burgess et al., 1998; Knight et al., 2002; Wilson et al., 1998).”
From The case for the development and use of ecologically valid measures of executive function in experimental and clinical neuropsychology (2006) · cites this paper as Alderman et al., 2003
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, this conceptualization appears to have morphed over the years to confound EV with face validity.”
From Conceptualization of the term 'ecological validity' in neuropsychological research on executive function assessment: a systematic review and call to action (2024) · cites this paper as Alderman et al., 2003
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Errors were classified according to a scheme previously used by other authors for naturalistic tasks [26,27]: omission, commission, estimation, not following rules, asking for help, questions, or comments.”
From Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD (2024) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The constructs evaluated by EF tests are apparently not those assessed by EF ratings or by direct evaluations of EF in daily life”
From Impairment in Occupational Functioning and Adult ADHD: The Predictive Utility of Executive Function (EF) Ratings Versus EF Tests (2010) · cites this paper as Alderman et al., 2003
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“'Rule-breakers' tend to show problems with control aspects of memory (e.g., show confabulation, temporal sequencing problems, and repetitive behaviour).”
From The case for the development and use of ecologically valid measures of executive function in experimental and clinical neuropsychology (2006) · cites this paper as Alderman et al. (2003)
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · The Statistician · doi:10.2307/2348956 · Cited by 8,278
A Modified Card Sorting Test Sensitive to Frontal Lobe Defects
Nelson, H. E. (1976) · Cortex · doi:10.1016/s0010-9452(76)80035-4 · Cited by 2,454
DEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 11×
“Shallice and Burgess (1991) described two procedures that were sensitive to their patients’ particular dysexecutive problems.”
BackgroundMethodResultInfluentialSelf-citationBehavioural Assessment of the Dysexecutive Syndrome
(2004) · Methodology Of Frontal And Executive Function · doi:10.4324/9780203344187-15 · Cited by 1,149
Self-citationRivermead Behavioural Memory Test: Præsentation og vurdering af en ny psykologisk prøve
COUR, P. L., & GALLAGHER, K. (1990) · Nordisk Psykologi · doi:10.1080/00291463.1990.10636996 · Cited by 988
The ecological validity of tests of executive function
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A. (1998) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617798466037 · Cited by 932
Self-citationAttention, self–regulation and consciousness
The American Association for Research into Nervous and Mental Diseases, Posner, M. I., & Rothbart, M. K. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0344 · Cited by 917
Response suppression, initiation and strategy use following frontal lobe lesions
Burgess, P. W., & Shallice, T. (1996) · Neuropsychologia · doi:10.1016/0028-3932(95)00104-2 · Cited by 854 · cited 1×
“This is a relatively common symptom of frontal lobe damage (e.g., Burgess & Shallice, 1996).”
BackgroundSelf-citationThe cognitive and neuroanatomical correlates of multitasking
Burgess, P. W., Veitch, E., de Lacy Costello, A., & Shallice, T. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(99)00134-7 · Cited by 708
Self-citationThe Involvement of the Frontal Lobes in Cognitive Estimation
Shallice, T., & Evans, M. E. (1978) · Cortex · doi:10.1016/s0010-9452(78)80055-0 · Cited by 704
Research works printed but not linked: 6
- Alderman, N. (2001). Management of challenging behaviour. In R.Ll. Wood and T. McMillan (Eds.), Neurobehavioural disability and social handicap (pp. 175-207). Hove, Psychology Press.
- Burgess, P.W., Baxter, D., Rose, M.J., & Alderman, N. (1996b). Delusional Paramnesic Misidentification. In P.W. Halligan and J.C. Marshall (Eds.), Method in madness: Case studies in cognitive neuropsychiatry . Hove: Psychology Press.
- Klosowska, D. (1976). Relation between ability to program ac- tions and location of brain damage. Polish Psychological Bulletin , 7 , 245-255.
- Knight, C. (1999). The development of a hospital version of the multiple errands test to assess executive functioning following severe acquired brain injury. Unpublished Doctoral Thesis. UK: The University of Birmingham.
- Nelson, H.E. (1991). The National Adult Reading Test (2nd ed.). Windsor, Berkshire: NFER Nelson.
- Robertson, I.H. (1996). Goal Management Training: A Clinical Manual . Cambridge: PsyConsult.
Cited by
Classification of traumatic brain injury for targeted therapies
Saatman, K. E., Duhaime, A.-C., Bullock, R., Maas, A. I. R., Valadka, A., & Manley, G. T. (2008) · Journal of Neurotrauma · doi:10.1089/neu.2008.0586 · Cited by 1,141
“In response, Alderman et al. (2003) have developed the “Multiple Errands Test” to describe the level of executive deficits of individuals with brain injury in the context of carrying out everyday tasks.”
Parsons, T. D. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00660 · Cited by 837
BURGESS, P. W., ALDERMAN, N., FORBES, C., COSTELLO, A., M-A.COATES, L., DAWSON, D. R., ANDERSON, N. D., GILBERT, S. J., DUMONTHEIL, I., & CHANNON, S. (2006) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617706060310 · Cited by 663
Self-citationUnderstanding Executive Control in Autism Spectrum Disorders in the Lab and in the Real World
Kenworthy, L., Yerys, B. E., Anthony, L. G., & Wallace, G. L. (2008) · Neuropsychology Review · doi:10.1007/s11065-008-9077-7 · Cited by 504
Barkley, R. A., & Murphy, K. R. (2010) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acq014 · Cited by 468
Metadata
- Authors
- ALDERMAN, N., BURGESS, P. W., KNIGHT, C., & HENMAN, C.
- Affiliations
- St Andrew's Healthcare (GB)
- University College London (GB)
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2003-01
- Volume
- 9
- Issue
- 1
- Pages
- 31-44
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- OpenAlex
- W2112429654
- Cited by
- 337
- References
- 29
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 11 · 2023: 19 · 2022: 4 · 2021: 15 · 2020: 10 · 2019: 12 · 2018: 13 · 2017: 16 · 2016: 15 · 2015: 21 · 2014: 20 · 2013: 25 · 2012: 17
- FWCI
- 25.25
- Type
- journal article
- Language
- en
- Open access
- green
- discovery.ucl.ac.uk
- Locations
- Journal of the International Neuropsychological Society (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Wellcome Trust
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- Multiple Errands Test, executive function, frontal lobe dysfunction, ecological validity, multitasking, rule violations, memory impairment, neurological patients, test sensitivity
- MeSH terms
- Adult, Brain Injuries, Cognition Disorders, Environment, Female, Frontal Lobe, Humans, Male, Middle Aged, Neuropsychological Tests, Surveys and Questionnaires, Severity of Illness Index, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ecological validity of a simplified version of the multiple errands shopping test. https://app.cochat.ai/papers/10.1017/s1355617703910046
- The paper
- ALDERMAN, N., BURGESS, P. W., KNIGHT, C., & HENMAN, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society. https://doi.org/10.1017/s1355617703910046
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.