Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index; 3 of the 27 sources its claims cite were checked for support.

The ecological validity of tests of executive function

Open access
BURGESS, PAUL W., ALDERMAN, NICK, EVANS, JON, EMSLIE, HAZEL, WILSON, BARBARA A. · 1998 · Journal of the International Neuropsychological Society

Abstract

Ninety-two mixed etiology neurological patients and 216 control participants were assessed on a range of neuropsychological tests, including 10 neuropsychological measures of executive function derived from 6 different tests. People who knew the patients well (relatives or carers) completed a questionnaire about the patient's dysexecutive problems in everyday life, and this paper reports the extent to which the tests predicted the patients' everyday life problems. All of the tests were significantly predictive of at least some of the behavioral and cognitive deficits reported by patients' carers. However, factor analysis of the patients' dysexecutive symptoms suggested a fractionation of the dysexecutive syndrome, with neuropsychological tests loading differentially on 3 underlying cognitive factors (Inhibition, Intentionality, and Executive Memory), supporting the conclusions that different tests measure different cognitive processes, and that there may be limits to the fractionation of the executive system.

Overview

CoChat Summary

TL;DR

In 92 mixed-etiology neurological patients and 216 controls, executive-function tests were generally correlated with carer-reported everyday dysexecutive problems, but different tests predicted different symptom factors. The dysexecutive syndrome fractionated at the behavioral level into five factors, with the first three (Inhibition, Intentionality, Executive Memory) showing differential relations to executive tests.

Key findings

  • All executive tests were significantly predictive of at least some carer-reported behavioral/cognitive deficits; patients performed worse than controls on all executive measures except Cognitive Estimates (t(127) = −.98, p = .33). Under Bonferroni correction, significant patient-control differences remained for MWCST Categories and Perseverative Errors, all three Trail Making measures, and SET.
  • On the Dysexecutive Questionnaire (DEX), patients rated themselves as showing fewer/less severe dysexecutive signs than observers (t(160) = −2.72, p < .01), whereas controls rated themselves higher than informants (t(331) = 3.65, p < .001), suggesting lack of insight in patients.
  • Factor analysis of carer ratings yielded five factors explaining 67.2% of variance (21.3, 15.5, 11.6, 10.6, 8.2%); the first three were Inhibition, Intentionality, and Executive Memory. Executive tests loaded differentially: Factor 1 related to all executive tasks except MWCST; Factor 2 related most strongly to SET (r = .46); Factor 3 related to MWCST and verbal fluency.
  • Sensitivity did not explain the factor-test pattern: SET was the second most sensitive measure (33.7% of patients at/below the 5th percentile of controls), Trails B 38.9%, Trails A 32.1%, B-A 25.9%, MWCST Perseverative Errors 28.6%, FAS 10.8%, Animals 8.2%, and Cognitive Estimates 3.6%.

Methods

  • 92 neurological patients of varying etiologies (59% head injury, 13% dementia, 8.5% cerebrovascular accidents, 6.5% encephalitis, 13% other; mean age 38.5 years, SD = 15.1; mean NART IQ 103.2; mean WAIS-R FSIQ 92.1) and 216 controls (mean age 46.1 years, SD = 19.8; mean NART IQ 102.7).
  • The DEX questionnaire covered 20 dysexecutive symptoms rated 0–4 by a relative/carer and by the participant; the neuropsychological battery included six executive tests (MWCST, Cognitive Estimates, Verbal Fluency FAS, Verbal Fluency Animals, Trail Making, SET) plus background tests of intellect, memory, language, and visual perception.
  • Analyses included correlations between DEX total/self/other-self scores and tests, varimax rotated factor analysis of independent raters’ scores, factor score–test correlations, and sensitivity analysis using the proportion of patients at or below the 5th percentile of controls.

Limitations

  • Stated: interpretation of Factor 1 was “perhaps premature”; the emotional/personality factors (4 and 5) “would benefit from further research”; and the possible one-way relation between confabulation and perseveration remained unresolved.
  • Evident: the control group was significantly older than the patient group (t = 3.46, df = 306, p = .001), though the paper calls this conservative; sample sizes varied widely across tests (e.g., N = 42 to 84), and the design is correlational, so causality cannot be inferred.
  • Evident: the DEX relies on subjective self- and carer ratings, and the mixed-etiology sample may limit generalizability to specific neurological groups.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1017/s1355617798466037

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Dysexecutive Questionnaire: Scores by group.
Fig. 1 Dysexecutive Questionnaire: Scores by group.From the PDF

Verification

Claims the paper makes

3 Valid · 1 Not valid · 12 Not checked · 74 Own results and interpretations

56 more claims

Create a free account to see all 90 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 13
  • It may state two separate claims as one. 19
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

6 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 47 references

Research works printed but not linked: 4

  1. Burgess, P.W., Alderman, N., Wilson, B.A., Evans, J.J., & Emslie, H. (1996b). The Dysexecutive Questionnaire. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome . Bury St. Edmunds, U.K.: Thames Valley Test Company.
  2. Burgess, P.W. & Wood, R.Ll. (1990). Neuropsychology of behaviour disorders following brain injury. In R.Ll. Wood (Ed.), Neurobehavioural sequelae of traumatic brain injury (pp. 110133). London: Taylor & Francis.
  3. Cicerone, K.D. & DeLuca, J. (1990). Neuropsychological predictors of head injury rehabilitation outcome. Journal of Clinical and Experimental Neuropsychology , 12 , 92 [Abstract].
  4. Stuss, D.T., Shallice, T., Alexander, M.P., & Picton, T.W. (1995). Amultidisciplinary approach to executive functions. Annals of the New York Academy of Sciences , 769 , 191-211.

Cited by

See all 942

Metadata

Authors
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A.
Affiliations
  • University College London (GB)
  • St Andrew's Healthcare (GB)
  • Medical Research Council (GB)
Venue
Journal of the International Neuropsychological Society
Published
1998-11
Volume
4
Issue
6
Pages
547-558
ISSN
  • 1355-6177 (ISSN-L)
  • 1469-7661
OpenAlex
W2168551754
Cited by
932
References
47
Citations by year
2026: 16 · 2025: 21 · 2024: 23 · 2023: 21 · 2022: 30 · 2021: 45 · 2020: 37 · 2019: 35 · 2018: 31 · 2017: 50 · 2016: 55 · 2015: 40 · 2014: 55 · 2013: 46 · 2012: 55
FWCI
9.00
Type
journal article
Language
en
Open access
Locations
  • Journal of the International Neuropsychological Society (publishedVersion)
  • PubMed (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
Funders
Wellcome Trust
Topics
  • Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
executive function, dysexecutive syndrome, ecological validity, neuropsychological assessment, everyday problems, inhibition, intentionality, neurological patients
MeSH terms
Adult, Mental Disorders, Brain Diseases, Cognition Disorders, Frontal Lobe, Humans, Neuropsychological Tests, Surveys and Questionnaires, Severity of Illness Index, Syndrome, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The ecological validity of tests of executive function. https://app.cochat.ai/papers/10.1017/s1355617798466037
The paper
BURGESS, P. W., ALDERMAN, N., EVANS, J., EMSLIE, H., & WILSON, B. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society. https://doi.org/10.1017/s1355617798466037

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.