The ecological validity of laboratory and analogue assessment methods of ADHD symptoms
The DOI matches its Crossref record; 116 of the 124 references it cites were found in a registry or an index.
Abstract
An important question in the attempt to generalize laboratory findings on attention deficit-hyperactivity disorder (ADHD) children to clinical issues concerning their assessment, diagnosis, outcome, and treatment response is the ecological validity of the commonly used tasks and analogue behavioral observation procedures. This paper examines the concept of ecological validity and issues inherent in its evaluation. The evidence from a variety of sources is then reviewed on the relationship between laboratory methods of assessing inattention, impulsivity, and overactivity and measures of these same constructs in natural settings. Additional findings pertaining to this issue from a recent study of 140 ADHD and normal children and 159 ADHD and normal adolescents using a multimethod battery of tests are also reported. In general, the ecological validity of most methods is of a low to moderate degree, with some traditional laboratory tasks proving unsatisfactory. A few tasks demonstrated acceptable degrees of ecological validity but even these require improvement. It is concluded that future advances in ecological validity are likely to come from: (a) a greater reliance on assessments of the target behaviors in natural settings and (b) combining several of the more promising tasks and analogue methods into a battery that is taken over longer time intervals than has been customary and averaged across repeated administrations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The preference for and popularity of using parent/teacher ratings to assess hyperactivity reflects the economic utility of obtaining, administering, and scoring the instruments, and their oft argued superior ecological validity relative to objective mechanical measures such as actigraphs (Barkley, 1991; Dane, Schachar, & Tannock, 2000; Halperin et al., 1993).”
From Ecological Validity of Clinic-Based Actigraphy for Assessing Hyperactivity in Clinically Evaluated Children with and without ADHD (2025) · cites this paper as Barkley, 1991
In the citing paper
“Although the analog classroom attempts to mimic many aspects of a regular school classroom, it admittedly represents a unique setting that may influence behavior (Barkley, 1991).”
From Analog Classroom Assessment of a Once-Daily Mixed Amphetamine Formulation, SLI381 (ADDERALL XR), in Children With ADHD (2003) · cites this paper as Barkley, 1991
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Diagnostic and Statistical Manual of Mental Disorders
&NA; (1988) · Alzheimer Disease & Associated Disorders · doi:10.1097/00002093-198802020-00022 · Cited by 12,526
Diagnostic and Statistical Manual of Mental Disorders
(2010) · Handbook of Disease Burdens and Quality of Life Measures · doi:10.1007/978-0-387-78665-0_5485 · Cited by 10,169
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
COOPER, A. M., & MICHELS, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,356
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Diagnostic and Statistical Manual of Mental Disorders (3rd ed. rev.)
Drake, M. (1988) · The American Journal of Occupational Therapy · doi:10.5014/ajot.42.10.683b · Cited by 5,240
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
KENDELL, R. E. (1980) · American Journal of Psychiatry · doi:10.1176/ajp.137.12.1630 · Cited by 5,189
Attention Deficit Hyperactivity Disorder: A Handbook for Diagnosis and Treatment
Barkley, R. A., & Poillion, M. J. (1994) · Behavioral Disorders · doi:10.1177/019874299401900205 · Cited by 4,639
Self-citation(1983) · Medical Entomology and Zoology · Cited by 4,251
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
Research works printed but not linked: 1
- Margolis, J. S. (1972).Academic correlates of sustained attention. Unpublished doctoral dissertation, University of California, Los Angeles.
Cited by
Barkley, R. A. (1997) · Psychological Bulletin · doi:10.1037//0033-2909.121.1.65 · Cited by 580
“…demonstrate that children with hyperactivity or ADHD produce greater errors of commission on continuous performance tasks, whether computerized (Barkley, 1991; Barkley, DuPaul, et al., 1990; Barkley et al., 1992; Grodzinsky & Diamond, 1992; Robins, 1992; see Corkum & Siegel, 1993, for a…”
BackgroundSelf-citationPharmacotherapy of Attention-Deficit Hyperactivity Disorder across the Life Cycle
SPENCER, T., BIEDERMAN, J., WILENS, T., HARDING, M., O'DONNELL, D., & GRIFFIN, S. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199604000-00008 · Cited by 830
Barkley, R. A., Grodzinsky, G., & DuPaul, G. J. (1992) · Journal of Abnormal Child Psychology · doi:10.1007/bf00916547 · Cited by 724
“The former studies are summarized elsewhere ( Barkley, 1991; Douglas, 1983; Douglas & Peters, 1979) and were not expressly attempting to evaluate frontal lobe functions in these children.”
MethodSelf-citationSolanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., Hechtman, L., Hinshaw, S., & Turkel, E. (2001) · Journal of Abnormal Child Psychology · doi:10.1023/a:1010329714819 · Cited by 639
“Replicating results for other LMs of AD/HD symptoms ( Barkley, 1991 ), neither task displayed any correlation with parent ratings.”
BackgroundResultInfluentialDulcan, M. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199710001-00007 · Cited by 628
Metadata
- Authors
- Barkley, R. A.
- Affiliations
- University of Massachusetts Chan Medical School (US)
- Corresponding author
- Barkley, Russell A.
- ORCID
- Barkley, Russell A.
- Venue
- Journal of Abnormal Child Psychology
- Published
- 1991-04
- Volume
- 19
- Issue
- 2
- Pages
- 149-178
- ISSN
- 0091-0627 (ISSN-L)
- 1573-2835
- OpenAlex
- W2091884533
- Cited by
- 419
- References
- 124
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 8 · 2023: 11 · 2022: 9 · 2021: 9 · 2020: 12 · 2019: 15 · 2018: 14 · 2017: 10 · 2016: 12 · 2015: 16 · 2014: 12 · 2013: 17 · 2012: 20
- FWCI
- 13.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Research on Child and Adolescent Psychopathology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r01mh041464-01a1, 5r01mh041583-06)
- National Institute of Mental Health (R01MH042181, MH42181, MH41464, MH41583)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Keywords
- attention deficit hyperactivity disorder, ecological validity, laboratory evaluation, inattention, impulsivity, hyperactivity, naturalistic observation, children and adolescents
- MeSH terms
- Attention Deficit Disorder with Hyperactivity, Child, Child Behavior Disorders, Humans, Impulsive Behavior, Motor Activity, Social Environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.