The ecological validity of laboratory and analogue assessment methods of ADHD symptoms
The DOI matches its Crossref record; 116 of the 124 references it cites were found in a registry or an index.
Abstract
An important question in the attempt to generalize laboratory findings on attention deficit-hyperactivity disorder (ADHD) children to clinical issues concerning their assessment, diagnosis, outcome, and treatment response is the ecological validity of the commonly used tasks and analogue behavioral observation procedures. This paper examines the concept of ecological validity and issues inherent in its evaluation. The evidence from a variety of sources is then reviewed on the relationship between laboratory methods of assessing inattention, impulsivity, and overactivity and measures of these same constructs in natural settings. Additional findings pertaining to this issue from a recent study of 140 ADHD and normal children and 159 ADHD and normal adolescents using a multimethod battery of tests are also reported. In general, the ecological validity of most methods is of a low to moderate degree, with some traditional laboratory tasks proving unsatisfactory. A few tasks demonstrated acceptable degrees of ecological validity but even these require improvement. It is concluded that future advances in ecological validity are likely to come from: (a) a greater reliance on assessments of the target behaviors in natural settings and (b) combining several of the more promising tasks and analogue methods into a battery that is taken over longer time intervals than has been customary and averaged across repeated administrations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The preference for and popularity of using parent/teacher ratings to assess hyperactivity reflects the economic utility of obtaining, administering, and scoring the instruments, and their oft argued superior ecological validity relative to objective mechanical measures such as actigraphs (Barkley, 1991; Dane, Schachar, & Tannock, 2000; Halperin et al., 1993).”
From Ecological Validity of Clinic-Based Actigraphy for Assessing Hyperactivity in Clinically Evaluated Children with and without ADHD (2025) · cites this paper as Barkley, 1991
In the citing paper
“Although the analog classroom attempts to mimic many aspects of a regular school classroom, it admittedly represents a unique setting that may influence behavior (Barkley, 1991).”
From Analog Classroom Assessment of a Once-Daily Mixed Amphetamine Formulation, SLI381 (ADDERALL XR), in Children With ADHD (2003) · cites this paper as Barkley, 1991
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Diagnostic and Statistical Manual of Mental Disorders
&NA; (1988) · Alzheimer Disease & Associated Disorders · doi:10.1097/00002093-198802020-00022 · Cited by 12,526
Diagnostic and Statistical Manual of Mental Disorders
(2010) · Handbook of Disease Burdens and Quality of Life Measures · doi:10.1007/978-0-387-78665-0_5485 · Cited by 10,169
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
COOPER, A. M., & MICHELS, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,356
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Diagnostic and Statistical Manual of Mental Disorders (3rd ed. rev.)
Drake, M. (1988) · The American Journal of Occupational Therapy · doi:10.5014/ajot.42.10.683b · Cited by 5,240
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
KENDELL, R. E. (1980) · American Journal of Psychiatry · doi:10.1176/ajp.137.12.1630 · Cited by 5,189
Attention Deficit Hyperactivity Disorder: A Handbook for Diagnosis and Treatment
Barkley, R. A., & Poillion, M. J. (1994) · Behavioral Disorders · doi:10.1177/019874299401900205 · Cited by 4,639
Self-citation(1983) · Medical Entomology and Zoology · Cited by 4,251
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
Research works printed but not linked: 1
- Margolis, J. S. (1972).Academic correlates of sustained attention. Unpublished doctoral dissertation, University of California, Los Angeles.
Cited by
Barkley, R. A. (1997) · Psychological Bulletin · doi:10.1037//0033-2909.121.1.65 · Cited by 580
“…demonstrate that children with hyperactivity or ADHD produce greater errors of commission on continuous performance tasks, whether computerized (Barkley, 1991; Barkley, DuPaul, et al., 1990; Barkley et al., 1992; Grodzinsky & Diamond, 1992; Robins, 1992; see Corkum & Siegel, 1993, for a…”
BackgroundSelf-citationPharmacotherapy of Attention-Deficit Hyperactivity Disorder across the Life Cycle
SPENCER, T., BIEDERMAN, J., WILENS, T., HARDING, M., O'DONNELL, D., & GRIFFIN, S. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199604000-00008 · Cited by 830
Barkley, R. A., Grodzinsky, G., & DuPaul, G. J. (1992) · Journal of Abnormal Child Psychology · doi:10.1007/bf00916547 · Cited by 724
“The former studies are summarized elsewhere ( Barkley, 1991; Douglas, 1983; Douglas & Peters, 1979) and were not expressly attempting to evaluate frontal lobe functions in these children.”
MethodSelf-citationSolanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., Hechtman, L., Hinshaw, S., & Turkel, E. (2001) · Journal of Abnormal Child Psychology · doi:10.1023/a:1010329714819 · Cited by 639
“Replicating results for other LMs of AD/HD symptoms ( Barkley, 1991 ), neither task displayed any correlation with parent ratings.”
BackgroundResultInfluentialDulcan, M. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199710001-00007 · Cited by 628
Attention-deficit hyperactivity disorder and hyperkinetic disorder
Swanson, J., Sergeant, J., Taylor, E., Sonuga-Barke, E., Jensen, P., & Cantwell, D. (1998) · The Lancet · doi:10.1016/s0140-6736(97)11450-7 · Cited by 601
Attention-deficit hyperactivity disorder and hyperkinetic disorder
Swanson, J. M., Sergeant, J. A., Taylor, E., Sonuga-Barke, E. J. S., Jensen, P. S., & Cantwell, D. P. (2001) · Attention Deficit Hyperactivity Disorders · doi:10.4324/9781315054315-2 · Cited by 572
Why obese children cannot resist food: The role of impulsivity
Nederkoorn, C., Braet, C., Van Eijs, Y., Tanghe, A., & Jansen, A. (2006) · Eating Behaviors · doi:10.1016/j.eatbeh.2005.11.005 · Cited by 532
“Correlations between different measures of impulsivity are low (Barkley, 1991).”
Relations Between Continuous Performance Test Performance Measures and ADHD Behaviors
Epstein, J. N., Erkanli, A., Conners, C. K., Klaric, J., Costello, J. E., & Angold, A. (2003) · Journal of Abnormal Child Psychology · doi:10.1023/a:1025405216339 · Cited by 520
“In general, correlations between omission errors and measures of inattention or commission errors and measures of impulsivity have been low to moderate and have not always been domain specific ( Barkley, 1991 ).”
BackgroundResultInfluentialRapport, M. D., Orban, S. A., Kofler, M. J., & Friedman, L. M. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.08.005 · Cited by 517
“, 2003; Klee & Garfinkel, 1983) and hyperactivity/impulsivity (Brocki, Tillman, & Bohlin, 2010), as well as with objectively observed classroom attention (Barkley, 1991; Rapport et al., 1987).”
BackgroundRoyall, D. R., Lauterbach, E. C., Cummings, J. L., Reeve, A., Rummans, T. A., Kaufer, D. I., LaFrance, Jr., & Coffey, C. E. (2002) · The Journal of Neuropsychiatry and Clinical Neurosciences · doi:10.1176/jnp.14.4.377 · Cited by 637
Learning Disabilities and ADHD: Overlapping Spectrum Disorders
Mayes, S. D., Calhoun, S. L., & Crowell, E. W. (2000) · Journal of Learning Disabilities · doi:10.1177/002221940003300502 · Cited by 457
“as performance tests, rating scales, behavioral observations, and clinical diagnoses) has also been demonstrated (Barkley 1991; Fischer, Newby, & Gordon, 1995; Gordon, DiNiro, Mettelman, & Tallmadge, 1989; Gordon & McClure, 1983; Gordon & Mettelman, 1987; Loge, Staton, & Beatty, 1990; Mayes et al., 1998c; Mayes & Calh…”
Waschbusch, D. A. (2002) · Psychological Bulletin · doi:10.1037//0033-2909.128.1.118 · Cited by 434
“When interpreting these data, it is important to note that performance measures of HIA often lack ecological validity (Barkley, 1991; Nichols & Waschbusch, 2001).”
MethodMayes, S. D., & Calhoun, S. L. (2007) · Child Neuropsychology · doi:10.1080/09297040601112773 · Cited by 420
“…scores and other measures of attention, including behavior rating scales, standardized observations, performance tests, and diagnoses of ADHD (Barkley, 1991; Barkley, DuPaul, & McMurray, 1990; Barkley & Grodzinsky, 1994; Barkley, Grodzinsky, & DuPaul, 1992; Fischer, Newby, & Gordon, 1995;…”
Chronis, A. M., Lahey, B. B., Pelham, W. E., Williams, S. H., Baumann, B. L., Kipp, H., Jones, H. A., & Rathouz, P. J. (2007) · Developmental Psychology · doi:10.1037/0012-1649.43.1.70 · Cited by 397
Nederkoorn, C., Smulders, F. T. Y., Havermans, R. C., Roefs, A., & Jansen, A. (2006) · Appetite · doi:10.1016/j.appet.2006.05.008 · Cited by 374
“Correlations between these different measures of impulsivity are low (Barkley, 1991).”
BackgroundThe d2 Test of Attention: Construct validity and extensions in scoring techniques
BATES, M. E., & LEMAY, E. P. (2004) · Journal of the International Neuropsychological Society · doi:10.1017/s135561770410307x · Cited by 355
“Barkley (1991), for example, reported that penciland-paper CPT formats, rather than computer administered versions, have resulted in higher correlations between children’s test scores and parent and teacher ratings of attention deficit hyperactivity disorder (ADHD) symptoms.”
BackgroundMonastra, V. J., Lubar, J. F., Linden, M., VanDeusen, P., Green, G., Wing, W., Phillips, A., & Fenger, T. N. (1999) · Neuropsychology · doi:10.1037//0894-4105.13.3.424 · Cited by 356
Willcutt, E. G., Pennington, B. F., Boada, R., Ogline, J. S., Tunick, R. A., Chhabildas, N. A., & Olson, R. K. (2001) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.110.1.157 · Cited by 451
“Indeed, although important concerns have been raised regarding the ecological validity of the CPT as a measure of ADHD (Barkley, 1991), children with ADHD exhibit impaired performance on a variety of different tasks based on the CPT paradigm (e. g. , Barkley, DuPaul, & McMurray, 1990; Chee, Logan,…”
MethodBrain Metabolism in Teenagers With Attention-Deficit Hyperactivity Disorder
Zametkin, A. J. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820170011002 · Cited by 342
Rizzo, A. A., Buckwalter, J. G., Bowerly, T., Van Der Zaag, C., Humphrey, L., Neumann, U., Chua, C., Kyriakakis, C., Van Rooyen, A., & Sisemore, D. (2000) · CyberPsychology & Behavior · doi:10.1089/10949310050078940 · Cited by 337
“Barkley and colleagues, 67 describe this approach as follows: The child is given a worksheet of math prob-RIZZO lems to complete in a very stimulating environment.”
Information Processing and Energetic Factors in Attention-Deficit/Hyperactivity Disorder
Sergeant, J. A., Oosterlaan, J., & van der Meere, J. (1999) · Handbook of Disruptive Behavior Disorders · doi:10.1007/978-1-4615-4881-2_4 · Cited by 324
Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007) · Child Neuropsychology · doi:10.1080/13825580600943473 · Cited by 291
“The lack of a significant finding of strong correlations between these laboratory methods of assessing attention and parent ratings of behavior, however, fits generally well with what has been described in the literature (Barkley, 1991).”
BackgroundResultInfluentialPsychological adjustment and adaptive impairments in young adults with ADHD
Barkley, R. A., Murphy, K., & Kwasnik, D. (1996) · Journal of Attention Disorders · doi:10.1177/108705479600100104 · Cited by 268
Self-citationRapport, M. D., Bolden, J., Kofler, M. J., Sarver, D. E., Raiker, J. S., & Alderson, R. M. (2009) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-008-9287-8 · Cited by 265
“(Werry 1968), analogue measures (Barkley 1991) and direct observations (Whalen et al.”
BackgroundAssessing inattention and impulsivity in children during the Go/NoGo task
Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009) · British Journal of Developmental Psychology · doi:10.1348/026151008x314919 · Cited by 263
“Go errors are typically considered as an indicator of inattention to the task, while NoGo errors and RT to Go responses are considered as indicators of impulsivity (Barkley, 1991; Halperin et al., 1991).”
Assessment of the Continuous Performance Test: Reliability and validity in a nonreferred sample.
Halperin, J. M., Sharma, V., Greenblatt, E., & Schwartz, S. T. (1991) · Psychological Assessment · doi:10.1037//1040-3590.3.4.603 · Cited by 266
Animal models of attention-deficit hyperactivity disorder.
Davids, E., Zhang, K., Tarazi, F. I., & Baldessarini, R. J. (2003) · Brain Research Reviews · doi:10.1016/s0165-0173(02)00274-6 · Cited by 250
Objective measurement of hyperactivity and attentional problems in ADHD
TEICHER, M. H., ITO, Y., GLOD, C. A., & BARBER, N. I. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199603000-00015 · Cited by 243
Analog Classroom Assessment of Adderall® in Children With ADHD
SWANSON, J. M., WIGAL, S., GREENHILL, L. L., BROWNE, R., WASLIK, B., LERNER, M., WILLIAMS, L., FLYNN, D., AGLER, D., CROWLEY, K., et al. (1998) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199805000-00014 · Cited by 218
Lambez, B., Harwood-Gross, A., Golumbic, E. Z., & Rassovsky, Y. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.10.007 · Cited by 207
“…these symptoms are assessed using subjective measures aimed at the behavioral manifestations of the disorder, involving different procedures across stages of development, such as parent and teacher rating scales in children (Barkley, 1991) and selfreport scales in adults (Kessler et al., 2005).”
BackgroundDoes the Conners' Continuous Performance Test Aid in ADHD Diagnosis?
McGee, R. A., Clark, S. E., & Symons, D. K. (2000) · Journal of Abnormal Child Psychology · doi:10.1023/a:1005127504982 · Cited by 200
“are becoming increasingly promoted as assessment devices ( Barkley, 1991 ).”
BackgroundMethodInfluentialMitchell, J. T., McIntyre, E. M., English, J. S., Dennis, M. F., Beckham, J. C., & Kollins, S. H. (2017) · Journal of Attention Disorders · doi:10.1177/1087054713513328 · Cited by 193
“Assessment methods that target behavior in the natural setting may provide a more ecologically valid assessment (Barkley, 1991).”
BackgroundMcMahon, R. J. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.62.5.901 · Cited by 197
Comorbidity of Attention-deficit Hyperactivity Disorder and Overanxious Disorder
PLISZKA, S. R. (1992) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199203000-00003 · Cited by 184
Dougherty, D. M., Bjork, J. M., Andrew Harper, R., Marsh, D. M., Gerard Moeller, F., Mathias, C. W., & Swann, A. C. (2003) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00197 · Cited by 186
Impulsivity in overweight children
Braet, C., Claus, L., Verbeken, S., & Van Vlierberghe, L. (2007) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-007-0623-2 · Cited by 183
“Secondly, the type of responses required on the MFFT may show minimal correspondence with children’s impulsive and inattentive behaviour exhibited at home [5].”
BackgroundRelationship between motor proficiency, attention, impulse, and activity in children with ADHD
Tseng, M. H., Henderson, A., Chow, S. M. K., & Yao, G. (2004) · Developmental Medicine & Child Neurology · doi:10.1017/s0012162204000623 · Cited by 178
“Studies have shown that Vigilance Task scores correlated with parents’ and teachers’ ratings (Barkley 1991, Wherry et al. 1993, Fischer et al. 1995, Mayes and Calhoun 2002).”
BackgroundPsychometric Properties of Impulsivity Measures: Temporal Stability, Validity and Factor Structure
Kindlon, D., Mezzacappa, E., & Earls, F. J. (1995) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1995.tb01316.x · Cited by 170
Defining and Classifying Learning Disabilities and Attention-Deficit/Hyperactivity Disorder
Shaywitz, B. A., Fletcher, J. M., & Shaywitz, S. E. (1995) · Journal of Child Neurology · doi:10.1177/08830738950100s111 · Cited by 165
Impaired Delayed Responding: A Unified Theory of Attention-Deficit Hyperactivity Disorder
Barkley, R. A. (1994) · Disruptive Behavior Disorders in Childhood · doi:10.1007/978-1-4899-1501-6_2 · Cited by 162
Self-citationA Review of the Validity of Laboratory Cognitive Tasks Used to Assess Symptoms of ADHD
Nichols, S. L., & Waschbusch, D. A. (2004) · Child Psychiatry and Human Development · doi:10.1023/b:chud.0000020681.06865.97 · Cited by 165
Evidence-Based Assessment of Conduct Problems in Children and Adolescents
McMahon, R. J., & Frick, P. J. (2005) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3403_6 · Cited by 158
“This endeavor is made more complicated by the fact that information from different informants (Achenbach, McConaughy, & Howell, 1987) and from different methods (Barkley, 1991) often show only modest correlations with each other.”
BackgroundInfluentialDougherty, D. M., Marsh, D. M., & Mathias, C. W. (2002) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195467 · Cited by 170
“These re-sponsesare thoughtto be relatedto attentionalandmemory-processing abilities (Barkley, 1991; Beale, Matthew, Oliver, & Cornballis,1987;Dougherty, Bjork, et al., 2000; Dougherty et al., 1999; Halperin, Wolf, Greenblatt, & Young, 1991; Halperin et al., 1988;O’Toole,Abramowitz, Morris, &…”
Multimethod study of attention and behavior problems in hearing-impaired children
Mitchell, T. V., & Quittner, A. L. (1996) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2501_10 · Cited by 176
Pharmacotherapy of Attention Deficit Hyperactivity Disorder
Spencer, T. J., Biederman, J., & Wilens, T. E. (2000) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/s1056-4993(18)30136-6 · Cited by 156
Gender Differences in Objective and Subjective Measures of ADHD Among Clinic-Referred Children
Slobodin, O., & Davidovitch, M. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00441 · Cited by 191
“CPT performance was poorly to moderately correlated with parent and teacher ratings and was often inconsistent with subtypes of ADHD diagnosis (Barkley, 1991; Edwards et al., 2007).”
BackgroundResultDetection of malingering in assessment of adult ADHD
Quinn, C. (2003) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(02)00150-6 · Cited by 152
Halperin, J. M., Matier, K., Bedi, G., Sharma, V., & Newcorn, J. H. (1992) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199203000-00002 · Cited by 149
Fahie, C. M., & Symons, D. K. (2003) · Journal of Applied Developmental Psychology · doi:10.1016/s0193-3973(03)00024-8 · Cited by 185
Audition and visual attention: The developmental trajectory in deaf and hearing populations.
Smith, L. B., Quittner, A. L., Osberger, M. J., & Miyamoto, R. T. (1998) · Developmental Psychology · doi:10.1037/0012-1649.34.5.840 · Cited by 144
Raiker, J. S., Rapport, M. D., Kofler, M. J., & Sarver, D. E. (2012) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-011-9607-2 · Cited by 135
Gerst, E. H., Cirino, P. T., Fletcher, J. M., & Yoshida, H. (2017) · Child Neuropsychology · doi:10.1080/09297049.2015.1120860 · Cited by 133
“Toplak, Bucciarelli, Jain, and Tannock (2008) examined four EF processes (inhibition, working memory, set shifting and planning) in an adolescent population with ADHD and controls.”
BackgroundInfluentialTranscranial direct current brain stimulation decreases impulsivity in ADHD
Allenby, C. E., Falcone, M., Bernardo, L., Wileyto, E. P., Rostain, A. L., Ramsay, J. R., Lerman, C. E., & Loughead, J. (2018) · Brain stimulation · doi:10.1016/j.brs.2018.04.016 · Cited by 151
Are tests of frontal lobe functions useful in the diagnosis of attention deficit disorders?
Barkley, R. A., & Grodzinsky, G. M. (1994) · The Clinical Neuropsychologist · doi:10.1080/13854049408401552 · Cited by 127
Self-citation(2016) · doi:10.1080/09297049.2016.1186617 · Cited by 123
“Subsequently, as recommended (Barkley, 1991; Díaz-Orueta et al., 2014; Nigg, Hinshaw, & Halperin, 1996; Rizzo et al., 2000), attention measures with increased ecological validity other than”
BackgroundSEIDMAN, L. J., BIEDERMAN, J., FARAONE, S. V., MILBERGER, S., NORMAN, D., SEIVERD, K., BENEDICT, K., GUITE, J., MICK, E., & KIELY, K. (1995) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199508000-00011 · Cited by 128
Dougherty, D. M., Marsh, D. M., Moeller, F. G., Chokshi, R. V., & Rosen, V. C. (2000) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2000.tb01972.x · Cited by 130
DENNIS, M., GUGER, S., RONCADIN, C., BARNES, M., & SCHACHAR, R. (2001) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617701766040 · Cited by 121
“That neurocognitive tests and parent ratings were not fully concordant is consistent with other reports in children with brain injury (e.g., Fletcher et al., 1996; Taylor & Schatschneider, 1992; Yeates et al., 1997) and in children with behavioral disorders (Barkley, 1991).”
ResultDuPaul, G. J., Anastopoulos, A. D., Shelton, T. L., Guevremont, D. C., & Metevia, L. (1992) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2104_10 · Cited by 124
“Nevertheless, the ecological validity of most clinic tests for the purpose of ADHD diagnosis has been found to be low to moderate, at best (Barkley, 1991).”
BackgroundMethodInfluentialEdwards, M. C., Gardner, E. S., Chelonis, J. J., Schulz, E. G., Flake, R. A., & Diaz, P. F. (2007) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-007-9098-3 · Cited by 120
“” Barkley (2006) discussed this issue, citing data and concerns that a 1.”
BackgroundInfluentialBerger, I., Slobodin, O., & Cassuto, H. (2016) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acw101 · Cited by 142
Arnold, L. E., Aman, M. G., Martin, A., Collier-Crespin, A., Vitiello, B., Tierney, E., Asarnow, R. F., Bell-Bradshaw, F., Freeman, B. J., Gates-Ulanet, P., et al. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005451304303 · Cited by 128
“Work in children with ADHD has shown the Cancellation Task to be among the most ecologically valid and sensitive measures of drug effects ( Barkley, 1991 ).”
BackgroundRapport, M. D., Chung, K., Shore, G., Denney, C. B., & Isaacs, P. (2000) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2904_8 · Cited by 123
“, 1988) and reviews (Barkley, 1991) concerning the ecological validity of clinic-based instruments.”
BackgroundResultMCCRACKEN, J. T., BIEDERMAN, J., GREENHILL, L. L., SWANSON, J. M., MCGOUGH, J. J., SPENCER, T. J., POSNER, K., WIGAL, S., PATAKI, C., ZHANG, Y., et al. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000046863.56865.fe · Cited by 116
“Although the analog classroom attempts to mimic many aspects of a regular school classroom, it admittedly represents a unique setting that may influence behavior (Barkley, 1991).”
BackgroundAttentional problems in children born very preterm or with extremely low birth weight at 7–9 years
Shum, D., Neulinger, K., O'Callaghan, M. J., & Mohay, H. A. (2007) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2007.08.006 · Cited by 140
“Indeed, in the ADHD literature, behavioral ratings have not been found to correlate highly with performance on attention tests (Barkley, 1991).”
BackgroundBarkley, R. A., Smith, K. M., Fischer, M., & NAVIA, B. A. (2006) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.30326 · Cited by 134
“…tests (which are poor at doing so; Grodzinsky and Barkley, 1999], have better ecological validity (relationships to behavior in natural settings; Barkley, 1991], sample behavior over longer time periods (months rather than minutes), are stable over development [Barkley et al., 2002], are…”
BackgroundSelf-citationBirmaher, B. B., Waterman, G. S., Ryan, N. D., Perel, J. M., McNabb, J., BALACH, L., Beaudry, M. B., NASR, F. N., KARAMBELKAR, J., ELTERICH, G., et al. (1998) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199805000-00015 · Cited by 115
Hyperactivity and delay aversion. III: The effect on cognitive style of imposing delay after errors.
Sonuga‐Barke, E. J. S., Williams, E., Hall, M., & Saxton, T. (1996) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1996.tb01390.x · Cited by 106
Vigilance and Sustained Attention in Children and Adults With ADHD
Tucha, L., Tucha, O. M., Walitza, S., Sontag, T. A., Laufkötter, R., Linder, M., & Lange, K. W. (2008) · Journal of Attention Disorders · doi:10.1177/1087054708315065 · Cited by 131
“This deficit has come to be seen as the most prominent disturbance of attention in children with ADHD (Aman & Turbott, 1986; Barkley, 1991; Douglas, 1983; Van der Meere & Sergeant, 1988).”
BackgroundAlcohol Increases Commission Error Rates for a Continuous Performance Test
Dougherty, D. M., Moeller, F. G., Steinberg, J. L., Marsh, D. M., Hines, S. E., & Bjork, J. M. (1999) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.1999.tb04356.x · Cited by 110
Cognitive enhancers for the treatment of ADHD
Bidwell, L. C., McClernon, F. J., & Kollins, S. H. (2011) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2011.05.002 · Cited by 119
Parsons, T. D., Duffield, T. C., & Asbee, J. (2019) · Neuropsychology Review · doi:10.1007/s11065-019-09407-6 · Cited by 117
Child Abuse and Performance Task Assessments of Executive Functions in Boys
Mezzacappa, E., Kindlon, D., & Earls, F. J. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00803 · Cited by 119
“In order to complement teachers’ observations and to address the matter of ecological validity associated with the testing conditions (Barkley, 1991 ; Kalverboer, 1989), we recorded offtask behaviors by quantifying the number of times during the test battery a child required redirection back to the task at hand.”
BackgroundMonden, Y., Dan, H., Nagashima, M., Dan, I., Tsuzuki, D., Kyutoku, Y., Gunji, Y., Yamagata, T., Watanabe, E., & Momoi, M. Y. (2012) · NeuroImage Clinical · doi:10.1016/j.nicl.2012.10.001 · Cited by 94
“Go errors (omission errors) are typically considered indicators of inattention to the task, while no-go errors (commission errors) and RT to go responses are considered indicators of impulsivity (Barkley, 1991; Newcorn et al., 2001).”
BackgroundDoes oligoantigenic diet influence hyperactive/conduct-disordered children ? a controlled trial
Schmidt, M. H., M�cks, P., Lay, B., Eisert, H. G., Fojkar, R., Fritz-Sigmund, D., Marcus, A., & Musaeus, B. (1997) · European Child & Adolescent Psychiatry · doi:10.1007/bf00566671 · Cited by 90
Tucha, O., Prell, S., Mecklinger, L., Bormann-Kischkel, C., Kübber, S., Linder, M., Walitza, S., & Lange, K. W. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0318-2 · Cited by 89
“…both omission and commission errors of children with ADHD receiving MPH. Omission and commission errors are assumed to reflect inattention and impulsivity, respectively (Barkley 1991; Corkum and Siegel 1993; Eliason and Richman 1987; Epstein et al. 1998; Halperin et al. 1991; Lassiter et al. 1994).”
BackgroundDevelopment of Visual Attention Skills in Prelingually Deaf Children Who Use Cochlear Implants
Horn, D. L., Davis, R. A. O., Pisoni, D. B., & Miyamoto, R. T. (2005) · Ear and Hearing · doi:10.1097/00003446-200508000-00003 · Cited by 91
Inhibitory Deficits in Reading Disability Depend on Subtype: Guessers but not Spellers
van der Schoot, M., & de Sergeant, V. R. L. T. M. H. J. (2000) · Child Neuropsychology · doi:10.1076/chin.6.4.297.3139 · Cited by 103
“It is interesting to note that a fast but inaccurate response strategy has also been established in ADHD children using tests that measure impulse control, such as MFFT (Barkley, 1991; DuPaul, Anastopoulos, Shelton, Guevremont, & Metevia, 1992; Milich & Kramer, 1984; Sergeant, Van Velthoven, & Virginia, 1979).”
BackgroundNelson, J. M., & Lovett, B. J. (2019) · Psychological Assessment · doi:10.1037/pas0000702 · Cited by 85
Maturational delay in ADHD: evidence from CPT
Berger, I., Slobodin, O., Aboud, M., Melamed, J., & Cassuto, H. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00691 · Cited by 95
“First, this finding indicates that the test provided sufficient cognitive demands for all ages, especially for older children that often find CPT too easy (Barkley, 1991; Robin, 1998; Uno et al., 2006).”
BackgroundThe relationship between psychopathy and impulsivity: A multi-impulsivity measurement approach
Morgan, J., Gray, N. S., & Snowden, R. J. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2011.03.043 · Cited by 87
Berger, I., & Cassuto, H. (2013) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.10.012 · Cited by 103
Lazar, J. W., & Frank, Y. (1998) · Journal of Neuropsychiatry · doi:10.1176/jnp.10.2.160 · Cited by 79
Robins, P. M. (1992) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00927117 · Cited by 93
“There is increasing evidence that, although ADHD and conduct disorders frequently co-occur, they represent overlapping but distinct disorders ( Barkley, 1991; Epstein et al., 1991).”
BackgroundAccornero, V. H., Amado, A. J., Morrow, C. E., Xue, L., Anthony, J. C., & Bandstra, E. S. (2007) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/01.dbp.0000268560.72580.f9 · Cited by 89
Korkman, M., Jaakkola, M., Ahlroth, A., Pesonen, A.-E., & Turunen, M. (2004) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-004-3005-z · Cited by 83
“Previous studies have also found the correspondence of different measures of attention to be relatively poor [4, 7, 39].”
BackgroundBehavioral Treatment of Attention-Deficit Hyperactivity Disorder in the Classroom
DuPaul, G. J., Guevremont, D. C., & Barkley, R. A. (1992) · Behavior Modification · doi:10.1177/01454455920162004 · Cited by 70
Self-citationAttention deficit disorder and neuropsychological functioning in children with Tourette's syndrome.
Yeates, K. O., & Bornstein, R. A. (1994) · Neuropsychology · doi:10.1037/0894-4105.8.1.65 · Cited by 77
Smith, B. H., Pelham, W. E., Evans, S. W., Gnagy, E. M., Molina, B. S. G., Bukstein, O. G., Greiner, A. R., Myak, C., Presnell, M., & Willoughby, M. T. (1998) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.6.2.187 · Cited by 76
Neuropsychological Testing is Not Useful in the Diagnosis of ADHD: Stop It (or Prove It)!
Barkley, R. A. (2019) · The ADHD Report · doi:10.1521/adhd.2019.27.2.1 · Cited by 68
Self-citationEye movement behavior in a real-world virtual reality task reveals ADHD in children
Merzon, L., Pettersson, K., Aronen, E. T., Huhdanpää, H., Seesjärvi, E., Henriksson, L., MacInnes, W. J., Mannerkoski, M., Macaluso, E., & Salmi, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-24552-4 · Cited by 78
Iron Status Is Associated with Performance on Executive Functioning Tasks in Nonanemic Young Women
Scott, S., & Murray‐Kolb, L. E. (2015) · Journal of Nutrition · doi:10.3945/jn.115.223586 · Cited by 76
Mühlberger, A., Jekel, K., Probst, T., Schecklmann, M., Conzelmann, A., Andreatta, M., Rizzo, A. A., Pauli, P., & Romanos, M. (2016) · Journal of Attention Disorders · doi:10.1177/1087054716647480 · Cited by 75
“Despite its popularity, the ecological validity of the CPT was often criticized (Barkley, 1991).”
BackgroundCarboni, J. A., Roach, A. T., & Fredrick, L. D. (2013) · Research in Human Development · doi:10.1080/15427609.2013.818487 · Cited by 91
“Despite talking more frequently, these children tend to listen and respond less to peers, which leads to unbalanced social interactions (Barkley, 1991).”
BackgroundAaron, P. G., Joshi, R. M., Palmer, H., Smith, N., & Kirby, E. (2002) · Journal of Learning Disabilities · doi:10.1177/00222194020350050301 · Cited by 69
“After evaluating continuous performance tests, Barkley (1991) concluded that the use of such instruments in the evaluation of ADHD is limited by their rather suspect ecological validity.”
MethodMuir-Broaddus, J. E., Rosenstein, L. D., Medina, D. E., & Soderberg, C. (2002) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(01)00170-6 · Cited by 69
“However, scores were analyzed separately for 6–11-year-olds and for 12–17-year-olds in keeping with Barkley, Grodzinsky, and DuPaul’s (1992)finding that the WCST may be sensitive to deficits in children, but rarely adolescents.”
BackgroundResultInfluentialOh, S., Choi, J., Han, D. H., & Kim, E. (2024) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-023-02174-z · Cited by 63
“These criteria might vary depending on the stage of development and can include self-report scales for adults and parent-and teacher-rating scales for children [10, 11].”
Tucha, O. M., Walitza, S., Mecklinger, L., Sontag, T. A., Kübber, S., Linder, M., & Lange, K. W. (2006) · Journal of Neural Transmission · doi:10.1007/s00702-006-0496-4 · Cited by 76
“Since laboratory measures are usually designed to prove theoretical predictions under strict control of situational variables, concerns regarding their ecological validity have been raised (Barkley, 1991).”
BackgroundClinical assessment of sustained attention in preschoolers
Corkum, V., Byrne, J. M., & Ellsworth, C. P. (1995) · Child Neuropsychology · doi:10.1080/09297049508401338 · Cited by 71
Metadata
- Authors
- Barkley, R. A.
- Affiliations
- University of Massachusetts Chan Medical School (US)
- Corresponding author
- Barkley, Russell A.
- ORCID
- Barkley, Russell A.
- Venue
- Journal of Abnormal Child Psychology
- Published
- 1991-04
- Volume
- 19
- Issue
- 2
- Pages
- 149-178
- ISSN
- 0091-0627 (ISSN-L)
- 1573-2835
- OpenAlex
- W2091884533
- Cited by
- 419
- References
- 124
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 8 · 2023: 11 · 2022: 9 · 2021: 9 · 2020: 12 · 2019: 15 · 2018: 14 · 2017: 10 · 2016: 12 · 2015: 16 · 2014: 12 · 2013: 17 · 2012: 20
- FWCI
- 13.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Research on Child and Adolescent Psychopathology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r01mh041464-01a1, 5r01mh041583-06)
- National Institute of Mental Health (R01MH042181, MH42181, MH41464, MH41583)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Keywords
- attention deficit hyperactivity disorder, ecological validity, laboratory evaluation, inattention, impulsivity, hyperactivity, naturalistic observation, children and adolescents
- MeSH terms
- Attention Deficit Disorder with Hyperactivity, Child, Child Behavior Disorders, Humans, Impulsive Behavior, Motor Activity, Social Environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.