The ecological validity of laboratory and analogue assessment methods of ADHD symptoms
The DOI matches its Crossref record; 116 of the 124 references it cites were found in a registry or an index.
Abstract
An important question in the attempt to generalize laboratory findings on attention deficit-hyperactivity disorder (ADHD) children to clinical issues concerning their assessment, diagnosis, outcome, and treatment response is the ecological validity of the commonly used tasks and analogue behavioral observation procedures. This paper examines the concept of ecological validity and issues inherent in its evaluation. The evidence from a variety of sources is then reviewed on the relationship between laboratory methods of assessing inattention, impulsivity, and overactivity and measures of these same constructs in natural settings. Additional findings pertaining to this issue from a recent study of 140 ADHD and normal children and 159 ADHD and normal adolescents using a multimethod battery of tests are also reported. In general, the ecological validity of most methods is of a low to moderate degree, with some traditional laboratory tasks proving unsatisfactory. A few tasks demonstrated acceptable degrees of ecological validity but even these require improvement. It is concluded that future advances in ecological validity are likely to come from: (a) a greater reliance on assessments of the target behaviors in natural settings and (b) combining several of the more promising tasks and analogue methods into a battery that is taken over longer time intervals than has been customary and averaged across repeated administrations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The preference for and popularity of using parent/teacher ratings to assess hyperactivity reflects the economic utility of obtaining, administering, and scoring the instruments, and their oft argued superior ecological validity relative to objective mechanical measures such as actigraphs (Barkley, 1991; Dane, Schachar, & Tannock, 2000; Halperin et al., 1993).”
From Ecological Validity of Clinic-Based Actigraphy for Assessing Hyperactivity in Clinically Evaluated Children with and without ADHD (2025) · cites this paper as Barkley, 1991
In the citing paper
“Although the analog classroom attempts to mimic many aspects of a regular school classroom, it admittedly represents a unique setting that may influence behavior (Barkley, 1991).”
From Analog Classroom Assessment of a Once-Daily Mixed Amphetamine Formulation, SLI381 (ADDERALL XR), in Children With ADHD (2003) · cites this paper as Barkley, 1991
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Diagnostic and Statistical Manual of Mental Disorders
&NA; (1988) · Alzheimer Disease & Associated Disorders · doi:10.1097/00002093-198802020-00022 · Cited by 12,526
Diagnostic and Statistical Manual of Mental Disorders
(2010) · Handbook of Disease Burdens and Quality of Life Measures · doi:10.1007/978-0-387-78665-0_5485 · Cited by 10,169
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
COOPER, A. M., & MICHELS, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,356
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Diagnostic and Statistical Manual of Mental Disorders (3rd ed. rev.)
Drake, M. (1988) · The American Journal of Occupational Therapy · doi:10.5014/ajot.42.10.683b · Cited by 5,240
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
KENDELL, R. E. (1980) · American Journal of Psychiatry · doi:10.1176/ajp.137.12.1630 · Cited by 5,189
Attention Deficit Hyperactivity Disorder: A Handbook for Diagnosis and Treatment
Barkley, R. A., & Poillion, M. J. (1994) · Behavioral Disorders · doi:10.1177/019874299401900205 · Cited by 4,639
Self-citation(1983) · Medical Entomology and Zoology · Cited by 4,251
Multiple Comparison Procedures
Hochberg, Y., & Tamhane, A. C. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316672 · Cited by 2,389
Research works printed but not linked: 1
- Margolis, J. S. (1972).Academic correlates of sustained attention. Unpublished doctoral dissertation, University of California, Los Angeles.
Cited by
Items 101–200 of 420
Utility of cognitive neuropsychological assessment in attention-deficit/hyperactivity disorder
Lange, K. W., Hauser, J., Lange, K. M., Makulska-Gertruda, E., Takano, T., Takeuchi, Y., Tucha, L., & Tucha, O. (2014) · ADHD Attention Deficit and Hyperactivity Disorders · doi:10.1007/s12402-014-0132-3 · Cited by 62
“…with ADHD, the ecological validity of the commonly used tasks and analogue behavioural observation procedures are also an important topic regarding the generalization of neuropsychological findings to clinical issues concerning their diagnosis, outcome and treatment response (e.g. Barkley 1991).”
BackgroundMethodUsing environmental distractors in the diagnosis of ADHD
Cassuto, H., Ben-Simon, A., & Berger, I. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00805 · Cited by 78
Clinical and Experimental Factors Influencing the Efficacy of Neurofeedback in ADHD: A Meta-Analysis
Bussalb, A., Congedo, M., Barthélemy, Q., Ojeda, D., Acquaviva, É., Delorme, R., & Mayaud, L. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00035 · Cited by 82
“The diagnosis of ADHD primarily relies on questionnairebased clinical evaluation (3), which can be supported by objective assessment metrics of executive function such as the Test of Variables of Attention (TOVA) (8), the Continuous Performance Test (CPT) (9), and the Sustained Attention to Response Task (SART) (10).”
MethodO'TOOLE, K., Abramowitz, A. J., MORRIS, R., & Dulcan, M. K. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199704000-00016 · Cited by 71
Hoyniak, C. P. (2017) · Developmental Neuropsychology · doi:10.1080/87565641.2016.1247162 · Cited by 66
“This finding supports the interpretation that the N2 elicited from these two tasks is representative of different cognitive processes, potentially with the CPT representing a slightly more difficult task due to the engagement of sustained attention capacities (Barkley, 1991; Levy, 1980).”
ResultWaschbusch, D., Pelham, W., Waxmonsky, J., & Johnston, C. (2009) · Journal of Developmental and Behavioral Pediatrics · doi:10.1097/dbp.0b013e31819f1c15 · Cited by 59
Sustained attention and behavioral characteristics associated with ADHD in adults
Avisar, A., & Shalev, L. (2011) · Applied Neuropsychology · doi:10.1080/09084282.2010.547777 · Cited by 59
“It might be assumed that deficits in sustained attention, as reflected by a high SD of RT and a high rate of omission errors, would correlate with the inattention symptoms of ADHD (Barkley, 1991 ; Epstein, Conners, Sitarenios, & Erhardt, 1998 ) and that, conversely, deficits in response inhibition, as measured by comm…”
BackgroundGiordani, B., Hodges, E. K., Guire, K. E., Ruzicka, D. L., Dillon, J. E., Weatherly, R. A., Garetz, S. L., & Chervin, R. D. (2012) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617711001743 · Cited by 64
“…shown a clear match between parental behavioral ratings and computerized sustained attention measures, leading to concern that laboratory-based tests may have only limited ecological validity and may not reflect the actual aspects of daily functioning to which parents are sensitive (Barkley, 1991).”
BackgroundKnouse, L. E., Mitchell, J. T., Brown, L. H., Silvia, P. J., Kane, M. J., Myin-Germeys, I., & Kwapil, T. R. (2008) · Journal of Attention Disorders · doi:10.1177/1087054707299411 · Cited by 60
“Thus, self-report methods that tap target behaviors in natural settings may provide a more accurate and ecologically valid assessment of functioning than self-reports that are typically administered in laboratory settings ( Barkley, 1991 ).”
BackgroundWho are the false negatives on continuous performance tests?
Fischer, M., Newby, R. F., & Gordon, M. (1995) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2404_6 · Cited by 58
Temporal Allocation of Visual Attention in Adult Attention Deficit Hyperactivity Disorder.
Hollingsworth, D. E., McAuliffe, S. P., & Knowlton, B. J. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/08989290151137359 · Cited by 58
Daley, K. B., Wodrich, D., & Hasan, K. S. (2006) · Jornal de Pediatria · doi:10.1016/j.jpeds.2005.08.076 · Cited by 60
Communicating Risks: Examining Hazard and Outrage in Multiple Contexts
Lachlan, K. A., & Spence, P. R. (2010) · Risk Analysis · doi:10.1111/j.1539-6924.2010.01511.x · Cited by 63
Matier-sharma, K., Perachio, N., Newcorn, J. H., Sharma, V., & Halperin, J. M. (1995) · Child Neuropsychology · doi:10.1080/09297049508402243 · Cited by 57
Potvin, S., Charbonneau, G., Juster, R.-P., Purdon, S., & Tourjman, S. V. (2016) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2016.06.004 · Cited by 56
Clinical applications of analogue behavioral observation: Dimensions of psychometric evaluation.
Haynes, S. N. (2001) · Psychological Assessment · doi:10.1037//1040-3590.13.1.73 · Cited by 83
“Measures of be haviors and events derived in analogue assessment are presumed to be valid estimates of similar behaviors and events in the client's natural environment (Barkley, 1991).”
BackgroundDifferences Between ADHD Inattentive and Combined Types on the CPT
Collings, R. D. (2003) · Journal of Psychopathology and Behavioral Assessment · doi:10.1023/a:1023525007441 · Cited by 66
“The relatively low correlations between the purported measures of inattention on the CPT (i.e., omission errors) and behavior observations of inattention suggest that factors other than attention explain the group differences on this task ( Barkley, 1991 ).”
BackgroundMethodInfluentialClinical Validity and Interpretation of the Gordon Diagnostic System in ADHD Assessments
Dickerson Mayes, S., Calhoun, L., & Crowell, E. W. (2001) · Child Neuropsychology · doi:10.1076/chin.7.1.32.3151 · Cited by 53
“…GDS subtest scores and other indicators of ADHD, including behavior rating scales, performance tests, clinical diag- noses, and behavioral observations (Barkley, 1991; Fischer, Newby, & Gordon, 1995; Gordon, DiNiro, Mettelman, & Tallmadge, 1989; Gordon, Mammen, DiNiro, & Mettelman, 1989; Gordon…”
Pediatric School Psychology: The Emergence of a Subspecialty
Power, T. J., Parrish, J. M., DuPaul, G. J., & Shapiro, E. S. (1995) · School Psychology Review · doi:10.1080/02796015.1995.12085765 · Cited by 53
Effortful control and early academic achievement of Chinese American children in immigrant families
Chen, S. H., Main, A., Zhou, Q., Bunge, S. A., Lau, N., & Chu, K. (2014) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2014.08.004 · Cited by 62
“…errors (i.e., failing to press the button in response to he target stimulus) on this task is thought to reflect sustained ttention, while a low rate of commission errors (i.e., responding o non-target stimuli) is generally thought to reflect inhibition Barkley, 1991; Halperin et al., 1988).”
BackgroundWehmeier, P. M., Schacht, A., Wolff, C., Otto, W. R., Dittmann, R. W., & Banaschewski, T. (2011) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2010.0142 · Cited by 52
“Increased OE is related to selective attention and deficient arousal (Barkley 1991).”
Preliminary evidence for a role for impulsivity in cognitive disinhibition in bulimia nervosa
Kemps, E., & Wilsdon, A. (2010) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390903264122 · Cited by 50
Behavioral Assessment of Core ADHD Symptoms Using the QbTest
Reh, V., Schmidt, M., Lam, L., Schimmelmann, B. G., Hebebrand, J., Rief, W., & Christiansen, H. (2015) · Journal of Attention Disorders · doi:10.1177/1087054712472981 · Cited by 51
“Although CPTs have excellent face validity and a great intuitive appeal as an objective measure for ADHD symptoms, research concerning the diagnostic utility of CPTs for ADHD remains controversial (Barkley, 1991; Halperin et al., 1990; McGee et al., 2000).”
BackgroundEEG biofeedback vs. placebo treatment for Attention-Deficit/Hyperactivity Disorder: A pilot study
Heywood, C., & Beale, I. (2003) · Journal of Attention Disorders · doi:10.1177/108705470300700105 · Cited by 51
“Based on reviews of assessment issues surrounding ADHD (Barkley, 1990, 1991; Barkley & Grodzinsky, 1994), seven attention and activity measures were used for repeatedmeasure variables: the ADHD Rating Scale (DuPaul, 1991), a brief rating scale for DSM III-R ADHD symptoms; the Child Attention…”
MethodWang, L.-J., Huang, Y.-S., Hsiao, C.-C., Chiang, Y.-L., Wu, C.-C., Shang, Z.-Y., & Chen, C.-K. (2011) · The World Journal of Biological Psychiatry · doi:10.3109/15622975.2010.512090 · Cited by 50
Attentional blink in adolescents with varying levels of impulsivity
Li, C. R., Chen, S., Lin, W., & Yang, Y. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.06.003 · Cited by 56
“The relationship between behavioral impulsivity and attention function has mostly been examined in terms of the performance of ADHD children in the CPT (see Barkley, 1992; Corkum and Siegel, 1993; for reviews).”
BackgroundReliability and validity of the online continuous performance test among young adults
Raz, S., Bar-Haim, Y., Sadeh, A., & Dan, O. (2014) · Assessment · doi:10.1177/1073191112443409 · Cited by 49
“Taken together, these assessments revealed reliability and validity results that may be somewhat lower than those proposed by Nunnally and Bernstein (1994) but are in line with previously published evaluations of CPT tasks (Barkley, 1991; Conners, 2004; Forbes, 1998; Leark, Wallace, & Fitzgerald, 2004; Llorente et al.…”
ResultMayes, S. D., Gordon, M., Calhoun, S. L., & Bixler, E. O. (2014) · Journal of Attention Disorders · doi:10.1177/1087054712448961 · Cited by 49
“Numerous studies demonstrate significant agreement between GDS scores and other measures of attention, including behavior rating scales, standardized observations, performance tests, and diagnoses of ADHD (Barkley, 1991; Barkley, DuPaul, & McMurray, 1990; Barkley & Grodzinsky, 1994; Barkley, Grodzinsky, & DuPaul, 1992…”
Attention deficit-hyperactivity disorder in adolescence: Critical assessment parameters
DuPaul, G. J., Guevremont, D. C., & Barkley, R. A. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90102-z · Cited by 48
Self-citationParent-child interactions during the initial weeks following brain injury in young children.
Wade, S. L., Taylor, H. G., Walz, N. C., Salisbury, S. R., Stancin, T., Bernard, L. A., Oberjohn, K. S., & Yeates, K. O. (2008) · Rehabilitation Psychology · doi:10.1037/0090-5550.53.2.180 · Cited by 57
“Because parent–child interactions vary depending on the context, similar to previous investigations (e.g., Barkley, 1991), we videotaped interactions in two contexts: (a) unstructured free play and (b) a structured teaching task.”
MethodMurray, L. K., & Kollins, S. H. (2000) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2000.33-573 · Cited by 48
“These findings support the hypothesis that the behavior of children with ADHD does not change in adaptive ways when environmental conditions change (i.e., lower sensitivity to reinforcement; Barkley, 1991, 1997; Haenlein & Caul, 1987; Quay, 1997).”
Naderi, A., Shaabani, F., Gharayagh Zandi, H., Calmeiro, L., & Brewer, B. W. (2020) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2019-0003 · Cited by 48
“In addition, Barkley (1991) reported that paper-and-pencil tests, rather than 214 computer-administered versions, have resulted in higher correlations between children’s test 215 scores and parent and teacher ratings of attention.”
BackgroundTime Perception: Does It Distinguish ADHD and RD Children in a Clinical Sample?
McGee, R., Brodeur, D., Symons, D., Andrade, B., & Fahie, C. (2004) · Journal of Abnormal Child Psychology · doi:10.1023/b:jacp.0000037778.61929.1b · Cited by 47
“Although research has identified measures that discriminate children with RD and ADHD from nonclinical controls (Barkley, 1991; Shapiro & Herod, 1994), few studies have found brief instruments that reliably distinguish them from clinical controls or from each other.”
BackgroundDevena, S. E., & Watkins, M. W. (2012) · Journal of Applied School Psychology · doi:10.1080/15377903.2012.669743 · Cited by 47
“Various methods are used to diagnose ADHD and can include the following: (a) direct observations (DuPaul, 1992), (b) structured interviews (Power & Ikeda, 1996), (c) behavior rating scales (Barkley, 1991), (d) multiple stage evaluation (DuPaul, 1992), and (e) cognitive profiles (Prifitera & Dersh, 1993).”
MethodChildren's motor activity: Reliability and relationship to attention and behavior
Reichenbach, L. C., Halperin, J. M., Sharma, V., & Newcorn, J. H. (1992) · Developmental Neuropsychology · doi:10.1080/87565649209540517 · Cited by 46
Contextual factors in vigilance testing of children with ADHD
Power, T. J. (1992) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00911242 · Cited by 46
“dures (Kupietz & Richardson, 1978) and teacher rating scales ( Barkley, 1991; Halperin et al., 1988; Klee & Garfinkel, 1983), but this association has not been found consistently (Lovejoy & Rasmussen, 1990).”
BackgroundWillis, W. G., & Weiler, M. D. (2005) · Developmental Neuropsychology · doi:10.1207/s15326942dn2701_6 · Cited by 52
“E-mail: wgwillis@uri.edu Offord, & Boyle, 1989), is among the most common and best studied neurobehavioral disorders of childhood (Barkley, 1991; Robbins, 1992; Shaywitz, Fletcher, & Shaywitz, 1995).”
BackgroundAnimal models to guide clinical drug development in ADHD: lost in translation?
Wickens, J. R., Hyland, B. I., & Tripp, G. (2011) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2011.01412.x · Cited by 51
“In theory, laboratory measures used in clinical studies of children with ADHD provide a bridge, but not all such measures are responsive to drug treatment (Barkley, 1991).”
BackgroundInfluentialLange, K. W., Tucha, L., Walitza, S., Gerlach, M., Linder, M., & Tucha, O. M. (2007) · Springer eBooks · doi:10.1007/978-3-211-73574-9_31 · Cited by 48
“The administration of methylphenidate significantly improves social interactions, diminishes oppositional and aggressive behaviour, and improves classroom behaviour (Whalen et al., 1989; Barkley, 1991 ).”
BackgroundRefinement and Psychometric Evaluation of the Executive Skills Questionnaire-Revised
Strait, J. E., Dawson, P., Walther, C. A. P., Strait, G. G., Barton, A. K., & McClain, M. B. (2019) · Contemporary School Psychology · doi:10.1007/s40688-018-00224-x · Cited by 57
“However, researchers have increasingly suggested that EF behavior rating scales are more ecologically valid than direct performance tests (Barkley 2012; Barkley 1991; Dawson and Guare 2010; Dehn 2008; Isquith et al. 2013; Samuels et al. 2016; Toplak et al. 2013).”
Components of Motor Deficiencies in ADHD and Possible Interventions
Dahan, A., Ryder, C. H., & Reiner, M. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.05.040 · Cited by 52
Media multitasking, impulsivity and dual task ability
Shin, M., Webb, A., & Kemps, E. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.11.018 · Cited by 42
Brand, S. T., Dunn, R., & Greb, F. (2002) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.1080/00098650209603953 · Cited by 43
Identification of AD/HD Subtypes Using Laboratory-Based Measures: A Cluster Analysis
Marks, D. J., Himelstein, J., Newcorn, J. H., & Halperin, J. M. (1999) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1021967632515 · Cited by 52
The factor structure of ADHD items in DSM-III-R: Internal consistency and external validation
Healey, J. M., Newcorn, J. H., Halperin, J. M., Wolf, L. E., Pascualvaca, D. M., Schmeidler, J., & O'Brien, J. D. (1993) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf01261603 · Cited by 42
“While there may be disagreement regarding the cological validity of these measures in diagnosing ADHD ( Barkley, 1991 ), the use of external validators in this study is important because it provides further evidence that two distinguishable constructs are contained within the larger ADHD symptom list.”
BackgroundBezdjian, S., Tuvblad, C., Wang, P., Raine, A., & Baker, L. A. (2014) · Developmental Psychology · doi:10.1037/a0038037 · Cited by 42
Differential Effects of Methylphenidate on Problem Solving in Adults With ADHD
Tucha, L., Tucha, O., Sontag, T. A., Stasik, D., Laufkötter, R., & Lange, K. W. (2011) · Journal of Attention Disorders · doi:10.1177/1087054709356391 · Cited by 42
“Since laboratory measures are usually designed to prove theoretical predictions under strict control of situational variables, concerns regarding their ecological validity have been raised (Barkley, 1991).”
BackgroundMethodVogt, C., & Williams, T. (2011) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2010.00593.x · Cited by 42
“assessment of the therapeutic response to stimulants has ecological validity, which is defined as the degree to which the results of a laboratory measure represents the actual behaviours of interest as they occur in natural settings (Barkley, 1991).”
BackgroundC. Tiffin‐Richards, M., Hasselhorn, M., Richards, M. L., Banaschewski, T., & Rothenberger, A. (2004) · Dyslexia · doi:10.1002/dys.281 · Cited by 42
“Both disorders have been shown to detrimentally affect IQ scores due to problems which these groups have with specific subtests (Thomson, 2003; Barkley, 1991; Tripp, Ryan, & Peace, 2002; Adams & Snowling, 2001).”
BackgroundRossiter, T. (2004) · Applied Psychophysiology and Biofeedback · doi:10.1023/b:apbi.0000026636.13180.b6 · Cited by 53
Schwebel, D. C., Hodgens, J. B., & Sterling, S. (2006) · Journal of Safety Research · doi:10.1016/j.jsr.2005.11.004 · Cited by 45
O’Neill, S. C., Schneiderman, R. L., Rajendran, K., Marks, D. J., & Halperin, J. M. (2013) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-013-9802-4 · Cited by 46
“This is not surprising given the robust literature showing weak-moderate concurrent associations between behavioral rating scales and laboratory and analoguemeasures of children’s ADHD behavior (Conners 2004; Reichenbach et al. 1992; see Barkley 1991, for a review).”
Kofler, M. J., Larsen, R., Sarver, D. E., & Tolan, P. H. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000103 · Cited by 39
“Observational and analogue tasks are generally recognized as providing more objective, molecular data regarding children’s ability to demonstrate target behaviors in novel settings (Harris & Lahey, 1982), whereas global teacherreport measures may provide more ecologically valid indicators of overall classroom social f…”
BackgroundA COMPUTERIZED TEST OF SELF‐CONTROL PREDICTS CLASSROOM BEHAVIOR
Hoerger, M. L., & Mace, F. C. (2006) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2006.171-04 · Cited by 41
“…objective and precise compared to subjective rating scales (Conners, 1990), laboratory measures will have limited applied value or ecological validity if they do not correspond to or predict behavior characteristic of ADHD in natural, uncontrolled environments (Barkley, 1991; Solanto et al., 2001).”
BackgroundTherapeutic Effects of Medication on ADHD: Implications for School Psychologists
DuPaul, G., Barkley, R., & McMurray, M. (2019) · School Psychology Review · doi:10.1080/02796015.1991.12085546 · Cited by 11
Self-citationUsing Virtual Reality to Assess Young Adult Smokers' Attention to Cues
Traylor, A. C., Bordnick, P. S., & Carter, B. L. (2009) · CyberPsychology & Behavior · doi:10.1089/cpb.2009.0070 · Cited by 40
“12 Indeed, Mogg et al 13 acknowledge that greater ecological validity is needed in attentional studies.”
Dougherty, D. M., Bjork, J. M., Moeller, F. G., Harper, R. A., Marsh, D. M., Mathias, C. W., & Swann, A. C. (2003) · The Journal of General Psychology · doi:10.1080/00221300309601271 · Cited by 40
“Researchers consider these responses to be related to components of selective attention (Barkley, 1991; Beale, Matthew, Oliver, & Comballis, 1987; Dougherty, Bjork, Marsh, & Moeller, 2000; Dougherty, Moeller, et al., 1999; Halperin et al., 1988; Halperin, Wolf, Greenblatt, & Young, 1991; O’Toole, Abramowitz, Morris, &…”
Continuous performance tests: A comparison of modalities
Baker, D. B., Taylor, C. J., & Leyva, C. (1995) · Journal of Clinical Psychology · doi:10.1002/1097-4679(199507)51:4<548::aid-jclp2270510414>3.0.co;2-q · Cited by 38
Slatcher, R. B., & Trentacosta, C. J. (2011) · Journal of Family Psychology · doi:10.1037/a0023728 · Cited by 43
“And while laboratory measurements provide an important perspective on child behaviors, their ecological validity is limited (Barkley, 1991).”
Júlvez, J., Debes, F., Weihe, P., Choi, A. L., & Grandjean, P. (2010) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2010.08.001 · Cited by 48
Chen, S. H., Zhou, Q., Uchikoshi, Y., & Bunge, S. A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01069 · Cited by 49
“…rate of omission errors, i.e., failing to press the button in response to the target stimulus, on similar tasks reflect sustained attention, while a high rate of commission errors, i.e., responding to non-target stimuli, reflect disinhibition or impulsivity (Halperin et al., 1988; Barkley, 1991).”
BackgroundTechnology Applications for Children with ADHD: Assessing the Empirical Support
Xu, C., Reid, R., & Steckelberg, A. L. (2002) · Education and Treatment of Children · Cited by 38
Discrimination of attention deficit hyperactivity disorder by the continuous performance test
LEVY, F., & HOBBES, G. (1997) · Journal of Paediatrics and Child Health · doi:10.1111/j.1440-1754.1997.tb01625.x · Cited by 39
Ethier, A.-A., Muckle, G., Jacobson, S. W., Ayotte, P., Jacobson, J. L., & Saint‐Amour, D. (2015) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2015.07.005 · Cited by 44
“Omissions reflect inattention where as false alarms reflect hyperactivity–impulsivity (Barkley, 1991; Epstein et al., 2003).”
BackgroundLlorente, A. (2001) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(00)00065-2 · Cited by 43
Attention-deficit/Hyperactivity Disorder
Shaywitz, B. A., Fletcher, J. M., & Shaywitz, S. E. (1997) · Advances in Pediatrics · doi:10.1016/s0065-3101(24)00056-2 · Cited by 41
Sutcliffe, P. A., Bishop, D., Houghton, S. J., & Taylor, M. F. (2006) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2006/076 · Cited by 38
An innovative ADHD assessment system using virtual reality
Yeh, S., Tsai, C.-F., Fan, Y.-C., Liu, P.-C., & Rizzo, A. (2012) · IEEE-EMBS Conference on Biomedical Engineering and Sciences · doi:10.1109/iecbes.2012.6498026 · Cited by 39
“In the past, ADHD patients were commonly diagnosed through clinical treatment or with some behavior scales (Barkley,1991); however, these tests were time-consuming indeed and their data were particularly susceptible to the influence of extrinsic factors (Abikoff et al., 1993).”
BackgroundThe Validity of the ADHD Section of the Diagnostic Interview Schedule for Children
McGrath, A. M., Handwerk, M. L., Armstrong, K. J., Lucas, C. P., & Friman, P. C. (2004) · Behavior Modification · doi:10.1177/0145445503258987 · Cited by 37
“The CPT has demonstrated equivocal utility in extant research in differentiating ADHD from non-ADHD participants (Barkley, 1991; Corkum & Siegel, 1993; Lassiter, D’Amato, Raggio, Whitten, & Bardos, 1994).”
Background(2000) · Journal of Attention Disorders · doi:10.1177/108705470000300401 · Cited by 36
Parents Influence the Visual Learning Environment Through Children's Manual Actions
McQuillan, M. E., Smith, L. B., Yu, C., & Bates, J. E. (2019) · Child Development · doi:10.1111/cdev.13274 · Cited by 48
“The free play context encourages exploratory behavior and higher order cognitive processing through examination, problem solving, and decision making with toys in view (Barkley, 1991).”
BackgroundNagashima, M., Monden, Y., Dan, I., Dan, H., Mizutani, T., Tsuzuki, D., Kyutoku, Y., Gunji, Y., Hirano, D., Taniguchi, T., et al. (2014) · Neurophotonics · doi:10.1117/1.nph.1.2.025007 · Cited by 29
Josman, N., & Meyer, S. (2018) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12525 · Cited by 43
Björklund, K., Liski, A., Samposalo, H., Lindblom, J., Hella, J., Huhtinen, H., Ojala, T., Alasuvanto, P., Koskinen, H.-L., Kiviruusu, O. H., et al. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1042 · Cited by 63
“Inhibitory control was assessed with a Go/No-Go –task [35,36] using the same stimulus materials and parameters as in Vuontela and colleagues [37].”
MethodEarly Clinical Assessment of Attention
DeWolfe, N. A., Byrne, J. M., & Bawden, H. N. (1999) · The Clinical Neuropsychologist · doi:10.1076/1385-4046(199911)13:04;1-y;ft458 · Cited by 34
Aggarwal, A., & Lillystone, D. (2000) · Journal of Paediatrics and Child Health · doi:10.1046/j.1440-1754.2000.00464.x · Cited by 33
Mezzacappa, E., Kindlon, D., & Earls, F. J. (1999) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1021936210844 · Cited by 40
“To address matters of ecologic validity (Barkley, 1991; Kalverboer, 1989), observations of behavior during task performance were made.”
BackgroundJohnson, K. A., White, M., Wong, P. S., & Murrihy, C. (2019) · Child Neuropsychology · doi:10.1080/09297049.2019.1639654 · Cited by 36
“…vague terms used in the scales, cross-contamination of different behavioural constructs within a question, the averaging of behaviour over a month, and informant bias may partially confound these measures (Barkley, 1991), and therefore may be problematic for use in research and clinical practice.”
BackgroundInfluentialAR-Therapist: Design and Simulation of an AR-Game Environment as a CBT for Patients with ADHD
Alqithami, S., Alzahrani, M., Alzahrani, A., & Mostafa, A. M. (2019) · Healthcare · doi:10.3390/healthcare7040146 · Cited by 39
“gy, as a heterogeneous developmental disorder, leading to bias- and extensive-diagnostic evaluations when examining patients through traditional clinical interviews and ratings of patients’ behaviors [2,3]. ADHD in underage patients can be observed in patients’ hyperactivity (i.e., inability to control their impulses)…”
BackgroundHong, N., Kim, J., Kwon, J.-H., Eom, H., & Kim, E. J. (2021) · Journal of Attention Disorders · doi:10.1177/1087054720986229 · Cited by 40
“However, the neurocognitive tasks used to assess patients with ADHD have been criticized for low ecological validity, because they are usually free of distracting stimuli (Barkley, 1991; Weis & Totten, 2004).”
BackgroundMayes, S. D., & Calhoun, S. L. (2002) · Psychological Reports · doi:10.2466/pr0.2002.91.2.575 · Cited by 33
Glucose effects on a continuous performance test of attention in adults
Flint, R. W., & Turek, C. (2003) · Behavioural Brain Research · doi:10.1016/s0166-4328(03)00002-0 · Cited by 38
Fogel, Y., Rosenblum, S., Hirsh, R., Chevignard, M., & Josman, N. (2020) · Occupational Therapy International · doi:10.1155/2020/3051809 · Cited by 42
“Barkley [15] described ecological validity as the extent to which performance evaluated in a laboratory represents the actual behaviors of interest as they occur in natural settings.”
BackgroundEcological Validity of the Conners' Continuous Performance Test II in a School-Based Sample
Weis, R., & Totten, S. J. (2004) · Journal of Psychoeducational Assessment · doi:10.1177/073428290402200104 · Cited by 32
Floyd, R. G., & Kirby, E. (2001) · Journal of Attention Disorders · doi:10.1177/108705470100500202 · Cited by 40
“Ratings of disinhibited behaviors by teachers and parents, behavioral observations of children in analogue settings, and other laboratoy measures of behavioral measures can be included (Barkley, 1991).”
BackgroundStroop/reverse-Stroop interference in typical development and its relation to symptoms of ADHD
Ikeda, Y., Okuzumi, H., & Kokubun, M. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2013.04.019 · Cited by 36
Specific Cognitive Deficits in ADHD: A Diagnostic Concern in Differential Diagnosis
Gupta, R., & Kar, B. R. (2010) · Journal of Child and Family Studies · doi:10.1007/s10826-010-9369-4 · Cited by 36
“Various CPTs have yielded false negative rates from 20 to 37% or higher (Greenberg & Waldman, 1993; Barkley, 1991), leading researchers to caution that “normal’ CPT performance should not be used as evidence to rule out a diagnosis of ADHD.”
BackgroundA cluster analytic study of schizotypal trait dimensions
Loughland, C. M., & Williams, L. M. (1997) · Personality and Individual Differences · doi:10.1016/s0191-8869(97)00086-x · Cited by 32
The effects of alcohol on laboratory-measured impulsivity after l-Tryptophan depletion or loading
Dougherty, D. M., Marsh, D. M., Mathias, C. W., Dawes, M. A., Bradley, D. M., Morgan, C., & Badawy, A. A. ‐. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0763-6 · Cited by 31
“Correct detections are thought to be related to components of selective attention (Beale et al. 1987; Halperin et al. 1988; Barkley 1991; O’Toole et al. 1997).”
BackgroundSuchy, Y., DesRuisseaux, L. A., Gereau Mora, M., Brothers, S. L., & Niermeyer, M. A. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000735 · Cited by 32
“…Ecological validity refers to the degree to which performance on standardized tests corresponds to the actual behavior of interest in natural settings (Barkley, 1991; Chaytor et al., 2006; Franzen and Wilhelm, 1996), and should therefore have characteristics similar to a naturally occurring…”
Aylward, G. P., Gordon, M., & Verhulst, S. J. (1997) · Assessment · doi:10.1177/107319119700400403 · Cited by 30
Allan, D. M., Allan, N. P., Lerner, M. D., Farrington, A. L., & Lonigan, C. J. (2015) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2015.02.001 · Cited by 38
Hopkins, M. E., Sharma, M., Evans, G. C., & Bucci, D. J. (2009) · Behavioral Neuroscience · doi:10.1037/a0015632 · Cited by 33
Wehmeier, P. M., Schacht, A., Ulberstad, F., Lehmann, M., Schneider-Fresenius, C., Lehmkuhl, G., Dittmann, R. W., & Banaschewski, T. (2012) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e318267c304 · Cited by 30
“Increased OE is related to selective attention and deficient arousal.(29)”
BackgroundLee, S. I., Hong, S. D., Kim, S.-Y., Kim, E., Kim, J., Kim, J.-H., Park, M., Park, S., Park, J.-H., Oh, E.-Y., et al. (2006) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2006.09.002 · Cited by 32
Netson, K. L., Conklin, H. M., Ashford, J. M., Kahalley, L. S., Wu, S., & Xiong, X. (2010) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsq102 · Cited by 33
“As noted above, CPT’s are routinely used to measure attention dysfunction, but have limited ecological validity (Barkley, 1991).”
BackgroundMethodInfluentialAhn, B., Joung, Y.-S., Kwon, J.-Y., Lee, D. I., Oh, S., Kim, B.-U., Cha, J. Y., Kim, J.-H., Lee, J. Y., Shin, H. Y., et al. (2021) · BMC Pediatrics · doi:10.1186/s12887-021-02597-0 · Cited by 29
Analogue assessment of child behavior problems.
Mori, L. T., & Armendariz, G. M. (2001) · Psychological Assessment · doi:10.1037//1040-3590.13.1.36 · Cited by 39
Munkvold, L. H., Manger, T., & Lundervold, A. J. (2012) · Child Neuropsychology · doi:10.1080/09297049.2012.753997 · Cited by 35
“…are assumed to reflect symptoms of inattention, errors of commission (i.e., responding when no response is required) are assumed to reflect impulsivity, and the measures across the six blocks are assumed to reflect sustained attention/vigilance (Barkley, 1991; Conners, 2000; Corkum & Siegel, 1993).”
BackgroundBoivin, M. J., Chounramany, C., Giordani, B., Xaisida, S., & Choulamountry, L. (1996) · Neuropsychology · doi:10.1037/0894-4105.10.4.588 · Cited by 32
“Barkley (1991), in a comprehensive review of the ecological validity of continuous performance test assessment, found that continuous performance measures were moderately to highly correlated with a variety of clinical, parental, and teacher ratings of attention in children with attentional disorders.”
Background
Metadata
- Authors
- Barkley, R. A.
- Affiliations
- University of Massachusetts Chan Medical School (US)
- Corresponding author
- Barkley, Russell A.
- ORCID
- Barkley, Russell A.
- Venue
- Journal of Abnormal Child Psychology
- Published
- 1991-04
- Volume
- 19
- Issue
- 2
- Pages
- 149-178
- ISSN
- 0091-0627 (ISSN-L)
- 1573-2835
- OpenAlex
- W2091884533
- Cited by
- 419
- References
- 124
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 8 · 2023: 11 · 2022: 9 · 2021: 9 · 2020: 12 · 2019: 15 · 2018: 14 · 2017: 10 · 2016: 12 · 2015: 16 · 2014: 12 · 2013: 17 · 2012: 20
- FWCI
- 13.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Research on Child and Adolescent Psychopathology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r01mh041464-01a1, 5r01mh041583-06)
- National Institute of Mental Health (R01MH042181, MH42181, MH41464, MH41583)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Keywords
- attention deficit hyperactivity disorder, ecological validity, laboratory evaluation, inattention, impulsivity, hyperactivity, naturalistic observation, children and adolescents
- MeSH terms
- Attention Deficit Disorder with Hyperactivity, Child, Child Behavior Disorders, Humans, Impulsive Behavior, Motor Activity, Social Environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.