Reliability and validity of the online continuous performance test among young adults
Abstract
Continuous Performance Tests (CPTs) are used in research and clinical contexts to measure sustained attention and response inhibition. Reliability and validity of a new Online Continuous Performance Test (OCPT) was assessed. The OCPT is designed for delivery over the Internet, thereby opening new opportunities for research and clinical application in naturalistic settings. In Study 1, participants completed the OCPT twice over a 1-week period. One test was taken at home and one in the laboratory. Construct validity was assessed against a gold standard CPT measure. Results indicate acceptable reliability between the home- and laboratory-administered tests. Modest to high correlations were observed between the OCPT scales and the corresponding scales of the gold standard CPT. Study 2 examined whether the OCPT may discriminate participants with attention deficit hyperactivity disorder from healthy controls. Results revealed significantly higher rates of omission and commission errors and greater response time variability in participants with attention deficit hyperactivity disorder relative to healthy controls. These results support the reliability and validity of the OCPT and suggest that it may serve as an effective tool for the assessment of attention function in naturalistic settings.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Differences in memory performance between healthy children and children with ADHD might have been underestimated because healthy children display worse cognitive performance at home than under laboratory conditions.
“Indeed, based on the findings that healthy children display worse cognitive performance at home than under laboratory conditions [47], differences between healthy children and children with ADHD in memory performance might have been even underestimated.”
Healthy children display worse cognitive performance at home than under laboratory conditions.
“Indeed, based on the findings that healthy children display worse cognitive performance at home than under laboratory conditions [47], differences between healthy children and children with ADHD in memory performance might have been even underestimated.”
Cites
Attention Deficit Hyperactivity Disorder: A Handbook for Diagnosis and Treatment
Barkley, R. A., & Poillion, M. J. (1994) · Behavioral Disorders · doi:10.1177/019874299401900205 · Cited by 4,632 · see citing works
Neurocognitive consequences of sleep deprivation
Goel, N., Rao, H., Durmer, J., & Dinges, D. (2009) · Seminars in Neurology · doi:10.1055/s-0029-1237117 · Cited by 2,154 · see citing works
(1998) · Cited by 2,026 · see citing works
Diagnostic and Statistical Manual of Mental Disorders
Preedy, V., & Watson, R. (2010) · Springer eBooks · doi:10.1007/978-0-387-78665-0_5485 · Cited by 1,146 · see citing works
Bora, E., Yücel, M., & Pantelis, C. (2008) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.009 · Cited by 1,021 · see citing works
Sudha, R. (2017) · Jaypee Brothers Medical Publishers (P) Ltd. eBooks · doi:10.5005/jp/books/13016_29 · Cited by 939 · see citing works
Rabin, L., Barr, W., & Burton, L. A. (2004) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2004.02.005 · Cited by 829 · see citing works
Attention-Deficit Hyperactivity Disorder
Barkley, R. A. (1998) · Scientific American · doi:10.1038/scientificamerican0998-66 · Cited by 688 · see citing works
Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment, 2nd ed.
Barkley, R. A. (1998) · Cited by 632 · see citing works
Relations Between Continuous Performance Test Performance Measures and ADHD Behaviors
Epstein, J. N., Erkanli, A., Conners, C. K., Klaric, J., Costello, J. E., & Angold, A. (2003) · Journal of Abnormal Child Psychology · doi:10.1023/a:1025405216339 · Cited by 520 · cited 4× · see citing works
“Conners’s CPT-II was selected as a validation tool for the OCPT because it is considered a gold standard CPT measure, producing valid and reliable assessments of attention function (e.g., Conners et al., 2003; Egeland & Kovalik-Gran, 2010; Epstein et al., 2003; Hill, Pella, Singh, Jones, & Gouvier, 2009; McGee et al.,…”
BackgroundMethodInfluentialDevelopmental Normative Data on The Test of Variables of Attention (T.O.V.A.™)
Greenberg, L. M., & Waldmant, I. D. (1993) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1993.tb01105.x · Cited by 449 · see citing works
Continuous Performance Test Performance in a Normative Epidemiological Sample
Conners, C. K., Epstein, J. N., Angold, A. C., & Klaric, J. (2003) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1025457300409 · Cited by 441 · see citing works
Losier, B. J., McGrath, P. J., & Klein, R. M. (1996) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1996.tb01494.x · Cited by 424 · see citing works
The ecological validity of laboratory and analogue assessment methods of ADHD symptoms
Barkley, R. A. (1991) · Journal of Abnormal Child Psychology · doi:10.1007/bf00909976 · Cited by 419 · cited 2× · see citing works
“Taken together, these assessments revealed reliability and validity results that may be somewhat lower than those proposed by Nunnally and Bernstein (1994) but are in line with previously published evaluations of CPT tasks (Barkley, 1991; Conners, 2004; Forbes, 1998; Leark, Wallace, & Fitzgerald, 2004; Llorente et al.…”
ResultIntra-Subject Variability in Attention-Deficit Hyperactivity Disorder
Klein, C., Wendling, K., Huettner, P., Ruder, H., & Peper, M. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.04.003 · Cited by 410 · see citing works
Sandra Kooij, J. J., Marije Boonstra, A., Swinkels, S. H. N., Bekker, E. M., de Noord, I., & Buitelaar, J. K. (2008) · Journal of Attention Disorders · doi:10.1177/1087054707299367 · Cited by 388 · see citing works
Corkum, P. V., & Siegel, L. S. (1993) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1993.tb01784.x · Cited by 378 · see citing works
(2008) · PubMed · Cited by 334 · see citing works
Assessment of the Continuous Performance Test: Reliability and validity in a nonreferred sample.
Halperin, J. M., Sharma, V., Greenblatt, E. R., & Schwartz, S. T. (1991) · Psychological Assessment · doi:10.1037/1040-3590.3.4.603 · Cited by 266 · see citing works
Does the Conners' Continuous Performance Test Aid in ADHD Diagnosis?
McGee, R. A., Clark, S. E., & Symons, D. K. (2000) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1005127504982 · Cited by 200 · see citing works
Neuropsychological Assessment of Response Inhibition in Adults With ADHD
Epstein, J. N., Johnson, D. E., Varia, I., & Conners, C. K. (2001) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.23.3.362.1186 · Cited by 189 · see citing works
A Review of the Validity of Laboratory Cognitive Tasks Used to Assess Symptoms of ADHD
Nichols, S. L., & Waschbusch, D. A. (2004) · Child Psychiatry and Human Development · doi:10.1023/b:chud.0000020681.06865.97 · Cited by 165 · see citing works
Walker, C. R., & Andrews, P. (2015) · Wiley Encyclopedia of Forensic Science · doi:10.1002/9780470061589.fsa303.pub2 · Cited by 161 · see citing works
Attentional impairments in deficit and nondeficit forms of schizophrenia
Buchanan, R. W., Strauss, M. E., Breier, A. F., Kirkpatrick, B., & Carpenter, W. T. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.3.363 · Cited by 153 · see citing works
Riccio, C. A., Reynolds, C. R., & Lowe, P. A. (2001) · Medical Entomology and Zoology · Cited by 150 · see citing works
Continuous Performance Test Results of Adults with Attention Deficit Hyperactivity Disorder
Epstein, J. N., Conners, C. K., Sitarenios, G., & Erhardt, D. (1998) · The Clinical Neuropsychologist · doi:10.1076/clin.12.2.155.2000 · Cited by 139 · see citing works
Neuropsychological Functioning of Adults with Attention Deficit Hyperactivity Disorder
Walker, A., Shores, E. A., Trollor, J. N., Lee, T., & Sachdev, P. S. (2000) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/1380-3395(200002)22:1;1-8;ft115 · Cited by 133 · see citing works
Continuous Performance Tests Are Sensitive to ADHD in Adults but Lack Specificity
Riccio, C. A., & Reynolds, C. R. (2001) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2001.tb05776.x · Cited by 125 · see citing works
Advokat, C. D., Martino, L., Hill, B. D., & Gouvier, W. D. (2007) · Journal of Attention Disorders · doi:10.1177/1087054706292106 · Cited by 99 · see citing works
Journal of Child and Adolescent Psychiatry
(2019) · Journal of Child and Adolescent Psychiatry · doi:10.14302/issn.2643-6655 · Cited by 94 · see citing works
Test of Variables of Attention
Dumont, R., & Willis, J. O. (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced2078 · Cited by 78 · see citing works
Validity of the Factor Structure of Conners’ CPT
Egeland, J., & Kovalik-Gran, I. (2009) · Journal of Attention Disorders · doi:10.1177/1087054709332477 · Cited by 68 · see citing works
Journal of Developmental and Behavioral Pediatrics
&NA; (1991) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/00004703-199104000-00001 · Cited by 54 · see citing works
Llorente, A. M., Amado, A. J., Voigt, R. G., Berretta, M. C., Fraley, J. K., Jensen, C. L., & Heird, W. C. (2001) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(00)00065-2 · Cited by 43 · see citing works
Online assessment of sustained attention following sleep restriction
Sadeh, A., Dan, O., & Bar‐Haim, Y. (2010) · Sleep Medicine · doi:10.1016/j.sleep.2010.02.001 · Cited by 34 · see citing works
Self-citationLeark, R. A., Wallace, D. R., & Fitzgerald, R. (2004) · Assessment · doi:10.1177/1073191104269186 · Cited by 32 · see citing works
Llorente, A. M., Amado, A. J., Voigt, R. G., et al. (2001) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/16.6.535 · Cited by 32 · see citing works
Hill, B. D., Pella, R., Singh, A. N. A., Jones, G. N., & Gouvier, W. (2009) · Journal of Attention Disorders · doi:10.1177/1087054708320384 · Cited by 31 · see citing works
Psychometric Differentiation of Conduct Disorder and Attention Deficit Disorder with Hyperactivity
BRIEN, J. D. O., Halperin, J. M., Newcorn, J. H., Sharma, V., Wolf, L. E., & MORGANSTEIN, A. (1992) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/00004703-199208000-00006 · Cited by 24 · see citing works
Llorente, A. M., Voigt, R. G., Jensen, C. L., Fraley, J. K., Heird, W. C., & Rennie, K. M. (2008) · Child Neuropsychology · doi:10.1080/09297040701563578 · Cited by 20 · see citing works
Jin (1998) · doi:10.1002/(sici)1097-4679(199806)54:4
Flagged first, then by citations
Cited by
Sorted by citations
Prehn-Kristensen, A., Munz, M., Göder, R., Wilhelm, I., Korr, K., Vahl, W., Wiesner, C. D., & Baving, L. (2014) · Brain Stimulation · doi:10.1016/j.brs.2014.07.036 · Cited by 176 · see citing works
Neural correlates of emotional intelligence in a visual emotional oddball task: An ERP study
Raz, S., Dan, O., & Zysberg, L. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2014.09.003 · Cited by 35 · see citing works
Self-citationMindfulness, Obsessive–Compulsive Symptoms, and Executive Dysfunction
Crowe, K., & McKay, D. (2016) · Cognitive Therapy and Research · doi:10.1007/s10608-016-9777-x · Cited by 32 · see citing works
- Authors
- Raz, S., Bar-Haim, Y., Sadeh, A., & Dan, O.
- Affiliations
- The Max Stern Yezreel Valley College (IL)
- Department of Psychology, Tel Aviv University
- Tel Aviv University (IL)
- Venue
- Assessment
- Publisher
- SAGE Publications
- Published
- 2012-04-18
- Volume
- 21
- Issue
- 1
- Pages
- 108-118
- ISSN
- 1073-1911 (ISSN-L)
- 1552-3489
- OpenAlex
- W2102258868
- Cited by
- 49
- References
- 41
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 6 · 2021: 5 · 2020: 6 · 2019: 2 · 2018: 3 · 2017: 3 · 2016: 7 · 2015: 4 · 2014: 6 · 2013: 2
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Life Sciences › Neuroscience › Cognitive Neuroscience › Mind wandering and attention
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- sustained attention, response inhibition, attention deficit hyperactivity disorder, online assessment, construct validity, test-retest reliability, naturalistic assessment, omission and commission errors, reaction time variability, young adults
- MeSH terms
- Adult, Attention, Attention Deficit Disorder with Hyperactivity, Diagnosis, Computer-Assisted, Female, Humans, Inhibition, Psychological, Male, Neuropsychological Tests, Pattern Recognition, Visual, Psychometrics, Psychomotor Performance, Reaction Time, Social Environment, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
