The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index; 15 of the 33 sources its claims cite were checked for support.
Executive functioning in children with ADHD: Investigating the cross-method correlations between performance tests and rating scales
Open accessAbstract
Objective: Replicated evidence shows a weak or non-significant correlation between different methods of evaluating executive functions (EF). The current study investigates the association between rating scales and cognitive tests of EF in a sample of children with ADHD and executive dysfunction. Method: The sample included 139 children (aged 6-13) diagnosed with ADHD and executive dysfunctions. The children completed subtests of the Cambridge Neuropsychological Test Automated Battery (CANTAB). Parents completed the Behavior Rating Inventory of Executive Function (BRIEF) and the Children's Organizational Skills Scale (COSS). Analysis: Pairwise Spearman correlations were calculated between the composite and separate subscales of cognitive tests and rating scales. In secondary analyses, pairwise Spearman correlations were conducted between all composite scales and subscales, stratified by child sex and child ADHD subtype. Results: The correlation analyses between composite scores yielded no significant correlations. The results when comparing CANTAB TO and BRIEF GE are r=-.095, p=.289, and r=.042, p=.643 when comparing CANTAB TO and COSS TO. The analyses between all composite scales and subscales found one significant negative correlation (r=-.25, p<.01). There are significant cross-method differences when stratified by the ADHD-Inattentive subtype, showing significant negative correlations (moderate) between CANTAB and BRIEF composite (r=-.355, p=.014) and subscales. Discussion: It is possible that the different methods measure different underlying constructs of EF. It may be relevant to consider the effects of responder bias and differences in ecological validity in both measurement methods. Conclusion: The results found no significant correlations. The expectation in research and clinical settings should not be to find the same results when comparing data from cognitive tests and rating scales. Future research might explore novel approaches to EF testing with a higher level of ecological validity, and designing EF rating scales that capture EF behaviors more so than EF cognition.
Overview
CoChat Summary
TL;DR
This study examined cross-method correlations between CANTAB cognitive tests and parent BRIEF/COSS rating scales in 139 children aged 6–13 with ADHD and executive dysfunction. It found no significant composite cross-method correlations overall, with some significant negative correlations in the ADHD-Inattentive subtype, suggesting tests and ratings may measure different EF constructs.
Key findings
- Composite cross-method correlations were non-significant: CANTAB TO vs BRIEF GE was r=−.095, p=.289; CANTAB TO vs COSS TO was r=.042, p=.643. By contrast, BRIEF and COSS composite scores correlated strongly: r=.526, p<.001.
- Secondary analyses across all composites and subscales found seven weak correlations (<r=.3), four negative; the abstract reports one significant negative correlation (r=−.25, p<.01).
- Stratified by ADHD-Inattentive subtype, CANTAB total and BRIEF Global Executive Composite showed a moderate negative correlation (r=−.355, p=.014); subscale analysis identified 10 significant correlations, two weak and eight moderate, with nine negative.
- Sex stratification showed no statistically significant cross-method differences; BRIEF–COSS correlation was r=.217 (p=.268) in girls versus r=.613 (p<.001) in boys, likely related to sample size (girls n=30, boys n=105).
Methods
- Baseline data from an RCT of Organizational Skills Training; 139 children aged 6–13 recruited from outpatient clinics in Southern Denmark (June 2017–November 2022), with ADHD verified by K-SADS, IQ >80, BRIEF plan/organize scores ≥60, and autism spectrum disorder excluded.
- Children completed CANTAB subtests (Spatial Working Memory, One Touch Stockings of Cambridge, Stop Signal Task); parents completed BRIEF and COSS.
- Primary and secondary analyses used pairwise Spearman correlations between composite and subscale scores, stratified by child sex and ADHD subtype (excluding hyperactive subtype due to insufficient cases), with a sensitivity analysis for ages 6–7 on COSS; analyses performed in STATA 17.0.
Limitations
- Stated: only parents rated BRIEF and COSS; selecting children with high BRIEF Organize scores may have restricted score distribution and reduced detection of BRIEF–CANTAB correlations; CANTAB working memory was non-verbal only; the planning item measured first-try correct answers, and alternate error-based items might yield different results; no specific ADHD-I vs ADHD-C comparison was included.
- Evident from the text: the paper notes that significant subscale correlations could represent random findings due to multiple comparisons.
- Evident from the discussion: parents were not blinded and knew the study targeted organizational difficulties and that lack of EF difficulties would lead to exclusion, which may have influenced their ratings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
12 Valid · 1 Not valid · 7 Not checked · 31 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In a meta-analysis conducted by Toplak et al. (14) examining the overall cross-method correlation in 20 individual studies, the overall median correlation between EF test and rating scales was only r=.19.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Introduction
What the sources say
- Supportedcites Toplak et al. (14) Toplak ME, West RF, Stanovich KE. Practitioner review: do performance-based measures and ratings of executive function assess the same construct? J Child Psychol Psychiatry. 2013;54(2):131–43. source
The section ‘Summary of the measurable associations between performance-based and rating measures of executive function’ reports that the authors scrutinized 20 studies and found a median correlation of 0.19 across them. This directly supports the attributed number and cross-method comparison. (LLM, conf=0.94)
plainstates an associationn = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“As argued by Toplak et al. (13), Ledochowski, Andrade & Toplak (16), and Kofler et al. (11), the lack of ecological validity involved in EF cognitive tests may partly explain the lack of expected cross-methodological correlation.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Discussion > Cross-methodological Biases
What the sources say
- Not checked — no full text of the sourcecites Toplak et al. (13) Toplak ME, Bucciarelli SM, Jain U, Tannock R. Executive functions: performance-based measures and the behavior rating inventory of executive function (BRIEF) in adolescents with attention deficit/hyperactivity disorder (ADHD). Child Neuropsychol. 2009;15(1):53–72. source
- Not checked — no full text of the sourcecites Ledochowski, Andrade & Toplak (16) Ledochowski J, Andrade BF, Toplak ME. A novel unstructured performance-based task of executive function in children with attention-deficit/hyperactivity disorder. J Clin Exp Neuropsychol. 2019;41(5):445–59. source
- Partly supportedcites Kofler et al. (11) Kofler MJ, Sarver DE, Harmon SL, Moltisanti A, Aduen PA, Soto EF, et al. Working memory and organizational skills problems in ADHD. J Child Psychol Psychiatry. 2018;59(1):57–67. sourceExperimental — accuracy not yet measured
The Discussion’s Limitations section says measuring cognitive abilities and organizational skills in different settings may blunt effect sizes, which partly supports a cross-method explanation. But the Discussion reports strong convergence between brief laboratory working-memory tests and ecologically valid impairments; it does not argue that the tests’ limited ecological validity explains a lack of correlation. Page numbers are unavailable in our copy. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Even though EF play a central role in ADHD, and individuals with ADHD score significantly lower than control groups on measures of EF (6, 7), research also shows that the relationship between ADHD and EF is not well understood.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Introduction
What the sources say
- Supportedcites [6] Krieger V, Amador-Campos JA. Assessment of executive function in ADHD adolescents: contribution of performance tests and rating scales. Child Neuropsychol. 2018;24(8):1063–87. source
The Discussion reports that the ADHD groups scored lower than controls on performance-based cognitive EF measures and behavioral EF rating scales. The Cognitive and behavioral executive functioning section also reports significant differences between the ADHD and control groups on multiple EF scales. The study's direct findings concern adolescents with ADHD. (LLM, conf=0.93)
- Not checked — no full text of the sourcecites [7] Claesdotter E, Cervin M, Akerlund S, Rastam M, Lindvall M. The effects of ADHD on cognitive performance. Nord J Psychiatry. 2018;72(3):158–63. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Replicated evidence shows a weak or non-significant correlation between different methods of evaluating executive functions (EF).”
- Also stated in: § Introduction · hedged
“Evidence indicates only weak correlations between different methods of evaluating EF.”
- Also stated in: § Introduction · plain
“Toplak et al. (13, 14), Krieger et Amador-Campos (6), Soto et al. (15), and others have found some modest, primarily non-significant or weak correlations between cognitive tests and rating scales measuring EF.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Abstract > Objective
What the sources say
- Not matchedcites Toplak et al. (13, 14)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Krieger et Amador-Campos (6)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Soto et al. (15) Soto EF, Kofler MJ, Singh LJ, Wells EL, Irwin LN, Groves NB, et al. Executive functioning rating scales: Ecologically valid or construct invalid? Neuropsychology. 2020;34(6):605–19. source
The Current Study section reports that Gerst et al. replicated weak-to-nonsignificant correlations between EF rating scales and performance tests (r = .20–.25). The Results, Tier 1 section also reports a modest correlation between those methods in this study (r = .30), though it was statistically significant. Page numbers were not supplied. (LLM, conf=0.94)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results when comparing CANTAB TO and BRIEF GE are r=−.095, p=.289, and r=.042, p=.643 when comparing CANTAB TO and COSS TO.”
- Also stated in: § Primary outcomes · plain
“The result when comparing CANTAB TO and BRIEF GE is r=−.095, p=.289), and r=.042, p=.643 when comparing CANTAB TO and COSS TO.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Abstract > Results
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Primary outcomes · plain
16 more claims
Create a free account to see all 51 claims and every source verdict.
- It may state two separate claims as one. 16
- Borderline: one of the tests for a substantial claim is unclear. 1
- Probably not a substantial claim. 15
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Results > Secondary Outcomes
“These correlations concern the CANTAB test item Working memory and the BRIEF rating scale item Monitoring, and both the CANTAB test item Planning and the CANTAB Composite total score and the COSS rating scale item Organized actions.”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Discussion > Primary outcomes
“Our most promising finding is the significant but weak correlation between the CANTAB-OT measure, which concerns Planning, and the COSS variable concerning Organized Action (r = −.22, p = .05).”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Results > Secondary Outcomes
“The participants characterized by the ADHD-I (predominantly inattentive) subtype express a significant negative correlation (moderate, r = .3–.5) when comparing CANTAB total scale and BRIEF Global executive composite (r=−.355, p=.014).”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Statistical Analyses
“In the interpretation of the secondary analysis, a p-value of .01 indicates a significant finding, to take the multiple testing into account.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Subscale and composite level of EF
“From the Stop Signal Task (SST) test, which measures inhibition, the variables SST Stop Signal Reaction Time, SST Directions Errors: Go Trials, and SST Directions Errors: Stop Trials are all weighted and applied as a single measure: SST weighted variable (SS).”
§ Executive functioning in children with ADHD Investigating the cross-method correlations between performance tests and rating scales > Subscale and composite level of EF
“This was done by adding z-standardized scores of the OTS CANTAB items with weights 2:1:1.”
Citations
Cites
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268
KAUFMAN, J., BIRMAHER, B., BRENT, D., RAO, U., FLYNN, C., MORECI, P., WILLIAMSON, D., & RYAN, N. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199707000-00021 · Cited by 10,148
Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.02.006 · Cited by 3,568
Psychological Assessment Resources
Abidin, R. R. (1995) · Medical Entomology and Zoology · Cited by 3,140
TEST REVIEW behavior rating inventory of executive function.
Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000) · Child Neuropsychology · doi:10.1076/chin.6.3.235.3152 · Cited by 1,925
Behavior Rating Inventory for Executive Function
Gioia, G. A., Isquith, P. Κ., & Roth, R. M. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_1881-2 · Cited by 1,571
Toplak, M. E., West, R. F., & Stanovich, K. E. (2013) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12001 · Cited by 1,381 · cited 5×
“Soto et al. (15), on the other hand, argued that the research design of earlier studies, such as Toplak et al. (13, 14), has an impact on the interpretation of these studies.”
BackgroundMethodResultInfluentialNigg, J. T., Willcutt, E. G., Doyle, A. E., & Sonuga-Barke, E. J. S. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.08.025 · Cited by 886
Gioia, G. A., Isquith, P. K., Retzlaff, P. D., & Espy, K. A. (2002) · Child Neuropsychology · doi:10.1076/chin.8.4.249.13513 · Cited by 608
Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2008) · Child Neuropsychology · doi:10.1080/09297040802070929 · Cited by 444
Cited by
Grieco, J. A., Evans, C. L., Yock, T. I., & Pulsifer, M. B. (2024) · Child s Nervous System · doi:10.1007/s00381-024-06579-2 · Cited by 3
Ceruti, C., & Marzocchi, G. M. (2025) · Children · doi:10.3390/children12080970 · Cited by 4
Zapatero, I. P., Barba, R. J., & Rodríguez, L. E. (2024) · Applied Neuropsychology Child · doi:10.1080/21622965.2024.2420219 · Cited by 4
Metadata
- Authors
- Olsen, K. D., Sukhodolsky, D., & Bikic, A.
- Affiliations
- Region of Southern Denmark (DK)
- Yale University (US)
- University of Southern Denmark (DK)
- Corresponding author
- Olsen, Kristoffer Dalsgaard
- Venue
- Scandinavian Journal of Child and Adolescent Psychiatry and Psychology
- Publisher
- Walter de Gruyter GmbH
- Published
- 2024-01-01
- Volume
- 12
- Issue
- 1
- Pages
- 1-9
- ISSN
- 2245-8875 (ISSN-L)
- PMC
- PMC11027034
- OpenAlex
- W4394966346
- Cited by
- 4
- References
- 26
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2
- FWCI
- 1.17
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Scandinavian Journal of Child and Adolescent Psychiatry and Psychology (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Jascha Fonden
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- executive function, attention deficit hyperactivity disorder, executive dysfunction, rating scales, cognitive tests, CANTAB, Behavior Rating Inventory of Executive Function, inattentive subtype, ecological validity, children
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Executive functioning in children with ADHD: Investigating the cross-method correlations between performance tests and rating scales. https://app.cochat.ai/papers/10.2478/sjcapp-2024-0001
- The paper
- Olsen, K. D., Sukhodolsky, D., & Bikic, A. (2024). Executive functioning in children with ADHD: Investigating the cross-method correlations between performance tests and rating scales. Scandinavian Journal of Child and Adolescent Psychiatry and Psychology. https://doi.org/10.2478/sjcapp-2024-0001
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.