Confirmatory Factor Analysis of the Behavior Rating Inventory of Executive Function-Adult Version in Healthy Adults and Application to Attention-Deficit/Hyperactivity Disorder
Open accessAbstract
The Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A) is a questionnaire measure designed to assess executive functioning in everyday life. Analysis of data from the BRIEF-A standardization sample yielded a two-factor solution (labeled Behavioral Regulation and Metacognition). The present investigation employed confirmatory factor analysis (CFA) to evaluate four alternative models of the factor structure of the BRIEF-A self-report form in a sample of 524 healthy young adults. Results indicated that a three-factor model best fits the data: a Metacognition factor, a Behavioral Regulation factor consisting of the Inhibit and Self-Monitor scales, and an Emotional Regulation factor composed of the Emotional Control and Shift scales. The three factors contributed 14%, 19%, and 24% of unique variance to the model, respectively, and a second-order general factor accounted for 41% of variance overall. This three-factor solution is consistent with recent CFAs of the Parent report form of the BRIEF. Furthermore, although the Behavioral Regulation factor score in the two-factor model did not differ between adults with attention-deficit/hyperactivity disorder and a matched healthy comparison group, greater impairment on the Behavioral Regulation factor but not the Emotional Regulation factor was found using the three-factor model. Together, these findings support the multidimensional nature of executive function and the clinical relevance of a three-factor model of the BRIEF-A.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 56 cited sources checked · 0 supported · 0 flagged
- Findingown data
In the three-factor model, the ADHD group showed greater impairment on the Behavioral Regulation factor than the healthy comparison group.
“greater impairment on the Behavioral Regulation factor but not the Emotional Regulation factor was found using the three-factor model.”
- Also stated in: § Factor Scores in Adult ADHD · plain
“In contrast, analysis of the three-factor model revealed poorer executive functioning in the ADHD group as reflect by the Behavioral Regulation factort(1) ¼ 2.18, p ¼ .04,d ¼ 0.71-but not the Emotional Regulation factor-t(1) ¼ 1.19, p ¼ .24,d ¼ 0.39.”
Quote in the paperSubstantial claim- Rests on an assumption: The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Also stated in: § Factor Scores in Adult ADHD · plain
- Findingown data
In the three-factor model, the ADHD group did not differ from the healthy comparison group on the Emotional Regulation factor.
“greater impairment on the Behavioral Regulation factor but not the Emotional Regulation factor was found using the three-factor model.”
- Also stated in: § Factor Scores in Adult ADHD · plain
“but not the Emotional Regulation factor-t(1) ¼ 1.19, p ¼ .24,d ¼ 0.39.”
Quote in the paperSubstantial claim- Rests on an assumption: The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Also stated in: § Factor Scores in Adult ADHD · plain
- Findingown data
The three-factor model fit better than the two-factor model.
“that the three-factor model improved fit beyond the two-factor model (Table 3), and that adding a fourth factor did not improve the model fit, resulting in an inadmissible solution-the correlation between the Internal and External Metacognition factors was estimated to be 1.02.”
Quote in the paperSubstantial claim - Findingown data
In that subset, higher depression showed a trend toward worse Behavioral Regulation in the two-factor model (r=.55, p=.07).
“a trend for greater difficulty on the Behavioral Regulation factor in the two-factor model (r ¼ .55,p ¼ .07)”
Quote in the paperNot a substantial claim- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Findingown data
Among patients with BDI-II data, higher depression was linked to worse Metacognition factor scores (r=.76, p=.004).
“In the subset of patients with BDI-II scores, greater depressed mood was associated with significantly worse executive function on the Metacognition (r ¼ .76,p ¼ .004)”
Quote in the paperNot a substantial claim- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Findingown data
Correlations among the three factors were high, from .70 to .79.
“The factors were also highly interrelated, with correlations ranging from .70 to .79.”
Quote in the paperNot a substantial claim - Findingown data
Across models, the ADHD group had significantly worse Metacognition factor scores (t=4.39, p=.001, d=1.42).
“Independent sample t-test indicated significantly worse functioning on the Metacognition factor in the ADHD group irrespective of model-t(1) ¼ 4.39, p ¼ .001,d ¼ 1.42.”
Quote in the paperSubstantial claim- Rests on an assumption: The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Findingown data
In that subset, depression was unrelated to Behavioral Regulation in the three-factor model (r=.30, p=.34).
“but was unrelated to score on the Behavioral Regulation factor in the three-factor model (r ¼ .30,p ¼ .34).”
Quote in the paperNot a substantial claim- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Findingcitation
The present Metacognition factor matched the BRIEF-A exploratory factor analysis, with Initiate, Working Memory, Plan/Organize, Task Monitor, and Organization of Materials.
“The structure of the Metacognition factor was found to be the same as that obtained in an exploratory factor analysis of the BRIEF-A, being composed of the Initiate, Working Memory, Plan/Organize, Task Monitor, and Organization of Materials scales (Roth et al., 2005).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
- Findingown data
Here, the Task-Monitor and Self-Monitor BRIEF-A scales had different loadings on Metacognition and Behavioral Regulation.
“In this study, the BRIEF-A Task-Monitor and Self-Monitor scales loaded differentially on the Metacognition and Behavioral Regulation factors, a finding that was also obtained in prior studies using the BRIEF to examine parent and teacher reports of executive functioning in children (Egeland & Fallmyr, 2010;Gioia et al., 2000), as well as an exploratory factor analysis of the BRIEF-A (Roth et al.,”
Quote in the paperSubstantial claim - Findingown data
The three BRIEF-A factors had significant correlations.
“Correlations among the three BRIEF-A factors were significant, however, indicating considerable interactions among components of executive function.”
Quote in the paperNot a substantial claim - Findingown data
In the same subset, higher depression was linked to worse Emotional Regulation factor scores (r=.68, p=.02).
“and Emotional Regulation (r ¼ .68,p ¼ .02)factors”
Quote in the paperNot a substantial claim- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Findingown data
Correlations among the nine BRIEF-A scales ranged from 0.21 to 0.72, indicating moderate to high associations.
“The nine BRIEF-A scales were moderately to highly correlated with one another, with coefficients ranging from 0.21 to 0.72 (Table 2).”
Quote in the paperNot a substantial claim - Findingown data
Self-reported depression was unrelated to Behavioral Regulation in the three-factor model.
“Mood was unrelated to Behavioral Regulation in the three-factor model but showed a trend to be associated with Behavioral Regulation in the two-factor model and was highly correlated with the Emotional Regulation factor.”
Quote in the paperSubstantial claim - Findingown data
In the three-factor model, adult ADHD was not associated with poorer Emotional Regulation factor scores.
“In contrast, analysis of the three-factor model revealed that adult ADHD is associated with poorer scores on the Behavioral Regulation factor (reflecting inhibitory control and monitoring of social behavior) but not Emotional Regulation factor (reflecting control of emotions and cognitive flexibility).”
Quote in the paperSubstantial claim - Findingown data
Self-reported depression was highly correlated with the Emotional Regulation factor.
“Mood was unrelated to Behavioral Regulation in the three-factor model but showed a trend to be associated with Behavioral Regulation in the two-factor model and was highly correlated with the Emotional Regulation factor.”
Quote in the paperSubstantial claim - Findingown data
Self-reported depression showed a trend toward association with Behavioral Regulation in the two-factor model.
“Mood was unrelated to Behavioral Regulation in the three-factor model but showed a trend to be associated with Behavioral Regulation in the two-factor model and was highly correlated with the Emotional Regulation factor.”
Quote in the paperSubstantial claim - Findingown data
Young adults with ADHD reported greater difficulty on the Metacognition factor than matched healthy adults.
“Our patient group reported greater difficulty on the Metacognition factor than a matched group of healthy adults, consistent with a prior study on adult ADHD (Rotenberg-Shpigelma et al., 2008).”
Quote in the paperSubstantial claim - Findingreasoning
The models showed imperfect fit to the data (e.g., RMSEAs >0.08).
“Still, this violation may be responsible for some of the models' imperfect fit to the data (e.g., RMSEAs .0.08).”
Quote in the paperNot a substantial claim - Findingown data
In the two-factor model, the ADHD group showed only a trend toward worse Behavioral Regulation factor scores.
“The Behavioral Regulation factor showed only a trend toward being worse in the ADHD group when examined in the two-factor model.”
Quote in the paperSubstantial claim - Findingown data
In the three-factor model, adult ADHD was associated with poorer Behavioral Regulation factor scores.
“In contrast, analysis of the three-factor model revealed that adult ADHD is associated with poorer scores on the Behavioral Regulation factor (reflecting inhibitory control and monitoring of social behavior) but not Emotional Regulation factor (reflecting control of emotions and cognitive flexibility).”
Quote in the paperSubstantial claim - Interpretationown data
The findings support the multidimensional nature of executive function.
“Together, these findings support the multidimensional nature of executive function and the clinical relevance of a three-factor model of the”
Quote in the paperSubstantial claim - Interpretationcitation
The three-factor solution is consistent with recent confirmatory factor analyses of the Parent report form of the BRIEF.
“This three-factor solution is consistent with recent CFAs of the Parent report form of the BRIEF.”
- Also stated in: § Discussion · plain
“This separation of the Behavioral Regulation Index into two factors, and the scale composition of those factors, is consistent with the results of CFAs of the nine-scale version of the original BRIEF that was designed for use with children and adolescents (Egeland & Fallmyr, 2010;Gioia & Isquith, 2002).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Egeland & Fallmyr, 2010
Not checked in the free run.
- cites Gioia & Isquith, 2002 source
Not checked in the free run.
- Also stated in: § Discussion · plain
- Interpretationown data
The results indicate that a three-factor BRIEF-A model has clinical usefulness.
“Together, these findings support the multidimensional nature of executive function and the clinical relevance of a three-factor model of the”
Quote in the paperSubstantial claim- Rests on an assumption: The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Premisecitation
Multiple research strands back the idea that executive functions are fractionated.
“Several lines of research, however, support the fractionation of executive functions.”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation
An analysis of the BRIEF-A standardization sample produced a two-factor solution labeled Behavioral Regulation and Metacognition.
“Analysis of data from the BRIEF-A standardization sample yielded a two-factor solution (labeled Behavioral Regulation and Metacognition).”
- Also stated in: § Introduction · plain
“Exploratory factor analysis of the BRIEF-A conducted separately for the two forms, using the normative sample as well as a mixed clinical and healthy adult sample, yielded a two-factor solution (Metacognition factor and Behavioral Regulation factor) consistent with the original version of the measure.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
- Also stated in: § Introduction · plain
- Interpretationcitation
These two factors conceptually overlap with theories giving emotion regulation a distinct role, such as Zelazo and Müller's cool/hot executive control model.
“In addition, the two factors appear to overlap conceptually, to some extent, with theoretical models of executive function that argue for a unique role of emotion regulation, such as that of Zelazo & Mu ¨ller (2002) proposing the presence”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zelazo & Mu ¨ller, 2002
Not checked in the free run.
- Interpretationown data
Finding separate metacognition, behavioral regulation, and emotional regulation factors fits models that fractionate executive function into partly distinct components.
“Rather, the observation of separate factors of metacognition, behavioral regulation (including inhibitory control), and emotional regulation meshes well with models of executive function emphasizing fractionation of executive function into at least partially distinct components each have important roles in self-regulation (Barkley, 1997;Miyake et al., 2000).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Barkley, 1997
Not checked in the free run.
- cites Miyake et al., 2000 source
Not checked in the free run.
- Interpretationown data
Present results, child BRIEF results, and other questionnaire measures of executive function do not support a unitary general executive construct.
“Nonetheless, the results of the present analyses, as well as those of the BRIEF designed for children (Egeland & Fallmyr, 2010;Gioia & Isquith, 2002) and other questionnaire measures of executive function (Chaytor & Schmitter-Edgecombe, 2007), are not consistent with a model emphasizing a unitary, general executive construct.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Egeland & Fallmyr, 2010
Not checked in the free run.
- cites Gioia & Isquith, 2002 source
Not checked in the free run.
- cites Chaytor & Schmitter-Edgecombe, 2007
Not checked in the free run.
- Interpretationown data
Those significant correlations suggest substantial interplay among executive-function components.
“Correlations among the three BRIEF-A factors were significant, however, indicating considerable interactions among components of executive function.”
Quote in the paperSubstantial claim - Premisecitation
Separate exploratory factor analyses of the BRIEF-A self- and informant-report forms, using normative and mixed clinical/healthy adult samples, produced a two-factor solution (Metacognition and Behavioral Regulation) like the original BRIEF.
“Exploratory factor analysis of the BRIEF-A conducted separately for the two forms, using the normative sample as well as a mixed clinical and healthy adult sample, yielded a two-factor solution (Metacognition factor and Behavioral Regulation factor) consistent with the original version of the measure.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
- Premisecitation
The BRIEF-A Task-Monitor scale, reflecting accurate behavioral task monitoring, has been most consistently linked to the anterior cingulate gyrus.
“Accurate monitoring of performance on behavioral tasks, reflected in the BRIEF-A Task-Monitor scale, has been most consistently associated with the anterior cingulate gyrus (Swick & Turken, 2002;van Veen & Carter, 2002).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Swick & Turken, 2002
Not checked in the free run.
- cites van Veen & Carter, 2002 source
Not checked in the free run.
- Interpretationcitation
Separate Behavioral Regulation and Emotional Regulation factors in the BRIEF-A agree with accumulating evidence for partly distinct neural substrates underlying these self-regulation forms.
“The presence of separate Behavioral Regulation and Emotional Regulation factors in the BRIEF-A is consistent with a growing body of evidence, indicating at least partly distinct neural substrates for these two forms of self-regulation (Kompus, Hugdahl, Ohman, Marklund, & Nyberg, 2009;Mohanty et al., 2007).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Kompus, Hugdahl, Ohman, Marklund, & Nyberg, 2009
Not checked in the free run.
- cites Mohanty et al., 2007 source
Not checked in the free run.
- Interpretationcitation
The results seem consistent with neuroimaging and acquired-lesion studies indicating partly separate neural correlates for different monitoring types.
“Our findings also appear to be consistent with functional neuroimaging research and studies of patients with acquired brain lesions, which together suggest at least a partial dissociation between the neural correlates of different types of monitoring, though they involve richly interconnected prefrontal regions.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Swick & Turken, 2002
Not checked in the free run.
- cites van Veen & Carter, 2002 source
Not checked in the free run.
- Interpretationreasoning
A single general second-order factor, called the General Executive Composite, could summarize the three first-order factors.
“This suggested that the three first-order factors (FOFs) could also be summarized in terms of their loadings on a single general second-order factor (SOF), labeled the General Executive Composite, as is shown in Fig. 1.”
Quote in the paperSubstantial claim - Study design and conductown data
The ADHD sample was a clinical convenience sample rather than a carefully selected, comorbidity-free research sample.
“Our sample of adults with ADHD was relatively small and represented a clinical convenience sample rather than a carefully selected, comorbidity-free research sample.”
Quote in the paperNot a substantial claim - Premisecitation
The BRIEF-A has shown utility in both clinical and non-clinical groups.
“There is support for the convergent and discriminant validity of the BRIEF-A (Roth et al., 2005) and its utility has been demonstrated in studies of clinical (Biederman et al., 2011;Chang, Davies, & Gavin, 2009;Garlinghouse, Roth, Isquith, Flashman, & Saykin, 2010;Kumbhani, Roth, Kuck, Flashman, & McAllister, 2010;Rabin et al., 2006) and non-clinical (Christ, Kanne, & Reiersen, 2010;Koven & Thomas”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Biederman et al., 2011 source
Not checked in the free run.
- cites Christ, Kanne, & Reiersen, 2010
Not checked in the free run.
- cites Rabin et al., 2006
Not checked in the free run.
- Interpretationreasoning
Reliance on the Global Executive Composite score might obscure more specific relationships between everyday executive functioning and clinical problems, neuropsychological test performance, or other salient variables.
“Together, the findings suggest that reliance on use of the Global Executive Composite score, representing the overall integrity of executive functions as measured by the BRIEF-A, might obscure more specific relationships between executive functioning in everyday life (as reflected by index/factor scores or individual scale scores) and clinical problems, neuropsychological test performance, or”
Quote in the paperSubstantial claim- Rests on an assumption: The BRIEF-A validly measures the overall integrity of executive functions.
- Study design and conductcitation
The study used normal theory maximum likelihood estimators that have been shown to be robust to at least modest violations of multivariate normality.
“Rather, we used normal theory maximum likelihood estimators that have been shown to be robust to at least modest violations of the multivariate normality assumption (Chou, Bentler, & Satorra, 1991;Cortina et al., 2001).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Chou, Bentler, & Satorra, 1991
Not checked in the free run.
- cites Cortina et al., 2001 source
Not checked in the free run.
- Premisecitation
Previous studies have demonstrated the importance of examining the BRIEF at the level of index/factor scores or individual scales in pediatric and adult populations.
“Indeed, previous studies have demonstrated the importance of examining the BRIEF at the level of the indexes/factor scores or at the level of individuals scales in a variety of pediatric (Brown et al., 2008;Mahone et al., 2002) and adult (Christ et al., 2010;Kumbhani et al., 2010;Schroeder & Kelley, 2008) populations.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Brown et al., 2008 source
Not checked in the free run.
- cites Mahone et al., 2002
Not checked in the free run.
- cites Christ et al., 2010
Not checked in the free run.
- Study design and conductnone given
The sample of adults with ADHD was relatively small.
“Our sample of adults with ADHD was relatively small and represented a clinical convenience sample rather than a carefully selected, comorbidity-free research sample.”
Quote in the paperNot a substantial claim - Premisecitation
Asymptotic distribution-free estimators require much larger sample sizes (in the 1,000s) than were available in this study.
“Asymptotic distribution-free estimators are now available for non-normal data (Browne, 1984;Jo ¨reskog & So ¨rbom, 2004) but they require much larger sample sizes (in the 1,000 s; see Cortina, Chen & Dunlap, 2001;Hu, Bentler, & Kano, 1992) than was available here.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Cortina, Chen & Dunlap, 2001 source
Not checked in the free run.
- cites Hu, Bentler, & Kano, 1992
Not checked in the free run.
- Study design and conductown data
Gender distribution did not differ between the ADHD and healthy groups.
“the groups did not differ with respect to gender distribution (% female: ADHD ¼ 36.8,Healthy ¼ 47.4).x 2 (1) ¼ 0.42, p ¼ .51.”
Quote in the paperNot a substantial claim - Premisecitation
Prior work indicated that treatment with methylphenidate improves scores on the BRIEF-A in adults with ADHD.
“Furthermore, a subset of the patients were medicated for the disorder, although prior work (Roth et al., 2005) has indicated that treatment with methylphenidate improves scores on the BRIEF-A in adults with ADHD, and thus medication status is unlikely to account for the differences observed between the patient and matched control groups.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
- Study design and conductnone given
The factor analysis sample consisted of generally well educated young adults.
“First, the factor analysis sample consisted of generally well educated young adults and thus it remains unknown whether the three-factor model would also provide the best fit in other populations.”
Quote in the paperSubstantial claim - Study design and conductnone given
A subset of the patients with ADHD were medicated for the disorder.
“Furthermore, a subset of the patients were medicated for the disorder, although prior work (Roth et al., 2005) has indicated that treatment with methylphenidate improves scores on the BRIEF-A in adults with ADHD, and thus medication status is unlikely to account for the differences observed between the patient and matched control groups.”
Quote in the paperNot a substantial claim - Interpretationcitation
Medication status is unlikely to account for the differences observed between the patient and matched control groups.
“Furthermore, a subset of the patients were medicated for the disorder, although prior work (Roth et al., 2005) has indicated that treatment with methylphenidate improves scores on the BRIEF-A in adults with ADHD, and thus medication status is unlikely to account for the differences observed between the patient and matched control groups.”
Quote in the paperNot a substantial claim - Interpretationown data
The violation of multivariate normality may be responsible for some of the models' imperfect fit to the data (e.g., RMSEAs >0.08).
“Still, this violation may be responsible for some of the models' imperfect fit to the data (e.g., RMSEAs .0.08).”
Quote in the paperNot a substantial claim
- May combine two claims. 21
- Classified as probably not a substantial claim. 18
May combine two claims.
Findingown dataWithin the three-factor solution, unique variance contributions were 14%, 19%, and 24% for the factors, and a general second-order factor explained 41% of total variance.
“The three factors contributed 14%, 19%, and 24% of unique variance to the model, respectively, and a second-order general factor accounted for 41% of variance overall.”
- Also stated in: § Confirmatory Factor Analysis · plain
“The three factors contributed 14%, 19%, and 24% of unique variance to the model, respectively, and a second-order general factor accounted for 41% of variance overall.”
Quote in the paperSubstantial claim- Also stated in: § Confirmatory Factor Analysis · plain
May combine two claims.
Findingown dataIn the two-factor model, the Behavioral Regulation factor score did not differ significantly between adults with ADHD and matched healthy comparison participants; the difference was only a trend.
“although the Behavioral Regulation factor score in the two-factor model did not differ between adults with attention-deficit/hyperactivity disorder and a matched healthy comparison group”
- Also stated in: § Factor Scores in Adult ADHD · plain
“In the two-factor model, the group difference for the Behavioral Regulation factor was only at the level of a trend-t(1) ¼ 1.83, p ¼ .08,d ¼ 0.59.”
Quote in the paperSubstantial claim- Rests on an assumption: The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
- Rests on an assumption: The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
- Also stated in: § Factor Scores in Adult ADHD · plain
May combine two claims.
Findingown dataIn healthy young adults, a three-factor model fits the BRIEF-A self-report data better than one-, two-, or four-factor models; the factors are Metacognition, Behavioral Regulation (Inhibit and Self-Monitor), and Emotional Regulation (Emotional Control and Shift).
“Results indicated that a three-factor model best fits the data: a Metacognition factor, a Behavioral Regulation factor consisting of the Inhibit and Self-Monitor scales, and an Emotional Regulation factor composed of the Emotional Control and Shift scales.”
- Also stated in: § Confirmatory Factor Analysis · hedged
“Thus, the three-factor solution appeared to best represent the data.”
- Also stated in: § Discussion · plain
“Results showed that a three-factor model fits the data better than either the one-, two-, or four-factor models tested.”
Quote in the paperSubstantial claim- Also stated in: § Confirmatory Factor Analysis · hedged
May combine two claims.
Findingown dataA fourth factor did not improve fit and led to an inadmissible solution; the Internal and External Metacognition factors correlated at 1.02.
“that the three-factor model improved fit beyond the two-factor model (Table 3), and that adding a fourth factor did not improve the model fit, resulting in an inadmissible solution-the correlation between the Internal and External Metacognition factors was estimated to be 1.02.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEvery CFA model was statistically rejected by chi-square, and no model satisfied the strict RMSEA threshold.
“The CFA indicated that all models tested were rejected statistically on the basis of the x 2 statistic and none of the models met the stringent cutoff criterion for RMSEA (Table 3).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe two-factor model fit better than the one-factor model, showing the BRIEF-A is not unidimensional.
“The Dx 2 test confirmed that the BRIEF-A is not unidimensional (i.e., the twofactor model fit significantly better than did the one-factor model), that the three-factor model improved”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe three factors explained 61%, 52%, and 58% of variance in their scales, respectively, and all loadings were high and significant.
“All factor loadings were relatively high and statistically significant with the Metacognition, Emotional Regulation, and Behavioral Regulation factors accounting for 61%, 52%, and 58% of the variance in their respective scales, respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBRIEF-A scores were positively skewed and some were also kurtotic in post hoc analyses.
“In addition, we discovered in post hoc analyses that BRIEF-A scores were positively skewed and some were also kurtotic.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationThe BRIEF-A is a questionnaire intended to measure executive functioning in daily life.
“The Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A) is a questionnaire measure designed to assess executive functioning in everyday life.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFor the eight BRIEF scales on parent and teacher forms, exploratory factor analysis produced two factors in both typically developing children and a mixed clinical group.
“Exploratory factor analysis of the eight scales of the parent and teacher forms of the BRIEF revealed a two-factor solution in both typically developing children and a mixed clinical sample (Gioia et al., 2000).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Gioia et al., 2000
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn that traumatic brain injury sample, the Inhibit scale had a stronger loading on Metacognition than on the expected Behavioral Regulation factor.
“In a sample of children with traumatic brain injury, a two-rather than one-factor structure involving the original eight scales was reported for the BRIEF parent form, as well as finding that the Inhibit scale loaded more strongly on the Metacognition factor than the expected Behavioral Regulation factor (Donders, DenBraber, & Vos, 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Donders, DenBraber, & Vos, 2010
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationGioia et al. (2002) found the Metacognition Index unchanged, but the Behavioral Regulation Index divided into Behavioral Regulation (Inhibit, Self-Monitor) and Emotional Regulation (Emotional Control, Shift) factors.
“Although the Metacognition Index remained unchanged, the Behavioral Regulation Index broke down into a Behavioral Regulation factor consisting of the Inhibit and Self-Monitor scales, and an Emotional Regulation factor composed of the Emotional Control and Shift scales.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Gioia et al., 2002 source
Not checked in the free run.
May combine two claims.
Interpretationown dataThese results suggest monitoring is not unitary; it changes with what is monitored and the context.
“These findings indicate that monitoring is not a unitary construct, but rather varies depending on the nature of the information being monitored and the context in which monitoring tasks place.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRecent CFAs in a mixed healthy and clinical sample supported a nine-scale, three-factor BRIEF model with separate Behavioral Regulation and Emotional Regulation factors for parent and teacher forms.
“Finally, the recent CFAs of the BRIEF parent and teacher forms in a mixed healthy and clinical sample supported a nine-scale, three-factor model of the BRIEF including separate Behavioral Regulation and Emotional Regulation factors (Egeland & Fallmyr, 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Egeland & Fallmyr, 2010
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationThat BRIEF-A two-factor structure held across genders and for both younger and older adults.
“This factor structure was invariant across genders and present irrespective of whether younger or older adults were considered.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThat epilepsy study found the Monitor scale had equal loadings on the Metacognition and Behavioral Regulation indices.
“The latter study did, however, find that the Monitor scale loaded equivalently on both the Metacognition Index and Behavioral Regulation Index, supporting the suggestion that this scale does not reflect a unitary construct (Gioia & Isquith, 2002).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Slick, Lautzenhiser, Sherman, & Eyrl, 2006
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn a mixed clinical sample, Gioia et al. (2002) reported that a three-factor model outperformed one-, two-, and four-factor models for the BRIEF parent report.
“A three-factor solution best fits the data, as opposed to one-, two-, or four-factor models.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Gioia et al., 2002 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFor children with traumatic brain injury, the original eight-scale BRIEF parent form was reported to have two factors rather than one.
“In a sample of children with traumatic brain injury, a two-rather than one-factor structure involving the original eight scales was reported for the BRIEF parent form, as well as finding that the Inhibit scale loaded more strongly on the Metacognition factor than the expected Behavioral Regulation factor (Donders, DenBraber, & Vos, 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Donders, DenBraber, & Vos, 2010
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationA recent study found adults with ADHD had worse scores than healthy comparison participants on both the Behavioral Regulation and Metacognition indices, with a larger gap on Metacognition.
“Finally, a recent study reported poorer functioning on both the Behavioral Regulation Index and Metacognition Index in adults with attention-deficit/hyperactivity disorder (ADHD) relative to a healthy comparison group, though the difference was larger for the latter index (Rotenberg-Shpigelman, Rapaport, Stern, & Hartmen-Maeir, 2008).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rotenberg-Shpigelman, Rapaport, Stern, & Hartmen-Maeir, 2008
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationStudies using factor analysis on performance-based tests usually find more than one component or factor, which supports fractionation.
“Factor analytic studies of performance-based tests have also supported a fractionation of executive functions, generally identifying more than one factor or component explaining variability (Busch, McBride, Curtiss, & Vanderploeg, 2005;Klenberg, Korkman, & Lahti-Nuuttila, 2001;Latzman & Markon, 2010).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Busch, McBride, Curtiss, & Vanderploeg, 2005
Not checked in the free run.
- cites Klenberg, Korkman, & Lahti-Nuuttila, 2001
Not checked in the free run.
- cites Latzman & Markon, 2010
Not checked in the free run.
May combine two claims.
InterpretationcitationPrior child BRIEF parent/teacher studies and a BRIEF-A exploratory factor analysis also found Task-Monitor and Self-Monitor loading differently.
“In this study, the BRIEF-A Task-Monitor and Self-Monitor scales loaded differentially on the Metacognition and Behavioral Regulation factors, a finding that was also obtained in prior studies using the BRIEF to examine parent and teacher reports of executive functioning in children (Egeland & Fallmyr, 2010;Gioia et al., 2000), as well as an exploratory factor analysis of the BRIEF-A (Roth et al.,”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Egeland & Fallmyr, 2010
Not checked in the free run.
- cites Gioia et al., 2000
Not checked in the free run.
- cites Roth et al., 2005
Not checked in the free run.
May combine two claims.
InterpretationcitationSplitting the Behavioral Regulation Index into Behavioral Regulation and Emotional Regulation factors, with the same scales, agrees with CFAs of the nine-scale child/adolescent BRIEF.
“This separation of the Behavioral Regulation Index into two factors, and the scale composition of those factors, is consistent with the results of CFAs of the nine-scale version of the original BRIEF that was designed for use with children and adolescents (Egeland & Fallmyr, 2010;Gioia & Isquith, 2002).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Egeland & Fallmyr, 2010
Not checked in the free run.
- cites Gioia & Isquith, 2002 source
Not checked in the free run.
May combine two claims.
InterpretationreasoningStatistically, the first-order and second-order models cannot be distinguished; they are alternative plausible representations of the same latent correlational structure.
“Note that the FOF and the SOF model are not differentiable statistically from one another, but are merely alternative plausible representations of the same latent correlational structure.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn children and adolescents with intractable epilepsy, the eight-scale BRIEF parent report was best described by two factors rather than one or three.
“A two-factor rather than one-or three-factor solution for the parent report form was found to be most appropriate in a sample of children and adolescents with intractable epilepsy (Slick, Lautzenhiser, Sherman, & Eyrl, 2006), although this study used the eight-rather than nine-scale model of the BRIEF (i.e., a single Monitor scale).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Slick, Lautzenhiser, Sherman, & Eyrl, 2006
Not checked in the free run.
May combine two claims.
Interpretationown dataThe study supports a multidimensional model of executive function, consistent with the design of the BRIEF-A and its forerunner the BRIEF.
“Overall, with these caveats in mind, this study supports a multidimensional model of executive function, consistent with the design of the BRIEF-A and its forerunner the BRIEF.”
Quote in the paperSubstantial claim- Rests on an assumption: The BRIEF-A validly measures the overall integrity of executive functions.
May combine two claims.
PremisecitationThe BRIEF-A has support for convergent and discriminant validity.
“There is support for the convergent and discriminant validity of the BRIEF-A (Roth et al., 2005) and its utility has been demonstrated in studies of clinical (Biederman et al., 2011;Chang, Davies, & Gavin, 2009;Garlinghouse, Roth, Isquith, Flashman, & Saykin, 2010;Kumbhani, Roth, Kuck, Flashman, & McAllister, 2010;Rabin et al., 2006) and non-clinical (Christ, Kanne, & Reiersen, 2010;Koven & Thomas”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationAsymptotic distribution-free estimators are available for non-normal data.
“Asymptotic distribution-free estimators are now available for non-normal data (Browne, 1984;Jo ¨reskog & So ¨rbom, 2004) but they require much larger sample sizes (in the 1,000 s; see Cortina, Chen & Dunlap, 2001;Hu, Bentler, & Kano, 1992) than was available here.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Browne, 1984
Not checked in the free run.
- cites Jo ¨reskog & So ¨rbom, 2004
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataBDI-II data existed for 12 patients and no matched controls.
“Beck Depression Inventory-II (BDI-II; Beck, Steer, & Brown, 1996) score was available for 12 of the patients (M ¼ 19.17, SD ¼ 9.42) but none of the matched controls.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationExploratory factor analysis of the BRIEF-A indicated that older and younger adults did not differ with respect to the two-factor structure.
“Although exploratory factor analysis of the BRIEF-A indicated that older and younger adults did not differ with respect to the two-factor structure reported (Roth et al., 2005), it is possible that age differences could be observed in the three-factor model.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
May combine two claims.
Study design and conductreasoningHealthy comparison participants were chosen pseudorandomly, matched on age and gender without knowing BRIEF-A scores, so their data were independent of the factor analysis.
“Patients were compared with a sample of healthy adults selected pseudorandomly (i.e., matched for age and gender by one of the authors, ASF, without reference to their BRIEF-A scores) from a research database at the Geisel School of Medicine at Dartmouth, ensuring that the data were independent from that used in the factor analysis.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationThe BRIEF-A shows excellent internal consistency (alpha .93-.96 for the three main indices) and one-month test-retest reliability (r=.93-.94 for those indices).
“The measure has excellent internal consistency (Cronbach a coefficients ranging from 0.93 to 0.96 for the three major indices) and 1-month test-retest reliabilities (ranging from r ¼ .93 to .94 for the three major indices; Roth et al., 2005).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationGender, race/ethnicity, and educational level have at most small effects on BRIEF-A scores (effect sizes generally 0.01 or less).
“Furthermore, while at most small effects on BRIEF-A scores have been reported in relation to gender, race/ ethnicity, and educational level (effect sizes being generally 0.01 or less; Roth et al., 2005), it remains an empirical question whether such variables impact the factor structure of the measure.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Roth et al., 2005
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductown dataThe present results are based on factor analysis of only the Self-Report form of the BRIEF-A.
“In addition, although exploratory factor analyses indicated consistent factor structures for the BRIEF-A Self-and Informant-Report forms, the present results are based on factor analysis of only the Self-Report form.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataNo participant scored high on the BRIEF-A validity scales Negativity, Infrequency, or Inconsistency.
“None of the participants had elevated scores on the three validity scales included in the BRIEF-A (Negativity, Infrequency, and Inconsistency).”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The factor structure estimated in the healthy young adult sample applies to the ADHD sample used for clinical comparisons.
“A sample of 19 adults meeting DSM-IV criteria for ADHD (American Psychiatric Association, 2000), referred to our clinics for neuropsychological assessment including the BRIEF-A, was examined to assess the clinical relevance of the factor structures.”
“Since the factor analysis indicated that the three-factor solution is preferable to the other alternate models tested here, we restricted group comparisons to scores for the two-and three-factor models.”
The paper relies on this without support.
The ADHD and matched healthy comparison groups are comparable on depression and other clinical variables that could affect BRIEF-A scores, despite BDI-II data being available only for patients.
“Beck Depression Inventory-II (BDI-II; Beck, Steer, & Brown, 1996) score was available for 12 of the patients (M ¼ 19.17, SD ¼ 9.42) but none of the matched controls.”
“Patients were compared with a sample of healthy adults selected pseudorandomly (i.e., matched for age and gender by one of the authors, ASF, without reference to their BRIEF-A scores) from a research database at the Geisel School of Medicine at Dartmouth, ensuring that the data were independent from that used in the factor analysis.”
The paper relies on this without support.
The BRIEF-A validly measures the overall integrity of executive functions.
“representing the overall integrity of executive functions as measured by the BRIEF-A”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent analyses support a factor structure of nine scales with three higher-order indices for the Behavior Rating Inventory of Executive Function.
“Recent analyses of the BRIEF in a mixed clinical sample (Gioia et al. 2002b) and with typically developing adults (Roth et al. 2013) support a factor structure of nine scales with three higher-order indices.”
From Characterizing the Factor Structure of Parent Reported Executive Function in Autism Spectrum Disorders: The Impact of Cognitive Inflexibility (2014) · cites this paper as Roth et al. 2013
The nine-factor model of the Behavior Rating Inventory of Executive Function was confirmed in the typically developing children group.
“We confirmed the nine-factor model of the BRIEF in our TDC group (i.e., Inhibition, Shift, Emotional Control, Initiate, Working Memory, Planning and Organization, Organization of Materials, Self-Monitor, and Task-Monitor) reported previously (e.g., Roth et al. 2013)”
From Characterizing the Factor Structure of Parent Reported Executive Function in Autism Spectrum Disorders: The Impact of Cognitive Inflexibility (2014) · cites this paper as Roth et al. 2013
The three-factor model alone was not confirmed among typically developing children in this study.
“However, the three-factor model alone (Gioia et al. 2002b; Roth et al. 2013) was not confirmed among TDC in this study.”
From Characterizing the Factor Structure of Parent Reported Executive Function in Autism Spectrum Disorders: The Impact of Cognitive Inflexibility (2014) · cites this paper as Roth et al. 2013
The BRIEF-A is a norm-referenced, self-report scale of EF with T-scores ≥65 indicating clinically significant impairment for indices and composite scores.
“The BRIEF-A is a norm-referenced, self-report scale of EF with T-scores ≥65 indicating clinically significant impairment for indices and composite scores (22, 23).”
From Characteristics of Sluggish Cognitive Tempo among adults with ADHD: objective neurocognitive measures align with self-report of executive function (2023) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
First model-comparison chi-square difference is miscalculated
MinorThe one-factor and two-factor chi-square values differ by 73.47, not the reported 71.47. The discrepancy does not change the stated direction of the comparison.
Reported 71.47 · recomputed 73.47
“| 1. One factor | 27 | 316.09* | 0.065 | 0.140 (0.13-0.16) | 0.92 | 0.94 | | Models 1 versus 2 | 1 | 71.47* | | | | | | 2. Two factor | 26 | 242.62* | 0.055 | 0.120 (0.10-0.13) | 0.93 | 0.95 |”
Eight-scale study is credited with distinguishing two Monitor scales
MinorThe discussion cites the 2000 BRIEF analysis as prior evidence that Task-Monitor and Self-Monitor load differently. Earlier, the paper says that analysis used eight scales; it says the separate Monitor scales were introduced in a subsequent nine-scale analysis.
“In this study, the BRIEF-A Task-Monitor and Self-Monitor scales loaded differentially on the Metacognition and Behavioral Regulation factors, a finding that was also obtained in prior studies using the BRIEF to examine parent and teacher reports of executive functioning in children (Egeland & Fallmyr, 2010;Gioia et al., 2000), as well as an exploratory factor analysis of the BRIEF-A (Roth et al., 2005).”
“Exploratory factor analysis of the eight scales of the parent and teacher forms of the BRIEF revealed a two-factor solution in both typically developing children and a mixed clinical sample (Gioia et al., 2000).”
Reported t-test degrees of freedom conflict with the group comparison
MinorThe paper reports independent-sample comparisons involving 19 ADHD patients and a matched healthy group, but labels the t tests with one degree of freedom. That degree of freedom is inconsistent with a conventional independent-sample test of these groups; the reported p values also do not correspond to t tests with one degree of freedom.
“In contrast, analysis of the three-factor model revealed poorer executive functioning in the ADHD group as reflect by the Behavioral Regulation factort(1) ¼ 2.18, p ¼ .04,d ¼ 0.71-but not the Emotional Regulation factor-t(1) ¼ 1.19, p ¼ .24,d ¼ 0.39.”
“A sample of 19 adults meeting DSM-IV criteria for ADHD (American Psychiatric Association, 2000), referred to our clinics for neuropsychological assessment including the BRIEF-A, was examined to assess the clinical relevance of the factor structures.”
Cites
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798 · see citing works
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · see citing works
Executive function in preschoolers: A review using an integrative framework.
Garon, N., Bryson, S. E., & Smith, I. M. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.1.31 · Cited by 2,695 · see citing works
Assessment and Development of Executive Function (EF) During Childhood
Anderson, P. (2002) · Child Neuropsychology · doi:10.1076/chin.8.2.71.8724 · Cited by 2,218 · see citing works
A normative‐developmental study of executive function: A window on prefrontal function in children
Welsh, M. C., Pennington, B. F., & Groisser, D. B. (1991) · Developmental Neuropsychology · doi:10.1080/87565649109540483 · Cited by 1,313 · see citing works
The anterior cingulate as a conflict monitor: fMRI and ERP studies
VANVEEN, V, & CARTER, C. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00930-7 · Cited by 1,258 · cited 1× · see citing works
“Accurate monitoring of performance on behavioral tasks, reflected in the BRIEF-A Task-Monitor scale, has been most consistently associated with the anterior cingulate gyrus (Swick & Turken, 2002; van Veen & Carter, 2002).”
MethodNeuropsychological studies of the frontal lobes.
Stuss, D. T., & Benson, D. F. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.3 · Cited by 1,073 · see citing works
Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior
Duncan, J., Emslie, H., Williams, P., Johnson, R., & Freer, C. (1996) · Cognitive Psychology · doi:10.1006/cogp.1996.0008 · Cited by 902 · see citing works
Testing Interaction Effects in LISREL: Examination and Illustration of Available Procedures
Cortina, J. M., Chen, G., & Dunlap, W. P. (2001) · Organizational Research Methods · doi:10.1177/109442810144002 · Cited by 512 · see citing works
Beer, J. S., John, O. P., Scabini, D., & Knight, R. T. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.6.871 · Cited by 455 · see citing works
Academic procrastination in college students: the role of self-reported executive function.
Rabin, L. A., Fogel, J., & Nutter-Upham, K. E. (2011) · Journal of clinical and experimental neuropsychology · doi:10.1080/13803395.2010.518597 · Cited by 381 · cited 1× · see citing works
“The average BRIEF-A scores were all relatively low (Table 2), consistent with those reported for other samples of healthy adults (Kumbhani et al., 2010; Rabin et al., 2010; Roth et al., 2005).”
ResultMohanty, A., Engels, A. S., Herrington, J. D., Heller, W., Ringo Ho, M., Banich, M. T., Webb, A. G., Warren, S. L., & Miller, G. A. (2007) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00515.x · Cited by 309 · see citing works
Control Functions of the Frontal Lobes. Modularity of the Central-Supervisory System?
Godefroy, O., Cabaret, M., Petit-Chenal, V., Pruvo, J.-P., & Rousseaux, M. (1999) · Cortex · doi:10.1016/s0010-9452(08)70782-2 · Cited by 141 · see citing works
Executive function in individuals with subthreshold autism traits
Christ, S. E., Kanne, S. M., & Reiersen, A. M. (2010) · Neuropsychology · doi:10.1037/a0019176 · Cited by 90 · see citing works
Flagged first, then by citations
Research works printed but not linked: 41
- 2010, SOCIAL NEUROSCIENCE, 5, 519, 10.1080/17470911003747386 · DOI
- Biederman, 2011, European neuropsychopharmacology : the journal of the European College of Neuropsychopharmacology, 21, 508, 10.1016/j.euroneuro.2010.11.005 · DOI · Paper page
- Brown, 2008, Neuropsychology, development, and cognition. Section C, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence, 14, 118, 10.1080/09297040601147605 · DOI · Paper page
- 1984, BRITISH JOURNAL OF MATHEMATICAL AND STATISTICAL PSYCHOLOGY, 37, 62, 10.1111/j.2044-8317.1984.tb00789.x · DOI
- Busch, 2005, Journal of clinical and experimental neuropsychology : official journal of the International Neuropsychological Society, 27, 1022, 10.1080/13803390490919263 · DOI
- 2009, JOURNAL OF PSYCHOPHYSIOLOGY, 23, 113, 10.1027/0269-8803.23.3.113 · DOI
- Chaytor, 2007, Brain injury : [BI], 21, 615, 10.1080/02699050701426949 · DOI
- 1991, BRITISH JOURNAL OF MATHEMATICAL AND STATISTICAL PSYCHOLOGY, 44, 347, 10.1111/j.2044-8317.1991.tb00966.x · DOI
- Dawson, 2012, Journal of clinical and experimental neuropsychology : official journal of the International Neuropsychological Society, 34, 297, 10.1080/13803395.2011.639297 · DOI
- 2010, JOURNAL OF NEUROPSYCHOLOGY, 4, 197, 10.1348/174866409X478970 · DOI
- 2010, Neuropsychology, development, and cognition. Section C, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence, 16, 326, 10.1080/09297041003601462 · DOI
- Garcia-Molina, 2012, Brain injury : [BI], 26, 864, 10.3109/02699052.2012.655362 · DOI
- Garlinghouse, 2010, Schizophrenia research, 120, 71, 10.1016/j.schres.2010.02.1067 · DOI
- 2012, PSYCHOLOLOGY OF ADDICTIVE BEHAVIORS, 26, 201, 10.1037/a0025207 · DOI
- 2002, Journal of the International Neuropsychological Society : JINS, 8, 229
- Gioia, 2002, Neuropsychology, development, and cognition. Section C, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence, 8, 249, 10.1076/chin.8.4.249.13513 · DOI · Paper page
- 1999, STRUCTURAL EQUATION MODELING, 6, 1, 10.1080/10705519909540118 · DOI · Paper page
- Hu, 1992, Psychological bulletin, 112, 351, 10.1037/0033-2909.112.2.351 · DOI
- Jurado, 2007, Neuropsychology review, 17, 213, 10.1007/s11065-007-9040-z · DOI · Paper page
- Klenberg, 2001, Developmental neuropsychology, 20, 407, 10.1207/S15326942DN2001_6 · DOI · Paper page
- Kompus, 2009, Neuroscience letters, 467, 76, 10.1016/j.neulet.2009.10.005 · DOI
- 2010, PERSONALITY AND INDIVIDUAL DIFFERENCES, 49, 24, 10.1016/j.paid.2010.02.034 · DOI
- Kumbhani, 2010, Journal of Neuropsychiatry and Clinical Neurosciences, 22, 304, 10.1176/appi.neuropsych.22.3.304 · DOI
- 2010, Assessment, 17, 172, 10.1177/1073191109356254 · DOI
- 2002, Archives of Clinical Neuropsychology, 17, 643, 10.1093/arclin/17.7.643 · DOI
- 1988, Psychological bulletin, 103, 391, 10.1037/0033-2909.103.3.391 · DOI
- 2007, Clinical Psychology: Science and Practice, 68, 1078
- Nigg, 2005, Journal of abnormal psychology, 114, 706, 10.1037/0021-843X.114.3.706 · DOI · Paper page
- 2010, Journal of clinical and experimental neuropsychology : official journal of the International Neuropsychological Society, 33, 344
- 2006, Archives of Clinical Neuropsychology, 21, 721, 10.1016/j.acn.2006.08.004 · DOI · Paper page
- Reid, 2010, The International journal of neuroscience, 120, 120, 10.3109/00207450903165577 · DOI
- 2008, ISRAELI JOURNAL OF OCCUPATIONAL THERAPY, 17, 77
- 2008, 57, 404, 10.1111/j.1741-3729.2008.00509.x · DOI
- Slick, 2006, Neuropsychology, development, and cognition. Section C, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence, 12, 181, 10.1080/09297040600611320 · DOI
- Stuss, 2000, Psychological research, 63, 289, 10.1007/s004269900007 · DOI · Paper page
- 2002, PNAS, 99, 16354, 10.1073/pnas.252521499 · DOI
- 1995, HANDBOOK OF NEUROPSYCHOLOGY, Vol 9, 125
- Turken, 2008, Neuroscience letters, 441, 7, 10.1016/j.neulet.2008.05.115 · DOI
- 2007, Annals of the New York Academy of Sciences, 1121, 528, 10.1196/annals.1401.025 · DOI
- Waber, 2006, Developmental neuropsychology, 29, 459, 10.1207/s15326942dn2903_5 · DOI
- 1991, Developmental neuropsychology, 7, 199
Cited by
Sorted by citations
Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014) · Handbook of Executive Functioning · doi:10.1007/978-1-4614-8106-5_18 · Cited by 188 · see citing works
Self-citationGranader, Y., Wallace, G. L., Hardy, K. K., Yerys, B. E., Lawson, R. A., Rosenthal, M., Wills, M. C., Dixon, E., Pandey, J., Penna, R., et al. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2169-8 · Cited by 106 · see citing works
Snyder, H. R., Friedman, N. P., & Hankin, B. L. (2021) · Assessment · doi:10.1177/1073191120965694 · Cited by 94 · see citing works
Hepark, S., Janssen, L., de Vries, A., Schoenberg, P. L. A., Donders, R., Kan, C. C., & Speckens, A. E. M. (2019) · Journal of Attention Disorders · doi:10.1177/1087054715613587 · Cited by 84 · see citing works
Krone, B., Adler, L. A., Anbarasan, D., Leon, T., Gallagher, R., Patel, P., Faraone, S. V., & Newcorn, J. H. (2023) · Frontiers in Child and Adolescent Psychiatry · doi:10.3389/frcha.2023.1188901 · Cited by 7 · see citing works
Golding, J., Rallison, A., Zhang, K., Awan, A., Romero, F., Lacbain, J., Lee, S., Momand, S., Azer, L., & Zhang, W. (2025) · Behavioral Sciences · doi:10.3390/bs15121748 · Cited by 7 · see citing works
“However, due to the high internal consistency of the full scale (Cronbach alpha = 0.96) and previously documented accuracy in capturing EF (Erkkilä et al., 2018; Xie et al., 2020; Azer et al., 2024), we feel comfortable addressing scores as EF (Roth et al., 2013).”
Influential
- Authors
- Roth, R. M., Lance, C. E., Isquith, P. K., Fischer, A. S., & Giancola, P. R.
- Affiliations
- Dartmouth–Hitchcock Medical Center (US)
- University of Georgia (US)
- University of Kentucky (US)
- Corresponding author
- Roth, R. M.
- Venue
- Archives of Clinical Neuropsychology
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-05-14
- Volume
- 28
- Issue
- 5
- Pages
- 425-434
- ISSN
- 0887-6177 (ISSN-L)
- 1873-5843
- PMC
- PMC3711374
- OpenAlex
- W2167020848
- Semantic Scholar
- 2dea20cbe38cb95031dacf7793c8fa61dfb2632f
- Cited by
- 197
- References
- 14
- Citations by year
- 2026: 19 · 2025: 17 · 2024: 17 · 2023: 25 · 2022: 21 · 2021: 19 · 2020: 18 · 2019: 9 · 2018: 11 · 2017: 9 · 2016: 13 · 2015: 10 · 2014: 7 · 2013: 1
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Archives of Clinical Neuropsychology (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Alcohol Abuse and Alcoholism (R01-AA-11691, R01AA011691)
- National Center for Research Resources
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Keywords
- executive function, factor structure, metacognition, behavioral regulation, emotion regulation, attention deficit hyperactivity disorder, self-report measures, young adults, inhibition, self-monitoring, emotional control, cognitive flexibility
- MeSH terms
- Adolescent, Adult, Attention Deficit Disorder with Hyperactivity, Factor Analysis, Statistical, Female, Humans, Male, Models, Psychological, Neuropsychological Tests, Case-Control Studies, Executive Function, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review