Psychometric properties and convergent and predictive validity of an executive function test battery for two-year-olds
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Executive function (EF) is an important predictor of numerous developmental outcomes, such as academic achievement and behavioral adjustment. Although a plethora of measurement instruments exists to assess executive function in children, only few of these are suitable for toddlers, and even fewer have undergone psychometric evaluation. The present study evaluates the psychometric properties and validity of an assessment battery for measuring EF in two-year-olds. A sample of 2437 children were administered the assessment battery at a mean age of 2;4 years (SD = 0;3 years) in a large-scale field study. Measures of both hot EF (snack and gift delay tasks) and cool EF (six boxes, memory for location, and visual search task) were included. Confirmatory Factor Analyses showed that a two-factor hot and cool EF model fitted the data better than a one-factor model. Measurement invariance was supported across groups differing in age, gender, socioeconomic status (SES), home language, and test setting. Criterion and convergent validity were evaluated by examining relationships between EF and age, gender, SES, home language, and parent and teacher reports of children's attention and inhibitory control. Predictive validity of the test battery was investigated by regressing children's pre-academic skills and behavioral problems at age three on the latent hot and cool EF factors at age 2 years. The test battery showed satisfactory psychometric quality and criterion, convergent, and predictive validity. Whereas cool EF predicted both pre-academic skills and behavior problems 1 year later, hot EF predicted behavior problems only. These results show that EF can be assessed with psychometrically sound instruments in children as young as 2 years, and that EF tasks can be reliably applied in large scale field research. The current instruments offer new opportunities for investigating EF in early childhood, and for evaluating interventions targeted at improving EF from a young age.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006) · The Journal of Educational Research · doi:10.3200/joer.99.6.323-338 · Cited by 6,937 · cited 2×
“The number of children completing each of the tasks is shown in Table 1 .”
InfluentialMiyake, A., & Friedman, N. P. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721411429458 · Cited by 3,944 · cited 1×
“In a recent revision of their theory, however, Miyake and Friedman (2012) showed that EF in adults is best represented by a common EF factor and separate updating-specific and shifting-specific factors.”
Skill formation and the economics of investing in disadvantaged children
Heckman, J. J. (2006) · Science · doi:10.1126/science.1128898 · Cited by 3,559
Blair, C., & Razza, R. P. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01019.x · Cited by 3,140 · cited 3×
“Specifically, studies have found that EF ability at preschool age predicts later academic achievement (Blair and Razza, 2007; Clark et al., 2010).”
BackgroundExecutive function in preschoolers: A review using an integrative framework.
Garon, N., Bryson, S. E., & Smith, I. M. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.1.31 · Cited by 2,695 · cited 2×
“Although many studies have investigated EF in preschoolers aged between 3 and 5 years in the past years (Wiebe et al., 2008, 2011; Willoughby et al., 2010) not much is known about EF development in toddlers (cf. Garon et al., 2008).”
Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.006 · Cited by 2,226
Preschool Program Improves Cognitive Control
Diamond, A., Barnett, W. S., Thomas, J., & Munro, S. (2007) · Science · doi:10.1126/science.1151148 · Cited by 2,025 · cited 1×
“To date, preschool and parenting programs have most often focused on promoting EF in preschoolers, i.e., three-to five-year-olds, from disadvantaged families (e.g., Diamond et al., 2007; Neville et al., 2013).”
Kochanska, G., Murray, K. T., & Harlan, E. T. (2000) · Developmental Psychology · doi:10.1037/0012-1649.36.2.220 · Cited by 1,993 · cited 7×
“Kochanska et al. (2000) snack delay task.”
InfluentialDevelopmentally Sensitive Measures of Executive Function in Preschool Children
Carlson, S. M. (2005) · Developmental Neuropsychology · doi:10.1207/s15326942dn2802_3 · Cited by 1,638
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Socioeconomic status and the brain: mechanistic insights from human and animal research
Hackman, D. A., Farah, M. J., & Meaney, M. J. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2897 · Cited by 1,409
Evans, G. W., & English, K. (2002) · Child Development · doi:10.1111/1467-8624.00469 · Cited by 1,232
Dimensions of executive functioning: evidence from children
Lehto, J. E., Juujärvi, P., Kooistra, L., & Pulkkinen, L. (2003) · British Journal of Developmental Psychology · doi:10.1348/026151003321164627 · Cited by 1,226 · cited 1×
“Although differentiation of EF into the three components of inhibition, shifting, and working memory in children has been confirmed by Lehto et al. (2003), a number of other studies support a two-factor over a three-factor model in childhood (Van der Ven et al., 2013; Usai et al., 2014).”
Blair, C., & Diamond, A. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000436 · Cited by 1,167 · cited 2×
“…a psychometric evaluation is crucial as “the results will only be as good as the test,” which entails that only valid and reliable assessment tools will contribute to our understanding of young children’s EF and thereby help to prevent academic failure from a young age (Blair and Diamond, 2008).”
Bilingual experience and executive functioning in young children
Carlson, S. M., & Meltzoff, A. N. (2008) · Developmental Science · doi:10.1111/j.1467-7687.2008.00675.x · Cited by 1,052
Neurocognitive correlates of socioeconomic status in kindergarten children
Noble, K. G., Norman, M. F., & Farah, M. J. (2005) · Developmental Science · doi:10.1111/j.1467-7687.2005.00394.x · Cited by 1,038
Ponitz, C. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J. (2009) · Developmental Psychology · doi:10.1037/a0015365 · Cited by 934 · cited 3×
“Finally, EF is important for more general learning-related skills, such as work attitude (Blair et al., 2005; Ponitz et al., 2009), and socioemotional skills (Denham et al., 2012).”
Wiebe, S. A., Espy, K. A., & Charak, D. (2008) · Developmental Psychology · doi:10.1037/0012-1649.44.2.575 · Cited by 829 · cited 5×
“Although many studies have investigated EF in preschoolers aged between 3 and 5 years in the past years (Wiebe et al., 2008, 2011; Willoughby et al., 2010) not much is known about EF development in toddlers (cf. Garon et al., 2008).”
InfluentialThe structure of executive function in 3-year-olds.
Wiebe, S. A., Sheffield, T., Nelson, J. M., Clark, C. A. C., Chevalier, N., & Espy, K. A. (2011) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2010.08.008 · Cited by 776
Raver, C. C., Jones, S. M., Li-Grining, C., Zhai, F., Bub, K., & Pressler, E. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01561.x · Cited by 754
Executive function and theory of mind: Stability and prediction from ages 2 to 3.
Carlson, S. M., Mandell, D. J., & Williams, L. (2004) · Developmental Psychology · doi:10.1037/0012-1649.40.6.1105 · Cited by 684 · cited 2×
“Executive function is an important predictor of academic achievement (Blair and Diamond, 2008), socio-emotional development (Carlson et al., 2004), and behavioral adjustment (Eisenberg et al., 2009; Espy et al., 2011) in the preschool period and beyond.”
Preschool executive functioning abilities predict early mathematics achievement
Clark, C. A. C., Pritchard, V. E., & Woodward, L. J. (2010) · Developmental Psychology · doi:10.1037/a0019672 · Cited by 671 · cited 1×
“Specifically, studies have found that EF ability at preschool age predicts later academic achievement (Blair and Razza, 2007; Clark et al., 2010).”
Executive function and theory of mind. Predictive relations from ages 2 to 4
Hughes, C., & Ensor, R. (2007) · Developmental Psychology · doi:10.1037/0012-1649.43.6.1447 · Cited by 453 · cited 3×
“With some exceptions (Hughes and Ensor, 2005, 2007; Fitzpatrick and Pagani, 2012), most studies have included relatively small samples of children that were tested in highly controlled laboratory settings.”
Blair, C., Granger, D., & Peters Razza, R. (2005) · Child Development · doi:10.1111/j.1467-8624.2005.00863.x · Cited by 367 · cited 1×
“Finally, EF is important for more general learning-related skills, such as work attitude (Blair et al., 2005; Ponitz et al., 2009), and socioemotional skills (Denham et al., 2012).”
The development of executive functions and early mathematics: A dynamic relationship
Van der Ven, S. H. G., Kroesbergen, E. H., Boom, J., & Leseman, P. P. M. (2012) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.2011.02035.x · Cited by 295 · cited 1×
“Moreover, development of EF over the preschool years, or growth in EF, is related to growth in academic skills such as math, vocabulary and emergent literacy (Mcclelland et al., 2007; Raver et al., 2011; Van der Ven et al., 2012).”
Self-citationWilloughby, M. T., The Family Life Project Investigators, Blair, C. B., Wirth, R. J., & Greenberg, M. (2010) · Psychological Assessment · doi:10.1037/a0018708 · Cited by 280 · cited 4×
“For example, Willoughby et al. (2010) have shown that the association between EF measures and parent, teacher, and research assistant ratings of hyperactivity in three-year olds were weak to moderate for separate test measures, but when EF was modeled as a latent factor, the association with…”
InfluentialA latent variable approach to determining the structure of executive function in preschool children.
Miller, M. R., Giesbrecht, G. F., Müller, U., McInerney, R. J., & Kerns, K. A. (2012) · Journal of Cognition and Development · doi:10.1080/15248372.2011.585478 · Cited by 272 · cited 3×
“Miller et al. (2012) concluded that measurement and response indicator selection is crucial and may explain different findings across studies, in line with the claims made by Van der Ven et al. (2013).”
Willoughby, M., Kupersmidt, J., Voegler-Lee, M., & Bryant, D. (2011) · Developmental Neuropsychology · doi:10.1080/87565641.2010.549980 · Cited by 267
Kim, S., Nordling, J. K., Yoon, J. E., Boldt, L. J., & Kochanska, G. (2013) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-012-9661-4 · Cited by 267
Executive Function in Preschool Children: Test–Retest Reliability
Beck, D. M., Schaefer, C., Pang, K., & Carlson, S. M. (2011) · Journal of Cognition and Development · doi:10.1080/15248372.2011.563485 · Cited by 262 · cited 1×
“…X is shown and withhold their response when stimulus Y is shown) and such rules are often too challenging for two-year-olds (Zelazo and Reznick, 1991), although shifting measures have been successfully administered to two-year-olds in some studies (e.g., Hughes and Ensor, 2007; Beck et al., 2011).”
Memory Maintenance and Inhibitory Control Differentiate from Early Childhood to Adolescence
Shing, Y. L., Lindenberger, U., Diamond, A., Li, S.-C., & Davidson, M. C. (2010) · Developmental Neuropsychology · doi:10.1080/87565641.2010.508546 · Cited by 239 · cited 1×
“Moreover, Shing et al. (2010) studied a battery of inhibitory control and working memory tasks in children aged 4–14.5 years old.”
InfluentialAllan, N. P., & Lonigan, C. J. (2011) · Developmental Psychology · doi:10.1037/a0023748 · Cited by 208 · cited 4×
“Children participating in this study were involved in the longitudinal national cohort study Pre-COOL on the effectiveness of preschool care and educational provisions in the Netherlands, commissioned by the Dutch Ministry of Education, Culture and Sciences (Veen et al., 2012).”
Influentialvan der Ven, S. H. G., Kroesbergen, E. H., Boom, J., & Leseman, P. P. M. (2013) · British Journal of Developmental Psychology · doi:10.1111/j.2044-835x.2012.02079.x · Cited by 149
Self-citation
Cited by
Executive function in the first three years of life: Precursors, predictors and patterns
Hendry, A., Jones, E. J. H., & Charman, T. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.005 · Cited by 297
Graham, A. M., Rasmussen, J. M., Rudolph, M. D., Heim, C. M., Gilmore, J. H., Styner, M., Potkin, S. G., Entringer, S., Wadhwa, P. D., Fair, D. A., et al. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.027 · Cited by 282
Neural substrates of early executive function development
Fiske, A., & Holmboe, K. (2019) · Developmental Review · doi:10.1016/j.dr.2019.100866 · Cited by 257
(2020) · Handbook of Clinical Neurology · doi:10.1016/b978-0-444-64150-2.00020-4 · Cited by 223
Veer, I. M., Luyten, H., Mulder, H., van Tuijl, C., & Sleegers, P. J. C. (2017) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2017.06.005 · Cited by 55
“In line with findings from other studies (Bialystok, 2001; Bialystok et al., 2009; Carlson, 2005; Carlson &Meltzoff, 2008; Diamond et al., 1997; Garon et al., 2008; Klenberg et al., 2001; Merrit et al., 2007; Mulder et al., 2014; Noble et al., 2007), gender, SES, home language, verbal ability, and age were significant…”
MethodResultSelf-citation
Metadata
- Authors
- Mulder, H., Hoofs, H., Verhagen, J., van der Veen, I., & Leseman, P. P. M.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2014-07-22
- Volume
- 5
- Pages
- 733-733
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2104282350
- Cited by
- 141
- References
- 37
- FWCI
- 15.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.