I. NIH TOOLBOX COGNITION BATTERY (CB): INTRODUCTION AND PEDIATRIC DATA
Open accessAbstract
This monograph presents the pediatric portion of the National Institutes of Health (NIH) Toolbox Cognition Battery (CB) of the NIH Toolbox for the Assessment of Neurological and Behavioral Function. The NIH Toolbox is an initiative of the Neuroscience Blueprint, a collaborative framework through which 16 NIH Institutes, Centers, and Offices jointly support neuroscience-related research, to accelerate discoveries and reduce the burden of nervous system disorders. The CB is one of four modules that measure cognitive, emotional, sensory, and motor health across the lifespan. The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies. This chapter describes the evolution of the CB; methods for selecting cognitive subdomains and instruments; the rationale for test design; and a validation study in children and adolescents, ages 3–15 years. Subsequent chapters feature detailed discussions of each test measure and its psychometric properties (Chapters 2–6), the factor structure of the test battery (Chapter 7), the effects of age and education on composite test scores (Chapter 8), and a final summary and discussion (Chapter 9). As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.
AI snapshot
Written from the paper’s full text.
TL;DR
This introductory chapter describes the development of the pediatric portion of the NIH Toolbox Cognition Battery (CB), a brief, freely available battery designed to measure cognition continuously from ages 3 to 85. It reports the subdomain selection process and a validation study in children and adolescents ages 3–15, concluding the CB has excellent psychometric properties and shows increasing differentiation of cognitive abilities with age.
Key findings
- Expert input (two online Requests for Information sent to 293 experts, followed by telephone interviews with a subset of 44) ranked subdomains as: executive function, episodic memory, language, processing speed, and attention; 57% of respondents also wanted a "general" or "global" cognitive score, met via composite scores (Chapter 8).
- Visuospatial functions were excluded because only 43% of respondents ranked them among their top four subdomains.
- The validation study enrolled 476 participants total (ages 3–85); the pediatric sample featured here comprises 208 children ages 3–15 (120 ages 3–6 and 88 ages 8–15), with a subset of 66 children (~32%) retested 7–21 days later.
- As the chapters in the monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for increasing differentiation of cognitive abilities with age.
Methods
- Instrument development: multidisciplinary expert surveys and interviews, a test instrument library review, twice-yearly Steering Committee consensus meetings plus monthly calls, a July 2007 day-long meeting to select instruments for validation, a 2008 public conference, and 2010 conference calls with 16 expert consultants; four special working groups (Cultural, Geriatric, Accessibility, Pediatric) reviewed instruments for diverse populations.
- Validation study: 476 participants recruited from four sites (NorthShore University HealthSystems in Chicago, Emory University in Atlanta, Kessler Institute for Rehabilitation in New Jersey, and the University of Minnesota), ages 3–85, recruited across age, gender, race, and education strata; validation measures were published neuropsychological tests matched to each CB construct.
- Analysis: Pearson correlations between age and test performance (calculated separately for children and adults), intraclass correlation coefficients (ICC) for test–retest reliability (ICC < .4 poor, .4–.74 adequate, ≥ .75 excellent), and correlations with established same-construct measures for convergent validity (r < .3 poor, .3–.59 adequate, ≥ .6 excellent), with lower correlations to different-construct measures as evidence of discriminant validity.
Limitations
- The paper states that limitations of the battery are discussed in the final chapter (Chapter 9); this introductory chapter does not itself enumerate them.
- Evident from the text: not all ages were sampled in the validation study, and education levels in the pediatric table are defined as highest parental education.
- Evident from the text: this monograph reports only the pediatric (ages 3–15) validation results; adult validation data are to be published separately, so conclusions here do not cover the full 3–85 range.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
1 of 21 cited sources checked · 1 supported · 0 flagged
- Findingnone given
The validation study provided evidence for the increasing differentiation of cognitive abilities with age.
“As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.”
Quote in the paperSubstantial claim - Findingown data
Fifty-seven percent of respondents listed a "general" or "global" cognitive score as desirable.
“Fifty-seven percent of respondents also listed a “general” or “global” cognitive score as desirable.”
Quote in the paperSubstantial claim - Findingown data
Only 43% of respondents ranked visuospatial functions among their top four subdomains.
“Only 43% of respondents ranked visuospatial functions among their top four subdomains, so this subdomain was not included in the final list.”
Quote in the paperSubstantial claim - Findingreasoning
The need for a global cognitive score was met through development of cognition composite scores.
“The need for a global cognitive score was met through development of cognition composite scores, described in Chapter 8.”
Quote in the paperSubstantial claim - Findingreasoning
Two aspects of language were selected for the CB: auditory single word comprehension and single word reading aloud.
“Two aspects of language were selected for the CB, due in part to the ease with which they can be measured across the lifespan: auditory single word comprehension (i.e., receptive vocabulary) and single word reading aloud (oral reading recognition; see Gershon et al., Chapter 4, this volume).”
Quote in the paperSubstantial claim
- Findingreasoning
The CB contains measures of all three components of EF.
“Because of the importance of EF, the CB contains measures of all three components, although the measure of working memory is considered separately, below.”
Quote in the paperSubstantial claim - Findingown data
The subdomains were ranked as follows: Executive function, episodic memory, language, processing speed, and attention.
“The subdomains were ranked as follows: Executive function, episodic memory, language, processing speed, and attention.”
Quote in the paperSubstantial claim - Study design and conductnone given
The selection of subdomains was based on importance to development and aging, significance for health and success in education and work, validation with respect to brain mechanisms, and ease of measurement.
“The selection of subdomains was based on: (1) their importance to the course of development and aging; (2) their significance for health and success in education and, in adults, for work; (3) their validation with respect to known underlying brain mechanisms; and (4) their ease of measurement and translation into brief test instruments.”
Quote in the paperSubstantial claim - Premisecitation
By the second year of life, infants remember temporally ordered sequences of items.
“By the second year of life, infants remember temporally ordered sequences of items as well (e.g., Bauer, Wenner, Dropik, & Wewerka, 2000).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bauer, Wenner, Dropik, & Wewerka, 2000
- Study design and conductown data
The validation study included the full age range of the NIH Toolbox, ages 3-85 years.
“The validation study included the full age range of the NIH Toolbox, ages 3–85 years, although this monograph focuses on the results of this study for children and young adolescents ages 3–15 years.”
Quote in the paperSubstantial claim - Interpretationreasoning
The CB has excellent psychometric properties.
“As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.”
Quote in the paperSubstantial claim - Premisecitation
Episodic memory shows dramatic changes over the first two decades of life.
“This subdomain shows dramatic changes over the first two decades of life (see Bauer, Larkina, & Deocampo, 2011, for a review) and is also susceptible to a variety of diseases, including encephalitis and temporolimbic epilepsy, and, in adulthood, Alzheimer’s disease (e.g., see Weintraub, Wicklund, & Salmon, 2012).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bauer, Larkina, & Deocampo, 2011
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Vocabulary has been widely accepted as a surrogate measure for overall crystallized intelligence.
“Vocabulary has been widely accepted as a surrogate measure for overall crystallized intelligence (Schmidt & Hunter, 2004).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Schmidt & Hunter, 2004 source
- Study design and conductown data
The pediatric validation sample included 208 three- to fifteen year olds.
“Table 2 illustrates the pediatric validation sample, including the 208 three- to fifteen year olds whose data are featured in this monograph.”
Quote in the paperNot a substantial claim - Premisecitation
Processing speed is very sensitive to any form of cerebral insult.
“Processing speed (PS), which refers to the speed with which simple cognitive operations can be performed, was included in the CB because it is very sensitive to any form of cerebral insult (see DeLuca & Kalmar, 2007; Weiler, Forbes, Kirkwood, & Waber, 2003) and to changes in development (e.g., Kail, 1991).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites DeLuca & Kalmar, 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Weiler, Forbes, Kirkwood, & Waber, 2003 source
- Study design and conductown data
The validation study involved a total of 476 participants recruited from multiple sites.
“To determine the reliability and validity of the instruments as measures of the target subdomains, the Cognition team conducted a validation study involving a total of 476 participants recruited from multiple sites (Chicago’s NorthShore University HealthSystems, Emory University in Atlanta, New Jersey’s Kessler Institute for Rehabilitation, and the University of Minnesota).”
Quote in the paperNot a substantial claim - Study design and conductown data
A subset of 66 child participants (approximately 32%) completed a retest 7-21 days later.
“A subset of 66 child participants (approximately 32%) completed a retest 7–21 days later to assess test–retest reliability and practice effects.”
Quote in the paperSubstantial claim - Premisecitation
Processing speed is sensitive to changes in development.
“Processing speed (PS), which refers to the speed with which simple cognitive operations can be performed, was included in the CB because it is very sensitive to any form of cerebral insult (see DeLuca & Kalmar, 2007; Weiler, Forbes, Kirkwood, & Waber, 2003) and to changes in development (e.g., Kail, 1991).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kail, 1991 source
- Classified as probably not a substantial claim. 22
- May combine two claims. 8
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationOral reading proficiency is a marker of educational opportunity in minority populations and can be used to adjust for group differences when comparing individuals of different ethnic and racial backgrounds.
“Oral reading proficiency also is a marker of educational opportunity in minority populations and can be used to adjust for group differences when comparing individuals of different ethnic and racial backgrounds (Manly, Byrd, Touradji, & Stern, 2004; Manly et al., 1999).”
Quote in the paperNot a substantial claim1 of 2 sources checkedClassified as probably not a substantial claim.
FindingreasoningThe process resulted in a focus on executive function and attention, episodic memory, language, working memory, and processing speed.
“The process resulted in a focus on (1) executive function and attention, (2) episodic memory, (3) language, (4) working memory, and (5) processing speed.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe information gathered from experts allowed identification of cognitive domains ranked in order of their importance as judged by experts, and determination of desirable characteristics for the final instruments.
“The information gathered from experts allowed us to identify cognitive domains ranked in order of their importance as judged by experts, and to determine the characteristics that would be desirable for the final instruments.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationThe construct represented in the CB is the simple reaction time required to make a same-different comparison between two visually presented stimuli.
“The construct represented in the CB is the simple reaction time required to make a same-different comparison between two visually presented stimuli (see Carlozzi, Tulsky, Kail, & Beaumont, Chapter 6, this volume).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWhen language development is delayed, the impact on further skill acquisition and academic progress can be profound.
“Indeed, when language development is delayed, the impact on further skill acquisition and academic progress can be profound (e.g., Dickinson, Golinkoff, & Hirsh-Pasek, 2010; Gleason & Ratner, 2009).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Dickinson, Golinkoff, & Hirsh-Pasek, 2010 source
- cites Gleason & Ratner, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEF deficits are seen in patients with acquired focal damage to prefrontal cortex who experience profound impairment in behavioral regulation despite the preservation of many basic intellectual functions.
“EF deficits are seen in patients with acquired focal damage to prefrontal cortex who experience profound impairment in behavioral regulation despite the preservation of many basic intellectual functions (see Stuss & Knight, 2002).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Stuss & Knight, 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAuditory single word comprehension develops prior to overt speech usage in hearing individuals.
“Auditory single word comprehension develops prior to overt speech usage in hearing individuals (Fenson et al., 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Fenson et al., 1994 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationEpisodic memory is susceptible to a variety of diseases, including encephalitis and temporolimbic epilepsy, and, in adulthood, Alzheimer's disease.
“This subdomain shows dramatic changes over the first two decades of life (see Bauer, Larkina, & Deocampo, 2011, for a review) and is also susceptible to a variety of diseases, including encephalitis and temporolimbic epilepsy, and, in adulthood, Alzheimer’s disease (e.g., see Weintraub, Wicklund, & Salmon, 2012).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Weintraub, Wicklund, & Salmon, 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEpisodic memory for single object-specific actions is apparent in infants in the first year of life.
“Episodic memory for single object-specific actions is apparent in infants in the first year of life (e.g., Carver & Bauer, 1999).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Carver & Bauer, 1999
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe CB is available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies.
“The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe CB is unique in its continuity across childhood, adolescence, early adulthood, and old age.
“The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEF can be divided into three partially independent components: cognitive flexibility, inhibitory control, and working memory.
“Recent factor-analytic work with adults suggests that EF can be divided into three partially independent components: cognitive flexibility, inhibitory control, and working memory (Miyake et al., 2000).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Miyake et al., 2000 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn children, impairments in EF or delays in its development have been linked to ADHD, autism spectrum disorders, Conduct Disorder, and other psychiatric conditions and symptoms.
“In children, impairments in EF or delays in its development have been linked to attention deficit hyperactivity disorder (ADHD) (Doyle, 2006), autism spectrum disorders, Conduct Disorder, and other psychiatric conditions and symptoms.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Doyle, 2006
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWorking memory is a component of executive function.
“Although working memory is a component of executive function (e.g., Miyake et al., 2000), it is often studied on its own, or as a type of memory.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Miyake et al., 2000 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe subdomains of executive function and attention are described together because one of the EF measures is also a measure of selective attention.
“The subdomains of executive function (EF) and attention are described together because one of the EF measures is also a measure of selective attention.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDisorders such as dyslexia hinder otherwise talented individuals from achieving educational and career goals.
“Disorders such as dyslexia hinder otherwise talented individuals from achieving educational and career goals (e.g., Meisinger, Bloom, & Hynd, 2010; Ziegler et al., 2008).”
Quote in the paperNot a substantial claim0 of 2 sources checkedClassified as probably not a substantial claim.
Study design and conductnone givenA systematic, research-based process was followed to select the subdomains for assessment.
“A systematic, research-based process was followed to select the subdomains for assessment.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenThe NIH Toolbox was conceived as an instrument for the systematic collection of data on cognitive, emotional, sensory, and motor health across disparate studies.
“The NIH Toolbox was conceived as an instrument for the systematic collection of data on cognitive, emotional, sensory, and motor health across disparate studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe CB team derived criteria for validation studies, including acceptable levels of test-retest reliability and convergent and discriminant validity.
“During that meeting, the CB team derived criteria for validation studies, including acceptable levels of test–retest reliability and convergent and discriminant validity.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationMental processing time can be separated from motor response time, and it varies with the number of mental operations required by a given task.
“Although PS paradigms often are based on motor reaction time, Sternberg’s (1966) elegant paradigm demonstrated that mental processing time can be separated from motor response time, and that it varies with the number of mental operations required by a given task.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sternberg, 1966 source
May combine two claims.
Study design and conductnone givenEligible participants were 3-85 years of age and sample recruitment was distributed across age, gender, race, and education strata.
“Eligible participants were 3–85 years of age and sample recruitment was distributed across age, gender, race, and education strata.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningDeveloping instruments for use across the broad age range of 3-85 years presented significant challenges.
“Developing instruments for use across the broad age range of 3–85 years presented significant challenges.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataNot all ages were sampled in this study.
“As Table 3 indicates, not all ages were sampled in this study; also, education levels indicated in the table are defined as highest parental education.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationWorking memory depends on prefrontal cortex, and is vulnerable to disruption from a wide range of cerebral insults.
“Like executive function more broadly, working memory depends on prefrontal cortex, and is vulnerable to disruption from a wide range of cerebral insults (see Tulsky et al., Chapter 5, this volume).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tulsky et al., Chapter 5
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataThere were 120 three- to six year olds and 88 eight- to fifteen year olds in the pediatric validation sample.
“There were a total of one hundred twenty 120 three- to six year olds and 88 eight- to fifteen year olds.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenThe guidance provided by the Pediatric Working Group and other working groups significantly improved the NIH Toolbox overall and strengthened its ability to obtain valid assessments from diverse populations.
“The guidance provided by the Pediatric Working Group, as well as the other working groups, significantly improved the NIH Toolbox overall and strengthened its ability to obtain valid assessments from diverse populations—not just from children.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
There is a lack of measures that are valid and appropriate across the entire 3- to 85-year age range in most areas of cognition.
“The difficulty of achieving this goal was obvious at the outset from the lack of such measures in most areas of cognition (despite the need for such measures).”
The paper relies on this without support.
Constructs are typically measured with very different tasks at different ages.
“More typically, constructs are measured with very different tasks at different ages.”
The paper relies on this without support.
Episodic memory is critical for the acquisition of knowledge and for building adaptive skills.
“Episodic memory, the capacity for storing and retrieving information, is critical for the acquisition of knowledge and for building adaptive skills.”
The paper relies on this without support.
Language develops rapidly over the first 3 years of life, although further changes occur throughout childhood.
“Language develops rapidly over the first 3 years of life, although further changes occur throughout childhood, and language proficiency is a fundamental skill that supports many other aspects of cognitive, social, and behavioral function.”
The paper relies on this without support.
Language proficiency is a fundamental skill that supports many other aspects of cognitive, social, and behavioral function.
“Language develops rapidly over the first 3 years of life, although further changes occur throughout childhood, and language proficiency is a fundamental skill that supports many other aspects of cognitive, social, and behavioral function.”
The paper relies on this without support.
Working memory is often studied on its own, or as a type of memory.
“Although working memory is a component of executive function (e.g., Miyake et al., 2000), it is often studied on its own, or as a type of memory.”
The paper relies on this without support.
From preschool age on, most working memory tasks either require retaining and reorganizing items before recalling them, or completing some processing activity in between presentations of the to-be-recalled items.
“From preschool age on, most working memory tasks either require retaining and reorganizing items before recalling them (e.g., backward digit span task), or completing some processing activity in between presentations of the to-be-recalled items (e.g., listening span task).”
The paper relies on this without support.
Such tasks tap into both information processing and storage, and yield a measure of working memory span that corresponds to the maximal amount of accurately recalled information.
“Such tasks tap into both information processing and storage, and yield a measure of working memory span that corresponds to the maximal amount of accurately recalled information.”
The paper relies on this without support.
Working memory shows age-related improvements across childhood and age-related declines during senescence.
“Working memory shows age-related improvements across childhood (as well as age-related declines during senescence).”
The paper relies on this without support.
Children differ from adults in many ways, including social, emotional, and selfregulatory ways that may affect performance on tasks designed to measure cognition.
“Children differ from adults in many ways, including social, emotional, and selfregulatory ways that may affect performance on tasks designed to measure cognition.”
The paper relies on this without support.
Children are able to demonstrate competence for constructs at younger ages when simple, easy-to-follow instructions are used and when task materials are engaging, concrete, and familiar.
“For example, children are able to demonstrate competence for constructs at younger ages when simple, easy-to-follow instructions are used and when task materials are engaging, concrete, and familiar.”
The paper relies on this without support.
Compared to healthy young adults, most children and even adolescents have shorter attention spans, are more easily distracted by external stimuli, and are less proficient at regulating their attention, behavior, and level of motivation to the task at hand.
“In addition, compared to healthy young adults, most children and even adolescents have shorter attention spans, are more easily distracted by external stimuli, and are less proficient at regulating their attention, behavior, and level of motivation to the task at hand.”
The paper relies on this without support.
Cognition includes many essential subdomains, some of which require lengthy and complex methods of assessment.
“Cognition includes many essential subdomains, some of which require lengthy and complex methods of assessment, so difficult decisions needed to be made regarding which to include at the cost of others.”
Cites
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798 · see citing works
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230 · see citing works
High-speed scanning in human memory
Sternberg, S. (1966) · Science · doi:10.1126/science.153.3736.652 · Cited by 3,576 · see citing works
Variability in Early Communicative Development
Fenson, L., Dale, P. S., Reznick, J. S., Bates, E., Thal, D. J., Pethick, S. J., Tomasello, M., Mervis, C. B., & Stiles, J. (1994) · Monographs of the Society for Research in Child Development · doi:10.2307/1166093 · Cited by 2,790 · see citing works
The Dimensional Change Card Sort (DCCS): A method of assessing executive function in children
Zelazo, P. D. (2006) · Nature Protocols · doi:10.1038/nprot.2006.46 · Cited by 1,579 · see citing works
Self-citationDevelopment of attentional networks in childhood
Rueda, M. R., Fan, J., McCandliss, B. D., Halparin, J. D., Gruber, D. B., Lercari, L. P., & Posner, M. I. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2003.12.012 · Cited by 1,339 · see citing works
General Mental Ability in the World of Work: Occupational Attainment and Job Performance.
Schmidt, F. L., & Hunter, J. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.86.1.162 · Cited by 1,238 · see citing works
Variability in early communicative development.
Fenson, L., Dale, P. S., Reznick, J. S., Bates, E. A., Thal, D. J., & Pethick, S. (1994) · PubMed · Cited by 1,006 · see citing works
The Wiley‐Blackwell Handbook of Childhood Cognitive Development
(2010) · Wiley eBooks · doi:10.1002/9781444325485 · Cited by 656 · see citing works
The Neuropsychological Profile of Alzheimer DiseasePreprint
Weıntraub, S., Wicklund, A. H., & Salmon, D. P. (2012) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a006171 · Cited by 569 · see citing works
Neural systems for compensation and persistence: young adult outcome of childhood reading disability
Shaywitz, S. E., Shaywitz, B. A., Fulbright, R. K., Skudlarski, P., Mencl, W. E., Constable, R. T., Pugh, K. R., Holahan, J. M., Marchione, K. E., Fletcher, J. M., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01836-x · Cited by 495 · see citing works
(2005) · Choice Reviews Online · doi:10.5860/choice.43-2279 · Cited by 441 · see citing works
NICHD Early Child Care Research Network (1997) · Child Development · doi:10.1111/j.1467-8624.1997.tb01967.x · Cited by 396 · see citing works
Speaking Out for Language: Why Language Is Central to Reading Development
Dickinson, D. K., Golinkoff, R. M., & Hirsh-Pasek, K. (2010) · Educational Researcher · doi:10.3102/0013189x10370204 · Cited by 377 · see citing works
Assessment of neurological and behavioural function: the NIH Toolbox
Gershon, R. C., Cella, D., Fox, N. A., Havlik, R. J., Hendrie, H. C., & Wagster, M. V. (2010) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70335-7 · Cited by 377 · see citing works
Self-citationChild-care effect sizes for the NICHD Study of Early Child Care and Youth Development.
(2006) · American Psychologist · doi:10.1037/0003-066x.61.2.99 · Cited by 376 · see citing works
Remembering the Times of Our Lives: Memory in Infancy and Beyond
Bauer, P. J. (2006) · Cited by 347 · see citing works
Self-citationAcculturation, reading level, and neuropsychological test performance among African American elders
Manly, J. J., Byrd, D. A., Touradji, P., & Stern, Y. (2004) · Applied Neuropsychology · doi:10.1207/s15324826an1101_5 · Cited by 254 · see citing works
Self-citationEffect of literacy on neuropsychological test performance in nondemented, education-matched elders
MANLY, J. J., JACOBS, D. M., SANO, M., BELL, K., MERCHANT, C. A., SMALL, S. A., & STERN, Y. (1999) · Journal of the International Neuropsychological Society · doi:10.1017/s135561779953302x · Cited by 250 · see citing works
Self-citationZiegler, J. C., Castel, C., Pech-Georgel, C., George, F., Alario, F.-X., & Perry, C. (2008) · Cognition · doi:10.1016/j.cognition.2007.09.004 · Cited by 249 · see citing works
(2000) · PubMed · Cited by 240 · see citing works
Processing time declines exponentially during childhood and adolescence
Kail, R. (1991) · Developmental Psychology · doi:10.1037/0012-1649.27.2.259 · Cited by 168 · cited 1× · see citing works
“…speed (PS), which refers to the speed with which simple cognitive operations can be performed, was included in the CB because it is very sensitive to any form of cerebral insult (see DeLuca & Kalmar, 2007; Weiler, Forbes, Kirkwood, & Waber, 2003) and to changes in development (e.g., Kail, 1991).”
Processing time declines exponentially during childhood and adolescence.
Kail, R. V. (1991) · Developmental Psychology · doi:10.1037//0012-1649.27.2.259 · Cited by 155 · see citing works
Information Processing Speed in Clinical Populations
DeLuca, J., & Kalmar, J. H. (2013) · Psychology Press eBooks · doi:10.4324/9780203783054 · Cited by 131 · see citing works
When the Event is More Than the Sum of its Parts: 9-month-olds' Long-term Ordered Recall
Carver, L. J. (1999) · Memory · doi:10.1080/741944070 · Cited by 131 · see citing works
(2006) · PubMed · Cited by 106 · see citing works
Reading fluency: Implications for the assessment of children with reading disabilities
Meisinger, E. B., Bloom, J. S., & Hynd, G. W. (2010) · Annals of Dyslexia · doi:10.1007/s11881-009-0031-z · Cited by 82 · see citing works
Bauer, P. J., Larkina, M., & Deocampo, J. A. (2010) · doi:10.1002/9781444325485.ch6 · Cited by 66 · see citing works
Self-citationPlacing Neuroanatomical Models of Executive Function in a Developmental Context
Brocki, K. C., Fan, J., & Fossella, J. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1417.025 · Cited by 24 · see citing works
The developmental course of processing speed in children with and without learning disabilities
Weiler, M. D., Forbes, P., Kirkwood, M., & Waber, D. (2003) · Journal of Experimental Child Psychology · doi:10.1016/s0022-0965(03)00034-1 · Cited by 21 · see citing works
Biology of Alzheimer's disease
Haass, C. (1999) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s004060050097 · Cited by 7 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Gleason, 2009, The development of language
Cited by
Sorted by citations
Distinct Global Brain Dynamics and Spatiotemporal Organization of the Salience Network
Chen, T., Cai, W., Ryali, S., Supekar, K., & Menon, V. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002469 · Cited by 480 · see citing works
Ahmed, S. F., Tang, S., Waters, N. E., & Davis-Kean, P. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000296 · Cited by 293 · see citing works
Socioeconomic status, white matter, and executive function in children
Ursache, A., Noble, K. G., & the Pediatric Imaging, N. A. G. S. (2016) · Brain and Behavior · doi:10.1002/brb3.531 · Cited by 256 · see citing works
Thompson, W. K., Barch, D. M., Bjork, J. M., Gonzalez, R., Nagel, B. J., Nixon, S. J., & Luciana, M. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.12.004 · Cited by 227 · see citing works
Outcome Measures for Clinical Trials in Down Syndrome
Esbensen, A. J., Hooper, S. R., Fidler, D., Hartley, S. L., Edgin, J., d'Ardhuy, X. L., Capone, G., Conners, F. A., Mervis, C. B., Abbeduto, L., et al. (2017) · American Journal on Intellectual and Developmental Disabilities · doi:10.1352/1944-7558-122.3.247 · Cited by 153 · see citing works
Hessl, D., Sansone, S. M., Berry-Kravis, E., Riley, K., Widaman, K. F., Abbeduto, L., Schneider, A., Coleman, J., Oaklander, D., Rhodes, K. C., et al. (2016) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-016-9167-4 · Cited by 126 · see citing works
Self-citationLipsey, M. W., Nesbitt, K. T., Farran, D. C., Dong, N., Fuhs, M. W., & Wilson, S. J. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000203 · Cited by 87 · see citing works
Schreiber, J. E., Possin, K. L., Girard, J. M., & Rey-Casserly, C. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617713001100 · Cited by 68 · see citing works
“The cognitive control measures overlap with measures in the NIH Toolbox Cognition Battery, which includes similar set-shifting and inhibition measures (Weintraub et al., 2013).”
MethodBecker, S. P., Dvorsky, M. R., Tamm, L., & Willoughby, M. T. (2021) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-020-00728-2 · Cited by 13 · see citing works
Luciana, M., Barch, D., & Herting, M. M. (2023) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2023.101311 · Cited by 7 · see citing works
Petersen, B., Vo, N.-T. N., Anton, N., Yeates, K. O., & Treble-Barna, A. (2025) · Journal of the International Neuropsychological Society · doi:10.1017/s135561772510146x · Cited by 1 · see citing works
- Authors
- Weintraub, S., Bauer, P. J., Zelazo, P. D., Wallner-Allen, K., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Slotkin, J., Blitz, D. L., Carlozzi, N. E., Havlik, R. J., Beaumont, J. L., Mungas, D., Manly, J. J., Borosh, B. G., Nowinski, C. J., & Gershon, R. C.
- Affiliations
- Northwestern University (US)
- ORCID
- Venue
- Monographs of the Society for Research in Child Development
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-08
- Volume
- 78
- Issue
- 4
- Pages
- 1-15
- ISSN
- 0037-976X (ISSN-L)
- 1540-5834
- PMC
- PMC3954750
- OpenAlex
- W2124548479
- Semantic Scholar
- d1eca722e2511fc70b9c76dcc25e95a32dc19a9e
- Cited by
- 248
- References
- 31
- Citations by year
- 2026: 22 · 2025: 31 · 2024: 22 · 2023: 22 · 2022: 35 · 2021: 26 · 2020: 22 · 2019: 15 · 2018: 19 · 2017: 11 · 2016: 15 · 2015: 3 · 2014: 3 · 2013: 2
- FWCI
- 10.36
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Monographs of the Society for Research in Child Development (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Institute on Aging (P30AG010129, R01AG010220)
- National Institute of Mental Health (P30MH062512)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Keywords
- NIH Toolbox Cognition Battery, cognitive development, test battery validation, test design, psychometric properties, factor structure, longitudinal cognitive assessment, children and adolescents
- MeSH terms
- Adolescent, Child, Child, Preschool, Cognition, Emotions, Female, Humans, Language, Male, Memory, Short-Term, National Institutes of Health (U.S.), Neuropsychological Tests, United States, Executive Function, Memory, Episodic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-28.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review