Factor Structure, Convergent Validity, and Discriminant Validity of the NIH Toolbox Cognitive Health Battery (NIHTB-CHB) in Adults
Open accessAbstract
The objective of this study is to evaluate the construct validity of the NIH Neurobehavioral Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. Confirmatory factor analysis was used to evaluate the dimensional structure underlying the NIHTB-CHB and Gold Standard tests chosen to serve as concurrent validity criteria for the NIHTB-CHB. These results were used to evaluate the convergent and discriminant validity of the NIHTB-CHB in adults ranging from 20 to 85 years of age. Five dimensions were found to explain the correlations among NIHTB-CHB and Gold Standard tests: Vocabulary, Reading, Episodic Memory, Working Memory and Executive Function/Processing Speed. NIHTB-CHB measures and their Gold Standard analogues defined factors in a pattern that broadly supported the convergent and discriminant validity of the NIHTB-CHB tests. This 5-factor structure was found to be invariant across 20–60 year old ( N =159) and 65–85 year old ( N =109) age groups that were included in the current validity study. Second order Crystallized Abilities (Vocabulary and Reading) and Fluid Abilities (Episodic Memory, Working Memory, Executive/Speed) factors parsimoniously explained correlations among the five first order factors. These results suggest that the NIHTB-CHB will provide both fine-grained and broad characterization of cognition across the adult age span. ( JINS , 2014, 20 , 1–9)
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Initial validation work supported a multidimensional structure of cognition with episodic memory, vocabulary, reading, working memory, and a processing speed/executive functioning abilities.
“The initial validation work also supported a multidimensional structure of cognition with episodic memory, vocabulary, reading, working memory, and a processing speed/executive functioning”
From Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury. (2017) · cites this paper as Mungas et al., 2014
Initial validation work provided initial evidence of convergent and discriminant validity among NIHTB-CB subtests.
“provided initial evidence of convergent and discriminant validity among NIHTB-CB subtests (Mungas et al., 2014; Mungas et al., 2013).”
From Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury. (2017) · cites this paper as Mungas et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798 · see citing works
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1× · see citing works
“Commonly used fit indices include the CFI, the Tucker-Lewis index (TLI; Tucker & Lewis, 1973), the root mean square error of approximation (RMSEA; Browne & Cudek, 1993), and the standardized root mean squared residual (SRMR; Bentler, 1995).”
MethodDelis-Kaplan Executive Function System
Delis, D. C., Kaplan, E., & Kramer, J. H. (2012) · PsycTESTS Dataset · doi:10.1037/t15082-000 · Cited by 2,683 · see citing works
Paced Auditory Serial-Addition Task: A Measure of Recovery from Concussion
Gronwall, D. M. A. (1977) · Perceptual and Motor Skills · doi:10.2466/pms.1977.44.2.367 · Cited by 2,395 · see citing works
Flagged first, then by citations
Research works printed but not linked: 11
- Albinet CT Boucard G Bouquet CA Audiffren M Processing speed and executive functions in cognitive aging: how to disentangle their mutual relationship? Brain and Cognition 2012 79 1 1 11 22387275
- Bentler PM Comparative fit indices in structural models. Psychological Bulletin 1990 107 238 246 2320703
- Bowden SC The role of factor analysis in construct validity: Is it a myth? Journal of the International Neuropsychological Society 2004 10 7 1018 1019 15803564
- Crane PK Narasimhalu K Gibbons LE Pedraza O Mehta KM Tang Y Mungas DM Composite scores for executive function items: demographic heterogeneity and relationships with quantitative magnetic resonance imaging. Journal of the International Neuropsychological Society 2008 14 5 746 759 18764970 PMC2683684
- Delis DC Jacobson M Bondi MW Hamilton JM Salmon DP The myth of testing construct validity using factor analysis or correlations with normal or mixed clinical populations: Lessons from memory assessment. Journal of the International Neuropsychological Society 2003 9 936 946 14632252
- Gershon RC Wagster MV Hendrie HC Fox NA Cook KF Nowinski CJ NIH toolbox for assessment of neurological and behavioral function. Neurology 2013 80 11 Suppl 3 S2 6 23479538 PMC3662335
- Mungas D Widaman K Zelazo PD Tulsky D Heaton RK Slotkin J Gershon RC NIH Toolbox Cognitive Health Battery (CB): Factor Structure For 3- To 15 Year Olds. Monographs Society for Research on Child Development 2013 78 4 103 118 Chapter VII PMC3950958 23952205
- Mungas D Widaman KF Reed BR Tomaszewski Farias S Measurement invariance of neuropsychological tests in diverse older persons. Neuropsychology 2011 25 2 260 269 21381830 PMC3058248
- Muthén LK Muthén BO Mplus User's Guide 1998-2012 Muthén & Muthén Los Angeles, CA Seventh Edition.
- Salthouse TA Relations between cognitive abilities and measures of executive functioning. Neuropsychology 2005 19 4 532 545 16060828
- Tuokko HA Chou PH Bowden SC Simard M Ska B Crossley M Partial measurement equivalence of French and English versions of the Canadian Study of Health and Aging neuropsychological battery. Journal of the International Neuropsychological Society 2009 15 3 416 425 19402928
Cited by
Sorted by citations
Thompson, W. K., Barch, D. M., Bjork, J. M., Gonzalez, R., Nagel, B. J., Nixon, S. J., & Luciana, M. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.12.004 · Cited by 227 · see citing works
Scott, E. P., Sorrell, A., & Benitez, A. (2019) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617719000614 · Cited by 69 · see citing works
Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury.
Tulsky, D. S., Carlozzi, N. E., Holdnack, J., Heaton, R. K., Wong, A., Goldsmith, A., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000174 · Cited by 67 · see citing works
Self-citation
- Authors
- Mungas, D., Heaton, R., Tulsky, D., Zelazo, P. D., Slotkin, J., Blitz, D., Lai, J.-S., & Gershon, R.
- Affiliations
- University of California, Davis (US)
- University of California San Diego (US)
- Rusk Rehabilitation (US)
- University of Minnesota (US)
- Northwestern University (US)
- Corresponding author
- Mungas, Dan
- ORCID
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014-06-24
- Volume
- 20
- Issue
- 6
- Pages
- 579-587
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- PMC
- PMC4103956
- OpenAlex
- W1981688932
- Cited by
- 95
- References
- 4
- Citations by year
- 2026: 7 · 2025: 11 · 2024: 9 · 2023: 12 · 2022: 13 · 2021: 13 · 2020: 8 · 2019: 6 · 2018: 6 · 2017: 5 · 2016: 1 · 2015: 1 · 2014: 3
- FWCI
- 5.10
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the International Neuropsychological Society (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- U.S. Public Health Service (HHS-N-260-2006-00007-C)
- National Institute on Aging (P30AG010129, R01AG010220)
- National Institute of Mental Health (P30MH062512)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- construct validity, factor structure, convergent validity, discriminant validity, cognitive assessment, adults, vocabulary, reading, episodic memory, working memory, executive function, processing speed, age differences, neurobehavioral assessment
- MeSH terms
- Adult, Age Factors, Aged, Aged, 80 and over, Cognition, Factor Analysis, Statistical, Female, Humans, Male, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, United States, Reproducibility of Results, Discriminant Analysis, Validation Studies as Topic, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review