Language Measures of the NIH Toolbox Cognition Battery
Open accessAbstract
Language facilitates communication and efficient encoding of thought and experience. Because of its essential role in early childhood development, in educational achievement and in subsequent life adaptation, language was included as one of the subdomains in the NIH Toolbox for the Assessment of Neurological and Behavioral Function Cognition Battery (NIHTB-CB). There are many different components of language functioning, including syntactic processing (i.e., morphology and grammar) and lexical semantics. For purposes of the NIHTB-CB, two tests of language—a picture vocabulary test and a reading recognition test—were selected by consensus based on literature reviews, iterative expert input, and a desire to assess in English and Spanish. NIHTB-CB’s picture vocabulary and reading recognition tests are administered using computer adaptive testing and scored using item response theory. Data are presented from the validation of the English versions in a sample of adults ages 20–85 years (Spanish results will be presented in a future publication). Both tests demonstrated high test–retest reliability and good construct validity compared to corresponding gold-standard measures. Scores on the NIH Toolbox measures were consistent with age-related expectations, namely, growth in language during early development, with relative stabilization into late adulthood. ( JINS , 2014, 20 , 1–10)
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Crystallized Cognition Composite Score correlates strongly with other known 'hold' tests.
“This composite correlates strongly with other known “hold” tests (Gershon et al., 2014)”
From NIH toolbox cognition tests following traumatic brain injury: Frequency of low scores. (2017) · cites this paper as Gershon et al., 2014
The Results (Validity Assessment; page unavailable) report strong correlations between two individual language tests and established vocabulary and reading measures: TPVT with PPVT-4 (0.80) and TORRT with WRAT-4 (0.86). The paper does not report a correlation for the Crystallized Cognition Composite Score itself, so the evidence supports the component tests rather than the stated composite. (LLM, conf=0.87)
Experimental — accuracy not yet measuredFor individuals with acquired brain injury, the Crystallized Cognition Composite Score can serve as an estimate of pre-injury general cognitive ability.
“For individuals with acquired brain injury, the Crystallized Cognition Composite Score can serve as an estimate of pre-injury general cognitive ability.”
From NIH toolbox cognition tests following traumatic brain injury: Frequency of low scores. (2017) · cites this paper as Gershon et al., 2014
The Introduction (Subdomain Definition; page unavailable) says reading and vocabulary tests can provide proxy estimates of overall intellectual ability in healthy individuals. It does not say that the Crystallized Cognition Composite Score estimates pre-injury ability in people with acquired brain injury; the same section notes that brain injuries can impair language performance. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Cognition assessment using the NIH Toolbox
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., Carlozzi, N. E., Slotkin, J., Blitz, D., Wallner-Allen, K., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872ded · Cited by 1,287 · cited 16× · see citing works
“The NIH Toolbox Picture Vocabulary Test and NIH Toolbox Oral Reading Recognition Test were released by the National Institutes of Health for royalty-free use by health and education researchers in late 2012 (see www.nihtoolbox. org for current information).”
BackgroundInfluentialSelf-citationAssessment of neurological and behavioural function: the NIH Toolbox
Gershon, R. C., Cella, D., Fox, N. A., Havlik, R. J., Hendrie, H. C., & Wagster, M. V. (2010) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70335-7 · Cited by 377 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 26
- Baumann JF Intensity in vocabulary instruction and effects on reading comprehension Topics in Language Disorders 2009 29 4 312 328 310.1097/TLD.1090b1013e3181c1029e1022. · DOI
- Boone KB Lu P Wen J Comparison of various RAVLT scores in the detection of noncredible memory performance Archives of Clinical Neuropsychology 2005 20 3 301 319 15797167
- Burton CL Strauss E Hultsch DF Hunter MA Cognitive functioning and everyday problem solving in older adults Clinical Neuropsychologist 2006 20 3 432 452 16895857
- Cattell RB Intelligence: Its structure, growth and action 1987 Amsterdam Elsevier
- Catts HW Fey ME Tomblin JB Zhang X A longitudinal investigation of reading outcomes in children with language impairments Journal of Speech, Language, and Hearing Research 2002 45 6 1142 1157 12546484
- Deyo RA Diehl AK Hazuda H Stern MP A simple language-based acculturation scale for Mexican Americans: Validation and application to health care research American Journal of Public Health 1985 75 1 51 55 3966599 PMC1646155
- Dunn DM Dunn LM PPVT-4: Peabody picture vocabulary test 2007 4th ed. Minneapolis Pearson
- Fenson L Dale PS Reznick JS Bates E Thal DJ Pethick SJ Variability in early communicative development Monographs of the Society for Research in Child Development 1994 59 5 1 173 7845413
- Gershon RC Slotkin J Manly JJ Blitz DL Beaumont JL Schnipke D Weintraub S NIH Toolbox Cognition Battery (CB): Measuring language (vocabulary comprehension and reading decoding). Chapter IV Monographs of the Society for Research in Child Development 2013 78 4 49 69 23952202 PMC7659464
- Gleason JB Ratner NB The development of language 2009 7th ed Boston Pearson/Allyn and Bacon
- Grober E Sliwinski M Development and validation of a model for estimating premorbid verbal intelligence in the elderly Journal of Clinical and Experimental Neuropsychology 1991 13 6 933 949 1779032
- Hirsh-Pasek K Golinkoff RM The origins of grammar: Evidence from early language comprehension 1996 Cambridge MIT Press
- Jefferson AL Gibbons LE Rentz DM Carvalho JO Manly J Bennett DA Jones RN A life course model of cognitive activities, socioeconomic status, education, reading ability, and cognition Journal of the American Geriatrics Society 2011 59 8 1403 1411 21797830 PMC3222272
- Kastner JW May W Hildman L Relationship between language skills and academic achievement in first grade Perceptual and Motor Skills 2001 92 2 381 390 11361297
- Nowinski CJ Victorson D Debb SM Gershon R Input on NIH Toolbox criteria: Surveying the end user research community Neurology 2013 80 11 Suppl. 3 S7 S12 23479548 PMC3662340
- Rasch G Probabilistic models for some intelligence and attainment tests 1980 Chicago University of Chicago Press
- Revicki DA Cella DF Health status assessment for the twenty-first century: Item response theory, item banking and computer adaptive testing Quality of Life Research 1997 6 6 595 600 9330558
- Rey A L'Examen Clinique en Psychologie 1958 Paris Press Universitaire de France
- Ritchie SJ Bates TC Enduring links from childhood mathematics and reading achievement to adult socioeconomic status Psychological Science 2013 24 7 1301 1308 23640065
- Salthouse TA Light LL Burke DM Effects of aging on verbal abilities: Examination of the psychometric literature Language, memory, and aging 1988 New York Cambridge University Press 17 35
- Scarborough HS Neuman SB Dickinson DK Connecting early language and literacy to later reading (dis)abilities: Evidence, theory, and practice Handbook of early literacy research 2001 New York Guilford Press 97 110
- Schmidt FL Hunter J General mental ability in the world of work: Occupational attainment and job performance Journal of Personality and Social Psychology 2004 86 1 162 173 14717634
- Smith BI Smith TD Taylor L Hobby M Relationship between intelligence and vocabulary Perceptual and Motor Skills 2005 100 1 101 108 15773700
- Victorson D Manly J Wallner-Allen K Fox N Purnell C Hendrie HC Gershon RC Using the NIH Toolbox in special populations: Considerations for the assessment of pediatric, geriatric, culturally diverse, non-English speaking and disabled individuals Neurology 2013 80 11 Suppl. 3 S13 S19 23479537 PMC3662333
- Weintraub S Dikmen SS Heaton RK Tulsky DS Zelazo PD Slotkin J Gershon R The cognition battery of the NIH Toolbox for assessment of neurological and behavioral function: Validation in an adult sample Journal of the International Neuropsychological Society 2014 PMC4103959 24959840
- Wolf MS Curtis LM Wilson EA Revelle W Waite KR Smith SG Baker DW Literacy, cognitive function, and health: Results of the LitCog study Journal of General Internal Medicine 2012 27 10 1300 1307 22566171 PMC3445686
Cited by
Sorted by citations
Thompson, W. K., Barch, D. M., Bjork, J. M., Gonzalez, R., Nagel, B. J., Nixon, S. J., & Luciana, M. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.12.004 · Cited by 227 · see citing works
Scott, E. P., Sorrell, A., & Benitez, A. (2019) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617719000614 · Cited by 69 · see citing works
Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury.
Tulsky, D. S., Carlozzi, N. E., Holdnack, J., Heaton, R. K., Wong, A., Goldsmith, A., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000174 · Cited by 67 · see citing works
Chadwick, L., Roth, E., Minich, N. M., Taylor, H. G., Bigler, E. D., Cohen, D. M., Bacevice, A., Mihalov, L. K., Bangert, B. A., Zumberge, N. A., et al. (2021) · Journal of Neurotrauma · doi:10.1089/neu.2020.7513 · Cited by 50 · see citing works
NIH toolbox cognition tests following traumatic brain injury: Frequency of low scores.
Holdnack, J. A., Iverson, G. L., Silverberg, N. D., Tulsky, D. S., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000145 · Cited by 23 · see citing works
Can mild traumatic brain injury alter cognition chronically? A LIMBIC-CENC multicenter study.
Walker, W. C., O'Neil, M. E., Ou, Z., Pogoda, T. K., Belanger, H. G., Scheibel, R. S., Presson, A. P., Miles, S. R., Wilde, E. A., Tate, D. F., et al. (2023) · Neuropsychology · doi:10.1037/neu0000855 · Cited by 22 · see citing works
Iverson, G. L., & Karr, J. E. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.724888 · Cited by 13 · see citing works
NIH Toolbox Cognition Battery Feasibility in Individuals With Williams Syndrome
Condy, E. E., Becker, L., Farmer, C., Kaat, A. J., Chlebowski, C., Kozel, B. A., & Thurm, A. (2022) · American Journal on Intellectual and Developmental Disabilities · doi:10.1352/1944-7558-127.6.473 · Cited by 6 · see citing works
- Authors
- Gershon, R. C., Cook, K. F., Mungas, D., Manly, J. J., Slotkin, J., Beaumont, J. L., & Weintraub, S.
- Affiliations
- Northwestern University (US)
- University of California, Davis (US)
- Columbia University (US)
- Corresponding author
- Gershon, Richard C.
- ORCID
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014-06-24
- Volume
- 20
- Issue
- 6
- Pages
- 642-651
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- PMC
- PMC4558909
- OpenAlex
- W2125514133
- Cited by
- 189
- References
- 2
- Citations by year
- 2026: 26 · 2025: 33 · 2024: 23 · 2023: 17 · 2022: 26 · 2021: 17 · 2020: 14 · 2019: 8 · 2018: 11 · 2017: 13 · 2015: 1
- FWCI
- 5.08
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the International Neuropsychological Society (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- Alzheimer's Association
- California Department of Public Health
- Brown University
- Northwestern University
- Temple University
- Davee Foundation
- NorthShore University HealthSystem
- Multiple Sclerosis Society
- National Institutes of Health (HHS-N-260–2006-00007-C, HHSN275201200007I)
- U.S. Public Health Service (HHS-N-260-2006-00007-C)
- National Institute on Disability and Rehabilitation Research (H133B090024)
- National Institute on Aging (P30AG010129, R01AG028786, R01AG037212, R01AG016206, R01AG010220, RC2AG036498, P30AG013854)
- National Institute on Deafness and Other Communication Disorders (R01DC008552)
- National Institute of Diabetes and Digestive and Kidney Diseases (U01DK082342)
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (U54AR057943, U01AR052177, U54AR057951)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (HHSN275201200007C)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Keywords
- NIH Toolbox Cognition Battery, language assessment, picture vocabulary test, syntactic processing, word meaning, computerized adaptive testing, item response theory, test-retest reliability, construct validity, age-related language change, cognitive aging
- MeSH terms
- Adult, Age Factors, Aged, Aged, 80 and over, Cognition, Diagnosis, Computer-Assisted, Female, Humans, Language, Language Tests, Male, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, Photic Stimulation, Reading, United States, Reproducibility of Results, Recognition, Psychology, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
