IV. NIH toolbox cognition battery (CB): measuring language (vocabulary comprehension and reading decoding)
Open accessAbstract
Mastery of language skills is an important predictor of daily functioning and health. Vocabulary comprehension and reading decoding are relatively quick and easy to measure and correlate highly with overall cognitive functioning, as well as with success in school and work. New measures of vocabulary comprehension and reading decoding (in both English and Spanish) were developed for the NIH Toolbox Cognition Battery (CB). In the Toolbox Picture Vocabulary Test (TPVT), participants hear a spoken word while viewing four pictures, and then must choose the picture that best represents the word. This approach tests receptive vocabulary knowledge without the need to read or write, removing the literacy load for children who are developing literacy and for adults who struggle with reading and writing. In the Toolbox Oral Reading Recognition Test (TORRT), participants see a letter or word onscreen and must pronounce or identify it. The examiner determines whether it was pronounced correctly by comparing the response to the pronunciation guide on a separate computer screen. In this chapter, we discuss the importance of language during childhood and the relation of language and brain function. We also review the development of the TPVT and TORRT, including information about the item calibration process and results from a validation study. Finally, the strengths and weaknesses of the measures are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The NIHTB-CB has demonstrated test-retest reliability (ICC 0.76 to 0.97) and convergent and discriminant validity.
“The developers evaluated and described the psychometric soundness of each test, including test–retest reliability (intra-class correlation coefficients ranging from 0.76 to 0.97) as well as convergent and discriminant validity (Bauer et al., 2013; Carlozzi et al., 2013; Gershon et al., 2013; Tulsky et al., 2013; Zelazo et al., 2013).”
From Cognitive weaknesses or impairments on the NIH toolbox cognition battery in children and adolescents: base rates in a normative sample and proposed methods for classification (2025) · cites this paper as Gershon et al., 2013
The Results (TPVT and TORRT, Test–Retest Reliability; page unavailable) report ICCs of 0.81 and 0.97 for the two NIH Toolbox language tests. The Criterion Validity results report evidence of convergent and discriminant validity for both. This paper does not establish the cited range’s lower bound of 0.76 or evaluate every test in the battery. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Assessment of neurological and behavioural function: the NIH Toolbox
Gershon, R. C., Cella, D., Fox, N. A., Havlik, R. J., Hendrie, H. C., & Wagster, M. V. (2010) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70335-7 · Cited by 377 · see citing works
Self-citationSpeaking Out for Language: Why Language Is Central to Reading Development
Dickinson, D. K., Golinkoff, R. M., & Hirsh-Pasek, K. (2010) · Educational Researcher · doi:10.3102/0013189x10370204 · Cited by 377 · see citing works
Self-citationEffect of literacy on neuropsychological test performance in nondemented, education-matched elders
MANLY, J. J., JACOBS, D. M., SANO, M., BELL, K., MERCHANT, C. A., SMALL, S. A., & STERN, Y. (1999) · Journal of the International Neuropsychological Society · doi:10.1017/s135561779953302x · Cited by 250 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 33
- Burton CL, Strauss E, Hultsch DF, & Hunter MA (2006). Cognitive functioning and everyday problem solving in older adults. Clinical Neuropsychologist, 20(3), 432– 452. 16895857
- Caplan D, & Hildebrandt N (1988). Disorders of syntactic comprehension. Cambridge, MA: MIT Press.
- Cattell RB (1987). Intelligence: Its structure, growth and action. Amsterdam: Elsevier.
- Dunn LM, & Dunn DM (2007). Peabody picture vocabulary test (4th ed.). San Antonio, TX: Pearson.
- Fenson L, Dale PS, Reznick JS, Bates E, Thal DJ, & Pethick SJ (1994). Variability in early communicative development. Monographs of the Society for Research in Child Development, 59(5), 1– 173. 7845413
- Fisher C (1996). Structural limits on verb mapping: The role of analogy in children's interpretations of sentences. Cognitive Psychology, 31(1), 41– 81. 8812021
- Friederici AD, Rüschemeyer SA, Hahne A, & Fiebach CJ (2003). The role of left inferior frontal and superior temporal cortex in sentence comprehension: Localizing syntactic and semantic processes. Cerebral Cortex, 13(2), 170– 177. 12507948
- Gleason JB, & Ratner NB (2009). The development of language (7th ed.). Boston: Pearson/Allyn and Bacon.
- Grober E, & Sliwinski M (1991). Development and validation of a model for estimating premorbid verbal intelligence in the elderly. Journal of Clinical and Experimental Neuropsychology, 13(6), 933– 949. 1779032
- Hirsch C, & Wexler K (2007). The late acquisition of raising: What children seem to think about seem In Davies WD & Dubinsky S (Eds.), New horizons in the analysis of control and raising (pp. 35– 70). New York: Springer.
- Hirsh-Pasek K, & Golinkoff RM (1996). The origins of grammar: Evidence from early language comprehension. Cambridge, MA: MIT Press.
- Hirsh-Pasek K, Kochanoff AT, Newcombe N, & De Villiers J (2005). Using scientific knowledge to inform preschool assessment: Making the case for empirical validity. Society for Research in Child Development Social Policy Report, 19(1), 3– 19.
- Hurtado N, Marchman VA, & Fernald A (2008). Does input influence uptake? Links between maternal talk, processing speed and vocabulary size in spanish-learning children. Developmental Science, 11(6), 31. PMC2898277 19046145
- Kastner JW, May W, & Hildman L (2001). Relationship between language skills and academic achievement in first grade. Perceptual and Motor Skills, 92(2), 381– 390. 11361297
- Kucera H, & Francis WN (1967). Computational analysis of present-day American English. Providence: Brown University Press.
- Kuhl P, & Rivera-Gaxiola M (2008). Neural substrates of language acquisition Annual Review of Neuroscience, 31, 511– 534. 18558865
- Kuhl PK (2004). Early language acquisition: Cracking the speech code. Nature Reviews Neuroscience, 5(11), 831– 843. 15496861
- Manly JJ, Byrd DA, Touradji P, & Stern Y (2004). Acculturation, reading level, and neuropsychological test performance among african american elders. Applied Neuropsychology, 11(1), 37– 46. 15471745
- Marcus GF, Vijayan S, Bandi Rao S, & Vishton PM (1999). Rule learning by seven-month-old infants. Science, 283(5398), 77– 80. 9872745
- Meisinger EB, Bloom JS, & Hynd GW (2010). Reading fluency: Implications for the assessment of children with reading disabilities. Annals of Dyslexia, 60(1), 1– 17. 20033795
- National Research Council Committee on the Prevention of Reading Difficulties in Young Children, Snow CE, Burns MS, Griffin P, & National Research Council Commission on Behavioral Social Sciences Education (2002). Preventing reading difficulties in young children: Intellectual property in the information age (8th ed.). Washington, DC: National Academies Press.
- NICHD Early Child Care Research Network. (2005). Pathways to reading: The role of oral language in the transition to reading. Developmental Psychology, 41(2), 428– 442. 15769197
- Price CJ (1998). The functional anatomy of word comprehension and production. Trends in Cognitive Sciences, 2(8), 281– 287. 21227210
- Price CJ (2000). The anatomy of language: Contributions from functional neuroimaging. Journal of Anatomy, 197(3), 335– 359. 11117622 PMC1468137
- Rapcsak SZ, Henry ML, Teague SL, Carnahan SD, & Beeson PM (2007). Do dual-route models accurately predict reading and spelling performance in individuals with acquired alexia and agraphia? Neuropsychologia, 45(11), 2519– 2524. 17482218 PMC1988783
- Rey A (1958). L'Examen clinique en psychologie. Paris: Press Universitaire de France.
- Saffran JR, Aslin RN, & Newport EL (1996). Statistical learning by 8-month-old infants. Science, 274(5294), 1926– 1928. 8943209
- Schmidt FL, & Hunter J (2004). General mental ability in the world of work: Occupational attainment and job performance. Journal of Personality and Social Psychology, 86(1), 162– 173. doi: 10.1037/0022-3514.86.1.162 14717634 · DOI · Paper page
- Seymour HN, Roeper T, & de Villiers JG (2004). Conclusions, future directions, and implications for remediation. Seminars in Speech and Language, 25(1), 113– 115. 15088237
- Sternberg RJ (2004). Intelligence in humans In Charles S (Ed.), Encyclopedia of Applied Psychology (pp. 321– 328). New York: Elsevier.
- Tsao F-M, Liu H-M, & Kuhl PK (2004). Speech perception in infancy predicts language development in the second year of life: A longitudinal study. Child Development, 75(4), 1067– 1084. 15260865
- Wolf MS, Gazmararian JA, & Baker DW (2005). Health literacy and functional health status among older adults. Archives of Internal Medicine, 165(17), 1946– 1952. 16186463
- Ziegler JC, Castel C, Pech-Georgel C, George F, Alario FX, & Perry C (2008). Developmental dyslexia and the dual route model of reading: Simulating individual differences and subtypes. Cognition, 107(1), 151– 178. 17959161
Cited by
Sorted by citations
Thompson, W. K., Barch, D. M., Bjork, J. M., Gonzalez, R., Nagel, B. J., Nixon, S. J., & Luciana, M. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.12.004 · Cited by 227 · see citing works
Hessl, D., Sansone, S. M., Berry-Kravis, E., Riley, K., Widaman, K. F., Abbeduto, L., Schneider, A., Coleman, J., Oaklander, D., Rhodes, K. C., et al. (2016) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-016-9167-4 · Cited by 126 · see citing works
Self-citationHackman, D. A., Cserbik, D., Chen, J.-C., Berhane, K., Minaravesh, B., McConnell, R., & Herting, M. M. (2021) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2021.0426 · Cited by 111 · see citing works
Shared Predisposition in the Association Between Cannabis Use and Subcortical Brain Structure
Pagliaccio, D., Barch, D. M., Bogdan, R., Wood, P. K., Lynskey, M. T., Heath, A. C., & Agrawal, A. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.1054 · Cited by 77 · see citing works
Moore, T. M., Kaczkurkin, A. N., Durham, E. L., Jeong, H. J., McDowell, M. G., Dupont, R. M., Applegate, B., Tackett, J. L., Cardenas-Iniguez, C., Kardan, O., et al. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000601 · Cited by 72 · see citing works
Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury.
Tulsky, D. S., Carlozzi, N. E., Holdnack, J., Heaton, R. K., Wong, A., Goldsmith, A., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000174 · Cited by 67 · see citing works
Kahathuduwa, C. N., Wakefield, S., West, B. D., Blume, J., Dassanayake, T. L., Weerasinghe, V. S., & Mastergeorge, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-70037-7 · Cited by 43 · see citing works
Wang, H., Rolls, E. T., Du, X., Du, J., Yang, D., Li, J., Li, F., Cheng, W., & Feng, J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01701-y · Cited by 42 · see citing works
Cook, N. E., Iverson, G. L., & Karr, J. E. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1473095
- Authors
- Gershon, R. C., Slotkin, J., Manly, J. J., Blitz, D. L., Beaumont, J. L., Schnipke, D., Wallner-Allen, K., Golinkoff, R. M., Gleason, J. B., Hirsh-Pasek, K., Adams, M. J., & Weintraub, S.
- Affiliations
- Northwestern University (US)
- Columbia University (US)
- University of Delaware (US)
- Boston University (US)
- Brown University (US)
- ORCID
- Venue
- Monographs of the Society for Research in Child Development
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-08
- Volume
- 78
- Issue
- 4
- Pages
- 49-69
- ISSN
- 0037-976X (ISSN-L)
- 1540-5834
- PMC
- PMC7659464
- OpenAlex
- W1893187780
- Cited by
- 157
- References
- 3
- Citations by year
- 2026: 16 · 2025: 21 · 2024: 21 · 2023: 13 · 2022: 20 · 2021: 19 · 2020: 11 · 2019: 9 · 2018: 6 · 2017: 12 · 2016: 2 · 2015: 2 · 2014: 3 · 2013: 1 · 2012: 1
- FWCI
- 5.51
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Monographs of the Society for Research in Child Development (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (n01ag60007-17-0-2)
- National Institute on Aging (N01 AG060007)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- NIH Toolbox Cognition Battery, vocabulary comprehension, reading decoding, receptive vocabulary, language development, item calibration, test validation, cognitive assessment
- MeSH terms
- Adolescent, Adult, Aged, Child, Child, Preschool, Female, Humans, Language, Male, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, Reading, United States, Reproducibility of Results, Comprehension, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review