CoChat
Sign Up
Cited by 342Cognitive Abilities and TestingHistorical and Modern Theater StudiesPsychological Testing and Assessment

The cognition battery of the NIH toolbox for assessment of neurological and behavioral function: validation in an adult sample

Open access
Weintraub, Sandra, Dikmen, Sureyya S., Heaton, Robert K., Tulsky, David S., Zelazo, Philip David, Slotkin, Jerry, Carlozzi, Noelle E., Bauer, Patricia J. +11 more·2014·Journal of the International Neuropsychological Society
DOI 10.1017/s1355617714000320PMC PMC4103959
Open this paper in CoChat — free account

Abstract

This study introduces a special series on validity studies of the Cognition Battery (CB) from the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) (Gershon, Wagster et al., 2013) in an adult sample. This first study in the series describes the sample, each of the seven instruments in the NIHTB-CB briefly, and the general approach to data analysis. Data are provided on test–retest reliability and practice effects, and raw scores (mean, standard deviation, range) are presented for each instrument and the gold standard instruments used to measure construct validity. Accompanying papers provide details on each instrument, including information about instrument development, psychometric properties, age and education effects on performance, and convergent and discriminant construct validity. One study in the series is devoted to a factor analysis of the NIHTB-CB in adults and another describes the psychometric properties of three composite scores derived from the individual measures representing fluid and crystallized abilities and their combination. The NIHTB-CB is designed to provide a brief, comprehensive, common set of measures to allow comparisons among disparate studies and to improve scientific communication. (JINS, 2014, 20, 1–12)

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1017/s1355617714000320

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These improvements suggest prominent learning effects as demonstrated with repeated administrations of cognitive tasks over short time periods.

    “suggesting prominent learning effects as demonstrated with repeated administrations of cognitive tasks over short time periods (Weintraub et al., 2014; Zelazo et al., 2014)”

    From A double-blind, randomized, sham-controlled clinical trial of cerebellar intermittent theta burst stimulation for bipolar disorder: Safety, tolerability, mood and cognitive effects (2025) · cites this paper as Weintraub et al., 2014

    The Validation Study section reports retesting 89 participants after 7–21 days, and the Results report practice effects on repeated cognitive tests. But their effect sizes ranged from 0.08 to 0.42, so the paper does not establish that the effects were consistently prominent. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • The NIH Toolbox Cognition Battery was developed using advanced psychometrics to attenuate floor or ceiling effects, making it ideal for assessing change.

    “which was developed using advanced psychometrics to attenuate floor or ceiling effects [43], thereby making it ideal for assessing change.”

    From A phase I trial of accelerated intermittent theta burst rTMS for amnestic MCI (2024) · cites this paper as [43]

    The Development of the Cognition Battery section describes computer-adaptive testing and item response theory for the language tests, but not for the entire battery. The Results summary reports minimal floor and ceiling effects in adults aged 20–65 and calls the findings encouraging for repeated and longitudinal measurement. It does not establish that advanced psychometrics attenuated those effects or that the battery is ideal for assessing change. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • The picture sequence memory test was not administered to mitigate participant burden and to minimize practice effects.

    “The picture sequence memory test was not administered to mitigate participant burden and to minimize practice effects given that it has been reported to have the largest effect size change over a comparable retest interval [43].”

    From A phase I trial of accelerated intermittent theta burst rTMS for amnestic MCI (2024) · cites this paper as [43]

  • The NIHTB-CB consists of seven tasks measuring different domains of cognitive function, including executive functioning, memory, processing speed, and language.

    “The NIH Toolbox Cognition Battery (NIHTB-CB) consists of seven tasks measuring different domains of cognitive function, including EF, memory, processing speed, and language (Weintraub et al., 2014; Zelazo et al., 2013).”

    From NIH Toolbox Cognition Battery Feasibility in Individuals With Williams Syndrome (2022) · cites this paper as Weintraub et al., 2014

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 43

  1. Akshoomoff N Newman E Thompson WK McCabe C Bloss CS Chang L Jernigan TL 2014 The NIH Toolbox Cognition Battery: Results from a large normative developmental sample (PING) Neuropsychology 28 1 1 10 10.1037/neu0000001 24219608 PMC3925365 · DOI
  2. Anderson V Catroppa C Morse S Haritou F Rosenfeld J 2005 Functional plasticity or vulnerability after early brain injury? Pediatrics 116 6 1374 1382 10.1542/peds.2004-1728 16322161 · DOI
  3. Andresen EM 2000 Criteria for assessing the tools of disability outcomes research Arch Phys Med Rehabil 81 12 Suppl 2 S15 20 11128900
  4. Barnes DE Yaffe K 2011 The projected effect of risk factor reduction on Alzheimer's disease prevalence Lancet Neurol 10 9 819 828 10.1016/S1474-4422(11)70072-2 21775213 PMC3647614 · DOI
  5. Bauer PJ Zelazo PD 2013 Ix Nih toolbox cognition battery (cb): summary, conclusions, and implications for cognitive development Monographs of the Society for Research in Child Development 78 4 133 146 10.1111/mono.12039 23952207 · DOI
  6. Beaumont JL Havlik R Cook KF Hays RD Wallner-Allen K Korper SP Gershon R 2013 Norming plans for the NIH Toolbox Neurology 80 11 Suppl 3 S87 92 10.1212/WNL.0b013e3182872e70 23479550 PMC3662345 · DOI · Paper page
  7. Brookmeyer R Gray S Kawas C 1998 Projections of Alzheimer's disease in the United States and the public health impact of delaying disease onset American Journal of Public Health 88 9 1337 1342 9736873 PMC1509089
  8. Carlozzi NE Tulsky DS Kail RV Beaumont JL 2013 Vi Nih toolbox cognition battery (cb): measuring processing speed Monographs of the Society for Research in Child Development 78 4 88 102 10.1111/mono.12036 23952204 PMC4425122 · DOI · Paper page
  9. Cernich A Reeves D Sun W Bleiberg J 2007 Automated Neuropsychological Assessment Metrics sports medicine battery Archives of Clinical Neuropsychology 22 Suppl 1 S101 114 17118625
  10. Cohen J 1992 A power primer Psychological Bulletin 112 155 159 19565683
  11. Coldwell SE Mennella JA Duffy VB Pelchat ML Griffith JW Smutzer G Hoffman HJ 2013 Gustation assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S20 24 23479539 PMC3662332
  12. Cook KF Dunn W Griffith JW Morrison MT Tanquary J Sabata D Gershon RC 2013 Pain assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S49 53 23479545 PMC3662342
  13. Dalton P Doty RL Murphy C Frank R Hoffman HJ Maute C Slotkin J 2013 Olfactory assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S32 36 23479541 PMC3662337
  14. Dikmen SS Heaton RK Grant I Temkin NR 1999 Test-retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery Journal of the International Neuropsychological Society 5 4 346 356 10349297
  15. Duff K Beglinger LJ Schoenberg MR Patton DE Mold J Scott JG Adams RL JCEN 1005 27 565-575 2005 Test-retest stability and practice effects of the RBANS in a community dwelling elderly sample Journal of Clinical and Experimental Neuropsychology 27 265 575 16019633
  16. Dunn W Griffith JW Morrison MT Tanquary J Sabata D Victorson D Gershon RC 2013 Somatosensation assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S41 44 23479543 PMC3662343
  17. Erlanger DM Kutner KC Barth JT Barnes R 1999 Neuropsychology of sports-related head injury: Dementia Pugilistica to Post Concussion Syndrome Clin Neuropsychol 13 2 193 209 10.1076/clin.13.2.193.1963 10949160 · DOI
  18. Fox NA 2013 Commentary on zelazo and bauer (editors), national institutes of health toolbox cognition battery (cb): validation for children between 3 and 15 years Monographs of the Society for Research in Child Development 78 4 150 155 10.1111/mono.12044 23952209 · DOI
  19. Gershon RC 2005 Computer adaptive testing J Appl Meas 6 1 109 127 15701948
  20. Gershon RC Slotkin J Manly J Blitz D Beaumont J Schnipke D Weintraub S 2013 NIH Toolbox Cognitive Battery (CB): Measuring Language (Vocabulary Comprehension and Reading Decoding) Monographs of the Society for Research in Child Development 78 9 49 69 23952202 PMC7659464
  21. Hodes RJ Insel TR Landis SC Research NIH Blueprint for Neuroscience 2013 The NIH toolbox: setting a standard for biomedical research Neurology 80 11 Suppl 3 S1 10.1212/WNL.0b013e3182872e90 23479536 PMC3662338 · DOI
  22. Lechuga MT Marcos-Ruiz R Bauer PJ 2001 Episodic recall of specifics and generalisation coexist in 25-month-old children Memory 9 2 117 132 11338937
  23. Lukowski AF Garcia MT Bauer PJ 2011 Memory for events and locations obtained in the context of elicited imitation: evidence for differential retention in the second year of life Infant Behav Dev 34 1 55 62 doi: S0163-6383(10)00104-9 [pii] 10.1016/j.infbeh.2010.09.006 21047688 PMC10128620 · DOI
  24. McKee AC Cantu RC Nowinski CJ Hedley-Whyte ET Gavett BE Budson AE Stern RA 2009 Chronic traumatic encephalopathy in athletes: progressive tauopathy after repetitive head injury J Neuropathol Exp Neurol 68 7 709 735 10.1097/NEN.0b013e3181a9d503 19535999 PMC2945234 · DOI · Paper page
  25. Mungas D Reed BR Marshall SC Gonzalez HM 2000 Development of psychometrically matched English and Spanish language neuropsychological tests for older persons Neuropsychology 14 2 209 223 10791861
  26. Mungas D Reed BR Crane PK Haan MZ González G 2004 Spanish and English Neuropsychological Assessment Scales (SENAS): further development and psychometric characteristics Psychol Assessment 16 347 359 15584794
  27. Mungas D Widaman K Zelazo PD Tulsky D Heaton R Slotkin J Gershon RC 2013 NIH Toolbox Cognitive Battery (CB): Factor Structure for 3- to 15-year-olds Monographs of the Society for Research in Child Development 78 103 118 23952205 PMC3950958
  28. Nowinski CJ Victorson D Debb SM Gershon RC 2013 Input on NIH Toolbox inclusion criteria: surveying the end-user community Neurology 80 11 Suppl 3 S7 12 23479548 PMC3662340
  29. Reuben DB Magasi S McCreath HE Bohannon RW Wang YC Bubela DJ Gershon RC 2013 Motor assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S65 75 23479547 PMC3662336
  30. Rine RM Schubert MC Whitney SL Roberts D Redfern MS Musolino MC Slotkin J 2013 Vestibular function assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S25 31 10.1212/WNL.0b013e3182872c6a 23479540 PMC3662339 · DOI
  31. Salsman JM Butt Z Pilkonis PA Cyranowski JM Zill N Hendrie HC Cella D 2013 Emotion assessment using the NIH Toolbox Neurology 80 11 Supplement 3 S76 86 23479549 PMC3662334
  32. Salsman JM Butt Z Pilkonis PA Cyranowski JM Zill N Hendrie HC Cella D 2013 in press Emotion assessment using the NIH Toolbox PMC3662334 23479549
  33. Salthouse TA 1976 Speed and age: multiple rates of age decline Experimental Aging Research 2 4 349 359 1017454
  34. Salthouse TA 1992 Influence of processing speed on adult age differences in working memory Acta Psychologica 79 2 155 170 1598844
  35. Shao H Breitner JC Whitmer RA Wang J Hayden K Wengreen H For the Cache County Investigators 2012 Hormone therapy and Alzheimer disease dementia: New findings from the Cache County Study Neurology 79 18 1846 1852 10.1212/WNL.0b013e318271f823 23100399 PMC3525314 · DOI
  36. Tulsky DS Carlozzi NE Chevalier N Espy KA Beaumont JL Mungas D 2013 NIH toolbox cognition battery (cb): measuring working memory Monographs of the Society for Research in Child Development 78 4 70 87 10.1111/mono.12035 23952203 PMC4427028 · DOI · Paper page
  37. Varma R McKean-Cowdin R Vitale S Slotkin J Hays RD 2013 Vision assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S37 40 10.1212/WNL.0b013e3182876e0a 23479542 PMC3662341 · DOI
  38. Victorson D Manly J Wallner-Allen K Fox N Purnell C Hendrie H Gershon R 2013 Using the NIH Toolbox in special populations: considerations for assessment of pediatric, geriatric, culturally diverse, non-English-speaking, and disabled individuals Neurology 80 11 Suppl 3 S13 19 10.1212/WNL.0b013e3182872e26 23479537 PMC3662333 · DOI
  39. Weintraub S Bauer PJ Zelazo PD Wallner-Allen K Dikmen SS Heaton RK Gershon RC 2013 I. NIH Toolbox Cognition Battery (CB): introduction and pediatric data Monographs of the Society for Research in Child Development 78 4 1 149 10.1111/mono.12031 23952199 PMC3954750 · DOI · Paper page
  40. Wolf MS Curtis LM Wilson EA Revelle W Waite KR Smith SG Baker DW 2012 Literacy, cognitive function, and health: results of the LitCog study Journal of General Internal Medicine 27 10 1300 1307 10.1007/s11606-012-2079-4 22566171 PMC3445686 · DOI
  41. Zecker SG Hoffman HJ Frisina R Dubno JR Dhar S Wallhagen M Wilson RH 2013 Audition assessment using the NIH Toolbox Neurology 80 11 Suppl 3 S45 48 10.1212/WNL.0b013e3182872dd2 23479544 PMC3662344 · DOI
  42. Zelazo PD 2006 The Dimensional Change Card Sort (DCCS): a method of assessing executive function in children Nature Protocols 1 297 301 17406248
  43. Zelazo PD Anderson JE Richler J Wallner-Allen K Beaumont JL Weintraub S 2013 NIH Toolbox Cognitive Battery (CB): Measuring Executive Function and Attention Monographs of the Society for Research in Child Development 16 33 23952200

Cited by

Sorted by citations

Authors
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Slotkin, J., Carlozzi, N. E., Bauer, P. J., Wallner-Allen, K., Fox, N., Havlik, R., Beaumont, J. L., Mungas, D., Manly, J. J., Moy, C., Conway, K., Edwards, E., Nowinski, C. J., & Gershon, R.
Affiliations
  • University of Washington (US)
  • University of California San Diego (US)
  • Kessler Foundation (US)
  • University of Minnesota (US)
  • Northwestern University (US)
  • University of Michigan (US)
  • Emory University (US)
  • University of Maryland, College Park (US)
  • Westat (United States) (US)
  • University of California, Davis (US)
  • Columbia University (US)
  • National Institute of Neurological Disorders and Stroke (US)
  • National Institutes of Health (US)
  • National Center for Complementary and Integrative Health (US)
ORCID
Venue
Journal of the International Neuropsychological Society
Publisher
Cambridge University Press (CUP)
Published
2014-06-24
Volume
20
Issue
6
Pages
567-578
ISSN
  • 1355-6177 (ISSN-L)
  • 1469-7661
DOI
10.1017/s1355617714000320
PMC
PMC4103959
OpenAlex
W2162218505
Cited by
342
References
24
Citations by year
2026: 28 · 2025: 37 · 2024: 39 · 2023: 41 · 2022: 42 · 2021: 43 · 2020: 29 · 2019: 22 · 2018: 25 · 2017: 22 · 2016: 6 · 2015: 2 · 2014: 3 · 2013: 2
FWCI
15.77
Type
journal article
Language
en
Open access
Licence
www.cambridge.org/core/terms (unspecified)
Locations
  • Journal of the International Neuropsychological Society (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion, public-domain)
Funders
  • National Institute on Aging (P30AG010129, R01AG010220, P30AG013854)
  • National Institute of Mental Health (P30MH062512)
  • National Institute on Deafness and Other Communication Disorders (R01DC008552)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
  • Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
  • Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Keywords
NIH Toolbox, cognitive assessment, test-retest reliability, practice effects, construct validity, adult cognition, neuropsychological assessment, fluid and crystallized intelligence, composite score
MeSH terms
Adolescent, Adult, Aged, Aged, 80 and over, Behavior, Child, Child, Preschool, Cognition, Female, Humans, Male, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, Psychometrics, United States, Reproducibility of Results, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review