Norming plans for the NIH Toolbox
Open accessAbstract
OBJECTIVE: The NIH Toolbox for Assessment of Neurological and Behavioral Function (NIH Toolbox) is a comprehensive battery of brief assessment tools. The purpose of this article is to describe plans to establish normative reference values for the NIH Toolbox measures. METHODS: A large sample will be obtained from the US population for the purpose of calculating normative values. The sample will be stratified by age (ages 3-85 years), sex, and language preference (English or Spanish) and have a total sample size of at least 4,205. The sample will include a minimum of 25-100 individuals in each targeted demographic and language subgroup. RESULTS: Norming methods will include poststratification adjustment calculated using iterative proportional fitting, also known as raking, so that the weighted sample will have the same distribution on key demographic variables as the US population described in the 2010 Census. CONCLUSIONS: As with any set of norms, users should be mindful of the reference population and make conclusions consistent with the limitations of normative sampling, since it is not a probability-based sample. However, the NIH Toolbox norming study has been designed to minimize bias and maximize representativeness and precision of estimates. The availability of a "toolbox" of normed measures will be an important foundation for addressing critical research questions in neurologic and behavioral health.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The NIHTB-CB was normed in a demographically diverse sample of 4,859 participants ages 3-85, with eligibility criteria including the capability of following test instructions and adequate visual and auditory functioning.
“The battery was normed in a demographically diverse sample of 4,859 participants ages 3–85, with eligibility criteria including the capability of following test instructions and adequate visual and auditory functioning (Beaumont et al., 2013).”
From NIH Toolbox Cognition Battery Feasibility in Individuals With Williams Syndrome (2022) · cites this paper as Beaumont et al., 2013
The Abstract describes a planned norming sample ages 3–85, stratified by demographic characteristics, with at least 4,205 participants—not a completed sample of 4,859. RELEVANT POPULATION lists the ability to follow test instructions as an eligibility criterion, but says adequate visual and auditory functioning is required only for a subset of measures. Page numbers are not available in our copy. (LLM, conf=0.90)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Assessment of neurological and behavioural function: the NIH Toolbox
Gershon, R. C., Cella, D., Fox, N. A., Havlik, R. J., Hendrie, H. C., & Wagster, M. V. (2010) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70335-7 · Cited by 377 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 5
- Rine RM, Roberts D, Corbin BA, et al. New portable tool to screen vestibular and visual function-National Insti- tutes of Health Toolbox initiative. J Rehabil Res Dev. 2012;49(2):209-220.
- Deming WE, Stephan FF. On a least squares adjustment of a sampled frequency table when the expected marginal totals are known. Ann Math Stat 1940;11:427-444.
- Bishop YMM, Fienberg SE, Holland PW. Discrete Mul- tivariate Analysis: Theory and Practice. Cambridge: MIT Press; 1975.
- Fienberg SE. The Analysis of Cross-Classified Categorical Data, 2nd ed. Cambridge: MIT Press; 1980.
- Little RJA, Rubin DB. Statistical Analysis With Missing Data. New York: John Wiley & Sons; 1987.
Cited by
Sorted by citations
NIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895 · see citing works
Self-citationHandgrip strength: a comparison of values obtained from the NHANES and NIH Toolbox studies
Bohannon, R. W., Wang, Y.-C., Yen, S.-C., & Grogan, K. A. (2019) · American Journal of Occupational Therapy · doi:10.5014/ajot.2019.029538 · Cited by 72 · see citing works
Self-Efficacy Buffers the Relationship between Educational Disadvantage and Executive Functioning
Zahodne, L. B., Nowinski, C. J., Gershon, R. C., & Manly, J. J. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617715000193 · Cited by 45 · see citing works
Self-citationIverson, G. L., & Karr, J. E. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.724888 · Cited by 13 · see citing works
NIH Toolbox Cognition Battery Feasibility in Individuals With Williams Syndrome
Condy, E. E., Becker, L., Farmer, C., Kaat, A. J., Chlebowski, C., Kozel, B. A., & Thurm, A. (2022) · American Journal on Intellectual and Developmental Disabilities · doi:10.1352/1944-7558-127.6.473 · Cited by 6 · see citing works
- Authors
- Beaumont, J. L., Havlik, R., Cook, K. F., Hays, R. D., Wallner-Allen, K., Korper, S. P., Lai, J.-S., Nord, C., Zill, N., Choi, S., Yost, K. J., Ustsinovich, V., Brouwers, P., Hoffman, H. J., & Gershon, R.
- Affiliations
- Northwestern University (US)
- From the Department of Medical Social Sciences (J.L.B., K.F.C., J.-S.L., S.C., V.U., R.G.), Northwestern University Feinberg School of Medicine, Chicago, IL; Westat (R.H., K.W.-A., S.P.K., C.N., N.Z.), Philadelphia, PA; University of California–Los Angeles (R.D.H.), Los Angeles; Department of Health Sciences Research (K.J.Y.), Mayo Clinic, Rochester, MN; and National Institutes of Health (P.B., H.J.H.), Bethesda, MD.
- ORCID
- Venue
- Neurology
- Published
- 2013-03-12
- Volume
- 80
- Issue
- 11_supplement_3
- Pages
- S87-92
- ISSN
- 0028-3878 (ISSN-L)
- 1526-632X
- PMC
- PMC3662345
- OpenAlex
- W2149978964
- Cited by
- 106
- References
- 1
- Citations by year
- 2026: 10 · 2025: 6 · 2024: 6 · 2023: 12 · 2022: 10 · 2021: 8 · 2020: 13 · 2019: 5 · 2018: 7 · 2017: 10 · 2016: 3 · 2015: 5 · 2014: 9 · 2013: 2
- FWCI
- 8.66
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Neurology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- Pfizer
- Northrop Grumman
- NorthShore University HealthSystem
- National Institutes of Health (4p20md000182-15, HHS-N-260–2006-00007-C, 06-01, P30-AG02-1684, 2P20MD000182, AG028748)
- Agency for Healthcare Research and Quality (U18HS016980, 1R03HS020700-01)
- U.S. Public Health Service (H133B090024, HHSN260200600007, UAR057936A)
- Allergan
- National Institute on Disability and Rehabilitation Research (H133B090024)
- National Institute on Aging (AG 020679-01, N01-AG-6-0007, P01AG020679, RC2AG036498, P30AG028748, 2P20MD000182, AG-260-06-01, P30AG021684)
- National Heart, Lung, and Blood Institute (K23HL085766)
- National Institute of Nursing Research (RC1NR011804)
- National Institute of Diabetes and Digestive and Kidney Diseases (U01DK082342)
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (1U5AR057943-01, AR 052177, U01AR052177)
- National Center on Minority Health and Health Disparities (2P20 MD000182, P30-AG028748)
- National Institute on Minority Health and Health Disparities (2P20MD000182, P20-MD000182)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD05469)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- NIH Toolbox, reference values, post-stratification, raking, sample representativeness, neurological function assessment, age and sex stratification, language preference
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Child, Child, Preschool, Data Collection, Ethnicity, Humans, Language, Middle Aged, National Institutes of Health (U.S.), Neuropsychological Tests, Reference Values, United States, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
