Psychometric properties of the NIH Toolbox cognition battery in healthy older adults: reliability, validity, and agreement with standard neuropsychological tests
Open accessAbstract
Objective: Few independent studies have examined the psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) in older adults, despite growing interest in its use for clinical purposes. In this paper we report the test–retest reliability and construct validity of the NIHTB-CB, as well as its agreement or concordance with traditional neuropsychological tests of the same construct to determine whether tests could be used interchangeably. Methods: Sixty-one cognitively healthy adults ages 60–80 completed “gold standard” (GS) neuropsychological tests, NIHTB-CB, and brain MRI. Test–retest reliability, convergent/discriminant validity, and agreement statistics were calculated using Pearson’s correlations, concordance correlation coefficients (CCC), and root mean square deviations. Results: Test–retest reliability was acceptable (CCC = .73 Fluid; CCC = .85 Crystallized). The NIHTB-CB Fluid Composite correlated significantly with cerebral volumes (r’s = |.35−.41|), and both composites correlated highly with their respective GS composites (r’s = .58−.84), although this was more variable for individual tests. Absolute agreement was generally lower (CCC = .55 Fluid; CCC = .70 Crystallized) due to lower precision in fluid scores and systematic overestimation of crystallized composite scores on the NIHTB-CB. Conclusions: These results support the reliability and validity of the NIHTB-CB in healthy older adults and suggest that the fluid composite tests are at least as sensitive as standard neuropsychological tests to medial temporal atrophy and ventricular expansion. However, the NIHTB-CB may generate different estimates of performance and should not be treated as interchangeable with established neuropsychological tests.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Prior studies found a small 2.7-point gain on the Fluid Cognition Composite standard scores with 3-5 weeks between administrations, but no practice effects with 15 months between administrations.
“Findings revealed a small 2.7-point gain with 3–5 weeks between administrations [44], yet no practice effects with 15 months between administrations [45].”
From Primary outcome from the augmenting cognitive training in older adults study (ACT): A tDCS and cognitive training randomized clinical trial (2023) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Practical Statistics for Medical Research.
Walter, S., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,665 · see citing works
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785 · see citing works
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771 · see citing works
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903 · see citing works
Tests for comparing elements of a correlation matrix
Steiger, J. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.87.2.245 · Cited by 4,621 · see citing works
Measurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300 · see citing works
The Halstead-Reitan neuropsychological test battery: Theory and clinical interpretation
Reitan, R. M., & Wolfson, D. E. (1993) · Medical Entomology and Zoology · Cited by 3,413 · see citing works
L’examen Clinique en Psychologie
Rubé, P. (1959) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1959.13.4.989 · Cited by 3,299 · see citing works
Regional Brain Changes in Aging Healthy Adults: General Trends, Individual Differences and Modifiers
Raz, N., Lindenberger, U., Rodrigue, K. M., Kennedy, K. M., Head, D., Williamson, A., Dahle, C., Gerstorf, D., & Acker, J. D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi044 · Cited by 2,875 · see citing works
Stroop Color and Word Test: Manual for Clinical and Experimental Uses.
Golden, C. J., Golden, C. J., & Golden, C. (1978) · NSUWorks (Nova Southeastern University) · Cited by 1,814 · see citing works
Passing, H., & Bablok, W. (1983) · cclm · doi:10.1515/cclm.1983.21.11.709 · Cited by 1,513 · see citing works
Cognition assessment using the NIH Toolbox
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., Carlozzi, N. E., Slotkin, J., Blitz, D., Wallner-Allen, K., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872ded · Cited by 1,287 · cited 6× · see citing works
“Initial studies indicated that these composites have strong test–retest reliability (i.e., ICCs ranging from .78 to .99) and moderate to strong convergent validity (r’s ranging from .48 to .93) with traditional neuropsychological tests (Heaton et al., 2014; Weintraub et al., 2013).”
BackgroundMethodResultInfluentialVision assessment using the NIH Toolbox
Varma, R., McKean‐Cowdin, R., Vitale, S., Slotkin, J., & Hays, R. D. (2013) · Neurology · doi:10.1212/wnl.0b013e3182876e0a · Cited by 1,197 · see citing works
Practical Statistics for Medical Research
Newcombe, R. G. (1992) · Journal of Epidemiology & Community Health · doi:10.1136/jech.46.5.549-a · Cited by 991 · see citing works
NIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895 · see citing works
The Alzheimer's Disease Centers' Uniform Data Set (UDS)
Weıntraub, S., Salmon, D. P., Mercaldo, N. D., Ferris, S. H., Graff‐Radford, N. R., Chui, H. C., Cummings, J. L., DeCarli, C. S., Foster, N. L., Galasko, D. R., et al. (2009) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e318191c7dd · Cited by 885 · see citing works
Bondi, M. W., Initiative, F. T. A. D. N., Edmonds, E. C., Jak, A. J., Clark, L. R., Delano-Wood, L., McDonald, C. R., Nation, D. A., Libon, D. J., Au, R., et al. (2014) · Journal of Alzheimer's Disease · doi:10.3233/jad-140276 · Cited by 750 · see citing works
Ivnik, R. J., Malec, J. F., Smith, G. E., Tangalos, E. G., & Petersen, R. C. (1996) · The Clinical Neuropsychologist · doi:10.1080/13854049608406689 · Cited by 547 · see citing works
Nestor, S. M., Rupsingh, R., Borrie, M., Smith, M., Accomazzi, V., Wells, J. L., Fogarty, J., Bartha, R., & Initiative, T. A. D. N. (2008) · Brain · doi:10.1093/brain/awn146 · Cited by 543 · see citing works
Reliability and Validity of Composite Scores from the NIH Toolbox Cognition Battery in Adults
Heaton, R. K., Akshoomoff, N., Tulsky, D., Mungas, D., Weintraub, S., Dikmen, S., Beaumont, J., Casaletto, K. B., Conway, K., Slotkin, J., et al. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000241 · Cited by 437 · see citing works
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Slotkin, J., Carlozzi, N. E., Bauer, P. J., Wallner-Allen, K., Fox, N., et al. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000320 · Cited by 342 · see citing works
An Overview on Assessing Agreement with Continuous Measurements
Barnhart, H. X., Haber, M. J., & Lin, L. I. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701376480 · Cited by 319 · see citing works
Casaletto, K. B., Umlauf, A., Beaumont, J., Gershon, R., Slotkin, J., Akshoomoff, N., & Heaton, R. K. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617715000351 · Cited by 271 · see citing works
Estimating the Generalized Concordance Correlation Coefficient through Variance Components
Carrasco, J. L., & Jover, L. (2003) · Biometrics · doi:10.1111/j.0006-341x.2003.00099.x · Cited by 233 · see citing works
Cognitive Aging and the Hippocampus in Older Adults
O’Shea, A. M., Cohen, R. A., Porges, E. C., Nissim, N. R., & Woods, A. J. (2016) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2016.00298 · Cited by 229 · see citing works
A web-based normative calculator for the uniform data set (UDS) neuropsychological test battery
Shirk, S. D., Mitchell, M. B., Shaughnessy, L. W., Sherman, J. C., Locascio, J. J., Weıntraub, S., & Atri, A. (2011) · Alzheimer s Research & Therapy · doi:10.1186/alzrt94 · Cited by 208 · see citing works
Predicting MCI outcome with clinically available MRI and CSF biomarkers
Heister, D. S., Brewer, J. B., Magda, S., Blennow, K., McEvoy, L. K., & Initiative, A. D. N. (2011) · Neurology · doi:10.1212/wnl.0b013e3182343314 · Cited by 201 · see citing works
Language Measures of the NIH Toolbox Cognition Battery
Gershon, R. C., Cook, K. F., Mungas, D., Manly, J. J., Slotkin, J., Beaumont, J. L., & Weintraub, S. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000411 · Cited by 189 · see citing works
Lucas, J. A., Ivnik, R. J., Willis, F. B., Ferman, T. J., Smith, G. E., Parfitt, F. C., Petersen, R. C., & Graff‐Radford, N. R. (2005) · The Clinical Neuropsychologist · doi:10.1080/13854040590945265 · Cited by 107 · see citing works
Mungas, D., Heaton, R., Tulsky, D., Zelazo, P. D., Slotkin, J., Blitz, D., Lai, J.-S., & Gershon, R. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000307 · Cited by 95 · see citing works
Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury.
Tulsky, D. S., Carlozzi, N. E., Holdnack, J., Heaton, R. K., Wong, A., Goldsmith, A., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000174 · Cited by 67 · see citing works
Buckley, R. F., Sparks, K. P., Papp, K. V., Dekhtyar, M., Martin, C., Burnham, S. C., Sperling, R. A., & Rentz, D. M. (2017) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2017.1 · Cited by 60 · see citing works
Utility of the NIH Toolbox for assessment of prodromal Alzheimer's disease and dementia
Hackett, K., Krikorian, R., Giovannetti, T., Meléndez‐Cabrero, J., Rahman, A., Caesar, E. E., Chen, J. L., Hristov, H., Seifan, A., Mosconi, L., et al. (2018) · Alzheimer s & Dementia Diagnosis Assessment & Disease Monitoring · doi:10.1016/j.dadm.2018.10.002 · Cited by 55 · see citing works
Construct validity of the NIH Toolbox Cognition Battery in individuals with stroke.
Carlozzi, N. E., Tulsky, D. S., Wolf, T., Goodnight, S. M., Heaton, R. K., Casaletto, K. B., Wong, A., Baum, C. M., Gershon, R. C., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000195 · Cited by 49 · see citing works
Mesial Temporal Sclerosis: Accuracy of NeuroQuant versus Neuroradiologist
Azab, M., Carone, M., Ying, S., & Yousem, D. M. (2015) · American Journal of Neuroradiology · doi:10.3174/ajnr.a4313 · Cited by 45 · see citing works
Dodge, H. H., Zhu, J. Y., Harvey, D. J., Saito, N. H., Silbert, L. C., Kaye, J. A., Koeppe, R. A., Albin, R. L., & Initiative, A. D. N. (2014) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2014.04.513 · Cited by 43 · see citing works
Barchard, K. A. (2011) · Psychological Methods · doi:10.1037/a0023351 · Cited by 39 · see citing works
Mathews, M. J., Abner, E. L., Kryscio, R. J., Jicha, G. A., Cooper, G. E., Smith, C. D., Caban‐Holt, A., & Schmitt, F. A. (2014) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2013.11.007 · Cited by 33 · see citing works
Berg, J.-L., Durant, J., Banks, S. J., & Miller, J. B. (2016) · The Clinical Neuropsychologist · doi:10.1080/13854046.2016.1186224 · Cited by 32 · see citing works
Baseline Cognition Assessment Among Patients With Oropharyngeal Cancer Using PROMIS and NIH Toolbox
Sinha, P., Wong, A., Kallogjeri, D., & Piccirillo, J. F. (2018) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2018.0283 · Cited by 31 · see citing works
Lang, S., Cadeaux, M., Opoku-Darko, M., Gaxiola‐Valdez, I., Partlo, L. A., Goodyear, B. G., Federico, P., & Kelly, J. J. (2016) · World Neurosurgery · doi:10.1016/j.wneu.2016.12.061 · Cited by 19 · see citing works
Loring, D. W., Bowden, S. C., Staikova, E., Bishop, J., Drane, D. L., & Goldstein, F. C. (2018) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acy028 · Cited by 19 · see citing works
NIH toolbox premorbid ability adjustments: Application in a traumatic brain injury sample.
Holdnack, J. A., Tulsky, D. S., Slotkin, J., Tyner, C. E., Gershon, R. C., Iverson, G. L., & Heinemann, A. W. (2017) · Rehabilitation Psychology · doi:10.1037/rep0000198 · Cited by 13 · see citing works
Flagged first, then by citations
1 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Wechsler D (1997). Wechsler memory scale: WMS-III (3 ed.). San Antonio: Psychological Corp., Harcourt Brace WorldCat.org.
Cited by
Sorted by citations
Age differences in the functional architecture of the human brain
Setton, R., Mwilambwe-Tshilobo, L., Girn, M., Lockrow, A. W., Baracchini, G., Hughes, C. S., Lowe, A. J., Cassidy, B. N., Li, J., Luh, W., et al. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac056 · Cited by 86 · see citing works
How measurement noise limits the accuracy of brain-behaviour predictions
Gell, M., Eickhoff, S. B., Omidvarnia, A., Küppers, V., Patil, K. R., Satterthwaite, T. D., Müller, V. I., & Langner, R. (2024) · Nature Communications · doi:10.1038/s41467-024-54022-6 · Cited by 80 · see citing works
Neuropsychological Tests in Post-operative Cognitive Dysfunction: Methods and Applications
Jun, L., Huang, K., Zhu, B., Zhou, B., Harb, A. K. A., Liu, L., & Wu, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.684307 · Cited by 61 · see citing works
Are Adverse Childhood Experiences Associated with Worse Cognitive Function in Older Adults?
Halpin, A., MacAulay, R. K., Boeve, A. R., D’Errico, L., & Michaud, S. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721001272 · Cited by 54 · see citing works
Bryant, A. M., Rose, N. B., Temkin, N. R., Barber, J. K., Manley, G. T., McCrea, M., Nelson, L. D., TRACK-TBI Investigators, Badjatia, N., Gopinath, S. P., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.49118 · Cited by 47 · see citing works
Taylor, B. K., Frenzel, M. R., Eastman, J. A., Wiesman, A. I., Wang, Y., Calhoun, V. D., Stephen, J. M., & Wilson, T. W. (2020) · Psychological Medicine · doi:10.1017/s0033291720003487 · Cited by 47 · see citing works
Ott, L. R., Schantell, M. D., Willett, M. P., Johnson, H. J., Eastman, J. A., Okelberry, H. J., Wilson, T. W., Taylor, B. K., & May, P. E. (2022) · Neuropsychology · doi:10.1037/neu0000813 · Cited by 36 · see citing works
Sense of purpose in life, cognitive function, and the phenomenology of autobiographical memory
Sutin, A. R., Luchetti, M., Aschwanden, D., Stéphan, Y., & Terracciano, A. (2021) · Memory · doi:10.1080/09658211.2021.1966472 · Cited by 26 · see citing works
ARMADA: Assessing reliable measurement in Alzheimer’s disease and cognitive aging project methods
Weıntraub, S., Karpouzian‐Rogers, T., Peipert, J. D., Nowinski, C. J., Slotkin, J., Wortman, K., Ho, E., Rogalski, E. J., Carlsson, C. M., Giordani, B., et al. (2021) · Alzheimer s & Dementia · doi:10.1002/alz.12497 · Cited by 23 · see citing works
Kochan, N. A., Heffernan, M., Valenzuela, M., Sachdev, P. S., Lam, B. C. P., Singh, M. F., Anstey, K. J., Chau, T., & Brodaty, H. (2022) · Journal of Alzheimer s Disease · doi:10.3233/jad-220665 · Cited by 20 · see citing works
Deng, G. E., Bao, T., Ryan, E. L., Benusis, L., Hogan, P., Li, Q. S., Dries, A. M., Konner, J. A., Ahles, T. A., & Mao, J. J. J. (2022) · Integrative Cancer Therapies · doi:10.1177/15347354221089221 · Cited by 19 · see citing works
Shapiro, A. L. B., Dabelea, D., Stafford, J. M., D’Agostino, R., Jr., Pihoker, C., Liese, A. D., SHAH, A. S., Bellatorre, A. C., Lawrence, J. M., Henkin, L. F., et al. (2021) · Diabetes Care · doi:10.2337/dc20-2308 · Cited by 18 · see citing works
Cohen, D. E., Kim, H., Levine, A., Devanand, D. P., Lee, S., & Goldberg, T. E. (2023) · International Psychogeriatrics · doi:10.1017/s1041610223000911 · Cited by 17 · see citing works
A Pilot Study of Cognition Among Hypoparathyroid Adults
Rubin, M. R., Tabacco, G., Omeragic, B., Majeed, R., Hale, C., & Brickman, A. M. (2022) · Journal of the Endocrine Society · doi:10.1210/jendso/bvac002 · Cited by 16 · see citing works
Manglani, H. R., Fisher, M. E., Duraney, E. J., Nicholas, J. A., & Prakash, R. S. (2022) · Multiple Sclerosis Journal · doi:10.1177/13524585221088731 · Cited by 16 · see citing works
Kairys, A., Daugherty, A., Kavcic, V., Shair, S., Persad, C., Heidebrink, J., Bhaumik, A., & Giordani, B. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s135561772100028x · Cited by 15 · see citing works
Novel approaches to measuring neurocognitive functions in Alzheimer's disease clinical trials
Carlson, S., Kim, H., Devanand, D. P., & Goldberg, T. E. (2022) · Current Opinion in Neurology · doi:10.1097/wco.0000000000001041 · Cited by 14 · see citing works
Utility of the <scp>iPad NIH</scp> Toolbox Cognition Battery in a clinical trial of older adults
Parsey, C. M., Bagger, J. E., Trittschuh, E. H., & Hanson, A. J. (2021) · Journal of the American Geriatrics Society · doi:10.1111/jgs.17382 · Cited by 14 · see citing works
Hausman, H. K., Alexander, G. E., Cohen, R., Marsiske, M., DeKosky, S. T., Hishaw, G. A., O'Shea, A., Kraft, J. N., Dai, Y., Wu, S., et al. (2023) · Brain Stimulation · doi:10.1016/j.brs.2023.05.021 · Cited by 13 · see citing works
Polk, R. J., Horta, M., Lin, T., Porges, E. C., Ojeda, M., Nazarloo, H. P., Carter, C. S., & Ebner, N. C. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0048 · Cited by 11 · see citing works
Wei, X., McKinlay, C. J. D., Harding, J. E., Wouldes, T. A., Rogers, J., Brown, G., & Franke, N. (2024) · Child Neuropsychology · doi:10.1080/09297049.2024.2447444 · Cited by 9 · see citing works
Muir, K. J., Donahue, C. C., Broshek, D. K., Resch, J. E., Solenski, N. J., & Laughon, K. (2022) · Neurotrauma Reports · doi:10.1089/neur.2022.0047 · Cited by 9 · see citing works
The validity of studying healthy aging with cognitive tests measuring different constructs
Hatahet, O., & Seghier, M. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-74488-0 · Cited by 9 · see citing works
COMbined Exercise Trial (COMET) to improve cognition in older adults: Rationale and methods
Szabo‐Reed, A. N., Clutton, J. E., White, S. S., Sciver, A. R. V., White, D., Morris, J. K., Martin, L. E., Lepping, R. J., Shaw, A. R., Perales‐Puchalt, J., et al. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106805 · Cited by 9 · see citing works
Five-Factor Model Personality Domains and Facets Associated With Markers of Cognitive Health
Sutin, A. R., Luchetti, M., Aschwanden, D., Sesker, A. A., Zhu, X., Stéphan, Y., & Terracciano, A. (2022) · Journal of Individual Differences · doi:10.1027/1614-0001/a000383 · Cited by 9 · see citing works
Ainsworth, N. J., Oughli, H. A., Lavretsky, H., Blumberger, D. M., Brown, P. J., Butters, M. A., Karp, J. F., Lenard, E. M., Lenze, E. J., McAndrews, M. P., et al. (2024) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2024.09.018 · Cited by 8 · see citing works
Lombardo, D., & Kaufmann, T. (2023) · Cerebral Cortex Communications · doi:10.1093/texcom/tgad015 · Cited by 8 · see citing works
Neurocognitive monitoring in congenital central hypoventilation syndrome with the NIH Toolbox®
Welbel, R. Z., Rand, C. M., Zhou, A. Z., Fadl‐Alla, A., Chen, M. L., Weese‐Mayer, D. E., & Zelko, F. A. J. (2022) · Pediatric Pulmonology · doi:10.1002/ppul.25973 · Cited by 8 · see citing works
Iverson, G. L., Gaudet, C. E., Kissinger-Knox, A. M., & Karr, J. E. (2022) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acac076 · Cited by 7 · see citing works
Rigby, T., Gregoire, A., Reader, J., Kahsay, Y., Fisher, J., Kairys, A. E., Bhaumik, A., Rahman‐Filipiak, A., Maher, A. C., Hampstead, B. M., et al. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617724000213 · Cited by 7 · see citing works
García, S., Askew, R. L., Kavcic, V., Shair, S. R., Bhaumik, A., Rose, E., Campbell, S., May, N., Hampstead, B. M., Dodge, H. H., et al. (2023) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0000000000000587 · Cited by 7 · see citing works
Effects of a 4-week pecan-enriched diet on cognitive function in healthy older adults
Cogan, B., Pearson, R. C., Paton, C. M., Jenkins, N. T., & Cooper, J. A. (2022) · Nutrition and Healthy Aging · doi:10.3233/nha-220181 · Cited by 6 · see citing works
Rigby, T., Kavcic, V., Shair, S. R., Hill‐Jarrett, T. G., García, S., Reader, J., Persad, C. C., Bhaumik, A., Pal, S., Hampstead, B. M., et al. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617724000444 · Cited by 6 · see citing works
Lai, H., Celentano, D. D., Treisman, G., Khalsa, J., Gerstenblith, G., Page, B., Mandler, R. N., Yang, Y., Salmeron, B., Bhatia, S., et al. (2023) · AIDS Patient Care and STDs · doi:10.1089/apc.2023.0006 · Cited by 6 · see citing works
Clinical Validation of Selected NIH Cognitive Toolbox Tasks in Pediatric Epilepsy
Matuska, E., Carney, A., Sepeta, L. N., Zelleke, T. G., Pasupuleti, A., & Berl, M. M. (2024) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2024.109684 · Cited by 5 · see citing works
Functionality of arousal-regulating brain circuitry at rest predicts human cognitive abilities
Podvalny, E., Sánchez-Romero, R., & Cole, M. W. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae192 · Cited by 5 · see citing works
Rose, S. G., Gergoire, A., Pal, S., Reader, J., Bhaumik, A., Slotkin, J., Ho, E., Nowinski, C. J., Persad, C. C., Maher, A. C., et al. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617724000699 · Cited by 5 · see citing works
Network geometry shapes the transformation of task representations across the human cortex
Chakravarthula, L. N. C., Ito, T., Tzalavras, A., & Cole, M. W. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02486-8 · Cited by 5 · see citing works
MacAulay, R. K., Boeve, A. R., & Halpin, A. (2021) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acab018 · Cited by 5 · see citing works
Karpouzian‐Rogers, T., Makowski‐Woidan, B., Kuang, A., Zhang, H., Fought, A. J., Engelmeyer, J., Mesulam, M. M., Weıntraub, S., & Rogalski, E. J. (2022) · Journal of the International Neuropsychological Society · doi:10.1017/s135561772200008x · Cited by 5 · see citing works
Cohen, S. B., Gurvitz, M. Z., Burns, K. M., Wheaton, O. A., Panigrahy, A., Umfleet, L. G., Loman, M. M., Brown, N. M., Cotts, T. B., Ermis, P. R., et al. (2023) · American Heart Journal · doi:10.1016/j.ahj.2023.04.002 · Cited by 5 · see citing works
Heisey, H. D., Kunik, M. E., Qualls, C., Segoviano-Escobar, M. B., & Villareal, D. T. (2022) · The journal of nutrition health & aging · doi:10.1007/s12603-022-1776-x · Cited by 5 · see citing works
Strawberries modestly improve cognition and cardiovascular health in older adults
Delaney, K. M., Tsang, M., Kern, M., Rayo, V. U., Jason, N., Hong, M. Y., Liu, C., & Hooshmand, S. (2025) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2025.104018 · Cited by 4 · see citing works
Yu, J. M., Brown, J., Meade, J., Gerber, G. F., Streiff, M. B., Kraus, P. S., Merrill, S. A., Pishko, A. M., Yui, J. C., Naik, R. P. P., et al. (2025) · Blood Advances · doi:10.1182/bloodadvances.2025017274 · Cited by 4 · see citing works
Yin, L., Caceres, M., Skowronski, J., & Muramatsu, N. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156515 · Cited by 4 · see citing works
Kuzmuk, L. E., Rebchuk, A. D., Deptuck, H. M., Cairncross, M., Silverberg, N. D., & Field, T. S. (2022) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2022.273 · Cited by 4 · see citing works
Schafer, E. C., Miller, S. E., Lam, B. P. W., Lee, D., Lohrey, M., Eason, A., Nedrud, C., Cairo, K., Olvera, G., Klarmann, R., et al. (2025) · American Journal of Audiology · doi:10.1044/2025_aja-25-00039 · Cited by 3 · see citing works
Lai, H. C., Treisman, G. J., Celentano, D. D., Gerstenblith, G., Mandler, R. N., Khalsa, J. H., Charurat, M. E., Lai, S., & Pearson, G. (2023) · International Journal of STD & AIDS · doi:10.1177/09564624231218762 · Cited by 3 · see citing works
Garcia, J. M., Mejia, Y. L. M., Lopez, A. P. O., Woods, S. P., Valier, H. K., & Medina, L. D. (2022) · Applied Neuropsychology Adult · doi:10.1080/23279095.2022.2114356 · Cited by 3 · see citing works
Kreinbrink, M., Gachechiladze, L., Srour, A., Inscore, A. B., & Chen, S. H. (2025) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2025.110715 · Cited by 2 · see citing works
Halter, C. M., Moll, A. C., Kero, K., Kavcic, V., Woodard, J. L., & Giordani, B. (2023) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000425 · Cited by 2 · see citing works
Gray matter and episodic memory associations with olfaction in middle‐aged to older adults
Eckert, M. A., Benitez, A. M., Soler, Z. M., Dubno, J. R., & Schlosser, R. J. (2023) · International Forum of Allergy & Rhinology · doi:10.1002/alr.23290 · Cited by 2 · see citing works
Self-citationExploring symptom clusters in mild cognitive impairment and dementia with the NIH Toolbox
Tyner, C. E., Boulton, A. J., Slotkin, J., Cohen, M. L., Weıntraub, S., Gershon, R. C., & Tulsky, D. S. (2024) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617724000055 · Cited by 2 · see citing works
Jutten, R. J., Ho, E., Karpouzian‐Rogers, T., Hulle, C. V., Carlsson, C. M., Dodge, H. H., Nowinski, C. J., Gershon, R. C., Weıntraub, S., & Rentz, D. M. (2025) · Alzheimer s & Dementia Diagnosis Assessment & Disease Monitoring · doi:10.1002/dad2.70046 · Cited by 2 · see citing works
Runk, A., Conaty, K., Calamia, M. R., Butters, M. A., & Gildengers, A. G. (2025) · Neuropsychology · doi:10.1037/neu0001034 · Cited by 1 · see citing works
Hippocampal subfields in aging: Sex-specific trajectories in structure and hemodynamics
Wen, J., Li, C., Sun, Z., Wang, C., Zhang, J., Guan, X., Xu, X., Wısnıewskı, T., & Ge, Y. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121343 · Cited by 1 · see citing works
Nelson, L. D., Simons, M. U., Jain, S., Sun, X., Choi, K. W., Temkin, N. R., Diaz-Arrastia, R. R., Gardner, R. C., Taylor, S. R., Manley, G. T., et al. (2026) · Journal of Neurotrauma · doi:10.1177/08977151261432398 · Cited by 1 · see citing works
MacLeod, C. A., Surgenor, L. J., Levack, W., Hackney, J. J., Theadom, A., Siegert, R. J., Silverberg, N. D., & Snell, D. L. (2020) · Brain Impairment · doi:10.1017/brimp.2020.14 · Cited by 1 · see citing works
Development and Validation of a Vocabulary Measure in the Mobile Toolbox
Young, S. R., Dworak, E. M., Kaat, A. J., Adam, H., Novack, M. A., Slotkin, J., Stoeger, J., Nowinski, C. J., Hosseinian, Z., Amagai, S., et al. (2024) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acae010 · Cited by 1 · see citing works
Card, M. R., & Ryals, A. J. (2024) · Perceptual and Motor Skills · doi:10.1177/00315125241240891 · Cited by 1 · see citing works
Ho, E., Karpouzian‐Rogers, T., Aytürk, E., Bedjeti, K., Weıntraub, S., & Gershon, R. C. (2025) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaf035 · Cited by 1 · see citing works
Current evolution of neurobehavioral methods
Bouchard, M. F., Tuerk, C., Eadeh, H., Rohlman, D. S., Saha, T., & Anger, W. K. (2022) · Advances in neurotoxicology · doi:10.1016/bs.ant.2022.04.004
Snell, D. L., Faulkner, J. W., Williman, J. A., Silverberg, N. D., Theadom, A., Surgenor, L. J., & Siegert, R. J. (2025) · Brain Impairment · doi:10.1071/ib24074
Thomas, A. B., Matthews, A. L., Brooks, O., Winquist, A., Nelson, L. A., Arias‐Fontenot, R., Buchwald, D., Casaletto, K. B., Weıntraub, S., Heaton, R. K., et al. (2025) · Alzheimer s & Dementia · doi:10.1002/alz.70673
Divers, R. M., Runk, A., Calamia, M. R., Breaux, E., Rasmussen, L., & Carmichael, O. (2026) · Aging & Mental Health · doi:10.1080/13607863.2026.2672679
Souza‐Talarico, J. N., Lehmler, H., Caldwell, J. K., Cortés, Y. I., Zuelsdorff, M. L., Fun, Y., Embree, J. L., Doyle, C., Halverson, K., Rangel, M. M., et al. (2026) · medRxiv · doi:10.64898/2026.05.21.26353825
Dog ownership and healthy brain aging: a pilot study
Potter, K., Martini, D. N., Sands, C. J., Falck, R. S., & Nagarajan, R. (2026) · PeerJ · doi:10.7717/peerj.21560
- Authors
- Scott, E. P., Sorrell, A., & Benitez, A.
- Affiliations
- Medical University of South Carolina (US)
- Appalachian State University (US)
- Corresponding author
- Scott, Emmi P.
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2019-07-01
- Volume
- 25
- Issue
- 08
- Pages
- 857-867
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- PMC
- PMC6733640
- OpenAlex
- W2953946857
- Cited by
- 69
- References
- 44
- Citations by year
- 2026: 5 · 2025: 11 · 2024: 12 · 2023: 12 · 2022: 19 · 2021: 8 · 2020: 2
- FWCI
- 5.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the International Neuropsychological Society (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (KL2TR000060, UL1TR000062)
- National Institute on Aging (K23AG044434)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- NIH Toolbox Cognition Battery, cognitive assessment, older adults, test-retest reliability, construct validity, fluid intelligence, crystallized intelligence, brain volume, medial temporal lobe atrophy, ventriculomegaly, healthy aging
- MeSH terms
- Aged, Aged, 80 and over, Aging, Female, Humans, Male, Middle Aged, Neuropsychological Tests, Psychometrics, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
