COMPUTERIZED COGNITIVE TESTING FOR USE IN CLINICAL TRIALS: A COMPARISON OF THE NIH TOOLBOX AND COGSTATE C3 BATTERIES
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Background: As prevention trials for Alzheimer’s disease move into asymptomatic populations, identifying older individuals who manifest the earliest cognitive signs of Alzheimer’s disease is critical. Computerized cognitive testing has the potential to replace current gold standard paper and pencil measures and may be a more efficient means of assessing cognition. However, more empirical evidence about the comparability of novel computerized batteries to paper and pencil measures is required. Objectives: To determine whether two computerized IPad batteries, the NIH Toolbox Cognition Battery and Cogstate-C3, similarly predict subtle cognitive impairment identified using the Preclinical Alzheimer Cognitive Composite (PACC). Design, Setting, Participants: A pilot sample of 50 clinically normal older adults (Mage=68.5 years±7.6, 45% non-Caucasian) completed the PACC assessment, and the NIH Toolbox and Cogstate-C3 at research centers of Massachusetts General and Brigham and Women’s Hospitals. Participants made 3-4 in-clinic visits, receiving the PACC first, then the NIH Toolbox, and finally the Cogstate-C3. Measurements: Performance on the PACC was dichotomized by typical performance (>= 0.5SD), versus subtle cognitive impairment (<0.5SD). Composites for each computerized battery were created using principle components analysis, and compared with the PACC using non-parametric Spearman correlations. Logistic regression analyses were used to determine which composite was best able to classify subtle cognitive impairment from typical performance. Results: The NIH Toolbox formed one composite and exhibited the strongest within-battery alignment, while the Cogstate-C3 formed two distinct composites (Learning-Memory and Processing Speed-Attention). The NIH Toolbox and C3 Learning-Memory composites exhibited positive correlations with the PACC (ρ=0.49, p<0.001; ρ=0.58, p<0.001, respectively), but not the C3 Processing Speed-Attention composite, ρ=-0.18, p=0.22. The C3 Learning-Memory was the only composite that classified subtle cognitive impairment, and demonstrated the greatest sensitivity (62%) and specificity (81%) for that subtle cognitive impairment. Conclusions: Preliminary findings suggest that the NIH Toolbox has the advantage of showing the strongest overall clustering and alignment with standardized paper-and-pencil tasks. By contrast, Learning-Memory tasks within the Cogstate-C3 battery have the greatest potential to identify cross-sectional, subtle cognitive impairment as defined by the PACC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Insights into the ageing mind: a view from cognitive neuroscience
Hedden, T., & Gabrieli, J. D. E. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1323 · Cited by 2,223 · cited 1×
“This supports other findings suggesting that processing speed and attention domains are less sensitive to AD-related change very early in the trajectory (18), and perhaps are more sensitive to age-related etiologies (27).”
Cognition assessment using the NIH Toolbox
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., Carlozzi, N. E., Slotkin, J., Blitz, D., Wallner-Allen, K., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872ded · Cited by 1,287 · cited 7×
“Participant characteristics and cognitive performance Full group n = 50 Subtle cognitive impairment n = 13 Typical performance n = 37 p Sex (% F) 62 46 67 .30 Age (yrs) 68.5 (7.5) 70.2 (9.1) 68.0 (7.0) .46 Education (yrs) 15.6 (3.1) 14.8 (3.1) 15.9 (2.7) .28 Race (% Black) 46 69 38 .10 Ethnicity (% Hispanic) 4 15 0 -*…”
InfluentialNIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895 · cited 1×
“The NIHTB-CB has shown strong convergent validity with other standard neuropsychological paper-and-pencil tests along the broad developmental trajectory (14), and was originally designed to complement measures used in research studies of cognition or to serve as a brief adjunct measure in longitudinal and epidemiologi…”
The Preclinical Alzheimer Cognitive Composite: Measuring Amyloid-Related Decline
Donohue, M. C., Sperling, R. A., Salmon, D. P., Rentz, D. M., Raman, R., Thomas, R. G., Weiner, M., & Aisen, P. S. (2014) · JAMA Neurology · doi:10.1001/jamaneurol.2014.803 · Cited by 860
Self-citationThe Evolution of Preclinical Alzheimer’s Disease: Implications for Prevention Trials
Sperling, R., Mormino, E., & Johnson, K. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.038 · Cited by 725 · cited 2×
“the Australian Imaging Biomarker and Lifestyle (AIBL) study of ageing, the Harvard Aging Brain Study (HABS), and the ante-amyloid (A3) clinical trial (11)).”
Self-citationMaruff, P., Thomas, E., Cysique, L., Brew, B., Collie, A., Snyder, P., & Pietrzak, R. H. (2009) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acp010 · Cited by 635
Status of computerized cognitive testing in aging: a systematic review
Wild, K., Howieson, D., Webbe, F., Seelye, A., & Kaye, J. (2008) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2008.07.003 · Cited by 436 · cited 1×
“Computerized testing has been proposed as a feasible and reliable way of testing older participants (1-4).”
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Slotkin, J., Carlozzi, N. E., Bauer, P. J., Wallner-Allen, K., Fox, N., et al. (2014) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617714000320 · Cited by 342 · cited 2×
“Studies examining the validity of computerized cognitive composites in relation to performance on conventional neuropsychological instruments are accruing (5-8), and furthermore, computerized testing has already become a secondary outcome in a major clinical trial (9).”
Akshoomoff, N., Beaumont, J. L., Bauer, P. J., Dikmen, S. S., Gershon, R. C., Mungas, D., Slotkin, J., Tulsky, D., Weintraub, S., Zelazo, P. D., et al. (2013) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12038 · Cited by 299 · cited 1×
“These composites were created consistent with previous reports using the Cogstate Brief Battery (19) and the NIHTB-CB (15).”
Hedden, T., Mormino, E. C., Amariglio, R. E., Younger, A. P., Schultz, A. P., Becker, J. A., Buckner, R. L., Johnson, K. A., Sperling, R. A., & Rentz, D. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2462-12.2012 · Cited by 182
Self-citation
Cited by
Current advances in digital cognitive assessment for preclinical Alzheimer's disease
Öhman, F., Hassenstab, J., Berron, D., Schöll, M., & Papp, K. V. (2021) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12217 · Cited by 214
Self-citationDigital neuropsychology: challenges and opportunities at the intersection of science and software
Germine, L., Reinecke, K., & Chaytor, N. S. (2019) · The Clinical Neuropsychologist · doi:10.1080/13854046.2018.1535662 · Cited by 171
Scott, E. P., Sorrell, A., & Benitez, A. (2019) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617719000614 · Cited by 69
“Moderate associations with neuropsychological tests of preclinical Alzheimer’s disease (Buckley et al., 2017) and hippocampal volumes (O’Shea et al., 2016) have been reported and interpreted as preliminary support for its clinical utility with older adults.”
BackgroundResultBiomarker-based signature of alzheimer's disease in pre-MCI individuals
Chipi, E., Salvadori, N., Farotti, L., & Parnetti, L. (2019) · Brain Sciences · doi:10.3390/brainsci9090213 · Cited by 27
Utility of the iPad NIH Toolbox Cognition Battery in a clinical trial of older adults
Parsey, C. M., Bagger, J. E., Trittschuh, E. H., & Hanson, A. J. (2021) · Journal of the American Geriatrics Society · doi:10.1111/jgs.17382 · Cited by 14
Metadata
- Authors
- Buckley, R. F., Sparks, K. P., Papp, K. V., Dekhtyar, M., Martin, C., Burnham, S., Sperling, R. A., & Rentz, D. M.
- Venue
- The Journal of Prevention of Alzheimer's Disease
- Publisher
- Elsevier BV
- Published
- 2017
- Volume
- 4
- Issue
- 1
- Pages
- 1-9
- ISSN
- 2274-5807 (ISSN-L)
- OpenAlex
- W2916252603
- Cited by
- 60
- References
- 10
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.