Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer’s disease
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Objective: Smartphones have the potential for capturing subtle changes in cognition that characterize preclinical Alzheimer’s disease (AD) in older adults. The Ambulatory Research in Cognition (ARC) smartphone application is based on principles from ecological momentary assessment (EMA) and administers brief tests of associative memory, processing speed, and working memory up to 4 times per day over 7 consecutive days. ARC was designed to be administered unsupervised using participants’ personal devices in their everyday environments. Methods: We evaluated the reliability and validity of ARC in a sample of 268 cognitively normal older adults (ages 65–97 years) and 22 individuals with very mild dementia (ages 61–88 years). Participants completed at least one 7-day cycle of ARC testing and conventional cognitive assessments; most also completed cerebrospinal fluid, amyloid and tau positron emission tomography, and structural magnetic resonance imaging studies. Results: First, ARC tasks were reliable as between-person reliability across the 7-day cycle and test-retest reliabilities at 6-month and 1-year follow-ups all exceeded 0.85. Second, ARC demonstrated construct validity as evidenced by correlations with conventional cognitive measures (r = 0.53 between composite scores). Third, ARC measures correlated with AD biomarker burden at baseline to a similar degree as conventional cognitive measures. Finally, the intensive 7-day cycle indicated that ARC was feasible (86.50% approached chose to enroll), well tolerated (80.42% adherence, 4.83% dropout), and was rated favorably by older adult participants. Conclusions: Overall, the results suggest that ARC is reliable and valid and represents a feasible tool for assessing cognitive changes associated with the earliest stages of AD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neuropathological stageing of Alzheimer-related changes.
Braak, H., & Braak, E. (1991) · Acta Neuropathologica · doi:10.1007/bf00308809 · Cited by 16,123
Desikan, R. S., Ségonne, F., Fischl, B., Quinn, B. T., Dickerson, B. C., Blacker, D., Buckner, R. L., Dale, A. M., Maguire, R. P., Hyman, B. T., et al. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.021 · Cited by 13,324
Sperling, R. A., Aisen, P. S., Beckett, L. A., Bennett, D. A., Craft, S., Fagan, A. M., Iwatsubo, T., Jack, C. R., Kaye, J., Montine, T. J., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.003 · Cited by 7,155 · cited 1×
“AD biomarkers can identify pathological changes in amyloid and tau that occur well before symptom onset (Barthélemy et al., 2020; Bateman et al., 2017; Price et al., 2009; Sperling et al., 2011).”
Self-citationEcological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · cited 5×
“EMA methods investigate psychological states and behaviors as they occur in natural environments (Shiffman et al., 2008; Sliwinski et al., 2018; Smyth & Stone, 2003).”
InfluentialBenedict, R. H. B., Schretlen, D., Groninger, L., & Brandt, J. (1998) · The Clinical Neuropsychologist · doi:10.1076/clin.12.1.43.1726 · Cited by 1,597 · cited 1×
“Correlations in the cognitively normal subsample (CDR 0 individuals) were on par with other studies which have examined such relationships (Braak & Braak, 1991; Papp et al., 2021; Snitz et al., 2020; Van Strien et al., 2009).”
Inverse relation between in vivo amyloid imaging load and cerebrospinal fluid Aβ 42 in humans
Fagan, A. M., Mintun, M. A., Mach, R. H., Lee, S., Dence, C. S., Shah, A. R., LaRossa, G. N., Spinner, M. L., Klunk, W. E., Mathis, C. A., et al. (2006) · Annals of Neurology · doi:10.1002/ana.20730 · Cited by 1,246 · cited 1×
“CSF was aliquoted at 500 μ L into polypropylene tubes and stored at − 80°C as previously described (Fagan et al., 2006).”
Self-citationThe anatomy of memory: an interactive overview of the parahippocampal–hippocampal network
van Strien, N. M., Cappaert, N. L. M., & Witter, M. P. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2614 · Cited by 1,041 · cited 1×
“Correlations in the cognitively normal subsample (CDR 0 individuals) were on par with other studies which have examined such relationships (Braak & Braak, 1991; Papp et al., 2021; Snitz et al., 2020; Van Strien et al., 2009).”
The Preclinical Alzheimer Cognitive Composite: Measuring Amyloid-Related Decline
Donohue, M. C., Sperling, R. A., Salmon, D. P., Rentz, D. M., Raman, R., Thomas, R. G., Weiner, M., & Aisen, P. S. (2014) · JAMA Neurology · doi:10.1001/jamaneurol.2014.803 · Cited by 860
Reliability: what is it, and how is it measured?
Bruton, A., Conway, J. H., & Holgate, S. T. (2000) · Physiotherapy · doi:10.1016/s0031-9406(05)61211-4 · Cited by 763 · cited 1×
“Intraclass correlations (ICCs), which show how strongly units within the same group resemble each other, were computed to examine test-retest reliability and between-person reliability such that ICCs between 0.75 and 0.90 indicate “ good ” reliability (Bruton et al., 2000).”
InfluentialNeuropathology of nondemented aging: presumptive evidence for preclinical Alzheimer disease
Price, J. L., McKeel, D. W., Buckles, V. D., Roe, C. M., Xiong, C., Grundman, M., Hansen, L. A., Petersen, R. C., Parisi, J. E., Dickson, D. W., et al. (2009) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2009.04.002 · Cited by 661 · cited 1×
“AD biomarkers can identify pathological changes in amyloid and tau that occur well before symptom onset (Barthélemy et al., 2020; Bateman et al., 2017; Price et al., 2009; Sperling et al., 2011).”
BackgroundSelf-citation
Cited by
AI-Assisted Detection of Biomarkers by Sensors and Biosensors for Early Diagnosis and Monitoring
Wasilewski, T., Kamysz, W., & Gębicki, J. (2024) · Biosensors · doi:10.3390/bios14070356 · Cited by 290
Polk, S. E., Öhman, F., Hassenstab, J., König, A., Papp, K. V., Schöll, M., & Berron, D. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01583-5 · Cited by 73
Self-citationReliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration
Staffaroni, A. M., Clark, A. L., Taylor, J. C., Heuer, H. W., Sanderson-Cimino, M., Wise, A. B., Dhanam, S., Cobigo, Y., Wolf, A., Manoochehri, M., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.4266 · Cited by 28
Self-citationWeb-based cognitive assessment in older adults: Where do we stand?
Belleville, S., LaPlume, A. A., & Purkart, R. (2023) · Current Opinion in Neurology · doi:10.1097/wco.0000000000001192 · Cited by 18
Taylor, J. C., Heuer, H. W., Clark, A. L., Wise, A. B., Manoochehri, M., Forsberg, L., Mester, C., Rao, M., Brushaber, D., Kramer, J., et al. (2023) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12423 · Cited by 20
Metadata
- Authors
- Nicosia, J., Aschenbrenner, A. J., Balota, D. A., Sliwinski, M. J., Tahan, M., Adams, S., Stout, S. S., Wilks, H., Gordon, B. A., Benzinger, T. L. S., Fagan, A. M., Xiong, C., Bateman, R. J., Morris, J. C., & Hassenstab, J.
- Venue
- Journal of the International Neuropsychological Society
- Publisher
- Cambridge University Press (CUP)
- Published
- 2022-09-05
- Volume
- 29
- Issue
- 5
- Pages
- 459-471
- ISSN
- 1355-6177 (ISSN-L)
- 1469-7661
- OpenAlex
- W4294592241
- Cited by
- 106
- References
- 23
- FWCI
- 11.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer’s disease. https://app.cochat.ai/papers/10.1017/s135561772200042x
- The paper
- Nicosia, J., Aschenbrenner, A. J., Balota, D. A., Sliwinski, M. J., Tahan, M., Adams, S., Stout, S. S., Wilks, H., Gordon, B. A., Benzinger, T. L. S., Fagan, A. M., Xiong, C., Bateman, R. J., Morris, J. C., & Hassenstab, J. (2023). Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer’s disease. Journal of the International Neuropsychological Society. https://doi.org/10.1017/s135561772200042x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.