Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the Elderly
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
While considerable knowledge has been gained through the use of established cognitive and motor assessment tools, there is a considerable interest and need for the development of a battery of reliable and validated assessment tools that provide real-time and remote analysis of cognitive and motor function in the elderly. Smartphones appear to be an obvious choice for the development of these "next-generation" assessment tools for geriatric research, although to date no studies have reported on the use of smartphone-based applications for the study of cognition in the elderly. The primary focus of the current study was to assess the feasibility, reliability, and validity of a smartphone-based application for the assessment of cognitive function in the elderly. A total of 57 non-demented elderly individuals were administered a newly developed smartphone application-based Color-Shape Test (CST) in order to determine its utility in measuring cognitive processing speed in the elderly. Validity of this novel cognitive task was assessed by correlating performance on the CST with scores on widely accepted assessments of cognitive function. Scores on the CST were significantly correlated with global cognition (Mini-Mental State Exam: r = 0.515, p<0.0001) and multiple measures of processing speed and attention (Digit Span: r = 0.427, p<0.0001; Trail Making Test: r = -0.651, p<0.00001; Digit Symbol Test: r = 0.508, p<0.0001). The CST was not correlated with naming and verbal fluency tasks (Boston Naming Test, Vegetable/Animal Naming) or memory tasks (Logical Memory Test). Test re-test reliability was observed to be significant (r = 0.726; p = 0.02). Together, these data are the first to demonstrate the feasibility, reliability, and validity of using a smartphone-based application for the purpose of assessing cognitive function in the elderly. The importance of these findings for the establishment of smartphone-based assessment batteries of cognitive and motor function in the elderly is discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some groups have developed mobile applications to assess cognitive function in different populations (114, 115).”
From Could Wearable and Mobile Technology Improve the Management of Essential Tremor? (2018) · cites this paper as [114]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sheikh (1986) · doi:10.1300/j018v05n01_09 · Cited by 7,236 · cited 1×
“In addition to the UDS neuropsychological test battery, participants were also administered the Geriatric Depression Scale (GDS, 15-item version) [32] as a measure of depressive symptomatology. b. Color-Shape test.”
MethodKaplan, E., Goodglass, H., Weıntraub, S., & Segal, O. (2001) · Medical Entomology and Zoology · Cited by 4,378
Moms, J. C., Heyman, A., Mohs, R. C., Hughes, J. P., van Belle, G., Fillenbaum, G., Mellits, E. D., & Clark, C. (1989) · Neurology · doi:10.1212/wnl.39.9.1159 · Cited by 4,130 · cited 1×
“…(Logical Memory Story A Immediate Recall from the Wechsler Memory Scale-Revised, Logical Memory Story A Delayed Recall from the Wechsler Memory Scale-Revised [29]), Verbal Fluency (Animal List Generation [30] and Vegetable List Generation), and naming (Boston Naming Test - 30 odd items [31]).”
MethodThe Halstead-Reitan neuropsychological test battery: Theory and clinical interpretation
Reitan, R. M., & Wolfson, D. E. (1993) · Medical Entomology and Zoology · Cited by 3,854
Consortium to Establish a Registry for Alzheimer's Disease (CERAD)
Fillenbaum, G. G., & Heyman, A. (2002) · Principles and Practice of Geriatric Psychiatry · doi:10.1002/0470846410.ch42(iii · Cited by 2,410
(2025) · Springer Reference Medizin · doi:10.1007/978-3-662-65186-5_302294 · Cited by 2,278
Morris, J. C., Mohs, R. C., Rogers, H., Fillenbaum, G. G., & Heyman, A. (1988) · PubMed · Cited by 1,131
Boulos, M., Wheeler, S., Tavares, C., & Jones, R. (2011) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-10-24 · Cited by 1,071 · cited 1×
“Smartphones are specialized mobile phones, which contain additional computing capacity/capabilities, that are likely going to be the principal platforms for the development of the next generation of clinical care/research [9,10].”
BackgroundHealthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970
The Alzheimer's Disease Centers' Uniform Data Set (UDS): The Neuropsychologic Test Battery
Weintraub, S., Salmon, D., Mercaldo, N., Ferris, S., Graff-Radford, N. R., Chui, H., Cummings, J., DeCarli, C., Foster, N. L., Galasko, D., et al. (2009) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e318191c7dd · Cited by 888 · cited 1×
“The neuropsychological test battery from the Uniform Data Set (UDS) of the Alzheimer’s Disease Centers’ (ADC) program of the National Institute on Aging consists of brief measures of attention, processing speed, executive function, episodic memory, and language [25].”
Method
Cited by
Free‐living monitoring of Parkinson's disease: Lessons from the field
Del Din, S., Godfrey, A., Mazzà, C., Lord, S., & Rochester, L. (2016) · Movement Disorders · doi:10.1002/mds.26718 · Cited by 370
Smartphones and Health Promotion: A Review of the Evidence
Bert, F., Giacometti, M., Gualano, M. R., & Siliquini, R. (2014) · Journal of Medical Systems · doi:10.1007/s10916-013-9995-7 · Cited by 319
“Among these, 32 were identified as meeting the inclusion criteria and specifically centered on health promotion – these were subjected to further analysis [12, 14 – 45 – Nutrition Among the fastest growing areas, we certainly find the set of applications that concern nutrition and diet.”
BackgroundDementia care and COVID-19 pandemic: a necessary digital revolution
Cuffaro, L., Di Lorenzo, F., Bonavita, S., Tedeschi, G., Leocani, L., & Lavorgna, L. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04512-4 · Cited by 311
Piau, A., Wild, K., Mattek, N., & Kaye, J. (2019) · Journal of Medical Internet Research · doi:10.2196/12785 · Cited by 252
The impact of post-adoption beliefs on the continued use of health apps
Cho, J. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.12.016 · Cited by 273
Metadata
- Authors
- Brouillette, R. M., Foil, H., Fontenot, S., Correro, A., Allen, R., Martin, C. K., Bruce-Keller, A. J., & Keller, J. N.
- Affiliations
- Pennington Biomedical Research Center (US)
- Corresponding author
- Keller, Jeffrey N.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-06-11
- Volume
- 8
- Issue
- 6
- Pages
- e65925
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3679011
- OpenAlex
- W2039772841
- Cited by
- 113
- References
- 35
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 4 · 2023: 10 · 2022: 5 · 2021: 12 · 2020: 10 · 2019: 16 · 2018: 11 · 2017: 9 · 2016: 9 · 2015: 8 · 2014: 9 · 2013: 2
- FWCI
- 6.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- smartphone-based cognitive assessment, processing speed, attention, test-retest reliability, validity, feasibility, remote cognitive assessment, non-demented elderly, geriatric assessment tools
- MeSH terms
- Aged, Cognition, Dementia, Female, Humans, Male, Neuropsychological Tests, Cell Phone
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the Elderly. https://app.cochat.ai/papers/10.1371/journal.pone.0065925
- The paper
- Brouillette, R. M., Foil, H., Fontenot, S., Correro, A., Allen, R., Martin, C. K., Bruce-Keller, A. J., & Keller, J. N. (2013). Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the Elderly. PLoS ONE. https://doi.org/10.1371/journal.pone.0065925
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
