Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the Elderly
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
While considerable knowledge has been gained through the use of established cognitive and motor assessment tools, there is a considerable interest and need for the development of a battery of reliable and validated assessment tools that provide real-time and remote analysis of cognitive and motor function in the elderly. Smartphones appear to be an obvious choice for the development of these "next-generation" assessment tools for geriatric research, although to date no studies have reported on the use of smartphone-based applications for the study of cognition in the elderly. The primary focus of the current study was to assess the feasibility, reliability, and validity of a smartphone-based application for the assessment of cognitive function in the elderly. A total of 57 non-demented elderly individuals were administered a newly developed smartphone application-based Color-Shape Test (CST) in order to determine its utility in measuring cognitive processing speed in the elderly. Validity of this novel cognitive task was assessed by correlating performance on the CST with scores on widely accepted assessments of cognitive function. Scores on the CST were significantly correlated with global cognition (Mini-Mental State Exam: r = 0.515, p<0.0001) and multiple measures of processing speed and attention (Digit Span: r = 0.427, p<0.0001; Trail Making Test: r = -0.651, p<0.00001; Digit Symbol Test: r = 0.508, p<0.0001). The CST was not correlated with naming and verbal fluency tasks (Boston Naming Test, Vegetable/Animal Naming) or memory tasks (Logical Memory Test). Test re-test reliability was observed to be significant (r = 0.726; p = 0.02). Together, these data are the first to demonstrate the feasibility, reliability, and validity of using a smartphone-based application for the purpose of assessing cognitive function in the elderly. The importance of these findings for the establishment of smartphone-based assessment batteries of cognitive and motor function in the elderly is discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some groups have developed mobile applications to assess cognitive function in different populations (114, 115).”
From Could Wearable and Mobile Technology Improve the Management of Essential Tremor? (2018) · cites this paper as [114]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sheikh (1986) · doi:10.1300/j018v05n01_09 · Cited by 7,236 · cited 1×
“In addition to the UDS neuropsychological test battery, participants were also administered the Geriatric Depression Scale (GDS, 15-item version) [32] as a measure of depressive symptomatology. b. Color-Shape test.”
MethodKaplan, E., Goodglass, H., Weıntraub, S., & Segal, O. (2001) · Medical Entomology and Zoology · Cited by 4,378
Moms, J. C., Heyman, A., Mohs, R. C., Hughes, J. P., van Belle, G., Fillenbaum, G., Mellits, E. D., & Clark, C. (1989) · Neurology · doi:10.1212/wnl.39.9.1159 · Cited by 4,130 · cited 1×
“…(Logical Memory Story A Immediate Recall from the Wechsler Memory Scale-Revised, Logical Memory Story A Delayed Recall from the Wechsler Memory Scale-Revised [29]), Verbal Fluency (Animal List Generation [30] and Vegetable List Generation), and naming (Boston Naming Test - 30 odd items [31]).”
MethodThe Halstead-Reitan neuropsychological test battery: Theory and clinical interpretation
Reitan, R. M., & Wolfson, D. E. (1993) · Medical Entomology and Zoology · Cited by 3,854
Consortium to Establish a Registry for Alzheimer's Disease (CERAD)
Fillenbaum, G. G., & Heyman, A. (2002) · Principles and Practice of Geriatric Psychiatry · doi:10.1002/0470846410.ch42(iii · Cited by 2,410
(2025) · Springer Reference Medizin · doi:10.1007/978-3-662-65186-5_302294 · Cited by 2,278
Morris, J. C., Mohs, R. C., Rogers, H., Fillenbaum, G. G., & Heyman, A. (1988) · PubMed · Cited by 1,131
Boulos, M., Wheeler, S., Tavares, C., & Jones, R. (2011) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-10-24 · Cited by 1,071 · cited 1×
“Smartphones are specialized mobile phones, which contain additional computing capacity/capabilities, that are likely going to be the principal platforms for the development of the next generation of clinical care/research [9,10].”
BackgroundHealthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970
The Alzheimer's Disease Centers' Uniform Data Set (UDS): The Neuropsychologic Test Battery
Weintraub, S., Salmon, D., Mercaldo, N., Ferris, S., Graff-Radford, N. R., Chui, H., Cummings, J., DeCarli, C., Foster, N. L., Galasko, D., et al. (2009) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e318191c7dd · Cited by 888 · cited 1×
“The neuropsychological test battery from the Uniform Data Set (UDS) of the Alzheimer’s Disease Centers’ (ADC) program of the National Institute on Aging consists of brief measures of attention, processing speed, executive function, episodic memory, and language [25].”
MethodClinical Gerontology: A Guide to Assessment and Intervention
Brink, T. L. (1986) · Medical Entomology and Zoology · Cited by 594
Cockrell, J. R., & Folstein, M. F. (2002) · Principles and Practice of Geriatric Psychiatry · doi:10.1002/0470846410.ch27(ii · Cited by 483
“Telestroke”: The Application of Telemedicine for Stroke
Levine, S. R., & Gorman, M. (1999) · Stroke · doi:10.1161/01.str.30.2.464 · Cited by 419
Home telehealth—Current state and future trends
Koch, S. (2006) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.09.002 · Cited by 410 · cited 1×
“Each of these mechanisms promotes remote patient, physician, and/or student interactions, which are critical features for the next generation of clinical research/care [2–8].”
BackgroundA re-conceptualization of access for 21st century healthcare
Fortney, J. C., Burgess, J. F., Bosworth, H. B., Booth, B. M., & Kaboli, P. J. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1806-6 · Cited by 311 · cited 3×
“The ability of smartphones to be worn on the body makes them particularly attractive for geriatric studies [9–11].”
BackgroundMartin, C. K., Correa, J. B., Han, H., Allen, H. R., Rood, J. C., Champagne, C. M., Gunturk, B. K., & Bray, G. A. (2012) · Obesity · doi:10.1038/oby.2011.344 · Cited by 272
Self-citationTen years of telerehabilitation: A literature overview of technologies and clinical applications
Rogante, M., Grigioni, M., Cordella, D., & Giacomozzi, C. (2010) · NeuroRehabilitation · doi:10.3233/nre-2010-0612 · Cited by 207 · cited 2×
“Recent technological advances such as telehealth and telemedicine products have proven to be very useful in a variety of settings [2–6].”
BackgroundMethodWorringham, C., Rojek, A., & Stewart, I. (2011) · PLoS ONE · doi:10.1371/journal.pone.0014669 · Cited by 202 · cited 2×
“…for smartphone-based applications to assist in a wide range of clinical research areas and the delivery of medical care related to falls, medication adherence, food intake, depression, stroke, diabetes management, rehabilitation, medication adherence, and patient point-of-care services [9–18].”
BackgroundDistraction: an assessment of smartphone usage in health care work settings
Gill, P., Kamath, A., & Gill, T. S. (2012) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s34813 · Cited by 192
OLSHANSKY, S. J., GOLDMAN, D. P., ZHENG, Y., & ROWE, J. W. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00581.x · Cited by 182 · cited 2×
“The number of elderly individuals in the United States is growing at an unprecedented rate, with nearly 10,000 individuals a day turning 65 in the United States [1].”
BackgroundDufau, S., Duñabeitia, J. A., Moret-Tatay, C., McGonigal, A., Peeters, D., Alario, F.-X., Balota, D. A., Brysbaert, M., Carreiras, M., Ferrand, L., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024974 · Cited by 177 · cited 2×
“It is important to point out that smartphone-based studies will also likely transform the way individuals are recruited for clinical research trials by decreasing the impact of geography, clinical capacity, patient diversity, and recruitment costs [12].”
BackgroundMethodValidity of a Smartphone-based instrumented Timed Up and Go
Mellone, S., Tacconi, C., & Chiari, L. (2012) · Gait & Posture · doi:10.1016/j.gaitpost.2012.02.006 · Cited by 169
Wireless Technology in Disease Management and Medicine
Clifford, G. D., & Clifton, D. (2012) · Annual Review of Medicine · doi:10.1146/annurev-med-051210-114650 · Cited by 134
Smartphone-based solutions for fall detection and prevention: the FARSEEING approach
Mellone, S., Tacconi, C., Schwickert, L., Klenk, J., Becker, C., & Chiari, L. (2012) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-012-0404-5 · Cited by 127 · cited 1×
“For example, smartphone-based applications have been used to deliver clinical care in a non-geriatric population for a variety of conditions including rehabilitation, depression, and falls [6,12,15].”
MethodBruce‐Keller, A. J., Brouillette, R., Tudor-Locke, C. E., Foil, H. C., Gahan, W. P., Nye, D. M., Guillory, L., & Keller, J. N. (2012) · Journal of Alzheimer s Disease · doi:10.3233/jad-2012-120025 · Cited by 67
Self-citationTelementoring and Teleproctoring
Rosser, J. C., Gabriel, N. H., Herman, B., & Murayama, M. (2001) · World Journal of Surgery · doi:10.1007/s00268-001-0129-x · Cited by 67
A Multi-Sensor Monitoring System of Human Physiology and Daily Activities
Doherty, S. T., & Oh, P. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0138 · Cited by 59 · cited 2×
“The ability of smartphones to be worn on the body makes them particularly attractive for geriatric studies [9–11].”
BackgroundPreliminary Comparison of Clinical and Free-Living Measures of Stepping Cadence in Older Adults
Tudor-Locke, C. E., Barreira, T. V., Brouillette, R., Foil, H. C., & Keller, J. N. (2013) · Journal of Physical Activity and Health · doi:10.1123/jpah.10.8.1175 · Cited by 48
Self-citationBarreira, T. V., Brouillette, R. M., Foil, H. C., Keller, J. N., & Tudor-Locke, C. (2013) · Journal of Aging and Physical Activity · doi:10.1123/japa.21.4.402 · Cited by 36
Self-citationAn overview of recent end-to-end wireless medical video telemedicine systems using 3G
Panayides, A. S., Pattichis, M. S., Pattichis, C. S., Schizas, C. N., Spanias, A., & Kyriacou, E. C. (2010) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2010.5628076 · Cited by 29
Steps per Day, Peak Cadence, Body Mass Index, and Age in Community-Dwelling Older Adults
Schuna, J. M., Brouillette, R., Foil, H. C., Fontenot, S., Keller, J. N., & Tudor-Locke, C. E. (2013) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31827e47ac · Cited by 25 · cited 1×
“All 57 participants for this study were recruited from the Louisiana Aging Brain Study (LABrainS) [19–24].”
BackgroundSelf-citationBrouillette, R., Martin, C. K., Correa, J. B., Davis, A. B., Han, H., Johnson, W. D., Foil, H. C., Hymel, A., & Keller, J. N. (2011) · Journal of Alzheimer s Disease · doi:10.3233/jad-2011-101455 · Cited by 21 · cited 1×
“All 57 participants for this study were recruited from the Louisiana Aging Brain Study (LABrainS) [19–24].”
BackgroundSelf-citationBruce‐Keller, A. J., Brouillette, R., Tudor‐Locke, C., Foil, H. C., Gahan, W. P., Correa, J. B., Nye, D. M., & Keller, J. N. (2012) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2011.03762.x · Cited by 17
Self-citationComparison of older adults’ steps/day using NL-1000 pedometer and two GT3X+ accelerometer filters
Barreira, T. V., Brouillette, R., Foil, H. C., Keller, J. N., & Tudor‐Locke, C. (2012) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2012.11.713 · Cited by 5
Self-citationThe Promise of Wireless : An Overview of a Device-To-Cloud mHealth Solution
Rajan, R. (2012) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-46.s2.26 · Cited by 1
Cited by
Free‐living monitoring of Parkinson's disease: Lessons from the field
Del Din, S., Godfrey, A., Mazzà, C., Lord, S., & Rochester, L. (2016) · Movement Disorders · doi:10.1002/mds.26718 · Cited by 370
Smartphones and Health Promotion: A Review of the Evidence
Bert, F., Giacometti, M., Gualano, M. R., & Siliquini, R. (2014) · Journal of Medical Systems · doi:10.1007/s10916-013-9995-7 · Cited by 319
“Among these, 32 were identified as meeting the inclusion criteria and specifically centered on health promotion – these were subjected to further analysis [12, 14 – 45 – Nutrition Among the fastest growing areas, we certainly find the set of applications that concern nutrition and diet.”
BackgroundDementia care and COVID-19 pandemic: a necessary digital revolution
Cuffaro, L., Di Lorenzo, F., Bonavita, S., Tedeschi, G., Leocani, L., & Lavorgna, L. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04512-4 · Cited by 311
Piau, A., Wild, K., Mattek, N., & Kaye, J. (2019) · Journal of Medical Internet Research · doi:10.2196/12785 · Cited by 252
The impact of post-adoption beliefs on the continued use of health apps
Cho, J. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.12.016 · Cited by 273
Metadata
- Authors
- Brouillette, R. M., Foil, H., Fontenot, S., Correro, A., Allen, R., Martin, C. K., Bruce-Keller, A. J., & Keller, J. N.
- Affiliations
- Pennington Biomedical Research Center (US)
- Corresponding author
- Keller, Jeffrey N.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-06-11
- Volume
- 8
- Issue
- 6
- Pages
- e65925
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3679011
- OpenAlex
- W2039772841
- Cited by
- 113
- References
- 35
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 4 · 2023: 10 · 2022: 5 · 2021: 12 · 2020: 10 · 2019: 16 · 2018: 11 · 2017: 9 · 2016: 9 · 2015: 8 · 2014: 9 · 2013: 2
- FWCI
- 6.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- smartphone-based cognitive assessment, processing speed, attention, test-retest reliability, validity, feasibility, remote cognitive assessment, non-demented elderly, geriatric assessment tools
- MeSH terms
- Aged, Cognition, Dementia, Female, Humans, Male, Neuropsychological Tests, Cell Phone
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
