Performance of a computer‐based assessment of cognitive function measures in two cohorts of seniors
Open accessAbstract
Background: Computer‐administered assessment of cognitive function is being increasingly incorporated in clinical trials; however, its performance in these settings has not been systematically evaluated. Design: The Seniors Health and Activity Research Program pilot trial (N = 73) developed a computer‐based tool for assessing memory performance and executive functioning. The Lifestyle Interventions and Independence for Elders investigators incorporated this battery in a full‐scale multicenter clinical trial (N = 1635). We describe relationships that test scores have with those from interviewer‐administered cognitive function tests and risk factors for cognitive deficits and describe performance measures (completeness, intraclass correlations [ICC]). Results: Computer‐based assessments of cognitive function had consistent relationships across the pilot and full‐scale trial cohorts with interviewer‐administered assessments of cognitive function, age, and a measure of physical function. In the Lifestyle Interventions and Independence for Elders cohort, their external validity was further demonstrated by associations with other risk factors for cognitive dysfunction: education, hypertension, diabetes, and physical function. Acceptable levels of data completeness (>83%) were achieved on all computer‐based measures; however, rates of missing data were higher among older participants (odds ratio = 1.06 for each additional year; p < 0.001) and those who reported no current computer use (odds ratio = 2.71; p < 0.001). ICCs among clinics were at least as low (ICC < 0.013) as for interviewer measures (ICC < 0.023), reflecting good standardization. All cognitive measures loaded onto the first principal component (global cognitive function), which accounted for 40% of the overall variance. Conclusion: Our results support the use of computer‐based tools for assessing cognitive function in multicenter clinical trials of older individuals. Copyright © 2013 John Wiley & Sons, Ltd.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
n-back depends on functions such as updating, inhibition, and attention, not simply working memory capacity.
“Research suggests that n-back is not simply a measure of working memory capacity but depends on functions such as updating, inhibition, and attention [52].”
From Wearable technology for high-frequency cognitive and mood assessment in major depressive disorder: longitudinal observational study (2019) · cites this paper as [52]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Guralnik, J. M., Simonsick, E. M., Ferrucci, L., Glynn, R. J., Berkman, L. F., Blazer, D. G., Scherr, P. A., & Wallace, R. B. (1994) · Journal of Gerontology · doi:10.1093/geronj/49.2.m85 · Cited by 9,792 · see citing works
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230 · see citing works
Lower-extremity function in persons over the age of 70 years as a predictor of subsequent disability
Guralnik, J. M., Ferrucci, L., Simonsick, E. M., Salive, M. E., & Wallace, R. B. (1995) · New England Journal of Medicine · doi:10.1056/nejm199503023320902 · Cited by 4,083 · see citing works
Costs of a predictible switch between simple cognitive tasks.
Rogers, R. D., & Monsell, S. (1995) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.124.2.207 · Cited by 3,170 · see citing works
(1987) · PubMed · Cited by 2,657 · see citing works
The hopkins verbal learning test: Development of a new memory test with six equivalent forms
Brandt, J. (1991) · Clinical Neuropsychologist · doi:10.1080/13854049108403297 · Cited by 1,317 · see citing works
Awh, E., Jonides, J., Smith, E. E., Schumacher, E. H., Koeppe, R. A., & Katz, S. (1996) · Psychological Science · doi:10.1111/j.1467-9280.1996.tb00662.x · Cited by 705 · see citing works
The Lifestyle Interventions and Independence for Elders Study: Design and Methods
Fielding, R. A., Rejeski, W. J., Blair, S. N., Church, T. S., Espeland, M. A., Gill, T. M., Guralnik, J. M., Hsu, F.-C., Katula, J. A., King, A. C., et al. (2011) · The Journals of Gerontology Series A · doi:10.1093/gerona/glr123 · Cited by 281 · see citing works
Self-citationFredrickson, J., Maruff, P. T., Woodward, M., Moore, L., Fredrickson, A., Sach, J., & Darby, D. (2009) · Neuroepidemiology · doi:10.1159/000264823 · Cited by 236 · see citing works
Guidelines for computer-based tests and interpretations
(1986) · PsycEXTRA Dataset · doi:10.1037/e502052009-001 · Cited by 190 · see citing works
Caffeine Improves Physical and Cognitive Performance during Exhaustive Exercise
Hogervorst, E., Bandelow, S., Schmitt, J. A. J., Jentjens, R. L. P. G., Oliveira, M., Allgrove, J. E., CARTER, T., & Gleeson, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31817bb8b7 · Cited by 186 · see citing works
Parsons, T. D., & Rizzo, A. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.9934 · Cited by 172 · see citing works
Clark, C. R., Paul, R. H., Williams, L. M., Arns, M., Fallahpour, K., HANDMER, C., & GORDON, E. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2006.06.005 · Cited by 145 · see citing works
Edwards, L. M., Murray, A. J., Holloway, C. J., Carter, E. E., Kemp, G. J., Codreanu, I., Brooker, H. J., Tyler, D. J., Robbins, P. A., & Clarke, K. (2010) · The FASEB Journal · doi:10.1096/fj.10-171983 · Cited by 127 · see citing works
the SHARP-P Study Group, Legault, C., Jennings, J. M., Katula, J. A., Dagenbach, D., Gaussoin, S. A., Sink, K. M., Rapp, S. R., Rejeski, W. J., Shumaker, S. A., et al. (2011) · BMC Geriatrics · doi:10.1186/1471-2318-11-27 · Cited by 126 · see citing works
Self-citationMaerlender, A., Flashman, L. A., Kessler, A., Kumbhani, S. R., Greenwald, R., Tosteson, T. D., & McAllister, T. W. (2010) · The Clinical Neuropsychologist · doi:10.1080/13854046.2010.516072 · Cited by 120 · see citing works
Human Factors Interventions for the Health Care of Older Adults
(2001) · doi:10.1201/b12459 · Cited by 117 · see citing works
Jennings, J. M., Webster, L. M., Kleykamp, B. A., & Dagenbach, D. (2005) · Aging, Neuropsychology, and Cognition · doi:10.1080/138255890968312 · Cited by 115 · see citing works
Self-citationde Jager, C. A., Schrijnemaekers, A.-C., Honey, T. E. M., & Budge, M. M. (2009) · Age and Ageing · doi:10.1093/ageing/afp068 · Cited by 113 · see citing works
The Role of Memory in the Age Decline in Digit-Symbol Substitution Performance
Salthouse, T. A. (1978) · Journal of Gerontology · doi:10.1093/geronj/33.2.232 · Cited by 109 · see citing works
Koski, L. M., Brouillette, M.-J., Lalonde, R., Hello, B., Wong, E., Tsuchida, A., & Fellows, L. K. (2011) · HIV Medicine · doi:10.1111/j.1468-1293.2010.00910.x · Cited by 85 · see citing works
Collerton, J. C., Collerton, D., Arai, Y., Barrass, K., Eccles, M., Jagger, C., McKeith, I. G., Saxby, B. K., Kirkwood, T. B. L., & the Newcastle 85+ Study Core Team (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01379.x · Cited by 80 · see citing works
Doniger, G. M., Dwolatzky, T., Zucker, D. M., Chertkow, H. M., Crystal, H., Schweiger, A., & Simon, E. S. (2006) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/153331750602100105 · Cited by 77 · see citing works
Carroll, K. M., Kiluk, B. D., Nich, C., Babuscio, T. A., Brewer, J. A., Potenza, M. N., Ball, S. A., Martino, S., Rounsaville, B. J., & Lejuez, C. W. (2010) · Substance Use & Misuse · doi:10.3109/10826084.2011.521069 · Cited by 75 · see citing works
Calkins, M., Tepper, P., Gur, R., Ragland, J., Klei, L., Wiener, H., Richard, J., Savage, R. M., Allen, T., O'Jile, J., et al. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.08091351 · Cited by 72 · see citing works
Practicality of a computerized system for cognitive assessment in the elderly
Fillit, H. M., Simon, E. S., Doniger, G. M., & Cummings, J. L. (2008) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2007.09.008 · Cited by 68 · see citing works
Examining cognitive function across the lifespan using a mobile application
Lee, H., Baniqued, P. L., Cosman, J. D., Mullen, S. P., McAuley, E., Severson, J., & Kramer, A. F. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2012.05.013 · Cited by 61 · see citing works
Self-citationBryan, C. J., & Hernandez, A. M. (2012) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e318238f146 · Cited by 43 · see citing works
Assessment of the effects of AZD3480 on cognitive function in patients with schizophrenia
Velligan, D. I., Brenner, R., Sicuro, F., Walling, D. P., Riesenberg, R. A., Sfera, A., Merideth, C., Sweitzer, D. E., & Jaeger, J. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2011.10.004 · Cited by 36 · see citing works
Concurrent Validity of a Computer-Based Cognitive Screening Tool for Use in Adults with HIV Disease
Becker, J. T., Dew, M. A., Aizenstein, H. J., López, O. L., Morrow, L. A., & Saxton, J. A. (2011) · AIDS Patient Care and STDs · doi:10.1089/apc.2011.0051 · Cited by 32 · see citing works
O'Halloran, J. P., Kemp, A. S., Gooch, K. N., Harvey, P. D., Palmer, B. W., Reist, C., & Schneider, L. S. S. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.11.015 · Cited by 28 · see citing works
Neuro-QOL and the NIH Toolbox: implications for epilepsy
Nowinski, C. J., Victorson, D. E., Cavazos, J. E., Gershon, R. C., & Cella, D. F. (2010) · Therapy · doi:10.2217/thy.10.55 · Cited by 24 · see citing works
Espeland, M. A., Rapp, S. R., Katula, J. A., Andrews, L., Felton, D., Gaussoin, S. A., Dagenbach, D., Legault, C., Jennings, J. M., Sink, K. M., et al. (2010) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2503 · Cited by 22 · see citing works
Self-citationComputerized Cognitive Assessment of Mild Cognitive Impairment in Urban African Americans
Doniger, G. M., Jo, M.-Y., Simon, E. S., & Crystal, H. (2009) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/1533317509342982 · Cited by 12 · see citing works
Ichimura, S., Ohira, T., Kobayashi, M., Kano, T., Akiyama, T., Orii, M., FUKUNAGA, A., & Kawase, T. (2010) · Neurologia medico-chirurgica · doi:10.2176/nmc.50.441 · Cited by 11 · see citing works
Flagged first, then by citations
1 of the 36 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- National Research Council The Prevention and Treatment of Missing Data in Clinical Trials Panel on Handling Missing Data in Clinical Trials 2010 Committee on National Statistics, Division of Behavioral and Social Sciences and Education The National Academies Press Washington, DC
Cited by
Sorted by citations
Espeland, M. A., Lipska, K. J., Miller, M. E., Rushing, J., Cohen, R. A., Verghese, J., McDermott, M. M., King, A. C., Strotmeyer, E. S., Blair, S. N., et al. (2016) · The Journals of Gerontology Series A · doi:10.1093/gerona/glw179 · Cited by 110 · see citing works
Self-citationCormack, F., McCue, M., Taptiklis, N., Skirrow, C., Glazer, E., Panagopoulos, E., van Schaik, T. A., Fehnert, B., King, J., & Barnett, J. H. (2019) · JMIR Mental Health · doi:10.2196/12814 · Cited by 79 · see citing works
Gates, N. J., & Kochan, N. A. (2015) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000141 · Cited by 56 · see citing works
Assessing Executive Function Using a Computer Game: Computational Modeling of Cognitive Processes
Hagler, S., Jimison, H. B., & Misha Pavel, C. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2299793 · Cited by 53 · see citing works
Newman, A. B., Dodson, J. A., Church, T. S., Buford, T. W., Fielding, R. A., Kritchevsky, S. B., Beavers, D. P., Pahor, M., Stafford, R. S., Szady, A. D., et al. (2016) · JAMA Cardiology · doi:10.1001/jamacardio.2016.1324 · Cited by 35 · see citing works
Self-citationEspeland, M. A., Newman, A. B., Sink, K. M., Gill, T. M., King, A. C., Miller, M. E., Guralnik, J. M., Katula, J. A., Church, T. S., Manini, T. M., et al. (2015) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2015.03.010 · Cited by 24 · see citing works
Self-citationHuppert, T. J., Karim, H. T., Lin, C.-C., Alqahtani, B. A., Greenspan, S. L., & Sparto, P. J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184918 · Cited by 23 · see citing works
A Tablet-PC-Based Cancellation Test Assessing Executive Functions in Older Adults
Wu, Y.-H., Vidal, J., de Rotrou, J., Sikkes, S. A. M., Rigaud, A., & Plichart, M. (2015) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2015.05.012 · Cited by 22 · see citing works
Christopoulou, S., Kotsilieris, T., & Anagnostopoulos, I. (2018) · Healthcare · doi:10.3390/healthcare6030109 · Cited by 20 · see citing works
The LIFE Cognition Study: design and baseline characteristics
Sink, K. M., Williamson, J. D., Espeland, M. A., Rushing, J., Castro, C. M., Church, T. R., Cohen, R., Gill, T. M., Henkin, L. F., Jennings, J., et al. (2014) · Clinical Interventions in Aging · doi:10.2147/cia.s65381 · Cited by 19 · see citing works
Self-citationCormack, F. K., McCue, M., Skirrow, C., Cashdollar, N. M., Taptiklis, N., van Schaik, T. A., Fehnert, B., King, J., Chrones, L., Sarkey, S., et al. (2023) · JMIR Mental Health · doi:10.2196/46895 · Cited by 14 · see citing works
Evidence-based health and clinical informatics: a systematic review on randomized controlled trials
Christopoulou, S. C., Kotsilieris, T., & Anagnostopoulos, I. E. (2017) · Health and Technology · doi:10.1007/s12553-016-0170-2 · Cited by 7 · see citing works
Towards adopting serious games for cognitive tests with Brazilian older people
do Amaral, L. A., Fortes, R. P. D. M., Chagas, M. H. N., Castro, P. C., Bittar, T. J., & Lobato, L. L. (2019) · Journal on Interactive Systems · doi:10.5753/jis.2019.715 · Cited by 4 · see citing works
Hagler, S. (2014) · OHSU Digital Commons · doi:10.6083/m4d50kp8 · Cited by 2 · see citing works
Serious games como apoio para avaliação e treinamento cognitivo na senescência
do Amaral, L. A. (2020) · doi:10.11606/t.55.2020.tde-08062020-092328 · Cited by 1 · see citing works
Rute-Pérez, S., Rodríguez-Domínguez, C., Sáez-Sanz, N., Pérez-Garcı́a, M., & Caracuel, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14072153
- Authors
- Espeland, M. A., Katula, J. A., Rushing, J., Kramer, A. F., Jennings, J. M., Sink, K. M., Nadkarni, N. K., Reid, K. F., Castro, C. M., Church, T., Kerwin, D. R., Williamson, J. D., Marottoli, R. A., Rushing, S., Marsiske, M., Rapp, S. R., & LIFE Study Group
- Affiliations
- Wake Forest University Health Sciences (US)
- Wake Forest University (US)
- University of Illinois Urbana-Champaign (US)
- University of Pittsburgh (US)
- Tufts University (US)
- Stanford University (US)
- Pennington Biomedical Research Center (US)
- Northwestern University (US)
- Yale University (US)
- University of Florida Health (US)
- Corresponding author
- Espeland, Mark A.
- ORCID
- Venue
- International Journal of Geriatric Psychiatry
- Publisher
- Wiley
- Published
- 2013-04-16
- Volume
- 28
- Issue
- 12
- Pages
- 1239-1250
- ISSN
- 0885-6230 (ISSN-L)
- 1099-1166
- PMC
- PMC3775886
- OpenAlex
- W1556406674
- Cited by
- 16
- References
- 36
- Citations by year
- 2025: 1 · 2023: 1 · 2020: 1 · 2019: 2 · 2018: 1 · 2017: 2 · 2016: 2 · 2015: 3 · 2014: 3
- FWCI
- 1.89
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Journal of Geriatric Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR000064)
- National Institute on Aging (U01AG22376, U01AG022376, 3U01AG022376-05A2S, R01AG029285, P30AG024827, P30AG028740, P30AG021332)
- National Institute of Diabetes and Digestive and Kidney Diseases (U01DK057136)
- National Center for Research Resources (UL1RR029890, M01RR007122)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Cancer-related cognitive impairment studies
- Keywords
- cognitive function, older adults, memory performance, executive function, generalizability, data completeness, missing data, intraclass correlation coefficient, physical function, cognitive risk factors, global cognitive function
- MeSH terms
- Aged, Aged, 80 and over, Cognition Disorders, Diagnosis, Computer-Assisted, Female, Humans, Life Style, Male, Pilot Projects, Risk Factors, Cohort Studies, Cognitive Behavioral Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
