CoChat

Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence

Open access
Libon, David J., Swenson, Rod, Price, Catherine C., Lamar, Melissa, Cosentino, Stephanie, Bezdicek, Ondrej, Kling, Mitchel A., Tobyne, Sean, Jannati, Ali, Banks, Russell, Pascual-Leone, Alvaro · 2024 · Frontiers in Psychology

The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.

Abstract

Introduction: A rapid and reliable neuropsychological protocol is essential for the efficient assessment of neurocognitive constructs related to emergent neurodegenerative diseases. We developed an AI-assisted, digitally administered/scored neuropsychological protocol that can be remotely administered in ~10 min. This protocol assesses the requisite neurocognitive constructs associated with emergent neurodegenerative illnesses. Methods: The protocol was administered to 77 ambulatory care/memory clinic patients (56.40% women; 88.50% Caucasian). The protocol includes a 6-word version of the Philadelphia (repeatable) Verbal Learning Test [P(r)VLT], three trials of 5 digits backward from the Backwards Digit Span Test (BDST), and the “animal” fluency test. The protocol provides a comprehensive set of traditional “core” measures that are typically obtained through paper-and-pencil tests (i.e., serial list learning, immediate and delayed free recall, recognition hits, percent correct serial order backward digit span, and “animal” fluency output). Additionally, the protocol includes variables that quantify errors and detail the processes used in administering the tests. It also features two separate, norm-referenced summary scores specifically designed to measure executive control and memory. Results: Using four core measures, we used cluster analysis to classify participants into four groups: cognitively unimpaired (CU; n = 23), amnestic mild cognitive impairment (MCI; n = 17), dysexecutive MCI ( n = 23), and dementia ( n = 14). Subsequent analyses of error and process variables operationally defined key features of amnesia (i.e., rapid forgetting, extra-list intrusions, profligate responding to recognition foils); key features underlying reduced executive abilities (i.e., BDST items and dysexecutive errors); and the strength of the semantic association between successive responses on the “animal” fluency test. Executive and memory index scores effectively distinguished between all four groups. There was over 90% agreement between how cluster analysis of digitally obtained measures classified patients compared to classification using a traditional comprehensive neuropsychological protocol. The correlations between digitally obtained outcome variables and analogous paper/pencil measures were robust. Discussion: The digitally administered protocol demonstrated a capacity to identify patterns of impaired performance and classification similar to those observed with standard paper/pencil neuropsychological tests. The inclusion of both core measures and detailed error/process variables suggests that this protocol can detect subtle, nuanced signs of early emergent neurodegenerative illness efficiently and comprehensively.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2024.1415629

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 57 references

Research works printed but not linked: 10

  1. Bauer, 2012, “Amnestic disorders,”, 504
  2. Butters, 1985, “Amnesic disorders,”, 403
  3. Delis, 1987, The California Verbal Learning Test, 1st Edn
  4. Heaton, 2004, Revised Comprehensive Norms for an Expanded Halstead-Reitan Battery: Demographically Adjusted Neuropsychological Norms for African American and Caucasian Adults Scoring Programs
  5. 2001, Crossing the Quality Chasm: A New Health System for the 21st Century
  6. Kaplan, 1991, The WAIS-R as a Neuropsychological Instrument
  7. Libon, Double dissociation of verbal serial list learning and semantic fluency test performance through automated analysis of acoustics, Front. Neurol.
  8. Penney, “The Digital Clock Drawing Test (dCDT) - II: A new computerized quantitative System,”
  9. Penney, “The Digital Clock Drawing Test (dCDT) - III: Clinician reliability for a new quantitative system,”
  10. Penney, “Digital Clock Drawing Test (dCBT) - IV: Total clock drawing and inter-stroke latencies or information revealed between the lines,”

Cited by

See all 16

Metadata

Authors
Libon, D. J., Swenson, R., Price, C. C., Lamar, M., Cosentino, S., Bezdicek, O., Kling, M. A., Tobyne, S., Jannati, A., Banks, R., & Pascual-Leone, A.
Affiliations
  • Rowan University (US)
  • University of North Dakota (US)
  • University of Florida (US)
  • Rush University Medical Center (US)
  • Columbia University Irving Medical Center (US)
  • Harvard University (US)
Corresponding author
Libon, David J.
Venue
Frontiers in Psychology
Published
2024-07-05
Volume
15
Pages
1415629-1415629
ISSN
1664-1078 (ISSN-L)
OpenAlex
W4400357021
Cited by
16
References
56
Citations by year
2026: 9 · 2025: 6 · 2024: 1
FWCI
4.70
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
  • Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords
digital neuropsychological assessment, neurodegenerative diseases, artificial intelligence, remote cognitive testing, Animal Fluency Test, amnesia, executive dysfunction, memory impairment, early detection of neurodegeneration, memory clinic patients

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence. https://app.cochat.ai/papers/10.3389/fpsyg.2024.1415629
The paper
Libon, D. J., Swenson, R., Price, C. C., Lamar, M., Cosentino, S., Bezdicek, O., Kling, M. A., Tobyne, S., Jannati, A., Banks, R., & Pascual-Leone, A. (2024). Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1415629

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.