CoChat

Developing an Image-Based Deep Learning Framework for Automatic Scoring of the Pentagon Drawing Test

Li, Yike, Guo, Jiajie, Yang, Peikai · 2022 · Journal of Alzheimer's Disease

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.

Abstract

Background: The Pentagon Drawing Test (PDT) is a common assessment for visuospatial function. Evaluating the PDT by artificial intelligence can improve efficiency and reliability in the big data era. This study aimed to develop a deep learning (DL) framework for automatic scoring of the PDT based on image data. Methods: A total of 823 PDT photos were retrospectively collected and preprocessed into black-and-white, square-shape images. Stratified fivefold cross-validation was applied for training and testing. Two strategies based on convolutional neural networks were compared. The first strategy was to perform an image classification task using supervised transfer learning. The second strategy was designed with an object detection model for recognizing the geometric shapes in the figure, followed by a predetermined algorithm to score based on their classes and positions. Results: On average, the first framework demonstrated 62%accuracy, 62%recall, 65%precision, 63%specificity, and 0.72 area under the receiver operating characteristic curve. This performance was substantially outperformed by the second framework, with averages of 94%, 95%, 93%, 93%, and 0.95, respectively. Conclusion: An image-based DL framework based on the object detection approach may be clinically applicable for automatic scoring of the PDT with high efficiency and reliability. With a limited sample size, transfer learning should be used with caution if the new images are distinct from the previous training data. Partitioning the problem-solving workflow into multiple simple tasks should facilitate model selection, improve performance, and allow comprehensible logic of the DL framework.

Overview

Integrity signals

Registry

Crossref · 10.3233/jad-210714

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 16

Metadata

Authors
Li, Y., Guo, J., & Yang, P.
Affiliations
  • Vanderbilt University Medical Center (US)
  • State Key Laboratory of Digital Manufacturing Equipment and Technology (CN)
  • Guangdong Yunjian Intelligent Technology Co. Ltd., Foshan, Guangdong, China
Corresponding author
  • Li, Yike
  • Guo, Jiajie
Venue
Journal of Alzheimer's Disease
Published
2022-01-04
Volume
85
Issue
1
Pages
129-139
ISSN
  • 1387-2877 (ISSN-L)
  • 1875-8908
OpenAlex
W3212345114
Cited by
16
References
41
Citations by year
2026: 2 · 2025: 2 · 2024: 4 · 2023: 6 · 2022: 2
FWCI
1.08
Type
journal article
Language
en
Open access
closed
Locations
  • Journal of Alzheimer s Disease (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
automatic scoring
MeSH terms
Mental Status and Dementia Tests, Deep Learning, Cognition, Humans, Retrospective Studies, ROC Curve, Reproducibility of Results, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.