Developing an Image-Based Deep Learning Framework for Automatic Scoring of the Pentagon Drawing Test
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: The Pentagon Drawing Test (PDT) is a common assessment for visuospatial function. Evaluating the PDT by artificial intelligence can improve efficiency and reliability in the big data era. This study aimed to develop a deep learning (DL) framework for automatic scoring of the PDT based on image data. Methods: A total of 823 PDT photos were retrospectively collected and preprocessed into black-and-white, square-shape images. Stratified fivefold cross-validation was applied for training and testing. Two strategies based on convolutional neural networks were compared. The first strategy was to perform an image classification task using supervised transfer learning. The second strategy was designed with an object detection model for recognizing the geometric shapes in the figure, followed by a predetermined algorithm to score based on their classes and positions. Results: On average, the first framework demonstrated 62%accuracy, 62%recall, 65%precision, 63%specificity, and 0.72 area under the receiver operating characteristic curve. This performance was substantially outperformed by the second framework, with averages of 94%, 95%, 93%, 93%, and 0.95, respectively. Conclusion: An image-based DL framework based on the object detection approach may be clinically applicable for automatic scoring of the PDT with high efficiency and reliability. With a limited sample size, transfer learning should be used with caution if the new images are distinct from the previous training data. Partitioning the problem-solving workflow into multiple simple tasks should facilitate model selection, improve performance, and allow comprehensible logic of the DL framework.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Current artificial intelligence (AI) technologies have demonstrated remarkable capabilities in healthcare diagnostics, particularly in image-based recognition systems (17–20).”
From A deep learning approach for acoustic-based identification of muscle tension dysphonia and spasmodic dysphonia (2026) · cites this paper as [20]
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Apple detection during different growth stages in orchards using the improved YOLO-V3 model
Tian, Y., Yang, G., Wang, Z., Wang, H., Li, E., & Liang, Z. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.01.012 · Cited by 1,043
Loey, M., Manogaran, G., Taha, M. H. N., & Khalifa, N. E. M. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102600 · Cited by 498
Comparative analysis of deep learning image detection algorithms
Srivastava, S., Divekar, A. V., Anilkumar, C., Naik, I., Kulkarni, V., & Pattabiraman, V. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00434-w · Cited by 350
Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study
Alzubaidi, L., Fadhel, M. A., Al-Shamma, O., Zhang, J., Santamaría, J., Duan, Y., & R. Oleiwi, S. (2020) · Applied Sciences · doi:10.3390/app10134523 · Cited by 258 · cited 2×
“However, recentstudieshaveshownthatsuchanapproachmay notalwaysbeeffective,especiallyonimagesthatare distinct from the previous training data (e.g., transfer learning from natural images to medical images) [23–25].”
Pentagon copying is more impaired in dementia with Lewy bodies than in Alzheimer's disease
A, T., Hughes, L. F., Kyrouac, G. A., Ghobrial, M. W., & Elble, R. J. (2001) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.70.4.483 · Cited by 170
Accurate and automated detection of surface knots on sawn timbers using YOLO-V5 model
Fang, Y., Guo, X., Chen, K., Zhou, Z., & Ye, Q. (2021) · BioResources · doi:10.15376/biores.16.3.5390-5406 · Cited by 160
Sánchez, S., Romero, H., & Morales, A. D. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/844/1/012024 · Cited by 155
Visuospatial working memory in Parkinson's disease.
Bradley, V. A., Welch, J. L., & Dick, D. J. (1989) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.52.11.1228 · Cited by 148
Cormack, F., Aarsland, D., Ballard, C., & Tovée, M. J. (2004) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1094 · Cited by 134
Quental, N. B. M., Brucki, S. M. D., & Bueno, O. F. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068398 · Cited by 121
Adibhatla, V. A., Chih, H.-C., Hsu, C.-C., Cheng, J., Abbod, M., & Shieh, J.-S. (2021) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2021223 · Cited by 112
Automatic dementia screening and scoring by applying deep learning on clock-drawing tests
Chen, S., Stromer, D., Alabdalrahim, H. A., Schwab, S., Weih, M., & Maier, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-74710-9 · Cited by 100
Chowdhury, N. I., Smith, T. L., Chandra, R. K., & Turner, J. H. (2019) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22196 · Cited by 99
Ting, H.-W., Chung, S., Chen, C.-F., Chiu, H.-Y., & Hsieh, Y. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05166-w · Cited by 91
Wang, Y., Li, Y., Cheng, Y., He, Z., Yang, J., Xu, J., Chi, Z., Chi, F., & Ren, D. (2019) · Ear and Hearing · doi:10.1097/aud.0000000000000794 · Cited by 81
Self-citationSjoding, M. W., Taylor, D., Motyka, J., Lee, E., Co, I., Claar, D., McSparron, J. I., Ansari, S., Kerlin, M. P., Reilly, J. P., et al. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00056-x · Cited by 81
Using Deep Learning for Image-Based Different Degrees of Ginkgo Leaf Disease Classification
Li, K., Lin, J., Liu, J., & Zhao, Y. (2020) · Information · doi:10.3390/info11020095 · Cited by 68
Caffarra, P., Gardini, S., Dieci, F., Copelli, S., Maset, L., Concari, L., Farina, E., & Grossi, E. (2013) · Behavioural Neurology · doi:10.1155/2013/728158 · Cited by 64
Amini, S., Zhang, L., Hao, B., Gupta, A., Song, M., Karjadi, C., Lin, H., Kolachalama, V. B., Au, R., & Paschalidis, I. C. (2021) · Journal of Alzheimer s Disease · doi:10.3233/jad-210299 · Cited by 64
A comparison of clock and pentagon drawing in Alzheimer's disease
Bourke, J., Castleden, C. M., Stephen, R., & Dennis, M. (1995) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.930100811 · Cited by 58
Transfer Learning Approach for Classification of Histopathology Whole Slide Images
Ahmed, S., Shaikh, A., Alshahrani, H. M., Alghamdi, A., Alrizq, M., Baber, J., & Bakhtyar, M. (2021) · Sensors · doi:10.3390/s21165361 · Cited by 49
Caffarra, P., Gardini, S., Dieci, F., et al. (2013) · PubMed · doi:10.3233/ben-120319 · Cited by 48
Mitolo, M., Salmon, D. P., Gardini, S., Galasko, D., Grossi, E., & Caffarra, P. (2014) · Journal of Alzheimer s Disease · doi:10.3233/jad-131403 · Cited by 44
Performance of the Pentagon Drawing test for the screening of older adults with Alzheimer's dementia
Martinelli, J. E., Cecato, J. F., Martinelli, M., de Melo, B. A. R., & Aprahamian, I. (2018) · Dementia & Neuropsychologia · doi:10.1590/1980-57642018dn12-010008 · Cited by 27
Ota, K., Murayama, N., Kasanuki, K., Kondo, D., Fujishiro, H., Arai, H., Sato, K., & Iseki, E. (2015) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acv016 · Cited by 25
A 5-min Cognitive Task With Deep Learning Accurately Detects Early Alzheimer's Disease
Almubark, I., Chang, L., Shattuck, K. F., Nguyen, T., Turner, R. S., & Jiang, X. (2020) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2020.603179 · Cited by 24
Intersecting pentagon copying and clock drawing test in mild and moderate Alzheimer's disease
Nagaratnam, N., Nagaratnam, K., & O'Mara, D. A. (2014) · Journal of Clinical Gerontology and Geriatrics · doi:10.1016/j.jcgg.2013.11.001 · Cited by 16
Park, I. G., Kim, Y. J., Kim, Y. J., & Lee, U. (2020) · Sensors · doi:10.3390/s20051283 · Cited by 16
Interrater Reliability of Three Clock Drawing Test Scoring Systems
South, M. B., Greve, K. W., Bianchini, K. J., & Adams, D. (2001) · Applied Neuropsychology · doi:10.1207/s15324826an0803_7 · Cited by 14
The standardised copy of pentagons test
Fountoulakis, K. Ν., Siamouli, M., Panagiotidis, P. T., Magiria, S., Kantartzis, S., Terzoglou, V. A., & Oral, T. (2011) · Annals of General Psychiatry · doi:10.1186/1744-859x-10-13 · Cited by 13
Vergouw, L. J. M., Salomé, M., Kerklaan, A. G., Kies, C., Roks, G., van den Berg, E., & de Jong, F. J. (2018) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000490045 · Cited by 12
Inter- and Intra-Rater Reliability of the New Harris-Goodenough Draw-A-Man Test
Dunn, J. A. (1967) · Perceptual and Motor Skills · doi:10.2466/pms.1967.24.1.269 · Cited by 10
Svirsky, M. A. (2019) · Ear and Hearing · doi:10.1097/aud.0000000000000817 · Cited by 5
Inter and intra-rater reliability of clock drawing test in school children
Koch, H. J., Hahn, B., & Szecsey, A. (2004) · International Journal of Clinical Practice · doi:10.1111/j.1368-5031.2004.00277.x · Cited by 2
Cited by
Chen, Z., Zhu, P., Qiu, W., Guo, J., & Li, Y. (2023) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12783 · Cited by 31
Self-citationChen, B., Li, Y., Sun, Y., Sun, H., Wang, Y., Lyu, J., Guo, J., Bao, S., Cheng, Y., Niu, X., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/51706 · Cited by 29
Self-citationPark, J. Y., Seo, E. H., Yoon, H., Won, S., & Lee, K. H. (2023) · Alzheimer s Research & Therapy · doi:10.1186/s13195-023-01283-w · Cited by 21
Tasaki, S., Kim, N., Truty, T., Zhang, A., Buchman, A. S., Lamar, M., & Bennett, D. A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00904-w · Cited by 20
Xu, Y., Qi, K., Białas, M., Xu, Q., Guo, X., & Chen, A. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1628814 · Cited by 18
Metadata
- Authors
- Li, Y., Guo, J., & Yang, P.
- Affiliations
- Vanderbilt University Medical Center (US)
- State Key Laboratory of Digital Manufacturing Equipment and Technology (CN)
- Guangdong Yunjian Intelligent Technology Co. Ltd., Foshan, Guangdong, China
- Corresponding author
- Li, Yike
- Guo, Jiajie
- ORCID
- Venue
- Journal of Alzheimer's Disease
- Publisher
- SAGE Publications
- Published
- 2022-01-04
- Volume
- 85
- Issue
- 1
- Pages
- 129-139
- ISSN
- 1387-2877 (ISSN-L)
- 1875-8908
- OpenAlex
- W3212345114
- Cited by
- 16
- References
- 41
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 4 · 2023: 6 · 2022: 2
- FWCI
- 1.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Alzheimer s Disease (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- automatic scoring
- MeSH terms
- Mental Status and Dementia Tests, Deep Learning, Cognition, Humans, Retrospective Studies, ROC Curve, Reproducibility of Results, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.