Artificial Intelligence for Cognitive Health Assessment: State-of-the-Art, Open Challenges and Future Directions
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The subjectivity and inaccuracy of in-clinic Cognitive Health Assessments (CHA) have led many researchers to explore ways to automate the process to make it more objective and to facilitate the needs of the healthcare industry. Artificial Intelligence (AI) and machine learning (ML) have emerged as the most promising approaches to automate the CHA process. In this paper, we explore the background of CHA and delve into the extensive research recently undertaken in this domain to provide a comprehensive survey of the state-of-the-art. In particular, a careful selection of significant works published in the literature is reviewed to elaborate a range of enabling technologies and AI/ML techniques used for CHA, including conventional supervised and unsupervised machine learning, deep learning, reinforcement learning, natural language processing, and image processing techniques. Furthermore, we provide an overview of various means of data acquisition and the benchmark datasets. Finally, we discuss open issues and challenges in using AI and ML for CHA along with some possible solutions. In summary, this paper presents CHA tools, lists various data acquisition methods for CHA, provides technological advancements, presents the usage of AI for CHA, and open issues, challenges in the CHA domain. We hope this first-of-its-kind survey paper will significantly contribute to identifying research gaps in the complex and rapidly evolving interdisciplinary mental health field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“In this section, various ML techniques, including deep learning [102], supervised and unsupervised approaches [103], Reinforcement Learning [104], Natural Language Processing [105], and Computer Vision [106] have been discussed to assess the cognitive health of a person.”
BackgroundThe future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015 · cited 1×
“In this way, the FL can solve the multi-hospital collaboration issue of lack of adequate data [296].”
BackgroundThe Future of Digital Health with Federated Learning
Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B., Maier-Hein, K., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.08119 · Cited by 3,495
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076 · cited 1×
“A dataset for the classification task consists of data from all the classes, and an unsupervised algorithm is not privy to this knowledge [146].”
MethodBig data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034
2019 Alzheimer’s disease facts and figures.
Alzheimer's Association (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2019.01.010 · Cited by 2,461 · cited 1×
“Forecasts suggest that early diagnosis in the MCI stage in the year 2050 can bring health care costs down by $231 billion [5].”
BackgroundIndustry 5.0: A survey on enabling technologies and potential applications
Maddikunta, P. K. R., Pham, Q.-V., B, P., Deepa, N., Dev, K., Gadekallu, T. R., Ruby, R., & Liyanage, M. (2022) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2021.100257 · Cited by 1,890
Self-citationAdvances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · cited 1×
“Natural Language Processing (NLP) is the ability of computers to understand the verbal and written communication of human beings [190, 191].”
BackgroundArtificial intelligence for mental health and mental illnesses: an overview
Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H.-C., & Jeste, D. V. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1094-0 · Cited by 970
Hierarchical Feature Representation and Multimodal Fusion with Deep Learning for AD/MCI Diagnosis
Suk, H.-I., Lee, S.-W., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.077 · Cited by 968 · cited 1×
“The technique presented in [174] is a novel method for a high-level latent feature representation from neuroimaging data via an ensemble classifier.”
MethodFederated learning for smart healthcare: A survey
Nguyen, D. C., Pham, Q.-V., Pathirana, P. N., Ding, M., Seneviratne, A., Lin, Z., Dobre, O., & Hwang, W.-J. (2023) · ACM Computing Surveys · doi:10.1145/3501296 · Cited by 827 · cited 1×
“FL, in which the raw data need not be transferred to the central storage, can be a possible solution to solve this issue [294, 295].”
BackgroundBasaia, S., Agosta, F., Wagner, L., Canu, E., Magnani, G., Santangelo, R., & Filippi, M. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.101645 · Cited by 738
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v1 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · Applied Sciences · doi:10.3390/app7101101 · Cited by 596
UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones
Micucci, D., Mobilio, M., & Napoletano, P. (2017) · doi:10.20944/preprints201706.0033.v2 · Cited by 596
Diagnosis-Independent Alzheimer Disease Biomarker Signature in Cognitively Normal Elderly People
De Meyer, G. (2010) · Archives of Neurology · doi:10.1001/archneurol.2010.179 · Cited by 462
Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease
König, A., Satt, A., Sorin, A., Hoory, R., Toledo‐Ronen, O., Derreumaux, A., Manera, V., Verhey, F., Aalten, P., Robert, P. H., et al. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.012 · Cited by 380 · cited 1×
“To distinguish between MCI and early-stage Alzheimer’s, patients are asked to perform tasks such as countdown, picture description, Scene description, and Semantic fluency (animals) [207].”
BackgroundToth, L., Hoffmann, I., Gosztolya, G., Vincze, V., Szatloczki, G., Banreti, Z., Pakaski, M., & Kalman, J. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666171121114930 · Cited by 290 · cited 2×
“Authors in [194] asked Patients to give spon-taneous answers to the questions asked by an expert by recalling two short back and white films.”
Bzdok, D., Krzywinski, M., & Altman, N. (2017) · Nature Methods · doi:10.1038/nmeth.4526 · Cited by 246 · cited 1×
“AI/ ML algorithms need a large volume of data to train [293].”
BackgroundMachine learning for comprehensive forecasting of Alzheimer’s Disease progression
Fisher, C. K., Smith, A. M., Walsh, J. R., Diseases, C. A. M., Simon, A. J., Edgar, C., Jack, C. R., Holtzman, D., Russell, D., Hill, D., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-49656-2 · Cited by 223 · cited 2×
“Authors in [150] employed a Conditional Restricted Boltzmann Machine to simulate Alzheimer’s disease progression from a 1909 patient.”
BackgroundMethodCurrent advances in digital cognitive assessment for preclinical Alzheimer's disease
Öhman, F., Hassenstab, J., Berron, D., Schöll, M., & Papp, K. V. (2021) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12217 · Cited by 214 · cited 1×
“Authors in [58] reviewed 11 research studies that discuss different computerised assessment techniques like tablet-based cognitive assessment, remotely administered tablet and smartphone-based cognitive assessment, and other recent data collection systems and analysis procedures like speech, eye…”
BackgroundBeltrami, D., Gagliardi, G., Rossini Favretti, R., Ghidoni, E., Tamburini, F., & Calzà, L. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00369 · Cited by 175
Explainable AI for 6G Use Cases: Technical Aspects and Research Challenges
Wang, S., Qureshi, M. A., Miralles-Pechuán, L., Huynh-The, T., Gadekallu, T. R., & Liyanage, M. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3386872 · Cited by 170
Self-citationPredicting probable Alzheimer's disease using linguistic deficits and biomarkers
Orimaye, S. O., Wong, J. S.-M., Golden, K. J., Wong, C. P., & Soyiri, I. N. (2017) · BMC Bioinformatics · doi:10.1186/s12859-016-1456-0 · Cited by 158 · cited 1×
“Therefore they introduced a new direction of cognitive health assessment through NLP. Authors in [211] an algorithm is proposed for predicting probable Alzheimer’s disease using linguistic deficits and biomarkers with the help of NLP and machine learning.”
Activity recognition and anomaly detection in smart homes
Fahad, L. G., & Tahir, S. F. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.102 · Cited by 86
Fully Automatic Speech-Based Analysis of the Semantic Verbal Fluency Task
König, A., Linz, N., Tröger, J., Wolters, M., Alexandersson, J., & Robert, P. (2018) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000487852 · Cited by 77 · cited 1×
“Authors in [212] automated analysis of Semantic Verbal Fluency (SVF) tests method is discussed for detection of MCI.”
MethodDementia medical screening using mobile applications: A systematic review with a new mapping model
Thabtah, F., Peebles, D., Retzler, J., & Hathurusingha, C. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103573 · Cited by 69 · cited 1×
“Authors in [62] reviewed different applications used for medical assessment of dementia and AD and presented a summary of features evaluated by different AD screening apps.”
MethodBloch, L., Friedrich, C. M., & Initiative, F. T. A. D. N. (2021) · Alzheimer's Research & Therapy · doi:10.1186/s13195-021-00879-4 · Cited by 68 · cited 1×
“…most famous NeuroImaging datasets are the Alzheimer’s Disease NeuroImaging Initiative (ADNI) dataset [242–247], Australian Imaging biomarkers and lifestyle study (AIBL) [248–252], Open Access Series of Imaging Studies (OASIS-3) [122, 253–256], Internet Brain Segmentation Repository (IBSR) [257–260”
BackgroundAn automatic Alzheimer’s disease classifier based on spontaneous spoken English
Bertini, F., Allevi, D., Lutero, G., Calzà, L., & Montesi, D. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2021.101298 · Cited by 66 · cited 4×
“NLP has been used in assesment [193] and detection [105, 194–200] of cognitive health.”
BackgroundMethodInfluentialTsai, C.-F., Chen, C.-C., Wu, E. H.-K., Chung, C.-R., Huang, C.-Y., Tsai, P.-Y., & Yeh, S.-C. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3118918 · Cited by 49
Baydargil, H. B., Park, J.-S., & Kang, D.-Y. (2021) · Applied Sciences · doi:10.3390/app11052187 · Cited by 30 · cited 2×
“Authors in [162] explore the anomaly analysis of Alzheimer’s disease using PET images for GANs.”
BackgroundTraMiner: vision-based analysis of locomotion traces for cognitive assessment in smart-homes
Zolfaghari, S., Khodabandehloo, E., & Riboni, D. (2022) · Cognitive Computation · doi:10.1007/s12559-020-09816-3 · Cited by 29 · cited 1×
“The most commonly used were the VanKasteren dataset [264–267], Center of Advanced Studies in Adaptive Systems (CASAS) dataset [268–271], and UCI HAR dataset [272–274].”
Methodde la Fuente Garcia, S., Ritchie, C. W., & Luz, S. (2020) · Journal of Alzheimer's Disease · doi:10.3233/jad-200888 · Cited by 5
Cited by
Vimbi, V., Shaffi, N., & Mahmud, M. (2024) · Brain Informatics · doi:10.1186/s40708-024-00222-1 · Cited by 433
Self-citationExplainable artificial intelligence in Alzheimer’s disease classification: a systematic review
Viswan, V., Shaffi, N., Mahmud, M., Subramanian, K., & Hajamohideen, F. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10192-x · Cited by 195
Self-citationBashir, A. K., Victor, N., Bhattacharya, S., Huynh-The, T., Chengoden, R., Yenduri, G., Maddikunta, P. K. R., Pham, Q.-V., Gadekallu, T. R., & Liyanage, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3304790 · Cited by 183
Self-citation
Metadata
- Authors
- Javed, A. R., Saadia, A., Mughal, H., Gadekallu, T. R., Rizwan, M., Maddikunta, P. K. R., Mahmud, M., Liyanage, M., & Hussain, A.
- Venue
- Cognitive Computation
- Published
- 2023-06-24
- Volume
- 15
- Issue
- 6
- Pages
- 1767-1812
- ISSN
- 1866-9956 (ISSN-L)
- 1866-9964
- OpenAlex
- W4381855863
- Cited by
- 82
- References
- 33
- FWCI
- 14.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.