Cited by 32Dementia and Cognitive Impairment ResearchArtificial Intelligence in HealthcareGeriatric Care and Nursing Homes

Machine learning-based predictive models for the occurrence of behavioral and psychological symptoms of dementia: model development and validation

Open access
Cho, Eunhee, Kim, Sujin, Heo, Seok-Jae, Shin, Jinhee, Hwang, Sinwoo, Kwon, Eunji, Lee, SungHee, Kim, SangGyun +1 more·2023·Scientific Reports

Abstract

The behavioral and psychological symptoms of dementia (BPSD) are challenging aspects of dementia care. This study used machine learning models to predict the occurrence of BPSD among community-dwelling older adults with dementia. We included 187 older adults with dementia for model training and 35 older adults with dementia for external validation. Demographic and health data and premorbid personality traits were examined at the baseline, and actigraphy was utilized to monitor sleep and activity levels. A symptom diary tracked caregiver-perceived symptom triggers and the daily occurrence of 12 BPSD classified into seven subsyndromes. Several prediction models were also employed, including logistic regression, random forest, gradient boosting machine, and support vector machine. The random forest models revealed the highest area under the receiver operating characteristic curve (AUC) values for hyperactivity, euphoria/elation, and appetite and eating disorders; the gradient boosting machine models for psychotic and affective symptoms; and the support vector machine model showed the highest AUC. The gradient boosting machine model achieved the best performance in terms of average AUC scores across the seven subsyndromes. Caregiver-perceived triggers demonstrated higher feature importance values across the seven subsyndromes than other features. Our findings demonstrate the possibility of predicting BPSD using a machine learning approach.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-023-35194-5

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • ML approaches have been developed to predict these behavioral abnormalities in AD patients by using data on sleep patterns and physical activity collected by actigraphy from wearable devices.

    “ML approaches have been developed to predict these behavioral abnormalities in AD patients by using data on sleep patterns and physical activity collected by actigraphy from wearable devices.38”

    From Machine learning reveals prominent spontaneous behavioral changes and treatment efficacy in humanized and transgenic Alzheimer's disease models (2024) · cites this paper as [38]

    The Discussion says the models predicted behavioral and psychological symptoms of dementia using actigraphy measures of sleep and activity, among other inputs. But the Results (Participant characteristics) show that the study included people with several types of dementia, not only Alzheimer’s disease; the claim narrows the population to AD patients. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 46

  1. [4]Kales HC Kern V Kim HM Blazek MC Moving evidence-informed assessment and management of behavioral and psychological symptoms of dementia into the real world: Training family and staff caregivers in the DICE Approach Am. J. Geriatr. Psychiatry 2020 28 1248 1255 10.1016/j.jagp.2020.08.008 32950366 · DOI
  2. [5]Dyer SM Harrison SL Laver K Whitehead C Crotty M An overview of systematic reviews of pharmacological and non-pharmacological interventions for the treatment of behavioral and psychological symptoms of dementia Int. Psychogeriatr. 2018 30 295 309 10.1017/S1041610217002344 29143695 · DOI
  3. [7]Herrmann N The contribution of neuropsychiatric symptoms to the cost of dementia care Int. J. Geriatr. Psychiatry 2006 21 972 976 10.1002/gps.1594 16955429 · DOI
  4. [8]Baharudin AD Din NC Subramaniam P Razali R The associations between behavioral-psychological symptoms of dementia (BPSD) and coping strategy, burden of care and personality style among low-income caregivers of patients with dementia BMC Public Health 2019 19 447 10.1186/s12889-019-6868-0 31196141 PMC6565534 · DOI
  5. [10]Richards KC Beck CK Progressively lowered stress threshold model: Understanding behavioral symptoms of dementia J. Am. Geriatr. Soc. 2004 52 1774 1775 10.1111/j.1532-5415.2004.52477.x 15450062 · DOI
  6. [11]Volicer L Hurley AC Management of behavioral symptoms in progressive degenerative dementias J. Gerontol. A Biol. Sci. Med. Sci. 2003 58 837 845 10.1093/gerona/58.9.M837 14528041 · DOI
  7. [12]Kolberg E The effects of bright light treatment on affective symptoms in people with dementia: A 24-week cluster randomized controlled trial BMC Psychiatry 2021 21 377 10.1186/s12888-021-03376-y 34320937 PMC8317398 · DOI
  8. [13]Todd WD Potential pathways for circadian dysfunction and sundowning-related behavioral aggression in Alzheimer’s disease and related dementias Front. Neurosci. 2020 14 910 10.3389/fnins.2020.00910 33013301 PMC7494756 · DOI
  9. [14]Hjetland GJ An actigraphy-based validation study of the Sleep Disorder Inventory in the nursing home Front. Psychiatry 2020 11 173 10.3389/fpsyt.2020.00173 32231600 PMC7083107 · DOI
  10. [15]Scales K Zimmerman S Miller SJ Evidence-based nonpharmacological practices to address behavioral and psychological symptoms of dementia Gerontologist 2018 58 S88 S102 10.1093/geront/gnx167 29361069 PMC5881760 · DOI
  11. [16]Cho CH Mood prediction of patients with mood disorders by machine learning using passive digital phenotypes based on the Circadian Rhythm: Prospective observational cohort study J. Med. Internet Res. 2019 21 e11029 10.2196/11029 30994461 PMC6492069 · DOI · Paper page
  12. [17]Asgari Mehrabadi M Sleep tracking of a commercially available smart ring and smartwatch against medical-grade actigraphy in everyday settings: Instrument validation study JMIR Mhealth Uhealth 2020 8 e20465 10.2196/20465 33038869 PMC7669442 · DOI
  13. [18]Mufti HN Hirsch GM Abidi SR Abidi SSR Exploiting machine learning algorithms and methods for the prediction of agitated delirium after cardiac surgery: Models development and validation study JMIR Med. Inform. 2019 7 e14993 10.2196/14993 31558433 PMC6913743 · DOI
  14. [19]Escudero J Zajicek JP Ifeachor E Early detection and characterization of Alzheimer's disease in clinical scenarios using Bioprofile concepts and K-means Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2011 2011 6470 6473 10.1109/IEMBS.2011.6091597 22255820 · DOI
  15. [20]Cho E Factors associated with behavioral and psychological symptoms of dementia: Prospective observational study using actigraphy J. Med. Internet Res. 2021 23 e29001 10.2196/29001 34714244 PMC8590188 · DOI
  16. [21]Luo W Guidelines for developing and reporting machine learning predictive models in biomedical research: A multidisciplinary view J. Med. Internet Res. 2016 18 e323 10.2196/jmir.5870 27986644 PMC5238707 · DOI · Paper page
  17. [24]Hughes CP Berg L Danziger WL Coben LA Martin RL A new clinical scale for the staging of dementia Br. J. Psychiatry 1982 140 566 572 10.1192/bjp.140.6.566 7104545 · DOI · Paper page
  18. [28]Camargos EF Louzada FM Nóbrega OT Wrist actigraphy for measuring sleep in intervention studies with Alzheimer's disease patients: Application, usefulness, and challenges Sleep Med. Rev. 2013 17 475 488 10.1016/j.smrv.2013.01.006 23669093 · DOI
  19. [29]Figueiro MG Tailored lighting intervention for persons with dementia and caregivers living at home Sleep Health 2015 1 322 330 10.1016/j.sleh.2015.09.003 27066526 PMC4822719 · DOI
  20. [30]Cole RJ Kripke DF Gruen W Mullaney DJ Gillin JC Automatic sleep/wake identification from wrist activity Sleep 1992 15 461 469 10.1093/sleep/15.5.461 1455130 · DOI
  21. [31]Cummings JL The Neuropsychiatric Inventory: Assessing psychopathology in dementia patients Neurology 1997 48 S10 16 10.1212/WNL.48.5_Suppl_6.10S 9153155 · DOI
  22. [32]Morganti F Soli A Savoldelli P Belotti G The Neuropsychiatric Inventory-Diary Rating Scale (NPI-Diary) is a method for improving stability in assessing neuropsychiatric symptoms in dementia Dement. Geriatr. Cogn Disord. Extra 2018 8 306 320 10.1159/000490380 PMC6180269 30323831 · DOI
  23. [33]Liew TM Symptom clusters of neuropsychiatric symptoms in mild cognitive impairment and their comparative risks of dementia: A cohort study of 8530 older adults J. Am. Med. Dir. Assoc. 2019 20 1054 e1051 1054.e1059 10.1016/j.jamda.2019.02.012 PMC6663577 30926409 · DOI
  24. [34]Liew TM Neuropsychiatric symptoms in cognitively normal older persons, and the association with Alzheimer's and non-Alzheimer's dementia Alzheimers Res. Ther. 2020 12 35 10.1186/s13195-020-00604-7 32234066 PMC7110750 · DOI
  25. [35]Aalten P Behavioral problems in dementia: factor analysis of the neuropsychiatric inventory Dementia Geriatr. Cogn. Disord. 2003 15 99 105 10.1159/000067972 12566599 · DOI
  26. [36]van der Linde RM Longitudinal course of behavioral and psychological symptoms of dementia: a systematic review Br. J. Psychiatry 2016 209 366 377 10.1192/bjp.bp.114.148403 27491532 PMC5100633 · DOI
  27. [37]van der Linde RM Dening T Matthews FE Brayne C Grouping of behavioral and psychological symptoms of dementia Int. J. Geriatr. Psychiatry 2014 29 562 568 10.1002/gps.4037 24677112 PMC4255309 · DOI
  28. [38]Canevelli M Behavioral and psychological subsyndromes in Alzheimer's disease using Neuropsychiatric Inventory Int. J. Geriatr. Psychiatry 2013 28 795 803 10.1002/gps.3904 23147419 · DOI
  29. [40]Micci-Barreca D Preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems ACM SIGKDD Explor. Newsl. 2001 3 27 32 10.1145/507533.507538 · DOI
  30. [42]Japkowicz, N. Class imbalance problem: Significance and strategies. Proceedings of the International Conference on Artificial Intelligence (2000).
  31. [43]Japkowicz, N. Class imbalances: We focus on the correct issue. Workshop on Learning from Imbalanced Dataset II (2003).
  32. [44]Chawla NV Bowyer KW Hall LO Kegelmeyer WP SMOTE: Synthetic minority oversampling technique J. Artif. Intell. Res. 2002 16 321 357 10.1613/jair.953 · DOI · Paper page
  33. [45]Breiman L Random forests Mach. Learn. 2001 45 5 32 10.1023/A:1010933404324 · DOI · Paper page
  34. [46]Friedman JH Greedy function approximation: A gradient boosting machine Ann. Stat. 2001 29 1189 1232 10.1214/aos/1013203451 · DOI · Paper page
  35. [47]Suthaharan S Support vector machine Machine learning models and algorithms for big data classification. Integrated Series in Information Systems 2016 Springer 207 235
  36. [48]Hyun S Moffatt-Bruce S Cooper C Hixon B Kaewprag P Prediction model for hospital-acquired pressure ulcer development: retrospective cohort study JMIR Med. Inform. 2019 7 e13785 10.2196/13785 31322127 PMC6670273 · DOI
  37. [50]Maji S Berg AC Malik J Efficient classification for additive kernel SVMs IEEE Trans. Pattern. Anal. Mach. Intell. 2013 35 66 77 10.1109/TPAMI.2012.62 22392703 · DOI
  38. [51]Hane CA Nori VS Crown WH Sanghavi DM Bleicher P Predicting onset of dementia using daily notes and machine learning: A case-control study JMIR Med. Inform. 2020 8 e17819 10.2196/17819 32490841 PMC7301255 · DOI
  39. [52]HekmatiAthar S Goins H Samuel R Byfield G Anwar M Data-driven forecasting of agitation for persons with dementia: A deep learning-based approach SN Comput. Sci. 2021 2 326 10.1007/s42979-021-00708-3 34109317 PMC8179095 · DOI
  40. [53]Sapci AH Sapci HA Innovative assisted living tools, remote monitoring technologies, artificial intelligence-driven solutions, and robotic systems for aging societies: A systematic review JMIR Aging 2019 2 e15429 10.2196/15429 31782740 PMC6911231 · DOI
  41. [54]Verdonk C Verdonk F Dreyfus G How can machine learning be used in clinical practice during an epidemic? Crit. Care 2020 24 265 10.1186/s13054-020-02962-y 32456690 PMC7250254 · DOI
  42. [55]Valembois L Wrist actigraphy: a simple way to record motor activity in elderly patients with dementia, apathy, or aberrant motor behavior J. Nutr. Health Aging 2015 19 759 764 10.1007/s12603-015-0530-z 26193860 · DOI
  43. [56]Alberdi A Smart home-based prediction of multi-domain symptoms related to Alzheimer's disease IEEE J. Biomed. Health Inform. 2018 22 1720 1731 10.1109/JBHI.2018.2798062 29994359 PMC6230688 · DOI
  44. [57]Toll DB Janssen KJ Vergouwe Y Moons KG Validation, updating and impact of clinical prediction rules: A review J. Clin. Epidemiol. 2008 61 1085 1094 10.1016/j.jclinepi.2008.04.008 19208371 · DOI
  45. [59]Vabalas A Gowen E Poliakoff E Casson AJ Machine learning algorithm validation with a limited sample size PLoS One 2019 14 e0224365 10.1371/journal.pone.0224365 31697686 PMC6837442 · DOI · Paper page
  46. [60]Husebo BS Sensing technology to monitor behavioral and psychological symptoms and assess treatment response in people with dementia. A systematic review Front. Pharmacol. 2020 10 1699 10.3389/fphar.2019.01699 32116687 PMC7011129 · DOI

Cited by

Sorted by citations

Authors
Cho, E., Kim, S., Heo, S.-J., Shin, J., Hwang, S., Kwon, E., Lee, S., Kim, S., & Kang, B.
Affiliations
  • Yonsei University (KR)
  • Woosuk University (KR)
  • Republic of Korea Army (KR)
Corresponding author
Kang, Bada
Venue
Scientific Reports
Published
2023-05-18
Volume
13
Issue
1
Pages
8073-8073
ISSN
2045-2322 (ISSN-L)
OpenAlex
W4377094006
Cited by
32
References
7
Citations by year
2026: 7 · 2025: 12 · 2024: 11 · 2023: 2
FWCI
6.52
Type
journal article
Language
en
Open access
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Research Foundation of Korea (NRF) grant funded by the Government of Korea (NRF-2018R1A2B6003506)
  • Basic Science Research Program through the NRF funded by the Ministry of Education (NRF-2020R1A6A1A03041989)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Health Professions › General Health Professions › Geriatric Care and Nursing Homes
Keywords
behavioral and psychological symptoms of dementia, community-dwelling older adults, dementia, actigraphy, symptom triggers, premorbid personality traits, random forest, gradient boosting, support vector machine, hyperactivity, euphoria, psychotic symptoms, affective symptoms
MeSH terms
Machine Learning, Aged, Behavioral Symptoms, Dementia, Humans, ROC Curve, Logistic Models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review