Machine learning-based predictive models for the occurrence of behavioral and psychological symptoms of dementia: model development and validation
Open accessAbstract
The behavioral and psychological symptoms of dementia (BPSD) are challenging aspects of dementia care. This study used machine learning models to predict the occurrence of BPSD among community-dwelling older adults with dementia. We included 187 older adults with dementia for model training and 35 older adults with dementia for external validation. Demographic and health data and premorbid personality traits were examined at the baseline, and actigraphy was utilized to monitor sleep and activity levels. A symptom diary tracked caregiver-perceived symptom triggers and the daily occurrence of 12 BPSD classified into seven subsyndromes. Several prediction models were also employed, including logistic regression, random forest, gradient boosting machine, and support vector machine. The random forest models revealed the highest area under the receiver operating characteristic curve (AUC) values for hyperactivity, euphoria/elation, and appetite and eating disorders; the gradient boosting machine models for psychotic and affective symptoms; and the support vector machine model showed the highest AUC. The gradient boosting machine model achieved the best performance in terms of average AUC scores across the seven subsyndromes. Caregiver-perceived triggers demonstrated higher feature importance values across the seven subsyndromes than other features. Our findings demonstrate the possibility of predicting BPSD using a machine learning approach.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ML approaches have been developed to predict these behavioral abnormalities in AD patients by using data on sleep patterns and physical activity collected by actigraphy from wearable devices.
“ML approaches have been developed to predict these behavioral abnormalities in AD patients by using data on sleep patterns and physical activity collected by actigraphy from wearable devices.38”
From Machine learning reveals prominent spontaneous behavioral changes and treatment efficacy in humanized and transgenic Alzheimer's disease models (2024) · cites this paper as [38]
The Discussion says the models predicted behavioral and psychological symptoms of dementia using actigraphy measures of sleep and activity, among other inputs. But the Results (Participant characteristics) show that the study included people with several types of dementia, not only Alzheimer’s disease; the claim narrows the population to AD patients. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Kok, J. S., Berg, I. J., & Scherder, E. J. A. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353441 · Cited by 20,589 · see citing works
Nichols, E., Steinmetz, J. D., Vollset, S. E., Fukutaki, K., Chalek, J., Abd-Allah, F., Abdoli, A., Abualhasan, A., Abu-Gharbieh, E., Akram, T. T., et al. (2022) · The Lancet Public Health · doi:10.1016/s2468-2667(21)00249-8 · Cited by 5,575 · see citing works
Self-citationBehavioral and psychological symptoms of dementia
Cerejeira, J., Lagarto, L., & Mukaetova-Ladinska, E. B. (2012) · Frontiers in Neurology · doi:10.3389/fneur.2012.00073 · Cited by 1,425 · see citing works
Assessment and management of behavioral and psychological symptoms of dementia
Kales, H. C., Gitlin, L. N., & Lyketsos, C. G. (2015) · BMJ · doi:10.1136/bmj.h369 · Cited by 1,247 · cited 2× · see citing works
“…as (1) those related to individuals with dementia, such as dementia-related neurobiological factors, unmet needs, and premorbid personality; (2) those related to caregivers, such as communication approach; and (3) environmental triggers such as lack of stimuli and environmental change 9 .”
BackgroundToot, S., Swinson, T., Devine, M., Challis, D., & Orrell, M. (2017) · International Psychogeriatrics · doi:10.1017/s1041610216001654 · Cited by 421 · see citing works
Ho, S. Y., Phua, K., Wong, L., & Bin Goh, W. W. (2020) · Patterns · doi:10.1016/j.patter.2020.100129 · Cited by 247 · see citing works
Management of Neuropsychiatric Symptoms in People with Dementia
Ballard, C., & Corbett, A. (2010) · CNS Drugs · doi:10.2165/11319240-000000000-00000 · Cited by 147 · see citing works
Flagged first, then by citations
Research works printed but not linked: 46
- [4]Kales HC Kern V Kim HM Blazek MC Moving evidence-informed assessment and management of behavioral and psychological symptoms of dementia into the real world: Training family and staff caregivers in the DICE Approach Am. J. Geriatr. Psychiatry 2020 28 1248 1255 10.1016/j.jagp.2020.08.008 32950366 · DOI
- [5]Dyer SM Harrison SL Laver K Whitehead C Crotty M An overview of systematic reviews of pharmacological and non-pharmacological interventions for the treatment of behavioral and psychological symptoms of dementia Int. Psychogeriatr. 2018 30 295 309 10.1017/S1041610217002344 29143695 · DOI
- [7]Herrmann N The contribution of neuropsychiatric symptoms to the cost of dementia care Int. J. Geriatr. Psychiatry 2006 21 972 976 10.1002/gps.1594 16955429 · DOI
- [8]Baharudin AD Din NC Subramaniam P Razali R The associations between behavioral-psychological symptoms of dementia (BPSD) and coping strategy, burden of care and personality style among low-income caregivers of patients with dementia BMC Public Health 2019 19 447 10.1186/s12889-019-6868-0 31196141 PMC6565534 · DOI
- [10]Richards KC Beck CK Progressively lowered stress threshold model: Understanding behavioral symptoms of dementia J. Am. Geriatr. Soc. 2004 52 1774 1775 10.1111/j.1532-5415.2004.52477.x 15450062 · DOI
- [11]Volicer L Hurley AC Management of behavioral symptoms in progressive degenerative dementias J. Gerontol. A Biol. Sci. Med. Sci. 2003 58 837 845 10.1093/gerona/58.9.M837 14528041 · DOI
- [12]Kolberg E The effects of bright light treatment on affective symptoms in people with dementia: A 24-week cluster randomized controlled trial BMC Psychiatry 2021 21 377 10.1186/s12888-021-03376-y 34320937 PMC8317398 · DOI
- [13]Todd WD Potential pathways for circadian dysfunction and sundowning-related behavioral aggression in Alzheimer’s disease and related dementias Front. Neurosci. 2020 14 910 10.3389/fnins.2020.00910 33013301 PMC7494756 · DOI
- [14]Hjetland GJ An actigraphy-based validation study of the Sleep Disorder Inventory in the nursing home Front. Psychiatry 2020 11 173 10.3389/fpsyt.2020.00173 32231600 PMC7083107 · DOI
- [15]Scales K Zimmerman S Miller SJ Evidence-based nonpharmacological practices to address behavioral and psychological symptoms of dementia Gerontologist 2018 58 S88 S102 10.1093/geront/gnx167 29361069 PMC5881760 · DOI
- [16]Cho CH Mood prediction of patients with mood disorders by machine learning using passive digital phenotypes based on the Circadian Rhythm: Prospective observational cohort study J. Med. Internet Res. 2019 21 e11029 10.2196/11029 30994461 PMC6492069 · DOI · Paper page
- [17]Asgari Mehrabadi M Sleep tracking of a commercially available smart ring and smartwatch against medical-grade actigraphy in everyday settings: Instrument validation study JMIR Mhealth Uhealth 2020 8 e20465 10.2196/20465 33038869 PMC7669442 · DOI
- [18]Mufti HN Hirsch GM Abidi SR Abidi SSR Exploiting machine learning algorithms and methods for the prediction of agitated delirium after cardiac surgery: Models development and validation study JMIR Med. Inform. 2019 7 e14993 10.2196/14993 31558433 PMC6913743 · DOI
- [19]Escudero J Zajicek JP Ifeachor E Early detection and characterization of Alzheimer's disease in clinical scenarios using Bioprofile concepts and K-means Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2011 2011 6470 6473 10.1109/IEMBS.2011.6091597 22255820 · DOI
- [20]Cho E Factors associated with behavioral and psychological symptoms of dementia: Prospective observational study using actigraphy J. Med. Internet Res. 2021 23 e29001 10.2196/29001 34714244 PMC8590188 · DOI
- [21]Luo W Guidelines for developing and reporting machine learning predictive models in biomedical research: A multidisciplinary view J. Med. Internet Res. 2016 18 e323 10.2196/jmir.5870 27986644 PMC5238707 · DOI · Paper page
- [24]Hughes CP Berg L Danziger WL Coben LA Martin RL A new clinical scale for the staging of dementia Br. J. Psychiatry 1982 140 566 572 10.1192/bjp.140.6.566 7104545 · DOI · Paper page
- [28]Camargos EF Louzada FM Nóbrega OT Wrist actigraphy for measuring sleep in intervention studies with Alzheimer's disease patients: Application, usefulness, and challenges Sleep Med. Rev. 2013 17 475 488 10.1016/j.smrv.2013.01.006 23669093 · DOI
- [29]Figueiro MG Tailored lighting intervention for persons with dementia and caregivers living at home Sleep Health 2015 1 322 330 10.1016/j.sleh.2015.09.003 27066526 PMC4822719 · DOI
- [30]Cole RJ Kripke DF Gruen W Mullaney DJ Gillin JC Automatic sleep/wake identification from wrist activity Sleep 1992 15 461 469 10.1093/sleep/15.5.461 1455130 · DOI
- [31]Cummings JL The Neuropsychiatric Inventory: Assessing psychopathology in dementia patients Neurology 1997 48 S10 16 10.1212/WNL.48.5_Suppl_6.10S 9153155 · DOI
- [32]Morganti F Soli A Savoldelli P Belotti G The Neuropsychiatric Inventory-Diary Rating Scale (NPI-Diary) is a method for improving stability in assessing neuropsychiatric symptoms in dementia Dement. Geriatr. Cogn Disord. Extra 2018 8 306 320 10.1159/000490380 PMC6180269 30323831 · DOI
- [33]Liew TM Symptom clusters of neuropsychiatric symptoms in mild cognitive impairment and their comparative risks of dementia: A cohort study of 8530 older adults J. Am. Med. Dir. Assoc. 2019 20 1054 e1051 1054.e1059 10.1016/j.jamda.2019.02.012 PMC6663577 30926409 · DOI
- [34]Liew TM Neuropsychiatric symptoms in cognitively normal older persons, and the association with Alzheimer's and non-Alzheimer's dementia Alzheimers Res. Ther. 2020 12 35 10.1186/s13195-020-00604-7 32234066 PMC7110750 · DOI
- [35]Aalten P Behavioral problems in dementia: factor analysis of the neuropsychiatric inventory Dementia Geriatr. Cogn. Disord. 2003 15 99 105 10.1159/000067972 12566599 · DOI
- [36]van der Linde RM Longitudinal course of behavioral and psychological symptoms of dementia: a systematic review Br. J. Psychiatry 2016 209 366 377 10.1192/bjp.bp.114.148403 27491532 PMC5100633 · DOI
- [37]van der Linde RM Dening T Matthews FE Brayne C Grouping of behavioral and psychological symptoms of dementia Int. J. Geriatr. Psychiatry 2014 29 562 568 10.1002/gps.4037 24677112 PMC4255309 · DOI
- [38]Canevelli M Behavioral and psychological subsyndromes in Alzheimer's disease using Neuropsychiatric Inventory Int. J. Geriatr. Psychiatry 2013 28 795 803 10.1002/gps.3904 23147419 · DOI
- [40]Micci-Barreca D Preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems ACM SIGKDD Explor. Newsl. 2001 3 27 32 10.1145/507533.507538 · DOI
- [42]Japkowicz, N. Class imbalance problem: Significance and strategies. Proceedings of the International Conference on Artificial Intelligence (2000).
- [43]Japkowicz, N. Class imbalances: We focus on the correct issue. Workshop on Learning from Imbalanced Dataset II (2003).
- [44]Chawla NV Bowyer KW Hall LO Kegelmeyer WP SMOTE: Synthetic minority oversampling technique J. Artif. Intell. Res. 2002 16 321 357 10.1613/jair.953 · DOI · Paper page
- [45]Breiman L Random forests Mach. Learn. 2001 45 5 32 10.1023/A:1010933404324 · DOI · Paper page
- [46]Friedman JH Greedy function approximation: A gradient boosting machine Ann. Stat. 2001 29 1189 1232 10.1214/aos/1013203451 · DOI · Paper page
- [47]Suthaharan S Support vector machine Machine learning models and algorithms for big data classification. Integrated Series in Information Systems 2016 Springer 207 235
- [48]Hyun S Moffatt-Bruce S Cooper C Hixon B Kaewprag P Prediction model for hospital-acquired pressure ulcer development: retrospective cohort study JMIR Med. Inform. 2019 7 e13785 10.2196/13785 31322127 PMC6670273 · DOI
- [50]Maji S Berg AC Malik J Efficient classification for additive kernel SVMs IEEE Trans. Pattern. Anal. Mach. Intell. 2013 35 66 77 10.1109/TPAMI.2012.62 22392703 · DOI
- [51]Hane CA Nori VS Crown WH Sanghavi DM Bleicher P Predicting onset of dementia using daily notes and machine learning: A case-control study JMIR Med. Inform. 2020 8 e17819 10.2196/17819 32490841 PMC7301255 · DOI
- [52]HekmatiAthar S Goins H Samuel R Byfield G Anwar M Data-driven forecasting of agitation for persons with dementia: A deep learning-based approach SN Comput. Sci. 2021 2 326 10.1007/s42979-021-00708-3 34109317 PMC8179095 · DOI
- [53]Sapci AH Sapci HA Innovative assisted living tools, remote monitoring technologies, artificial intelligence-driven solutions, and robotic systems for aging societies: A systematic review JMIR Aging 2019 2 e15429 10.2196/15429 31782740 PMC6911231 · DOI
- [54]Verdonk C Verdonk F Dreyfus G How can machine learning be used in clinical practice during an epidemic? Crit. Care 2020 24 265 10.1186/s13054-020-02962-y 32456690 PMC7250254 · DOI
- [55]Valembois L Wrist actigraphy: a simple way to record motor activity in elderly patients with dementia, apathy, or aberrant motor behavior J. Nutr. Health Aging 2015 19 759 764 10.1007/s12603-015-0530-z 26193860 · DOI
- [56]Alberdi A Smart home-based prediction of multi-domain symptoms related to Alzheimer's disease IEEE J. Biomed. Health Inform. 2018 22 1720 1731 10.1109/JBHI.2018.2798062 29994359 PMC6230688 · DOI
- [57]Toll DB Janssen KJ Vergouwe Y Moons KG Validation, updating and impact of clinical prediction rules: A review J. Clin. Epidemiol. 2008 61 1085 1094 10.1016/j.jclinepi.2008.04.008 19208371 · DOI
- [59]Vabalas A Gowen E Poliakoff E Casson AJ Machine learning algorithm validation with a limited sample size PLoS One 2019 14 e0224365 10.1371/journal.pone.0224365 31697686 PMC6837442 · DOI · Paper page
- [60]Husebo BS Sensing technology to monitor behavioral and psychological symptoms and assess treatment response in people with dementia. A systematic review Front. Pharmacol. 2020 10 1699 10.3389/fphar.2019.01699 32116687 PMC7011129 · DOI
Cited by
Sorted by citations
Miller, S. R., Luxem, K., Lauderdale, K., Nambiar, P., Honma, P. S., Ly, K. K., Bangera, S., Bullock, M., Shin, J., Kaliss, N., et al. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.114870 · Cited by 24 · see citing works
Self-citation
- Authors
- Cho, E., Kim, S., Heo, S.-J., Shin, J., Hwang, S., Kwon, E., Lee, S., Kim, S., & Kang, B.
- Affiliations
- Yonsei University (KR)
- Woosuk University (KR)
- Republic of Korea Army (KR)
- Corresponding author
- Kang, Bada
- Venue
- Scientific Reports
- Published
- 2023-05-18
- Volume
- 13
- Issue
- 1
- Pages
- 8073-8073
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC10195861
- OpenAlex
- W4377094006
- Cited by
- 32
- References
- 7
- Citations by year
- 2026: 7 · 2025: 12 · 2024: 11 · 2023: 2
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Research Foundation of Korea (NRF) grant funded by the Government of Korea (NRF-2018R1A2B6003506)
- Basic Science Research Program through the NRF funded by the Ministry of Education (NRF-2020R1A6A1A03041989)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › General Health Professions › Geriatric Care and Nursing Homes
- Keywords
- behavioral and psychological symptoms of dementia, community-dwelling older adults, dementia, actigraphy, symptom triggers, premorbid personality traits, random forest, gradient boosting, support vector machine, hyperactivity, euphoria, psychotic symptoms, affective symptoms
- MeSH terms
- Machine Learning, Aged, Behavioral Symptoms, Dementia, Humans, ROC Curve, Logistic Models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review