The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index; 1 of the 4 sources its claims cite were checked for support.
Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality
Open accessPublished version of a preprint
Abstract
BACKGROUND: Over the past decade, there has been an increase in the use of information technologies to educate and support people with dementia and their family caregivers. At the same time, chatbot technologies have become increasingly popular for use by the public and have been identified as having benefits for health care delivery. However, little is known about how chatbot technologies may benefit people with dementia and their caregivers. OBJECTIVE: This study aims to identify the types of current commercially available chatbots that are designed for use by people with dementia and their caregivers and to assess their quality in terms of features and content. METHODS: Chatbots were identified through a systematic search on Google Play Store, Apple App Store, Alexa Skills, and the internet. An evidence-based assessment tool was used to evaluate the features and content of the identified apps. The assessment was conducted through interrater agreement among 4 separate reviewers. RESULTS: Of the 505 initial chatbots identified, 6 were included in the review. The chatbots assessed varied significantly in terms of content and scope. Although the chatbots were generally found to be easy to use, some limitations were noted regarding their performance and programmed content for dialog. CONCLUSIONS: Although chatbot technologies are well established and commonly used by the public, their development for people with dementia and their caregivers is in its infancy. Given the successful use of chatbots in other health care settings and for other applications, there are opportunities to integrate this technology into dementia care. However, more evidence-based chatbots that have undergone end user evaluation are needed to evaluate their potential to adequately educate and support these populations.
Overview
CoChat Summary
## TL;DR
This systematic review identified only 6 commercially available chatbots aimed at people with dementia and their caregivers, suggesting the field was still in an early stage. The apps were generally easy to use, but their content was limited, mostly English-only, and often not clearly evidence based.
## Key findings
- Of 505 initial chatbots identified, only 6 met inclusion criteria; these were 1 text-based mobile app and 5 Alexa Skills voice apps.
- Half of the apps focused on dementia education and half on memory/reminiscence; none made claims about expected outcomes, and no peer-reviewed research was identified for any of the apps.
- In functionality, 5 of the 6 chatbots were found to be easy to use once started, and 3 of the 5 education-focused chatbots had a breadth of knowledge and flexibility in interpreting information.
- Only 1 app passed the Turing test, and all chatbots had limited programmed dialog; 5 apps had privacy statements, and 2 apps stated they were not substitutes for medical care or advice.
## Methods
- Systematic review and critical appraisal of commercially available chatbots for dementia, conducted between December 2019 and April 2020.
- Searches were run on Google Play Store, Apple App Store, Amazon Alexa Skills, and the internet using terms including “Chatbot,” “Virtual Assistant,” “Alzheimer’s,” “dementia,” “health,” and “caregiver.”
- Inclusion required interactive text or voice dialog, dementia focus, intended use by people with dementia and/or caregivers, English availability, and public availability; 4 reviewers independently assessed features/content using an evidence-based tool grounded in Radziwill and Benton, with interrater agreement and thematic analysis.
## Limitations
- The paper states that additional dementia-related chatbots may have existed but were not identified despite an extensive search.
- The authors note there are no standardized measurement tools for chatbot technology, and the mobile app rating scale did not fit because too many items were not applicable.
- Evident from the text: the review assessed apps only as they existed in April/May 2020, so app characteristics may have changed afterward; also, only English-language, publicly available apps were included.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
1 Valid · 1 Not valid · 4 Not checked · 65 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the apps made claims about the expected outcomes of using the app, and no peer-reviewed research was identified for any of the apps.”
§ Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality > Results > Overview
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In general, the evaluators assessed the chatbots as having features aimed at increasing the user’s enjoyment while using them.”
§ Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality > Results > Satisfaction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the apps made claims about the expected outcomes of using the app, and no peer-reviewed research was identified for any of the apps.”
§ Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality > Results > Overview
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only 1 app (app number 3) passed the Turing test, which is the extent to which one can tell the difference between conversing with a human and the chatbot.”
- Also stated in: § Humanity Versus Usefulness · plain
“We found that most chatbots did not pass the Turing test, which mainly means that they were unable to keep the conversation going while pretending to be human.”
§ Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality > Results > Effectiveness
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Humanity Versus Usefulness · plain
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the apps were programmed to respond to patterns or the social context of user input.”
§ Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality > Results > Satisfaction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 71 claims and every source verdict.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 18
- The quote only partly states this claim. 1
Citations
Cites
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 2×
“One of the first established chatbots was programmed in the 1960s, called ELIZA, which was used for text-based psychiatric interviews [11].”
2019 Alzheimer’s disease facts and figures.
Alzheimer's Association (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2019.01.010 · Cited by 2,461 · cited 3×
“This can have a negative impact on the quality of care and outcomes for people with dementia [31].”
InfluentialMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 4×
“A recent systematic review by Laranjo et al [10] concluded that despite the potential benefits of conversational agents in the health care field, limited research has evaluated the efficacy and safety of this technology.”
InfluentialChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 1×
“In a review of chatbots for psychiatric care, it was reported that chatbots demonstrate efficacy in facilitating psychoeducation and self-adherence to treatment [24].”
Brandtzaeg, P. B., & Følstad, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70284-1_30 · Cited by 788 · cited 1×
“Over the past decade, chatbot technologies have increasingly been used by people to meet a variety of daily needs, including social and emotional support and information seeking [1].”
Smith, G. E., Housen, P., Yaffe, K., Ruff, R., Kennison, R. F., Mahncke, H. W., & Zelinski, E. M. (2009) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2008.02167.x · Cited by 785 · cited 1×
“For people with dementia, designers may consider how evidence-based cognitive training and other evidence-based programs can be administered via a chatbot [39].”
DALE, R. (2016) · Natural Language Engineering · doi:10.1017/s1351324916000243 · Cited by 485 · cited 1×
“…is largely because of the advancements in deep learning technology [15], which enables agent-based chatbots, and the advancements in voice recognition technology, which have facilitated voice assistants such as Apple’s Siri, Microsoft’s Cortana, Amazon’s Alexa, and Google’s new Assistant [16].”
Massive Exploration of Neural Machine Translation Architectures
Britz, D., Goldie, A., Luong, M.-T., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1151 · Cited by 482 · cited 1×
“The renewed interest in chatbots in recent years is largely because of the advancements in deep learning technology [15], which enables agent-based chatbots, and the advancements in voice recognition technology, which have facilitated voice assistants such as Apple’s Siri, Microsoft’s Cortana,…”
Survey on Chatbot Design Techniques in Speech Conversation Systems
A., S., & John, D. (2015) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2015.060712 · Cited by 479
Research works printed but not linked: 1
- RadziwillNMBentonMCEvaluating quality of chatbots and intelligent conversational agentsarXiv - Computer Science, Computers and Society20172011-05-11https://arxiv.org/abs/1704.04579
Cited by
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
Artificial intelligence and chatbots in psychiatry
Pham, K. T., Nabizadeh, A., & Selek, S. (2022) · Psychiatric Quarterly · doi:10.1007/s11126-022-09973-8 · Cited by 241
“Fortunately, cloud-based web services such as Amazon Web Service (AWS) have recently started to offer “HIPAA- compliant” connections [16].”
BackgroundHealth-focused conversational agents in person-centered care: a review of apps
Parmar, P., Ryu, J., Pandya, S., Sedoc, J., & Agarwal, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00560-6 · Cited by 113
ChatGPT vs Google for Queries Related to Dementia and Other Cognitive Decline: Comparison of Results
Hristidis, V., Ruggiano, N., Brown, E. L., Ganta, S. R. R., & Stewart, S. (2023) · Journal of Medical Internet Research · doi:10.2196/48966 · Cited by 108
“Previously, we conducted a systematic review of commercially available chatbot apps that targeted PLWD [6].”
Self-citationCorbett, C. F., Wright, P. J., Jones, K., & Parmer, M. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.742012 · Cited by 81
“Relatedly, an inability to remember the necessary commands to interact with a VHA may create frustration and agitation in people, particularly those with cognitive deficits (33).”
Background
Metadata
- Authors
- Ruggiano, N., Brown, E. L., Roberts, L., Framil Suarez, C. V., Luo, Y., Hao, Z., & Hristidis, V.
- Affiliations
- University of Alabama (US)
- Florida International University (US)
- University of California, Riverside (US)
- Corresponding author
- Hristidis, Vagelis
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-06-03
- Volume
- 23
- Issue
- 6
- Pages
- e25006
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8212632
- OpenAlex
- W3164447366
- Cited by
- 100
- References
- 41
- Citations by year
- 2026: 21 · 2025: 26 · 2024: 27 · 2023: 13 · 2022: 12 · 2021: 1
- FWCI
- 2.13
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- chatbots, dementia, family caregivers, dementia care, digital health interventions, caregiver education
- MeSH terms
- Delivery of Health Care, Dementia, Humans, Caregivers, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality. https://app.cochat.ai/papers/10.2196/25006
- The paper
- Ruggiano, N., Brown, E. L., Roberts, L., Framil Suarez, C. V., Luo, Y., Hao, Z., & Hristidis, V. (2021). Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality. Journal of Medical Internet Research. https://doi.org/10.2196/25006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
