A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; 6 of the 17 sources its claims cite were checked for support.
Abstract
This paper reviews different types of conversational agents used in health care for chronic conditions, examining their underlying communication technology, evaluation measures, and AI methods. A systematic search was performed in February 2021 on PubMed Medline, EMBASE, PsycINFO, CINAHL, Web of Science, and ACM Digital Library. Studies were included if they focused on consumers, caregivers, or healthcare professionals in the prevention, treatment, or rehabilitation of chronic diseases, involved conversational agents, and tested the system with human users. The search retrieved 1087 articles. Twenty-six studies met the inclusion criteria. Out of 26 conversational agents (CAs), 16 were chatbots, seven were embodied conversational agents (ECA), one was a conversational agent in a robot, and another was a relational agent. One agent was not specified. Based on this review, the overall acceptance of CAs by users for the self-management of their chronic conditions is promising. Users’ feedback shows helpfulness, satisfaction, and ease of use in more than half of included studies. Although many users in the studies appear to feel more comfortable with CAs, there is still a lack of reliable and comparable evidence to determine the efficacy of AI-enabled CAs for chronic health conditions due to the insufficient reporting of technical implementation details.
Overview
CoChat Summary
TL;DR
This systematic review synthesized 26 studies of AI conversational agents (CAs) for chronic conditions, finding generally promising user acceptance but insufficient technical reporting to establish efficacy. Users reported helpfulness, satisfaction, and ease of use in more than half of included studies, yet the evidence base remains heterogeneous and hard to compare.
Key findings
- From 1087 unique articles screened, 26 studies met inclusion criteria; these evaluated 16 chatbots, 7 embodied conversational agents, 1 robot-based CA, 1 relational agent, and 1 unspecified agent.
- User experience was the most commonly reported evaluation measure (25 studies), with helpfulness, satisfaction, and ease of use common in more than half of included studies; technical performance was reported in only 6 studies and health-related measures in 18.
- Reported technical performance included accuracy of 89–99.2% for five CAs and specificity of 93–99.7% for three CAs; one hypertension study reported 96% achieved goal rate, 81% cough accuracy, and 41% compliance.
- Health-related findings included decreased delirium (p < 0.001) and loneliness (p = 0.01), reduced depression and anxiety (p = 0.053 and 0.029), improved self-management for older people (p = 0.001), and high medication adherence/physical activity/satisfaction measures (84–89%).
Methods
- PRISMA-guided systematic review registered on OSF Preregistration (DOI 10.17605/OSF.IO/GDWSH), searching PubMed Medline, EMBASE, PsycINFO, CINAHL, Web of Science, and ACM Digital Library in February 2021 without year or language restriction.
- Inclusion required primary research focused on consumers, caregivers, or healthcare professionals in prevention, treatment, or rehabilitation of chronic diseases using CAs and tested with human users; reviews, perspectives, opinion papers, news articles, whole-health-system evaluations, individual component evaluations, and Wizard-of-Oz studies were excluded.
- Two independent reviewers screened titles/abstracts and full texts, with disagreements resolved by Zoom meeting; four reviewers extracted data on study characteristics, participants, evaluation measures, and main findings, categorizing measures as technical performance, user experience, or health-related.
Limitations
- Paper-stated: most studies did not include technical performance details, making replicability problematic; the reviewed literature is heterogeneous and dominated by quasi-experimental studies, suggesting a nascent field.
- Paper-stated: there is a lack of reliable and comparable evidence to determine efficacy of AI-enabled CAs for chronic health conditions due to insufficient reporting of technical implementation details.
- Evident from the text: no included study targeted dialogue management of agent-based interactions, no CAs were usable across other populations, and no broad-scale analysis was applied to communities or countries with high chronic-condition management demands; safety aspects are described as neglected.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 1 Not valid · 15 Not checked · 45 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the quasi-experimental studies evaluated the medication adherence system of interaction dialogue, finding decreased delirium (p < 0.001) and loneliness (p = 0.01) [45].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.3. Evaluation Measures
What the sources say
- Partly supportedcites [45] Bott, 2019, A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study, J. Med. Internet Res. sourceExperimental — accuracy not yet measured
The outcome figures and design match: Results > Delirium reports a significant reduction in delirium presence from enrollment to discharge in the intervention group (P<.001) with no change in controls (P=.25), and Results > Loneliness reports a decrease in loneliness for avatar participants versus controls (P=.01); the study is a case-control pre-post (quasi-experimental) trial of 95 adults over 65. However, the cited paper's intervention is not a medication adherence system: Methods > Experimental Intervention describes Care Coach, a human-in-the-loop relational embodied conversational agent (animated dog/cat avatar) delivering psychosocial support and protocols for reorientation, cognitive engagement, toileting checks and fall prevention, and states explicitly that 'the avatar relational agent is not a medical professional that provides clinical information.' Searched our copy for medication/adherence/pill/reminder content and found none, so the 'medication adherence system of interaction dialogue' characterization is not supported by this source. (LLM, conf=0.78)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One RCT measured the outcomes using a 5-point Likert-type scale, finding improved self-management for older people with the chatbot (p = 0.001) [28].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.3. Evaluation Measures
What the sources say
- Partly supportedcites [28] Baptista, 2020, The My Diabetes Coach Research Group Acceptability of an Embodied Conversational Agent for Type 2 Diabetes Self-Management Education and Support via a Smartphone App: Mixed Methods Study, JMIR mHealth uHealth sourceExperimental — accuracy not yet measured
The Acceptability: Quantitative Data section says participants used a 5-point Likert-type scale to rate the agent’s traits, not self-management outcomes. The Sample Characteristics section reports P=.001 for differences in the number of interactions with Laura, not improved self-management among older people. The analysis used participants from the trial’s intervention arm. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The spoken system for a major depressive disorder used embodied CAs, and showed sensitivity (49%) and specificity (93%) [46].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.3. Evaluation Measures
What the sources say
- Supportedcites [46] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci. Rep. source
The Results section ('Global performance of ECA diagnosis of MDD in comparison with diagnosis', p. 3 of our copy) states the ECA had an overall sensitivity of 49% [31; 66] and specificity of 93% [88; 97] against the psychiatrist's DSM-5 diagnosis in 179 outpatients, exactly the figures the claim attributes. The Method ('Clinical interview conducted by a software-driven virtual human') confirms the system is a spoken/conversational one — an embodied conversational agent with a speech synthesizer and a speech recognizer that encodes each patient response — so 'spoken system using embodied CAs for major depressive disorder' matches the source's own description, and the Discussion reiterates these validity findings. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“This is aligned with the findings of the previous systematic reviews of CAs in healthcare [1,27].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 4. Discussion
What the sources say
- Supportedcites [1] Schachner, 2020, Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review, J. Med. Internet Res. source
In Discussion > Principal Findings, the cited systematic review reports that 70% of its included studies were quasi-experimental, compared with 20% RCTs and 10% proof-of-concept. It therefore supports the citing paper’s statement that its finding aligns with a previous review of conversational agents in health care, specifically one focused on chronic conditions. (LLM, conf=0.93)
- Supportedcites [27] Laranjo, 2018, Conversational agents in healthcare: A systematic review, J. Am. Med. Inform. Assoc. source
The Results section (‘Description of included studies’) states that most included studies were quasi-experimental, with only two randomized controlled trials and one cross-sectional study. The Discussion (‘Main findings’) likewise describes a predominance of quasi-experimental designs over RCTs, supporting the claimed alignment. (LLM, conf=0.94)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Twenty-six studies met the inclusion criteria.”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
29 more claims
Create a free account to see all 66 claims and to verify the 11 references still open.
- It may state two separate claims as one. 21
- Probably not a substantial claim. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recent advancements with voice-based conversational agents28 could interact with patients over the phone to overcome barriers with the writing and typing typically required of traditional questionnaires, and also increase access for patients who are of lower socioeconomic status, limited English proficiency, or elderly.29–32”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.1. Description of Included Studies
“One study focused on prediabetes with obesity [51].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > References
“51. Sahu A.K. Sharma S. Puthal D. Lightweight Multi-party Authentication and Key Agreement Protocol in IoT-based E-Healthcare Service”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.1. Description of Included Studies
“Three studies dealt with cancer (breast cancer, geriatric oncology, after cancer treatment) [34,47,50].”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > References
“50. Puthal D. Mir Z.H. Filali F. Menouar H. Cross-layer architecture for congestion control in Vehicular Ad-hoc Networks”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.1. Description of Included Studies
“HIV [53,54,55,56]”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > References
“56. Puthal D. Nepal S. Ranjan R. Chen J. A secure big data stream analytics framework for disaster management on the cloud”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.3. Evaluation Measures
“accuracy (89–99.2% for five CAs) [31,37,40,43,48]”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.3. Evaluation Measures
“The urinary incontinence article mentioned accuracy, but without clarifying the percentage or rate of accuracy [31].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > 3. Results > 3.1. Description of Included Studies
“Other conditions included hypertension [43], heart failure [38], HIV [53,54,55,56]”
§ A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions > References
“54. Puthal D. Ranjan R. Nanda A. Nanda P. Jayaraman P.P. Zomaya A. Secure authentication and load balancing of distributed edge datacenters”
1 more finding
Create a free account to see every finding of this check.
Citations
Cites
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 5×
“This is aligned with the findings of the previous systematic reviews of CAs in healthcare [1,27].”
BackgroundMethodResultInfluentialSelf-citationInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322 · cited 2×
“Search terms included “conversational agents”, “dialogue systems”, “relational agents”, and “chatbots” (complete search strategy available in Appendix A) [1,6,25,26].”
BackgroundChatbots in the fight against the COVID-19 pandemic
Miner, A. S., Laranjo, L., & Kocaballi, A. B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0280-0 · Cited by 322 · cited 1×
“They can also help in completing specific tasks such as self‐monitoring and overcoming obstacles for self‐management, which is important in chronic disease management and in the fight against pandemics [6,16].”
BackgroundSelf-citationSchachner, T., Keller, R., & v Wangenheim, F. (2020) · Journal of Medical Internet Research · doi:10.2196/20701 · Cited by 267 · cited 9×
“This is aligned with the findings of the previous systematic reviews of CAs in healthcare [1,27].”
BackgroundMethodResultInfluentialGreer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265
Chaix, B., Bibault, J.-E., Pienkowski, A., Delamon, G., Guillemassé, A., Nectoux, P., & Brouard, B. (2019) · JMIR Cancer · doi:10.2196/12856 · Cited by 227 · cited 1×
“cer, geriatric oncology, after cancer treatment) [34,47,50].”
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
“…[35,45]; preconception, pregnancy, and postpartum health [36]; support for smoking cessation [38]; management of weight [39] and chronic conditions [6,9,20,40]; vaccine communication [26]; and broader health care acceptability [27]—these reviews often exhibit significant limitations in scope and…”
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Kurniawan, M. H., Handiyani, H., Nuraini, T., Hariyati, R. T. S., & Sutrisno, S. (2024) · Annals of Medicine · doi:10.1080/07853890.2024.2302980 · Cited by 177
Applications of Artificial Intelligence to Obesity Research: Scoping Review of Methodologies
An, R., Shen, J., & Xiao, Y. (2022) · Journal of Medical Internet Research · doi:10.2196/40589 · Cited by 98
Chatbot Adoption: A Multiperspective Systematic Review and Future Research Agenda
Alsharhan, A. M., Al‐Emran, M., & Shaalan, K. F. (2023) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2023.3298360 · Cited by 95
“This observation is similar to what has been found in earlier reviews [40], [50], [51].”
Result
Metadata
- Authors
- Bin Sawad, A., Narayan, B., Alnefaie, A., Maqbool, A., Mckie, I., Smith, J., Yuksel, B., Puthal, D., Prasad, M., & Kocaballi, A. B.
- Affiliations
- School of Computer Science, Faculty of Engineering and IT, University of Technology Sydney, Sydney 2007, Australia
- University of Technology Sydney (AU)
- The University of Sydney (AU)
- Khalifa University of Science and Technology (AE)
- Corresponding author
- Puthal, Deepak
- ORCID
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2022-03-29
- Volume
- 22
- Issue
- 7
- Pages
- 2625
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC9003264
- OpenAlex
- W4220766556
- Cited by
- 113
- References
- 56
- Citations by year
- 2026: 29 · 2025: 29 · 2024: 26 · 2023: 23 · 2022: 6
- FWCI
- 1.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- chatbots, embodied conversational agents, chronic disease, self-management, artificial intelligence in healthcare, user acceptance, user satisfaction, evaluation metrics
- MeSH terms
- Information Technology, Artificial Intelligence, Chronic Disease, Communication, Delivery of Health Care, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions. https://app.cochat.ai/papers/10.3390/s22072625
- The paper
- Bin Sawad, A., Narayan, B., Alnefaie, A., Maqbool, A., Mckie, I., Smith, J., Yuksel, B., Puthal, D., Prasad, M., & Kocaballi, A. B. (2022). A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions. Sensors. https://doi.org/10.3390/s22072625
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
