Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 1,201–1,300 of 1,371
Multi-agent and knowledge graph-based social and emotional learning question-answering
Tang, S., Liu, M., Yang, B., Xu, X., Chen, D., Peng, Y., & Li, T. (2026) · The Computer Journal · doi:10.1093/comjnl/bxag033 · Cited by 1
Exploring Agentic AI in Multi-Agent Communication and Domain Applications
Rajasree, R. S., Gopika, G. S., Sreekrishna, M., Prabakar, D., Prema, S., & Chithra, K. (2026) · International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI) · doi:10.1109/icmsci67830.2026.11469603
TrackWise: A Privacy-Preserving Client-Side Conversational Agent for Ambient Chronic Illness Support
Nasri, S. A. E. M., & Kavakli, M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-16992-1_15
McGee, A. E., Parsons, G., Zhaunova, L., Paul, A., Kazlou, A., Xu, Y., Stsefanovich, H., Klepchukova, A., & Meczner, A. (2026) · Digital Health · doi:10.1177/20552076261435861
“14,15 20 – 22 Even studies that explicitly provide external reviews of the correctness and safety of sexual health chatbots 23,24 assess already deployed systems from an outside perspective and do not report the internal, end-to-end frameworks used to design and operate them.”
Trani, L., Fontana, A., GRECO, A. G., Egidi, F., Cacioppo, M., & Sideli, L. (2026) · The Journal of Sports Medicine and Physical Fitness · doi:10.23736/s0022-4707.26.17642-7 · Cited by 1
Emotional AI and Human Interaction: Transforming Expression, Trust, and Relationship
Indhu, V., Nisha, A. R., & Subramani, A. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8337-8.ch009
Jiang, Q., Chen, X. S., Patel, D., Brazendale, K., & Alejandro, S. (2026) · doi:10.2196/preprints.98889
Alsisi, S. M. E. (2026) · International Journal of Business & Economics (IJBE) · doi:10.58885/ijbe.v11i1.82.sa
Sayed, F., Park, A., Sullivan, P. S., Jordan, A., Kwon, S., & Ge, Y. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag044
Le-Hoang, P. V., Cam-Tu, N. T., Thu-Ha, N. T., & Nguyen-Tan, L. (2026) · Review of Marketing Science · doi:10.1515/roms-2025-0099
“Prior research has shown that users ’ trust, perceived usefulness, and information credibility are critical determinants of healthcare chatbot adoption, as inaccurate or unreliable information may lead to serious consequences in health-related decision-making (Cheng and Jiang 2020; Laranjo 2018).”
Yang, Z., Zhang, X., Yang, Y., Li, J., & Zhao, X. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11487052
“This is especially important in applications like medical coaching [33].”
Balogun, E. B., Wimmer, H., & Rebman, C. M. (2026) · Journal of Information Systems Applied Research and Analytics · doi:10.62273/rjmj2996
Fang, F., Chen, X., Huo, F., & Liu, X. (2026) · Digital Health · doi:10.1177/20552076261450307
“13,14 Traditional online medical consultations primarily relied on text-based dialogue, lacking the emotional expression and non-verbal cues in face-to-face interactions.”
Mind Mirror: An AI-Enhanced Digital Companion for Mental Wellness and Self-Care
Reddy, N. V. R. S., Reddy, B. I., Satvika, T., Meghana, P., Yeshashwini, Y., & Badrinath, K. (2026) · International Conference on Machine Learning and Autonomous Systems (ICMLAS) · doi:10.1109/icmlas67792.2026.11483641
CHATBOT COMO FERRAMENTA DE APOIO TÉCNICO E GERENCIAL PARA HORTAS URBANAS NO SEMIÁRIDO BRASILEIRO
Nascimento, T. S., Clementino, V. D. R., da Silva, J. A. N., et al. (2026) · RECIMA21 - Revista Científica Multidisciplinar · doi:10.47820/recima21.v7i5.7876
Affordances and Constraints of Child-Voice Agent Interaction: A Scoping Review
Çakır, E., Karahanoğlu, A., Ludden, G., & Reidsma, D. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2658256
Desgroseilliers, J., Hamel, C., Ogundokun, K., & Latulippe, K. (2026) · Medicine Advances · doi:10.1002/med4.70065 · Cited by 2
“In neurodegenerative diseases, chatbots can support communication (e.g., via voice synthesis or text‐to‐speech), enable symptom monitoring, and guide caregivers in managing decline, thereby enhancing autonomy and reducing caregiver burden [16].”
Ethnobridge: Reviving Traditional Wisdom Through AI for Contemporary Wellness
Shaik, S., Abraham, M. I., & Senthamilarasi, N. (2026) · International Conference on Innovative Trends in Information Technology (ICITIIT) · doi:10.1109/icitiit68860.2026.11499738
AuraCare: AI Integrated Mental Health Companion
B, D. B. S., Akash Selvadoss, N., Rahul, K., Saranya, M., & Swarna Gowsalya, P. (2026) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs67901.2026.11502587
“AuraCare offers 24/7 availability, which human therapists cannot always guarantee[9].”
Kalhapure, P. J. R. M. A. M. V. V. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-34984
Arefi, S. M. S. A., Ahmad, W., Zarbouti, D., Eldeeb, H. B., Haider, S. A., & Godorozha, D. (2026) · UK-China Teaching, Learning, and Educational Technology (TILE-TEC) · doi:10.1109/tile-tec70450.2026.11682096
“Furthermore, the authors in [23] conducted a systematic review of AI-based chatbots in healthcare and found that such tools can support behavior change and mental health care, while also highlighting the importance of safety, transparency, and human supervision.”
Generative AI in Surgical Care: Evaluating Large Language Model Performance in Patient Education
Hall, A. E., Patel, A. K., Shariati, K., Perrotta, A. T., Argame, A. A., Tseng, C. Y., Tseng, C., Hidalgo, M. A., & Lee, J. C. (2025) · Journal of Artificial Intelligence for Medical Sciences · doi:10.55578/joaims.251202.001
“Their ability to enhance healthcare efficiency and personalize patient interactions has positioned them as promising tools in the evolving landscape of digital health technology [13–15].”
Evaluating Chatbots as Nursing Assistants in Palliative Care: A Narrative Review
Dehnayebi, M. J., Etedali, M., Safarabadi, M., Parnikh, H., & Talebi, H. M. (2026) · Indian Journal of Palliative Care · doi:10.25259/ijpc_144_2025 · Cited by 2
Conversational Agents in Augmented Reality: A Systematic Review
Wu, Y., Mahmud, R., Sawad, A. B., van den Hoven, E., & Kocaballi, A. B. (2026) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3815590 · Cited by 2
Self-citationAlam, N. (2026) · Journal of Couple & Relationship Therapy · doi:10.1080/15332691.2026.2670271
“The accessibility and non-judgmental nature of AI companions might offer therapeutic benefits (Laranjo et al., 2018).”
InfluentialSun, Y., & Wu, L.-Y. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1841351 · Cited by 3
“Such platforms can tailor content to individual learners’ needs, track progress, and provide timely interventions, thereby enhancing engagement and learning outcomes (67, 68).”
Liu, J., Yang, S. A., Ma, D., Niu, Q., Zhang, Z., Nagai‐Tanima, M., & Aoyama, T. (2026) · JMIR Infodemiology · doi:10.2196/90295 · Cited by 2
“Prior health chatbots have been typically retrieved from single knowledge sources [11], whereas our iterative multitool architecture integrates 4 heterogeneous collections, enabling responses that synthesize information across source types.”
Hemalatha, P., Dharani, G. S., Sandeep, K. S., Manoj, S., & Balaji, B. (2026) · International Conference on Artificial Intelligence and Machine Learning Applications Theme: Healthcare and Internet of Things (AIMLA) · doi:10.1109/aimla67915.2026.11522331
“…as a scalable patient support interface, with systematic reviews showing that unconstrained natural-language health chatbots are a new area of study but that many studies are still lacking rigorous evaluation of effectiveness and safety, and need safety-conscious designs and standard reporting[12].”
Conceptual analysis of Chatbots in nursing education applications
Li, L., Chen, X., Ma, S., Yang, Z., & Wang, Y. (2026) · Nurse Education Today · doi:10.1016/j.nedt.2026.107188
Khodaei, B., Alishani, M. M., Mirtajaddini, S., Jafari, B., & Alizadeh, S. (2025) · International Journal of Aging · doi:10.34172/ija.9099 · Cited by 1
“14 These virtual assistants do not take the place of the personal connection that happens between a nurse and a patient, but they do help.”
Graf, P., Hillmann, S., Zoellick, J. C., Laske, L., Jung, L., Voigt‐Antons, J., Harnisch, P. L., Ashrafi, N., Compagna, D., Therstappen, E., et al. (2026) · doi:10.2196/preprints.102156
Rabet, A., Khandan, A., Rabet, A., Rouzi, M. D., Rodriguez, F., Garibay, A., Armstrong, D. G., & Najafi, B. (2026) · Diabetology · doi:10.3390/diabetology7050096 · Cited by 1
“Therefore, while AI-enabled support is promising, its effectiveness depends on contextual intelligence, personalization, and integration within a patient-centered reinforcement strategy [28,29].”
M, G., Tj, P., A, M., & Gowda, A. (2026) · 2026 4th International Conference on Knowledge Engineering and Communication Systems (ICKECS) · doi:10.1109/ickecs70176.2026.11527615 · Cited by 1
An intention-oriented multi-agent dialogue system for patient-centered decision-making
Liu, P., & Xiao, L. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03498-x
Chahid, A., Chahid, I., Emharraf, M., & Belkasmi, M. G. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18894-6_21
The Formal Superior: Conversational Agent ShamAIn
Cho, H. (2026) · KAIST research series · doi:10.1007/978-981-92-0537-0_6
Role of AI chatbots in nutrition and dietary guidance
Agarwal, S., & Singh, V. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-40501-3.00014-5
Designing AI-Based Entrepreneurial Coaching Systems
Liebschner, J., Heinz, D., & Satzger, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-28313-9_2
Hatfield, S., & Tamm, J. (2026) · Theoretical and Applied Ergonomics · doi:10.3390/tae2030017
Can AI Care? Affective Large Language Models for Adolescents: Empathy, Trust, and EngagementPreprint
Watfa, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6866619
Yusuf, H., Money, A., & Daylamani-Zad, D. (2026) · Educational Technology Research and Development · doi:10.1007/s11423-026-10634-x · Cited by 1
Abzhanova, D., Toxanov, S., & Biloshchytskyi, A. (2026) · IEEE Conference on Technologies for Sustainability · doi:10.1109/sustech67720.2026.11536498
Digital empathy in online communication: A systematic literature review
Dewi, W. N. A., Purwanto, E., & Mulawarman, M. (2026) · Counsenesia Indonesian Journal Of Guidance and Counseling · doi:10.36728/cijgc.v7i1.6566 · Cited by 3
Thapar, P., Harsh, Tripathi, Y., Anand Krishnan, P. K., Sameer, U. S., Diwakar, A., & Yadav, V. S. (2026) · International Conference on Intelligent Systems in Engineering, Secured Systems and Cybersecurity (ICISESSC) · doi:10.1109/icisessc68634.2026.11542800
Vankit, S. A., Shama, N. S., Kadam, J. A., Toxtli, C., & Volonte, M. (2026) · Computer Animation and Virtual Worlds · doi:10.1002/cav.70146
“ECAs are increasingly deployed in digital health to deliver scalable, interactive, and personalized interventions across prevention, treatment, and self-management contexts [6, 7].”
Rao, S. A., Saxena, J., Patil, S., & Singh, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7426-0.ch013
Ethical Sensemaking in AI Mental Health Chatbots: An Analysis of User Reviews
Rahman, M. M., & Chaudry, B. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3813050
“Typically embedded in direct-to-consumer (DTC) applications, they draw on therapeutic techniques such as cognitive behavioral strategies, mood tracking, and reflective prompts to provide emotional support and guided reflection outside traditional clinical settings [37, 60].”
Angermayr, K., Neuendorf, N. L., & Scherr, S. (2026) · Health Communication · doi:10.1080/10410236.2026.2666885
Jeong, Y., Cha, H., & Suh, E. E. (2026) · JMIR Cancer · doi:10.2196/96241 · Cited by 5
“Multiturn conversational interaction refers to systems that maintain context by integrating the current message and previous conversation history when generating responses [17, 18].”
Kim, Y., Hong, J., & Lee, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2678531 · Cited by 1
García-Viola, A., Márquez‐Hernández, V. V., Garrido-Molina, J. M., Alcayde, A., & Rodríguez-García, M. C. (2026) · JMIR Research Protocols · doi:10.2196/92511
“Conversational agents based on structured and rule-based architectures have demonstrated utility in health care by providing information, guidance, and emotional support in an accessible and continuous manner [24-26].”
ElshikhIdris, M. A. M., Ali, A. S. H., Mahmoud, S. Y., Aziz, Y. M. S., Ali, I., Farah, S., & Altayeb, W. F. M. (2026) · Cureus · doi:10.7759/cureus.111334
“Laranjo et al. [8] similarly concluded that no single architecture is superior across all contexts and that user-centred design and workflow integration matter more than technological sophistication alone.”
Deva, R., Thapa, A., Mehta, Z., Kapile, S. K., Jalota, S., Karusala, N., & Ismail, A. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806721 · Cited by 1
“Yet, as researchers and practitioners have started using LLMs to mediate sensitive forms of health communication, there is a growing recognition of the mismatch between what evaluation metrics capture and what actually matters in use [11, 32].”
InfluentialJiang, Q., Chen, X. S., Patel, D., Brazendale, K., & Alejandro, S. (2026) · JMIR Pediatrics and Parenting · doi:10.2196/98889
“Digital health and mHealth have rapidly expanded as a delivery channel for behavior change interventions, supported by widespread mobile device access and increasing interest from health systems in scalable, low-cost approaches [9,10].”
What Older Adults Need from Digital Loneliness Support: A Mixed-Methods Requirements StudyPreprint
Zhao, J., & Or, C. K. (2026) · Research Square · doi:10.21203/rs.3.rs-9991723/v1
Patil, P., Mouli, S., & Dai, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6993650
You, C., Ghosh, R., Maxim, A., Peng, X., Tamboli, D. N. A., Huang, Z., Canales, R., Venkatakrishnan, R., & Lok, B. C. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29842-3_28 · Cited by 1
McAlister, K. L., Jewell, C. C., & Huberty, J. (2026) · JMIR Formative Research · doi:10.2196/95811
“These AI agents differ from earlier static or rule-based AI tools by enabling dynamic, free-text dialogue that can adapt in real time to user input [12].”
Shah, N., Morris, M., Daraban, C., Johnson, S., & Murphy, S. L. (2026) · Arthritis Care & Research · doi:10.1002/acr.80109 · Cited by 1
Wang, T., Hongyu, D., Zhou, G., & Mao, Y. (2026) · Frontiers in Oral Health · doi:10.3389/froh.2026.1870413
“This is particularly true for apical surgery, here patient-oriented information is often simplified, fragmented, or shaped by the communication style favored by a given platform (11, 12).”
Kharshid, A. M., Alasasfeh, O., Saleh, M., Halasah, A., Alsulman, S. A., Alfaqeer, R., Tarawneh, R., Alhawarneh, D., Maaitah, F., & Alkfaween, M. (2026) · Pharmacia · doi:10.3897/pharmacia.73.e186370
Akpan, A., Sandy, I. M., Oloko, O., Ebubechi, A., Nwachukwu, E., Ilo, C., Timothy, M., James, E. A. U., Udoubom, I. A., Kinoti, J., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-10175428/v1
Petify: Enhancing Pet Wellbeing Through Smart Technology
Dhinesh kumar, R., R, D. A., & Venkatesan, S. (2025) · International Conference on Emerging Research in Computational Science (ICERCS) · doi:10.1109/icercs65898.2025.11581184
“Almost all chatbots in health care incorporate conversational AIs, which are greatly needed in accessibility improvements [9].”
Sheikh, M., Chen, C., & Haque, M. R. (2026) · ACM Interactive Health Conference · doi:10.1145/3786579.3804968
Beyond AI Capability – Governance, Trust, and Realistic Scope in Rural Health Chatbots
Krayter, S., Bhattacharjee, S., Fatima, F., Patanker, A., Epping, L., & Müller, C. (2026) · ACM Interactive Health Conference · doi:10.1145/3786579.3804951
“Conversational agents (chatbots) have emerged as a promising intervention to lower informational barriers and improve service discovery [24].”
Stakeholder-Informed Design of LLM-Based Chatbots for Post-secondary Mental Health Support
Shayaninasab, M., Kim, J. E., Kitson, A., & Yalçın, Ö. N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31048-4_8
Brucker-Kley, E., Keller, T., Scherer, C., Segerer, S., & de Spindler, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30542-8_26
Xie, Q., Ye, D., Ren, R., & Hua, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29596-5_16
Chen, L., & Chen, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30414-8_1
Scaling Healthcare Engagement with AI Voice Agents: A Real-World Evaluation Study
Ellis, R. J., Goodman, M., Moturu, S. T., Philip, S., Buzzard, P., Madan, A., & Berry, S. K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30813-9_67
Diviani, N. (2026) · Springer eBooks · doi:10.1007/978-3-032-11375-7_441
Li, C., & Shi, Y. (2026) · PLoS ONE · doi:10.1371/journal.pone.0353384
“As conversational health technologies became increasingly prevalent, Laranjo et al. [49] emphasized that usability and interaction capabilities were central considerations in the adoption and evaluation of such systems in health contexts.”
NG-SAC-M: Nash-guided SAC with migration for IoT healthcare
Bouchemal, N., Zendaoui, N., & Siari, N. B. (2026) · Computer Networks · doi:10.1016/j.comnet.2026.112535
Abesadze, N., Fernandes, A., & Rubin, E. (2026) · Cureus · doi:10.7759/cureus.112306
Lengier, M., Zych, S., Powęska, N., Świstak, S., Pastuszak, F. C., Małyszek, P., Świderska, M., Buziak, J., Papińska, J., & Pielacha, J. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.2(50).2026.5736
Zhou, H., Skalski-Fouts, Z., Nguyen, L., Rivera, C., Spring, B., Miao, H., & Zhang, X. (2026) · Smart Health · doi:10.1016/j.smhl.2026.100694
Machado, S., Muthreja, C., Mody, P., Rampariya, I., Shah, V., Mangrulkar, R., & Badgujar, C. (2026) · International Conference on Innovations in Communication, Geoscience and Robotics (ICICGR) · doi:10.1109/icicgr68236.2026.11600207
PacePal: A Geo-Aware Retrieval-Augmented Chatbot Prototype for Walking Support
Chakraborty, S., Shoaib, M., Sarfraz, M. M., & Tabassum, M. (2026) · International Conference on Human Centric Artificial Intelligence (ICHCAI) · doi:10.1109/ichcai70183.2026.11607641
“Conversational agents in healthcare more broadly have been systematically reviewed, revealing their potential for chronic disease management, mental health support, and patient education, while highlighting the need for rigorous evaluation frameworks [8].”
AI Chatbots on South African University Library Websites
Molepo, M. J., & Shokane, M. (2026) · De Gruyter eBooks · doi:10.1515/9783111336459-003
Marey, A., Pal, B., Yaşar, A. B., Rath, S., Francese, G., Ghorab, H. M., Niemierko, J., Jamill, M. S. W., & Umair, M. (2026) · JMIR Formative Research · doi:10.2196/95883
“This dimension is aligned with patient-centered communication evaluations in conversational AI research [19,22,25].”
SPARC: Exploring Interaction, Sensemaking, and Engagement in AI-Augmented News Reading
Besheli, M. A., & Jasim, M. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816213 · Cited by 1
“Recent advances in conversational AI systems provide new opportunities to support sensemaking tasks in various domains, such as healthcare [37] and e-commerce [27], and data analytics [48].”
Logical consistency as a foundation for emotional persuasion by AI
Tsumura, T., & Terada, K. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100363 · Cited by 1
Sevgi, M., Ong, A. Y., Lean, K., Rees, S., Lim, E., Merle, D., Day, A. C., Hussain, B., Keane, P., Higham, A., et al. (2026) · JMIR Formative Research · doi:10.2196/90809
“Previous research has highlighted public and patient concerns regarding the lack of perceived empathy and the risk of depersonalization when using automated systems in health care [29,31].”
Wati, N. H., Hantono, B. S., & Permanasari, A. E. (2026) · IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT) · doi:10.1109/iaict71158.2026.11621050
“3) Limitations of Local NLP: The creation of trust-worthy and contextual chatbots is hampered by the underutilization of NLP models tailored for the Indonesian language, particularly in the healthcare industry [12]–[14].”
Denecke, K., & Gabarrón, E. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1785085 · Cited by 1
Pavão, J., Bastardo, R., Silva, A. G., & Rocha, N. P. (2026) · JMIR Human Factors · doi:10.2196/102911
“In addition, AI techniques have enabled more advanced dialogue management, facilitating the exhibition of human-like behaviors, the recognition of users’ emotions and intentions, and the use of various information sources for reasoning and decision-making [8-10].”
InfluentialRathmann, R., Bozkurt, A., Kaindl, A., Piazza, A., & Garg, R. (2026) · Edition HMD · doi:10.1007/978-3-658-51795-3_19
Brucker-Kley, E., Keller, T., Segerer, S., Scherer, C., & de Spindler, A. (2026) · Edition HMD · doi:10.1007/978-3-658-51795-3_22
Wójcik, S., Domienik‐Karłowicz, J., & Rulkiewicz, A. (2026) · doi:10.2196/preprints.107978
CurePro: A Hybrid Conversational AI and Patient Assistant Model for Digital Healthcare
Gautam, R., Koushik, R., Parashar, R., et al. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30909-9_44
Martínez, M. R., Díaz, V. C., & Cambra, U. C. (2026) · VISUAL REVIEW International Visual Culture Review / Revista Internacional de Cultura Visual · doi:10.62161/revvisual.v18.5863
The application of chatbots in perinatal mental health interventions: a scoping review protocol
Huang, Z., Ma, G., Ding, Q., Dai, D., Ye, Y., Shi, Y., & Gu, C. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-116106
Carvalho, D. B. F., Souza, E. D. P., Dias, B. P. M., Detomi, G. H. A., Sousa, P. V. F., Dias, W. M., & Viana, M. C. (2026) · Anais do Workshop sobre as Implicações da Computação na Sociedade (WICS) · doi:10.5753/wics.2026.21040
“Em contextos sensíveis, como a saúde mental, tais limitações podem resultar em aconselhamento inadequado, autoridade percebida indevida, falhas de redirecionamento para cuidado humano e uso fora do escopo clínico apropriado (Laranjo et al. , 2018; Blease et al. , 2019).”
Panela, T. L. V. (2026) · International Journal of Biosciences (IJB) · doi:10.12692/ijb/28.5.186-194
BioMistral-Powered Chatbot for CT Image Analysis and Patient Summaries
Gani, S., Shirodkar, V., & Giraddi, S. G. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31523-6_29
Technology “Synthetic patient” and development of Surgical-Case-Simulator web application
Litvin, A., Берещенко, В. В., М., Г. Ф., & Leohenkii, N. A. (2026) · Health and Ecology Issues · doi:10.51523/2708-6011.2026-23-2-15
Health Intelligence Recommendation System
Satvika, A., Hemanth, S. V., Reddy, B. S. C., et al. (2026) · doi:10.1109/gseact68539.2026.11620096
“Laranjo et al. [14] demonstrated how conversational agents enhance self-care and patient engagement.”
Laranjo, L., Zeng, A., O’Hagan, E. T., Trivedi, R., Sathiaraj, R., Thomas, S., Thiagalingam, A., Kovoor, P., Sivagangabalan, G., Kizana, E., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-120834
Self-citationJeong, M.-A., & Kim, S.-D. (2026) · Applied Sciences · doi:10.3390/app16167899
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.