Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 1,001–1,100 of 1,371
AI Chatbots for Psychological Health for Health Professionals: A Scoping Review (Preprint)Preprint
Han, J.-H., Baek, G., & Cha, C. (2024) · doi:10.2196/preprints.67682 · Cited by 1
Enhancing Gaze Prediction in Multi-Party Conversations via Speaker-Aware Multimodal Adaptation
Lee, M.-C., & Deng, Z. (2025) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3716553.3750755
“In recent years, dialogue agents, including interactive robots and virtual agents, have become increasingly prevalent across various domains, from customer service and healthcare to education and entertainment [17].”
Ghosh, R., You, C., Venkatakrishnan, R., & Lok, B. C. L. (2025) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3765766.3765769 · Cited by 1
“As virtual agents take on more prominent roles in sensitive health domains, perceived trust becomes critical to user acceptance and adherence to their advice [14, 41, 54, 82].”
Abedi, A., Chu, C. H., & Khan, S. S. (2026) · doi:10.2196/preprints.91559 · Cited by 1
Pambudi, R. U., Shiddiqi, A. M., Ijtihadie, R. M., Amoriza, M. N. A. R., Tee, H., Madany, F. A., Akbar, R. J., & Navastara, D. A. (2026) · SoftwareX · doi:10.1016/j.softx.2026.102537 · Cited by 1
Han, L., Wei, M., Chen, Q., Wang, A., Pang, R., & Yip, D. K. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789085
“Advances in natural language processing (NLP) and machine learning (ML) have enabled CAs capable of engaging users in fluid, human-like dialogue [39].”
Smart Doctor: An Intelligent App for Medical Advice and Digital Health Record
Parvez, R. M. S., Choyon, A., Hasanuzzaman, & Rahman, A. (2019)
Classification as Decoder: Trading Flexibility for Control in Medical DialoguePreprint
Shleifer, S., Chablani, M., Kannan, A., Katariya, N., & Amatriain, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08554
“enerations to a fixed set of high quality responses. 2 Related Work Healthcare dialog models: Most published dialog models in healthcare generate templated content supported by a knowledge graph (c.f. [5] for a comprehensive survey). [6] proposes Woebot, a conversational agent designed to deliver cognitive behavioral t…”
BackgroundMonteiro, M. D. S., & Salgado, L. (2019) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.5753/ihc.2019.8415
“Dentre os trabalhos que fizeram revisões de literatura do uso de AIC em saúde [2, 10, 19], no mais recente, apresentado por Montenegro, da Costa e Righi [12] em 2019, os autores buscaram os principais contextos de interação e modelos de comunicação envolvendo AIC.”
BackgroundFeledichuk, D. (2019) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-9avb-gq80 · Cited by 1
How do Physiotherapists and Patients talk? Developing and annotating RiMotivAzione dialogue corpus.
Bolioli, A., Alloatti, F., Guadalupi, M., et al. (2019)
Laiteerapong, N. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-05707-3
Understanding User Utterances in a Dialog System for Caregiving
Asao, Y., Kloetzer, J., Mizuno, J., Saiki, D., Kadowaki, K., & Torisawa, K. (2020) · Language Resources and Evaluation · Cited by 4
Baclic, O., Tunis, M. C., Young, K., Doan, C., & Swerdfeger, H. (2020) · Relevé des maladies transmissibles au Canada · doi:10.14745/ccdr.v46i06a02f
Desenvolvimento e avaliação de um agente conversacional para candidatos à doação de sangue
Roman, M. K., Bellei, E. A., Biduski, D., Araújo, C. S., & Marchi, A. C. B. D. (2020) · doi:10.5753/sbcas.2020.11567
“Resultados dos itens e escalas do User Experience Questionnaire.”
BackgroundDetecting the patient's need for help with machine learningPreprint
Lahti, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.13626
Paschoal, L. N. (2020) · Conferencia Iberoamericana de Software Engineering · Cited by 1
Agarwal, S., Alhuwail, D., & John, O. (2020) · Springer eBooks · doi:10.1007/978-3-030-05325-3_73-1
Hossain, M. Y., Azhar, U., To, Y., Choi, J. M., & Zaman, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77820-0_6
[Learning the nursing process in nursing education].
Hentinen, M., & Janhonen, S. (1990) · PubMed · Cited by 3
Olga iCognito group, & Zakharov, A. (2021) · doi:10.2196/preprints.35977 · Cited by 1
Li, Y., Zhu, B., Liu, X., Li, J., Chen, D., Liang, S., & Bressington, D. T. (2022) · doi:10.2196/preprints.36116
Dialogue management based on forcing a user through a discourse tree of a text
Galitsky, B. A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-824521-7.00004-1
Mee, S. J., & Daher, S. (2022) · Computer · doi:10.1109/mc.2021.3126528
Detecting the patient’s need for help with machine learning based on expressions
Lahti, L. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01502-8 · Cited by 1
Enhancing service interactions with conversational agents
van Pinxteren, M. M. E. (2022) · Research Publications (Maastricht University) · doi:10.26481/dis.20220524mp · Cited by 2
College Enquiry Chat Bot System with Text to Speech
Chaudhari, P., Lokhande, S., Ghule, V., et al. (2022) · International Journal of Scientific Research in Science and Technology · doi:10.32628/ijsrst229139
Amusa, L. B., & Twinomurinzi, H. (2022) · doi:10.2196/preprints.39157
Exploring the role of health apps in supporting young people with depression: a mixed methods study
Martinengo, L. (2021) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/157124
Hunsrisakhun, J., Pithpornchaiyakul, S., Naorungroj, S., & Pupong, K. (2022) · doi:10.2196/preprints.39218
Bastardo, R., Pavão, J., & Rocha, N. P. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-04826-5_31 · Cited by 1
Martinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M. R., Kowatsch, T., Atun, R. A., Michie, S., & Car, L. T. (2022) · doi:10.2196/preprints.39243
Calvo, R. A., Peters, D., Cook, D., Rizos, G., Schuller, B., Wong, E., Kallis, C., & Quint, J. K. (2022) · doi:10.2196/preprints.42965
Zapke, L., Liebs, H., Davis, J., Kollwitz, C., Liebergesell, M., Bontrup, F., & Gohil, K. (2022) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-022-00926-0
“So finden sie nicht nur Einsatz in der Symptomüberprüfung, sondern auch in der Therapie, dem Selbstmanagement, in der Bereitstellung von GI und der Prävention (Abdalrazaq et al. 2019; Frangoudes et al. 2021; Laranjo et al. 2018).”
BackgroundDhinagaran, D. A. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/163179
Musil, B., & Plohl, N. (2022) · doi:10.18690/um.ff.11.2022.11 · Cited by 1
Umetna inteligenca in eksistenčno tveganje
Lipuš, A. (2022) · doi:10.18690/um.ff.11.2022.10
Borstner, B., & Šetar, N. (2022) · doi:10.18690/um.ff.11.2022.5 · Cited by 5
Od Descartesa do Alexe: filozofski pogled na razvoj umetne inteligence
Bregant, J. (2022) · doi:10.18690/um.ff.11.2022.1 · Cited by 1
Transformacija 'inteligence roja' {Swarm Intelligence} na umetno inteligenco
Martinc, U., Aberšek, B., & Borstner, B. (2022) · doi:10.18690/um.ff.11.2022.9 · Cited by 1
Artificial Intelligence Applications in Clinical Neurosurgery
Sobhanian, P., Shafizad, M., Karami, S., Mozaffari, F., Arab, A., Razani, G., Shafiekhani, P., & Safari, S. (2022) · Precision Medicine and Clinical OMICS · doi:10.5812/pmco-133563 · Cited by 2
Application of Voice Personal Assistants in the Context of Smart University
Ochoa-Orihuel, J. (2022) · Repositorio Institucional de la Universidad de Burgos (University of Burgos) · doi:10.36443/10259/7454
Czere, J. T., & Péntek, M. (2022) · IEEE International Symposium on Intelligent Systems and Informatics (SISY) · doi:10.1109/sisy56759.2022.10036294 · Cited by 1
Exploring Accessibility and Companionship in Boardgames via Alexa
Karim, S. (2023) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2023-15403
Mancini, A., & Fabbo, A. (2023) · Springer eBooks · doi:10.1007/978-3-031-27968-3_33
Inoue, K., Lala, D., Ochi, K., Kawahara, T., & Skantze, G. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3610661.3617151
“Socially-situated conversations encompass a wide range of interactions, from brief exchanges such as reception and information guide [7, 22] to more extended conversations such as counseling [4, 13, 18, 20] and interviews [6, 8, 11, 24].”
BackgroundA Systematic Review of Chatbot-Enabled Chronic Disease Management Interventions and mHealthPreprint
Islam, J., Hasan, M., & Hasan, M. M. (2023) · doi:10.36227/techrxiv.22815275.v2
Smart AI Bot for Healthcare Assistance
Ghoul, Y., & Zitouni, N. (2023) · The Springer series in applied machine learning · doi:10.1007/978-3-031-41925-6_12
AI: The Future of Family Medicine
Asif, M. (2023) · World Family Medicine Journal/Middle East Journal of Family Medicine · doi:10.5742/mewfm.2023.95256206
Guimarães, G. R., Silva, C. S., Contreras, J. C. Z., Figueiredo, R. G., de Pesquisa, U. G., Tiraboschi, R. B., Gomes, C. M., & de Bessa, J. (2023) · medRxiv · doi:10.1101/2023.11.10.23294668
“More recently, chatbots, which combine AI with messaging interfaces, have emerged as precise tools for generating direct responses(14,15).”
MethodPires, J. G. (2024) · medRxiv · doi:10.1101/2023.12.31.23300681 · Cited by 2
“Safer”: Design and Development of a Supportive Assistant for Emotion Regulation
Diano, F., Ponticorvo, M., & Sica, L. S. (2023) · IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) · doi:10.1109/metroxraine58569.2023.10405747
“However, AI limitations and the need for substantial financial resources pose challenges [4, 26].”
BackgroundShould Conversational Agents Care About Our Gender Identity?
Cocchi, A., Bosse, T., & van Pinxteren, M. M. E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-54975-5_9 · Cited by 3
Machine Learning in Medical Imaging: Ethico-Legal and Privacy Issues
Sıngh, V., & Rani, S. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-5261-8.ch003
Introduction to Artificial Intelligence (AI) and AI-Related Concepts
Brigham, C. R., Buttar, W. A., Bucksbaum, M., & Talmage, J. B. (2023) · AMA guides newsletter · doi:10.1001/amaguidesnewsletters.2023.sepoct03
MindMate: Nurturing Mental Wellness
Manda, R. (2024) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem32468
Li, L., Marcelo, A. C., Yu, C. C. H., Law, A. T. P., & Ferreira, M. L. (2024) · doi:10.2196/preprints.60460
Fernandes, U. D. S., Chagas, B. A., & Prates, R. O. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60615-1_3
The Co-design Process in the Creation of Conversational Agents for People with Dementia
Dawood, S., Alsarhan, R., Albesher, A., Alsedais, F., Aldakheel, A., Alangari, S., & Almoammar, N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61546-7_22 · Cited by 3
Artificial Intelligence to Support Self-management and Coaching
Mitchell, E. G., & Mamykina, L. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13244-5.00007-9
Unveiling the Transformative Landscape: A Bibliometric Exploration of AI Integration in Healthcare
Chandel, A., Gopal, K., Pahuja, A., & Nayyar, V. (2024) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/979-8-3693-6660-8.ch014
A Structured Literature Review on Conversational Agents that Empower Health Interventions
Pietrantoni, N. (2023) · International Conference on Information Systems and Software Technologies (ICI2ST) · doi:10.1109/ici2st62251.2023.00024 · Cited by 1
“In addition, the Context was adopted from Laranjo et al. [11] and Parmer et al. [66] and refined through an iterative process using the health domains mentioned in the samples.”
Evolution of Generative AI in Healthcare
Thakur, N. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-3731-8.ch002 · Cited by 1
Huang, Y., Li, L., Dong, W., Dong, Y., Huang, Y., & Liu, H. (2024) · doi:10.2196/preprints.65435 · Cited by 1
The Use of Conversational Agents in Self-Management: A Retrospective AnalysisPreprint
Çolakoğlu, S., Durmus, M., Polat, Z. P., Yildiz, A., & Sezgın, E. (2024) · medRxiv · doi:10.1101/2024.09.01.24312881
“18 In addition, the current studies with CAs concentrated on text-based and smartphone app–delivered CAs with a focus on small case studies, suggesting further work on the feasibility, acceptability, and effectiveness of different CA formats.”
BackgroundSharpe, B. T. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/p8akd
Consumer and Chatbots – A New Level of Interaction: A Systematic Review
Sanak-Kosmowska, K., & Kaczorowska–Spychalska, D. (2023) · Przegląd Organizacji · doi:10.33141/po.2023.04.47
PuzzleAide: Comparing Audio and Embodied Assistants for MR Puzzle-Solving
Hajahmadi, S., Mostajeran, F., Heuer, K., Lux, A., Mends-Cole, G. O., Cascarano, P., Steinicke, F., & Marfia, G. (2024) · ACM Symposium on Spatial User Interaction (SUI) · doi:10.1145/3677386.3688899
“Evolving from simple rule-based chatbots, CVAs now span diverse applications in healthcare, education, and entertainment [11, 15, 18, 22, 27].”
Six, S., Schlesener, E. A., Hill, V., Babu, S. V., & Byrne, K. A. (2024) · doi:10.2196/preprints.67330
Socially Competent Agents That Care
Wolfert, P., Neerincx, A., Thunberg, S., et al. (2024) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3687272.3691360
“Embodied conversational agents have potential to e.g., improve physical activity, nutritional behavior, and accessibility to online health information [3].”
Building an extensible, AI-augmented ecological momentary assessment platform
Zhao, F. (2024) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/105952 · Cited by 2
Transforming Healthcare Management
Rao, P. B., Raghavendra, R., Suresh, S., Bhingradiya, T. A., Mehta, T., Savaliya, S. H., & Singh, H. B. (2024) · Advances in computer and electrical engineering book series · doi:10.4018/979-8-3693-9591-2.ch001
di Bona, K., Ijaz, K., & Ahmadpour, N. (2024) · doi:10.2196/preprints.69833
Challenges in Evidence‐Based Healthcare
Frain, J. (2025) · Wiley eBooks · doi:10.1002/9781394219346.ch9
Jimenez, D., Castano-Villegas, N., Llano, I., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5133901
An E-Learning Tool to Combat AMR
Schranz, G., Camilleri, V., Sciortino, M., & Tartari, E. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-85363-0_14 · Cited by 1
A Systematic Review of Virtual Health Assistants in Preventive Cancer Care Communication (Preprint)Preprint
Raisa, A., Chen, X., Bryan, E. G., Bylund, C. L., Alpert, J. M., Lok, B. C. L., Fisher, C. L., Thomas, L., & Krieger, J. L. R. (2025) · doi:10.2196/preprints.73616
Quantitative Review of Conversational Agents in E-Health Using NLP and AI
Carchiolo, V., & Malgeri, M. (2024) · Global Congress on Emerging Technologies (GCET) · doi:10.1109/gcet64327.2024.10934583 · Cited by 1
Jung, S., Kum, J., & Lee, M. (2025) · Electronics · doi:10.3390/electronics14081592
Yun, B., Kim, B., Lee, J. H., Ko, H., Kim, J., Kim, W., Kim, B. R., Park, S. Y., Kim, J., & Kim, G. H. (2025) · doi:10.2196/preprints.75308
Interaction in Cognitive Behavioral Therapy
Shidara, K., & Kudo, T. (2025) · Springer eBooks · doi:10.1007/978-981-96-1313-7_11 · Cited by 1
Routine Change in Obesity and Type 2 Diabetes
Bassin, S. R., Vaca, R., & Srinath, R. (2025) · Springer eBooks · doi:10.1007/978-3-031-82888-1_29
Abe, K., Quan, C., Cao, S., & Luo, Z. (2025) · Applied Sciences · doi:10.3390/app15095092 · Cited by 2
Exploring Young Adults' Attitudes Towards AI-Driven mHealth Apps: A Qualitative Study (Preprint)Preprint
Aboueldahab, A., Damaschi, G., D’Αddario, M., & Steca, P. (2025) · doi:10.2196/preprints.76075
Serenify: An AI-Powered Virtual Therapist for Accessible Mental Health Support
Chauhan, V. P., & Goel, V. (2025) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2025.70773
Improving query reformulation in voice search
Sa, N. (2020) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/g6aq-kcrr
Frank, K., Mücksch, J., Siems, F., & Schubert, K. (2025) · Forum Dienstleistungsmanagement · doi:10.1007/978-3-658-48325-8_25
Designing a Neural Question-Answering System for Times of (Information) Pandemics
Graf, J., Lancho, G., Heinrich, K., Möller, F., Schoormann, T., & Zschech, P. (2025) · Information Systems Management · doi:10.1080/10580530.2025.2507175
“QASs serve, among other purposes, as chatbots for customer support (Sharma & Gupta, 2018) and conversational agents in medicine (Laranjo et al., 2018).”
Diviani, N. (2025) · Springer eBooks · doi:10.1007/978-3-031-40858-8_441-1 · Cited by 1
Zhou, B., Yan, X., Shi, J., Xiang, Y., Chen, D., Yao, Q., & Yinjun, H. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1535270
“These intelligent human-computer interaction technologies have the potential to automate routine tasks, such as providing health consultations (16–18), auxiliary diagnosis (19, 20), and efficient information collection (21).”
In Reply to Kleebayoon and Wiwanitkit
Lee, J. J., Byun, H. K., Kim, Y. T., et al. (2025) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2025.03.071
Leveraging BERT Variants for Intent Classification in Patient Summary Chatbots
Vasili, A., & Schiza, E. C. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-97313-0_18
Clinical Decision Support Systems (CDSS) and Symptom Checkers in Primary Healthcare
Demurtas, J., Crescitelli, M. E. D., Meer, A., Laranjo, L., Oyugi, J. O., Kirk, U. B., & Huibers, L. (2025) · TELe-Health · doi:10.1007/978-3-031-89661-3_26
Self-citationMahto, M. K., Srivastava, D., & Srivastava, S. K. (2025) · Wiley eBooks · doi:10.1002/9781394275397.ch9
Furuya‐Kanamori, L., & Flaherty, G. T. (2025) · Journal of Travel Medicine · doi:10.1093/jtm/taaf068
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.