Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 301–400 of 1,371
Agher, D., Sedki, K., Desprès, S., Albinet, J.-P., Jaulent, M., & Tsopra, R. (2022) · Journal of Medical Internet Research · doi:10.2196/25384 · Cited by 31
“Alternatively, a conversational agent (or chatbot), a computer program designed to simulate human text or verbal conversations [47,48], could be added.”
BackgroundDenecke, K., & May, R. (2022) · Journal of Medical Internet Research · doi:10.2196/41583 · Cited by 27
“Relying on language, a CA might support multiple languages or only one [28].”
InfluentialRealism of the face lies in skin and eyes: Evidence from virtual and human agents
Vaitonyté, J., Blomsma, P. A., Alimardani, M., & Louwerse, M. M. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100065 · Cited by 34
Acceptance of technological agency: Beyond the perception of utilitarian value
Yu, B., Vahidov, R. M., & Kersten, G. E. (2021) · Information & Management · doi:10.1016/j.im.2021.103503 · Cited by 33
Conversational agents for depression screening: A systematic review
Otero-González, I., Pacheco-Lorenzo, M. R., Iglesias, M. J. F., & Anido, L. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105272 · Cited by 34
Khosravi, M., & Azar, G. (2024) · Digital Health · doi:10.1177/20552076241247983 · Cited by 36
“40 In summary, the evidence regarding the factors in fl uen-cing the engagement of patients with chatbots in the outcome category seems to be insuf fi cient for any de fi nitive conclusion.”
BackgroundChatbots Utility in Healthcare Industry: An Umbrella Review
Afsahi, A. M., SeyedAlinaghi, S., Molla, A., Mirzapour, P., Jahani, S., Razi, A., Mojdeganlou, P., Karimi, E., Mehrtak, M., Dadras, O., et al. (2024) · Frontiers in Health Informatics · doi:10.30699/fhi.v13i0.561 · Cited by 28
Perioperative application of chatbots: a systematic review and meta-analysis
Lin, S.-J., Sun, C., Chen, D., Kang, Y., Lai, N. M., Chen, K., & Chen, C. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100985 · Cited by 39
“Future multicentre trials with varied and diverse populations are also expected to help establish the applicability and effectiveness of chatbots across different demographics and clinical settings.”
Beyond one-shot explanations: a systematic literature review of dialogue-based xAI approaches
Mindlin, D., Beer, F., Sieger, L. N., Heindorf, S., Esposito, E., Ngomo, A.-C. N., & Cimiano, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11007-7 · Cited by 42
“Domain-specific chatbot reviews Surveys often examine dialogue systems within specific domains, such as medicine (Laranjo et al. 2018; Vaidyam et al. 2019; Montenegro et al. 2019) and education (Paladines and Ramirez 2020), as well as systems designed for open-domain purposes (Huang et al. 2020 ).”
Speech diversity and speech interfaces: considering an inclusive future through stammering
Clark, L., Cowan, B. R., Roper, A., Lindsay, S., & Sheers, O. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406139 · Cited by 25
“As speech interfaces becomemore mainstream, research is beginning to explore how they can be placed in a wide variety of contexts such as healthcare [14], automotive interfaces [13], education [12] and retail [21].”
BackgroundA Chatbot System to Support Mine Safety Procedures during Natural Disasters
Tsai, M., Chan, H.-Y., Chan, Y.-L., Shen, H.-K., Lin, P.-Y., & Hsu, C.-W. (2021) · Sustainability · doi:10.3390/su13020654 · Cited by 35
“Laranjo et al. [17] observed that recent studies of chatbots in the medical field are commonly related to mental health and suggested that the utilization of chatbots for health-related issues is an emerging research field.”
BackgroundMlakar, I., Šafran, V., Hari, D., Rojc, M., Alankuş, G., Luna, R. P., & Ariöz, U. (2021) · Symmetry · doi:10.3390/sym13071187 · Cited by 27
“The conversational agents have the potential to play a significant role in healthcare; from assistants during clinical consultations, to supporting positive behavior changes, or as assistants in living environments helping with daily tasks and activities [19,20].”
BackgroundDigital Therapeutics: Virtual Coaching Powered by Artificial Intelligence on Real-World Data
den Akker, H. O., Cabrita, M., & Pnevmatikakis, A. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.750428 · Cited by 27
“Conversational agents, also referred to as virtual agents, are receiving growing interest in the healthcare domain (Provoost et al., 2017; Laranjo et al., 2018; Kamali et al., 2020).”
BackgroundPham, V. K., Thi, T. D. P., & Duong, N. T. (2024) · SAGE Open · doi:10.1177/21582440241300007 · Cited by 50
“Previous studies attempted to explain AI-powered information search behavior from different perspectives such as Chatbots and Conversational Agents (Laranjo et al., 2018; J. Li et al., 2016).”
Mehl, A., Bergey, F., Cawley, C., & Gilsdorf, A. (2020) · JMIR mhealth and uhealth · doi:10.2196/21364 · Cited by 26
“In the past years, a growing number of studies have shown the benefits of mobile phone app–based symptom assessment tools for improved health outcomes (eg, in lowering the barrier to seek help) [23-29].”
BackgroundDigital encounters: Human interactions in mHealth behavior change interventions
Müssener, U. (2021) · Digital Health · doi:10.1177/20552076211029776 · Cited by 31
“in the form of mobile apps.(40) Chatbots are designed based on data of individual characteristics and behavior trajectories.”
BackgroundMaharjan, R., Rohani, D. A., Bækgaard, P., Bardram, J., & Doherty, K. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469600 · Cited by 25
“The growing trend in ownership of smart speaker devices including Amazon’s Echo and Google’s Home [46] has led to increased interest in these systems’ potential to support healthcare [25, 27, 28, 31, 44].”
BackgroundSiedlikowski, S., Noël, L.-P., Moynihan, S. A., & Robin, M. R. (2021) · Journal of Medical Internet Research · doi:10.2196/27283 · Cited by 27
Puspitasari, I. W., Rinawan, F. R., Purnama, W. G., Susiarno, H., & Susanti, A. I. (2022) · Informatics · doi:10.3390/informatics9040088 · Cited by 45
“A recent systematic review identifies limited studies examining semi-automated chatbots, mainly for handling pregnant women’s health [44].”
A survey on agents applications in healthcare: Opportunities, challenges and trends
Sulis, E., Mariani, S., & Montagna, S. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107525 · Cited by 30
“Conversational agents are an example in this context: they provide an interface between digital and human by answering questions, suggesting or reminding therapies and healthy life styles, acquiring data and accordingly providing support to decision making [13].”
Reddy, T., Giabbanelli, P. J., & Mago, V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22419-6_9 · Cited by 27
Artificial intelligence versus clinicians
Rampton, V. (2020) · BMJ · doi:10.1136/bmj.m1326 · Cited by 27
Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review
Boumans, R., van de Sande, Y., Thill, S., & Bosse, T. (2022) · JMIR Aging · doi:10.2196/32473 · Cited by 23
“For example, Laranjo et al [17] found 2 studies, one for military personnel with PTSS and one on training for people with autism spectrum disorders.”
Viduani, A. C., Cosenza, V., Fisher, H. L., Buchweitz, C., Piccin, J., Pereira, R. B., Kohrt, B. A., Mondelli, V., van Heerden, A. C., Araújo, R., et al. (2023) · JMIR Human Factors · doi:10.2196/44388 · Cited by 30
“Although chatbots are becoming increasingly more common in health care settings [38], few studies have provided detailed analyses and empirical discussions of specific design elements and development techniques [39].”
BackgroundJbene, M., Chehri, A., Saadane, R., Tigani, S., & Jeon, G. (2024) · Expert Systems · doi:10.1111/exsy.13712 · Cited by 41
“These channels include speech, text, facial expressions, and gestures (Laranjo et al., 2018).”
Conversational Agents Supporting Self-Management in People With a Chronic Disease: Systematic Review
Peerbolte, T. F., van Diggelen, R. J. A., van den Haak, P., Geurts, K., Evers, L. J. W., Bloem, B. R., de Vries, N. M., & van den Berg, S. W. (2025) · Journal of Medical Internet Research · doi:10.2196/72309 · Cited by 36
“If a study aims to further characterize the dialogue management systems of CAs, the framework by Laranjo et al [54] offers a valuable basis to refine CA characterization and technical evaluation.”
Cuesta, S. A., Blanes-Selva, V., Conejero, J. A., Frígola, A., Portolés, M. G., Merino-Torres, J. F., Rubio-Almanza, M., Syed-Abdul, S., Li, Y., Vilar-Mateo, R., et al. (2021) · JMIR Medical Informatics · doi:10.2196/17503 · Cited by 31
“Furthermore, chatbots, also referred to as conversational user interfaces, are gradually being adopted in mobile health (mHealth) apps [7] and serve to assess the long-term user experience [8].”
BackgroundLanguage Use in Conversational Agent–Based Health Communication: Systematic Review
Shan, Y., Ji, M., Xie, W., Qian, X., Li, R., Zhang, X., & Hao, T. (2022) · Journal of Medical Internet Research · doi:10.2196/37403 · Cited by 30
“Due to their increasing capabilities and expanding accessibility, CAs are playing critical roles in various health-related aspects of patients’ daily lives through responding to users in natural language [79,83-86].”
BackgroundWe need to chat about artificial intelligence
Coiera, E. W., Verspoor, K. M., & Hansen, D. P. (2023) · The Medical Journal of Australia · doi:10.5694/mja2.51992 · Cited by 29
Self-citationEvaluation of inpatient medication guidance from an artificial intelligence chatbot
Beavers, J. R., Schell, R. F., VanCleave, H. Z., Dillon, R. C., Simmons, A., Chen, H., Chen, Q., Anders, S. H., Weinger, M. B., & Nelson, S. D. (2023) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxad193 · Cited by 28
Large Language Models and Rule-Based Approaches in Domain-Specific Communication
Halvoník, D., & Kapusta, J. (2024) · IEEE Access · doi:10.1109/access.2024.3436902 · Cited by 30
Waizenegger, L., Seeber, I., Dawson, G. S., & Desouza, K. C. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.636 · Cited by 27
“(CAs) which are dialogue systems that simulate human conversations using text or spoken language [2] are a popular means to automate the interactions between customers and the organisation.”
BackgroundChung, J., Gendron, T., Winship, J., Wood, R. E., Mansion, N., Parsons, P., & Demiris, G. (2024) · The Gerontologist · doi:10.1093/geront/gnad145 · Cited by 23
Martín, M. S., & Urbistondo, P. A. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-1214-8.ch009 · Cited by 29
Arigo, D., Jake‐Schoffman, D. E., & Pagoto, S. (2024) · Journal of Behavioral Medicine · doi:10.1007/s10865-024-00526-x · Cited by 32
“Conversational agents, a popular type of LLM, use ML and NLP to engage in conversations with humans (Laranjo et al., 2018).”
AI in digital sports coaching – a systematic review
Jud, M., & Thalmann, S. (2025) · Managing Sport and Leisure · doi:10.1080/23750472.2024.2449016 · Cited by 32
“Reviews that predominantly focus on health aspects, such as motivating people to exercise, promoting a healthier lifestyle, or supporting recovery after accidents/illnesses (Laranjo et al., 2018), do not specifically address the coaching aspect itself.”
You, Y., & Gui, X. (2021) · PubMed · doi:10.48550/arxiv.2101.04796 · Cited by 120
Schmid, D., Staehelin, D., Bucher, A. M., Dolata, M., & Schwabe, G. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492845 · Cited by 27
“If CA mimic human communication behavior [36], they must provide a rich set of social cues.”
BackgroundMakasi, T., Nili, A., Desouza, K. C., & Tate, M. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.292 · Cited by 29
“The algorithms that generate responses improve overtime by automatically learning user inquiry patterns [19].”
Automatic Thoughts and Facial Expressions in Cognitive Restructuring With Virtual Agents
Shidara, K., Tanaka, H., Adachi, H., Kanayama, D., Sakagami, Y., Kudo, T., & Nakamura, S. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.762424 · Cited by 26
“Some proposed virtual agents employ CBT methodology with mixed degrees of effectiveness (Laranjo et al., 2018; Montenegro et al., 2019).”
Chatbots in the Field of Mental Health: Challenges and Opportunities
Viduani, A. C., Cosenza, V., Araújo, R., & Kieling, C. (2022) · Springer eBooks · doi:10.1007/978-3-031-10698-9_8 · Cited by 27
Lin, X., Martinengo, L., Jabir, A. I., Ho, A. H. Y., Car, J., Atun, R. A., & Car, L. T. (2023) · Journal of Medical Internet Research · doi:10.2196/45984 · Cited by 40
“First, users might have concerns about the limitations of some mental health CAs in understanding their inputs and providing suitable dialog responses [69], as reported in previous studies on health care CAs [70,71].”
Smartphone Applications to Prevent Type 2 Diabetes: A Systematic Review and Meta-Analysis
Jahan, E., Almansour, R., Ijaz, K., Baptista, S. N., Giordan, L. B., Ronto, R., Zaman, S. J., O’Hagan, E. T., & Laranjo, L. (2024) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2024.01.008 · Cited by 29
Self-citationPhysicians’ Perceptions of the Use of a Chatbot for Information Seeking: Qualitative Study
Koman, J., Fauvelle, K., Schück, S., Texier, N., & Mebarki, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15185 · Cited by 21
“However, little scientific research has examined the use of conversational agents through physicians’ viewpoints [12-15], and none have taken into account medical information addressed to health professionals.”
BackgroundNiksirat, K. S., Anthoine-Milhomme, E., Randin, S., Huguenin, K., & Cherubini, M. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462040 · Cited by 35
“However, the recent advances in the fields of natural-language processing [40] and conversational agents [26, 44, 72] could enable solutions to be built, where chatbots could mediate the discussion between the parties, and they could provide the information on the conditions of use of the OSN or information on the spe…”
BackgroundWong, J., Foussat, A. C., Ting, S., Acerbi, E., van Elburg, R. M., & Chua, M. C. (2021) · JMIR Pediatrics and Parenting · doi:10.2196/30169 · Cited by 26
“Although chatbots are used in many apps, one of the more innovative areas of development is for interactive data collection in the health care sector [14].”
BackgroundLet's (Tik) Talk About Fitness Trends
Štajer, V., Milovanović, I., Todorović, N., Ranisavljev, M., Pišot, S., & Drid, P. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.899949 · Cited by 36
“For example, AI chatbots, also called virtual conversational agents, engage in conversation techniques to facilitate natural language dialogues with users employing speech, text, or both to simulate human in-person communication (35, 36).”
BackgroundVirtual Customer Assistants in finance: From state of the art and practices to design guidelines
Iovine, A., Narducci, F., Musto, C., de Gemmis, M., & Semeraro, G. M. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100534 · Cited by 29
Li, B., Wang, A., Strachan, P., Séguin, J. A., Lachgar, S., Schroeder, K. C., Fleck, M. S., Wong, R., Karthikesalingam, A., Natarajan, V., et al. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651891 · Cited by 25
“Artificial intelligence (AI)-based conversational agents have been proposed as interactive, highly expressive tools with the potential to solicit relevant medical history and convey information in a manner resembling that of medical professionals [15–18].”
BackgroundSaunders, S., Terrera, G. M., Watson, J., Clarke, C. L., Luz, S. F., Evans, A. R., & Ritchie, C. W. (2018) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1016/j.trci.2018.10.013 · Cited by 21
“An interactive dialog system [24] for gathering patient feedback is envisaged, which will be deployed as an app on networked mobile devices (smartphones, tablets) and conventionalWeb browsers.”
BackgroundKraus, M., Schiller, M. R. G., Behnke, G., Bercher, P., Dorna, M., Dambier, M., Glimm, B., Biundo, S., & Minker, W. (2020) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3382507.3418818 · Cited by 25
“CAs extend the abilities of agents by additionally providing guidance and help with problem-solving, decision-making, and learning [41].”
BackgroundA Context-Aware Conversational Agent in the Rehabilitation Domain
Mavropoulos, T., Μεδίτσκος, Γ., Symeonidis, S., Kamateri, E., Rousi, M., Tzimikas, D., Papageorgiou, L., Eleftheriadis, C., Adamopoulos, G., Vrochidis, S., et al. (2019) · Future Internet · doi:10.3390/fi11110231 · Cited by 23
“Language generation is the process of producing meaningful text from nonlinguistic knowledge representations [13] and has preoccupied researchers since the 2000s, with most contemporary studies (References [14,15]) presenting promising results by utilising Deep Neural Network (DNN)-based systems.”
BackgroundInfluentialde Ligt, K. M., Hommes, S., Vromans, R., Boomstra, E., van de Poll-Franse, L. V., & Krahmer, E. (2025) · Journal of Medical Internet Research · doi:10.2196/60777 · Cited by 28
“Furthermore, conversational agents, which emulate human conversation through text or speech [32], can be integrated into PROMs administration systems, allowing patients to complete PROMs verbally using familiar devices such as computers, smartphones, or tablets [31].”
Qin, J., Nan, Y., Li, Z., & Meng, J. (2025) · Journal of Medical Internet Research · doi:10.2196/76296 · Cited by 33
“The specific outcomes examined depend on the goals of the CA application, such as treatment adherence, pain-related impairment, and improvement in healthy eating and physical activity [5,6,14,37].”
InfluentialMultimorbidity and consultation time: a systematic review
Tadeu, A. C. R., Caetano, I. R. C. E. S., de Figueiredo, I. J., & Santiago, L. M. (2020) · BMC Family Practice · doi:10.1186/s12875-020-01219-5 · Cited by 28
Conversational Agents for Mental Health and Wellbeing
Callejas, Z., & Griol, D. (2021) · Logic, argumentation & reasoning · doi:10.1007/978-3-030-61438-6_11 · Cited by 29
Proposal of a novel Artificial Intelligence Distribution Service platform for healthcare
Väänänen, A., Haataja, K., Vehviläinen-Julkunen, K. M., & Toivanen, P. (2021) · F1000Research · doi:10.12688/f1000research.36775.1 · Cited by 28
The interplay of a conversational ontology and AI planning for health dialogue management
Teixeira, M. S., Maran, V., & Dragoni, M. (2021) · ACM Symposium on Applied Computing · doi:10.1145/3412841.3441942 · Cited by 31
“Given these requirements, current commercial health DSs are highly domain-specific and heavily based on hand-crafted rules and features [19].”
BackgroundConversational Agents for Elderly Interaction
Pinto, N., França, J. B. D. S., Sousa, H. P., Vivacqua, A. S., & García, A. C. B. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437883 · Cited by 29
“Authors investigated topics such as the main characteristics, applications, evaluation measures [5], architectures, data types [10], ways and methods for implementation of personalization [9], illnesses tackled and agents’ capabilities [3], screening, treatments, diagnosis of mental health [11],…”
BackgroundMorales-de-Jesús, V. M., Gómez-Adorno, H., Somodevilla-Garcia, M., & Vilariño, D. (2021) · Healthcare · doi:10.3390/healthcare9081036 · Cited by 31
Upon Improving the Performance of Localized Healthcare Virtual Assistants
Malamas, N., Papangelou, K., & Symeonidis, A. L. (2022) · Healthcare · doi:10.3390/healthcare10010099 · Cited by 23
“of commercial and experimental English-speaking assistants have been developed focusing on different sub-domains and tasks [5]: they can be used to check symptoms, provide well-being recommendations, retrieve information, track activities and habits and perform teleconsultation, just to just name a few.”
BackgroundTreating persistent pain after breast cancer: practice gaps and future directions
Groef, A. D., Meeus, M., Heathcote, L. C., Wiles, L., Catley, M. J., Vogelzang, A. R., Olver, I., Runciman, W. B., Hibbert, P. D., Dams, L., et al. (2022) · Journal of Cancer Survivorship · doi:10.1007/s11764-022-01194-z · Cited by 26
“For digitally delivered pain science education, technologies using a conversational agent may offer benefit [97].”
BackgroundFridolin: participatory design and evaluation of a nutrition chatbot for older adults
Weber, P. P., Mahmood, F., Ahmadi, M., von Jan, V., Ludwig, T. G., & Wieching, R. (2023) · i-com · doi:10.1515/icom-2022-0042 · Cited by 22
Kannampallil, T., Ajilore, O., Lv, N., Smyth, J. M., Wittels, N. E., Ronneberg, C. R., Kumar, V., Xiao, L., Dosala, S., Barve, A., et al. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02462-x · Cited by 31
“There is considerable published literature and on-going research on the use of text-based applications (“chatbots”) for mental health support [44, 45]; however, a recent meta-analysis showed that text-based chatbots had mixed results [46].”
BackgroundDefining the Role of Large Language Models in Urologic Care and Research
Gupta, R., Pedraza, A. M., Gorin, M. A., & Tewari, A. K. (2023) · European Urology Oncology · doi:10.1016/j.euo.2023.07.017 · Cited by 22
Kuoppamäki, S., Jaberibraheem, R., Hellstrand, M., & McMillan, D. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01055-4 · Cited by 27
Role of Artificial Intelligence (AI) in Dentistry: A Literature Review
Chakravorty, S., Aulakh, B. K., Shil, M., Nepale, M., Puthenkandathil, R., & Syed, W. (2023) · Journal of Pharmacy And Bioallied Sciences · doi:10.4103/jpbs.jpbs_466_23 · Cited by 26
“[10,11] Limitation of AI AI’s key negatives include its high cost, limited accessibility, possibility for bias and data security breaches, lack of human emotions, and programming openness.”
Conversational Agent in mHealth to empower people managing the Parkinson’s Disease
Macedo, P., Pereira, C. M., Mota, P., Silva, D. A., Frade, A., & Madeira, R. N. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.11.074 · Cited by 21
“Over the last two decades, a substantial body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes in distinct areas [7, 8].”
BackgroundMethodInfluentialCheng, S. C., Backonja, U., Buck, B., Monroe‐DeVita, M., & Walsh, E. (2020) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12591 · Cited by 27
Survey on Various Conversational Systems
Fernandes, S., Gawas, R., Alvares, P., Femandes, M., Kale, D., & Aswale, S. (2020) · International Conference on Emerging Trends in Information Technology and Engineering (ICETITE) · doi:10.1109/ic-etite47903.2020.126 · Cited by 23
A review on polyadic chatbots: trends, challenges, and future research directions
Kuhail, M. A., Taj, I., Alimamy, S., & Shawar, B. A. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02287-0 · Cited by 32
Ranisch, R., & Haltaufderheide, J. (2025) · Digital Society · doi:10.1007/s44206-025-00161-2 · Cited by 21
Potential application of conversational agents in HIV testing uptake among high-risk populations
Garett, R., & Young, S. D. (2022) · Journal of Public Health · doi:10.1093/pubmed/fdac020 · Cited by 19
“31 In HIV, researchers have already explored the feasibility and acceptability of CA to promote testing.”
BackgroundPregnancy in the time of COVID-19: towards Fetal monitoring 4.0
Kahankova, R. V., Barnova, K., Jaroš, R., Pavlíček, J., Snåšel, V., & Martínek, R. (2023) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-023-05349-3 · Cited by 26
Chatbots in Airport Customer Service—Exploring Use Cases and Technology Acceptance
Auer, I., Schlögl, S., & Glowka, G. (2024) · Future Internet · doi:10.3390/fi16050175 · Cited by 36
Kim, Y., Kang, Y., Kim, B. R., Kim, J., & Kim, G. H. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2362406 · Cited by 27
“It selects responses from a predetermined set by following decision trees and simple rules according to the user input (Laranjo et al. 2018; Mohamad Suhaili, Salim, and Jambli 2021).”
Conversational Interfaces for Health: Bibliometric Analysis of Grants, Publications, and Patents
Xing, Z., Yu, F., Du, J., Walker, J. S., Paulson, C. B., Mani, N. S., & Song, L. (2019) · Journal of Medical Internet Research · doi:10.2196/14672 · Cited by 24
“Instead, different approaches in presenting CIs for health can potentially benefit health care resolutions in different clinical scenarios [2,3].”
InfluentialUsing Large Language Models for Chronic Disease Management Tasks: Scoping Review
Mukalazi, S. H., Ouyang, J., Namatovu, H. K., Ssemaluulu, P. M., Kimbugwe, N., Orach, C. G., & Waiswa, P. (2025) · JMIR Medical Informatics · doi:10.2196/66905 · Cited by 26
“Emotional support is increasingly recognized as essential in chronic disease management [49], which helps patients overcome psychological barriers to treatment adherence and lifestyle modifications.”
A Wizard-of-Oz Interface and Persona-based Methodology for Collecting Health Counseling Dialog
Kearns, W. R., Kaura, N., Divina, M., Vo, C., Si, D., Ward, T. M., & Yuwen, W. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382902 · Cited by 29
“Their efficacy in health counseling dialog has been demonstrated in a number of randomized controlled trials [24,26,30].”
BackgroundA prototype educational virtual assistant for diabetes management
Anastasiadou, M., Alexiadis, A., Polychronidou, E., Votis, K., & Tzovaras, D. K. (2020) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe50027.2020.00169 · Cited by 26
“Eventhough conversational systems have proven to be beneficial for health-related purposes, most assistants allow only constrained user input (e.g., multiple-choice answers) [7].”
BackgroundShin, J. Y., & Huh-Yoo, J. (2020) · Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3422024 · Cited by 18
Diabetes and conversational agents: the AIDA project case study
Alloatti, F., Bosca, A., Di, L., & Pieraccini, F. (2021) · Discover Artificial Intelligence · doi:10.1007/s44163-021-00005-1 · Cited by 23
“The application of CAs in the healthcare sector is a relatively recent phenomenon, in fact most of the studies have been carried out starting from 2010 [23, 24].”
BackgroundAI and Robotics in the Fight Against COVID-19 Pandemic
Khamis, A. M., Meng, J., Wang, J., Azar, A. T., Prestes, E., Li, H., Hameed, I. A., & Haidegger, T. P. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-72834-2_3 · Cited by 20
A Review of Plan-Based Approaches for Dialogue Management
Teixeira, M. S., & Dragoni, M. (2022) · Cognitive Computation · doi:10.1007/s12559-022-09996-0 · Cited by 22
Enhancing serious illness communication using artificial intelligence
Chua, I. S., Ritchie, C. S., & Bates, D. W. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00556-2 · Cited by 22
Design recommendations for chatbots to support people with depression
de Souza, P. M., Pires, I. D. C., Motti, V. G., Caseli, H. D. M., Neto, J. B. B., Martini, L. C., & Néris, V. P. D. A. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559119 · Cited by 24
“Moreover, the studies published were mainly about the user experience and rarely evaluated in regards to the chatbot’s efcacy and safety [22, 38].”
BackgroundMethodMoldt, J.-A., Wietek, T. F., Mamlouk, A. M., & Herrmann‐Werner, A. (2022) · Digital Health · doi:10.1177/20552076221139092 · Cited by 24
“21 Mental-health chatbots and virtual agents for emotional support are already being used in the fi eld of mental health 22 and in learning environments using electronic devices and media.”
MethodAshton, L., Adam, M., Whatnall, M. C., Rollo, M. E., Burrows, T. L., Hansen, V., & Collins, C. E. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01511-4 · Cited by 21
“, users select preprogrammed responses in the chat), or unconstrained using natural language input, which allows free text or speech [2, 4].”
BackgroundMethodInfluentialNatural Language Processing for Radiation Oncology: Personalizing Treatment Pathways
Lin, H., Ni, L., Phuong, C., & Hong, J. C. (2024) · Pharmacogenomics and Personalized Medicine · doi:10.2147/pgpm.s396971 · Cited by 25
“26 Their ability to accurately interpret and generate language has led to improved diagnostic accuracy, enhanced patient engagement, and more efficient healthcare operations.”
BackgroundCarrasco, R., Baker, F. A., Bukowska, A. A., Clark, I. N., Flynn, L. M., McMahon, K., Odell‐Miller, H., Stensæth, K. A., Tamplin, J., Sousa, T. V., et al. (2020) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3441000.3441082 · Cited by 24
“The development of conversational agents in healthcare is an emerging feld that would beneft from more robust experimental designs and standardised evaluation methods [33].”
Vázquez, A., Zorrilla, A. L., Olaso, J. M., & Torres, M. I. (2023) · Sensors · doi:10.3390/s23031423 · Cited by 20
“As in [29], we have computed the ratio of user turns labelled as a repetition request by the NLU as a measure of the quality of the NLG: the more repetition request from the users, the more likely the NLG is producing not-understandable sentences.”
BackgroundMethodHow to Evaluate Health Applications with Conversational User Interface?
Kerstin, D., & Jim, W. (2020) · Studies in Health Technology and Informatics · doi:10.3233/shti200307 · Cited by 18
“[1].”
Artificial intelligence-based conversational agent to support medication prescribing
Preininger, A. M., South, B., Heiland, J., Buchold, A., Baca, M., Wang, S., Nipper, R., Kutub, N., Bohanan, B., & Jackson, G. P. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa009 · Cited by 16
“There are few rigorous studies of conversational agents in healthcare, and none related to pharmacy.(28) Thus, the current study is the first to report the technical performance of a conversational agent aimed at answering medication-related questions using ground-truth intents established by 2 independent SMEs, under…”
BackgroundDoctor Chatbot: The EUʼs Regulatory Prescription for Generative Medical AI
Hauglid, M. K., & Mahler, T. (2023) · Oslo Law Review · doi:10.18261/olr.10.1.1 · Cited by 26
Lee, J., Byun, H. K., Kim, Y. T., Shin, J., & Kim, Y. B. (2024) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2024.12.012 · Cited by 21
Trivedi, R., Shaw, T. J., Sheahen, B., Chow, C. K., & Laranjo, L. (2025) · Journal of Medical Internet Research · doi:10.2196/64325 · Cited by 20
Self-citationConversational User Interfaces on Mobile Devices
Jaber, R., & McMillan, D. (2020) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3405755.3406130 · Cited by 21
“There have been studies highlighting the potential benefits of using conversational agents for health-related purposes, for example, assisting clinicians during the consultation or assisting patients in compiling health-related diaries [54].”
BackgroundUsability and User eXperience Evaluation of Conversational Systems: A Systematic Mapping Study
Guerino, G. C., & Valentim, N. (2020) · Brazilian Symposium on Software Engineering · doi:10.1145/3422392.3422421 · Cited by 25
“[36], the authors investigated characteristics, applications, and evaluation measures of conversational agents for health care.”
BackgroundExamining AI Methods for Micro-Coaching Dialogs
Mitchell, E. G., Elhadad, N., & Mamykina, L. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501886 · Cited by 25
“Until recently, most chatbots in health have been scripted or rule-based [38], and while these approaches have shown promising results, they can also be perceived as stagnant and repetitive, which can hamper long-term engagement [38, 48].”
BackgroundResultInfluentialHocking, J., Oster, C., Maeder, A., & Lange, B. S. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00025 · Cited by 16
“Attention was given to how the specific clinical needs of adults with brain-related neurological conditions were considered and reflected in the design of the CA, and how the CA was used within a rehabilitation context.”
BackgroundInfluential
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.