Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 101–200 of 1,371
Evaluation of the Current State of Chatbots for Digital Health: Scoping Review
Xue, J., Zhang, B., Zhao, Y., Zhang, Q., Zheng, C., Jiang, J., Li, H., Liu, N., Li, Z., Fu, W., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/47217 · Cited by 132
“Although previous reviews have primarily focused on chatbots for improving mental health [13] or their use in health care settings [8], this study provides a broader literature mapping encompassing all health-related chatbots.”
An Empirical Study of Older Adult’s Voice Assistant Use for Health Information Seeking
Brewer, R., Pierce, C., Upadhyay, P., & Park, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484507 · Cited by 89
“However, existing research on health information seeking online has primarily examined screen-based modalities, such as using search engines, social media, or other medical websites to search for health information [30].”
BackgroundLoveys, K., Sagar, M., Pickering, I., & Broadbent, E. (2021) · JMIR Mental Health · doi:10.2196/31586 · Cited by 86
“CAs are artificial agents that include a dialogue system, and may or may not include a digital embodiment or face [28].”
Dailah, H. G., Koriri, M. D., Sabei, A., Kriry, T., & Zakri, M. (2024) · Healthcare · doi:10.3390/healthcare12242555 · Cited by 149
“It can chat through text, voice, or visual interactions, allowing users to engage as they would with a natural person [87].”
(2022) · doi:10.2196/32630 · Cited by 83
“Prior conceptual conversational agent studies have developed taxonomies, typologies, and classifications of different types of chatbots, for example, differentiating chatbots for domain-specific or for general-purpose use [39], for specific applications (eg, business-to-business customer services [40] and health care…”
BackgroundA Repository of Conversational Datasets
Henderson, M., Budzianowski, P., Casanueva, I., Coope, S., Gerz, D., Kumar, G., Mrkšić, N., Spithourakis, G., Su, P.-H., Vulić, I., et al. (2019) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/w19-4101 · Cited by 108
Kocaballi, A. B., Quiroz, J. C., Rezazadegan, D., Berkovsky, S., Magrabi, F., Coiera, E., & Laranjo, L. (2020) · Journal of Medical Internet Research · doi:10.2196/15823 · Cited by 73
“Given their expanding capabilities and widespread availability, CAs are being increasingly used for health purposes, particularly to support patients and health consumers with health-related aspects of their daily lives [5-9].”
BackgroundSelf-citationHuq, S. M., Maskeliūnas, R., & Damaševičius, R. (2024) · Disability and Rehabilitation: Assistive Technology · doi:10.1080/17483107.2022.2146768 · Cited by 82
“Recently, several survey articles on the conversational agents in healthcare were published [4,11–14, 18 The aim of this study is to perform a systematic review of the current applications, gaps, and challenges in the existing research body on the AI-based conversational agents and dialogue systems…”
BackgroundVaidyam, A. N., Linggonegoro, D., & Torous, J. (2021) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720966429 · Cited by 81
“Other conditions included hypertension, asthma, type 2 diabetes, obstructive sleep apnea, sexual health, and breast cancer.(10) In today’s evolving landscape of rapidly changing technology, growing global health concerns, and lack of access to high-quality mental health care, use and evaluation of these conversational…”
BackgroundInfluentialTrust in AI chatbots: A systematic review
Ng, S. W. T., & Zhang, R. (2025) · Telematics and Informatics · doi:10.1016/j.tele.2025.102240 · Cited by 142
Voice-Controlled Intelligent Personal Assistants in Health Care: International Delphi Study
(2021) · doi:10.2196/25312 · Cited by 78
“In the health care field, various research trials using virtual assistants have shown major advancements in physical training, diet adjustments, accessibility to health information, etc [5,29,30].”
InfluentialThe Use and Promise of Conversational Agents in Digital Health
Dingler, T., Kwasnicka, D., Wei, J., Gong, E., & Oldenburg, B. (2021) · Yearbook of Medical Informatics · doi:10.1055/s-0041-1726510 · Cited by 81
Nadarzynski, T., Puentes, V., Pawlak, I., Mendes, T., Montgomery, I., Bayley, J., & Ridge, D. (2021) · Sexual Health · doi:10.1071/sh21123 · Cited by 83
Automated vs. Human Health Coaching: Exploring Participant and Practitioner Experiences
Mitchell, E. G., Maimone, R., Cassells, A. N., Tobin, J. N., Davidson, P., Smaldone, A. M., & Mamykina, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449173 · Cited by 88
“many areas related to individuals’ health [6,7,30,54,60].”
BackgroundInfluentialSezgin, E., Militello, L. K., Huang, Y., & Lin, S. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz141 · Cited by 83
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.”
BackgroundPandey, S., & Sharma, S. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100198 · Cited by 77
Schillaci, C. E., de Cosmo, L. M., Piper, L., Nicotra, M., & Guido, G. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.123025 · Cited by 98
Hindelang, M., Sitaru, S., & Zink, A. (2024) · JMIR Medical Informatics · doi:10.2196/56628 · Cited by 79
Data Decentralisation of LLM-Based Chatbot Systems in Chronic Disease Self-Management
Montagna, S., Ferretti, S., Klopfenstein, L. C., Florio, A., & Pengo, M. F. (2023) · Proceedings of the 2023 ACM Conference on Information Technology for Social Good · doi:10.1145/3582515.3609536 · Cited by 76
“grounding on messaging apps such as Telegram and WhatsApp, which are now almost universally used [16, 24].”
BackgroundDigital Therapeutics in Parkinson’s Disease: Practical Applications and Future Potential
Ellis, T. D., & Earhart, G. M. (2021) · Journal of Parkinson s Disease · doi:10.3233/jpd-202407 · Cited by 96
“Advances in machine learning, particularly in neural networks, have allowed for more complex dialogue management methods and conversational flexibility [7].”
BackgroundOpportunities and Challenges of AI-Driven Customer Service
Chaturvedi, R., & Verma, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-33898-4_3 · Cited by 124
Promoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review
Luo, T. C., Aguilera, A., Lyles, C. R., & Figueroa, C. A. (2021) · Journal of Medical Internet Research · doi:10.2196/25486 · Cited by 68
“…other reviews’ evaluations of health care conversational agents, which show that natural language processing and machine learning are underused, high-quality evidence and attention to patient safety are lacking, and study methods and evaluation measures are often inconsistently reported [8,20,21].”
A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions
Preum, S. M., Munir, S., Ma, M., Yasar, M. S., Stone, D. J., Williams, R. D., Alemzadeh, H., & Stankovic, J. A. (2021) · ACM Computing Surveys · doi:10.1145/3419368 · Cited by 104
“Data collection & self-monitoring Temporal, spatial, personal, and situational context, mobility or ubiquitous, adaptiveness, and energy efficiency Providing support for (i) self-monitoring of patients or (ii) collection of longitudinal behavioral data for disease management or health risk assessment [61] [44].”
BackgroundInfluentialAnisha, S. A., Sen, A., & Bain, C. (2024) · Journal of Medical Internet Research · doi:10.2196/56114 · Cited by 102
“Another area that needs to be focused on is patient safety [126], which was also not highlighted in the included studies.”
Computer-Controlled Virtual Humans in Patient-Facing Systems: Systematic Review and Meta-Analysis
Chattopadhyay, D., Ma, T., Sharifi, H., & Martyn-Nemeth, P. A. (2020) · Journal of Medical Internet Research · doi:10.2196/18839 · Cited by 68
“Laranjo et al [37] surveyed conversational agents with unconstrained natural language input capabilities in health care and included 17 articles, of which only 2 were randomized controlled trials (RCTs).”
BackgroundResultRoman, M. K., Bellei, E. A., Biduski, D., Pasqualotti, A., de Araújo, C. D. S. R., & Marchi, A. C. B. D. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103461 · Cited by 77
Feng, Y., Hang, Y., Wu, W., Song, X., Xiao, X., Dong, F., & Qiao, Z. (2025) · Journal of Medical Internet Research · doi:10.2196/69639 · Cited by 142
“These systems enable personalized, interactive support through therapeutic dialogues that emulate human communication patterns [26], demonstrating the potential to enhance therapeutic engagement and improve clinical outcomes [27].”
Evaluation of chatbot-delivered interventions for self-management of depression: Content analysis.
Martinengo, L., Lum, E., & Car, J. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.09.028 · Cited by 67
Irfan, B., Kuoppamäki, S., Hosseini, A., & Skantze, G. (2025) · Autonomous Robots · doi:10.1007/s10514-025-10190-y · Cited by 108
AI in healthcare: A narrative review
Väänänen, A., Haataja, K., Vehviläinen-Julkunen, K., & Toivanen, P. (2021) · F1000Research · doi:10.12688/f1000research.26997.2 · Cited by 69
Jack, B. W., Bickmore, T., Yinusa-Nyahkoon, L., Reichert, M., Julce, C., Sidduri, N., Martin-Howard, J., Zhang, Z., Woodhams, E., Fernandez, J., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30189-8 · Cited by 68
Liu, Y., Yan, W., Hu, B., Li, Z., & Lai, Y. L. (2022) · Digital Health · doi:10.1177/20552076221129718 · Cited by 91
“100 The core requirement for the participants in our study is to acquire useful health-related information, speci fi cally, diagnoses and related treatments.”
BackgroundTo, Q. G., Green, C., & Vandelanotte, C. (2021) · JMIR mHealth and uHealth · doi:10.2196/28577 · Cited by 68
“A chatbot or conversational agent is a computer program that can interact with users [13].”
BackgroundDigital disruption of dietetics: are we ready?
Kelly, J. T., Collins, P. F., McCamley, J., Ball, L., Roberts, S., & Campbell, K. L. (2021) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.12827 · Cited by 66
Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104494 · Cited by 67
Ryu, H., Kim, S., Kim, D., Han, S., Lee, K., & Kang, Y. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415223 · Cited by 66
“Although some regard chatbots as identical beings [51], for this research, we followed the definition of a chatbot under the higher category of conversational agents [38, 59].”
BackgroundMethodChen, C., Johnson, J. G., Charles, K., Lee, A., Lifset, E. T., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471218 · Cited by 67
Nallam, P., Bhandari, S., Sanders, J., & Martin-Hammond, A. (2020) · Gerontology and Geriatric Medicine · doi:10.1177/2333721420985975 · Cited by 65
“) and their use in healthcare (Laranjo et al., 2018; Sezgin et al., 2020) with a recent focus on older adults.”
BackgroundRobotic Telemedicine for Mental Health: A Multimodal Approach to Improve Human-Robot Engagement
Lima, M. R., Wairagkar, M., Natarajan, N., Vaitheswaran, S., & Vaidyanathan, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.618866 · Cited by 64
“Intelligent virtual assistants have been deployed in healthcare for delivering cognitive behavior therapy (Fitzpatrick et al., 2017) or assist older people in the living environment; see (Laranjo et al., 2018) for a recent review.”
BackgroundA Semantic Web Framework for Automated Smart Assistants: A Case Study for Public Health
Sermet, Y., & Demir, I. (2021) · Big Data and Cognitive Computing · doi:10.3390/bdcc5040057 · Cited by 59
“Relevant Work Conversational intelligent agents have been extensively researched and applied in many fields, including health care [24], finance [25], environmental sciences [26], psychology [27], and administration [28].”
BackgroundMagno, F., & Dossena, G. (2022) · The TQM Journal · doi:10.1108/tqm-02-2022-0080 · Cited by 89
Rollwage, M., Habicht, J., Juechems, K., Carrington, B., Viswanathan, S., Stylianou, M., Hauser, T. U., & Harper, R. (2023) · JMIR AI · doi:10.2196/44358 · Cited by 62
“Moreover, there is little evidence of the efficacy of such tools in real-world clinical settings [18,19].”
BackgroundEvaluation Techniques for Chatbot Usability: A Systematic Mapping Study
Ren, R., Castro, J. W., Acuña, S. T., & de Lara, J. (2019) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194019400163 · Cited by 63
Jabir, A. I., Martinengo, L., Lin, X., Torous, J., Subramaniam, M., & Tudor Car, L. (2023) · Journal of Medical Internet Research · doi:10.2196/44548 · Cited by 63
“Recent technological advances have led to the proliferation of digital interventions, such as conversational agents (CAs), in different areas of health care, including mental health [1].”
Kocaballi, A. B., Sezgin, E., Clark, L., Carroll, J. M., Huang, Y., Huh-Yoo, J., Kim, J., Kocielnik, R., Lee, Y.-C., Mamykina, L., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38525 · Cited by 62
“Recent review studies have highlighted some of the challenges including NLP [21,22], patient safety [1,23,24], integration with other technologies [22], information dissemination [25,26], medico-legal issues [27], and ethics [28].”
Self-citationde Cock, C., Milne-Ives, M., van Velthoven, M. H., Alturkistani, A., Lam, C., & Meinert, E. (2020) · JMIR Research Protocols · doi:10.2196/16934 · Cited by 62
“Laranjo et al [24] conducted a systematic review of conversational agents in 2018, in which they investigated the characteristics, applications, and evaluation measures of conversational agents; however, this was limited to agents with unconstrained natural language input and systems that had been tested with human pa…”
BackgroundArtificial Intelligence in Health: New Opportunities, Challenges, and Practical Implications
Lau, A. Y. S., Staccini, P., & Informatics, S. E. F. T. I. Y. S. O. E. A. C. H. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677935 · Cited by 61
“For example, with the rise of voice-only or voice-first interfaces, one could explore whether conversational agents have a role to support patients and consumers with their daily tasks [12].”
BackgroundSelf-citationOnline interventions geared toward increasing resilience and reducing distress in family caregivers
Shin, J. Y., & Choi, S. W. (2019) · Current Opinion in Supportive and Palliative Care · doi:10.1097/spc.0000000000000481 · Cited by 70
The Chatbots’ Challenge to Education: Disruption or Destruction?
Birenbaum, M. (2023) · Education Sciences · doi:10.3390/educsci13070711 · Cited by 61
Vilaza, G. N., & McCashin, D. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689736 · Cited by 60
“When it comes to conversational agents, according to a recent systematic review, most of them have not been tested using “end-user safety” as a criterion (35).”
BackgroundUnderstanding Public Perceptions of AI Conversational Agents: A Cross-Cultural Analysis
Liu, Z., Li, H., Chen, A., Zhang, R., & Lee, Y.-C. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642840 · Cited by 60
Vowels, L. M., Francois-Walcott, R. R. R., & Darwiche, J. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100078 · Cited by 59
Robinson, N., Connolly, J., Hides, L. M., & Kavanagh, D. J. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100320 · Cited by 67
Arnold, A., Kolody, S., Comeau, A., & Miguel Cruz, A. (2024) · Disability and Rehabilitation: Assistive Technology · doi:10.1080/17483107.2022.2065369 · Cited by 59
“In the first group, the studies were summarized by exploring the use of voice assistants or ECA interventions for the prevention and management of mental health conditions [30,32,33].”
MethodA Typology of Chatbots in Public Service Delivery
Makasi, T., Nili, A., Desouza, K. C., & Tate, M. (2021) · IEEE Software · doi:10.1109/ms.2021.3073674 · Cited by 71
The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems
Ziems, C., Yu, J., Wang, Y.-C., Halevy, A., & Yang, D. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.261 · Cited by 58
Validity of Chatbot Use for Mental Health Assessment: Experimental Study
Schick, A., Feine, J., Morana, S., Maedche, A., & Reininghaus, U. (2022) · JMIR mHealth and uHealth · doi:10.2196/28082 · Cited by 58
“Irrespective of the popularity of chatbots, reviews of their application in the context of (mental) health emphasize the quasi-experimental nature of studies and the need to empirically evaluate their impact [7,16,23-26].”
BackgroundFrom Machine Learning to Patient Outcomes: A Comprehensive Review of AI in Pancreatic Cancer
Tripathi, S., Tabari, A., Mansur, A., Dabbara, H., Bridge, C. P., & Daye, D. (2024) · Diagnostics · doi:10.3390/diagnostics14020174 · Cited by 75
“AI chatbots are being used to provide patients with round-the-clock assistance, answer their queries, schedule appointments, and even provide basic medical advice [15].”
BackgroundLahat, A., Sharif, Κ., Zoabi, N., Patt, Y. S., Sharif, Y., Fisher, L., Shani, U., Arow, M., Levin, R., & Klang, E. (2024) · Journal of Medical Internet Research · doi:10.2196/54571 · Cited by 74
Emerging Roles and Relationships Among Humans and Interactive AI Systems
Lindgren, H. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2435693 · Cited by 100
“Lack of appropriate adaptation of a service robot’s behaviour to the human’s emotional state may cause breakdown situations (Tewari & Lindgren, 2022), but has also been found in studies on human interacting with embodied virtual agents in the context of healthcare (Laranjo et al., 2018).”
Use of automated conversational agents in improving young population mental health: a scoping review
Balan, R., Dobrean, A., & Poetar, C. R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01072-1 · Cited by 56
“One such cutting edge digital solution is conversational agents (CAs), de fi ned as systems simulating human interaction using text, speech, gestures, facial, or sensorial expressions as input and/or output 5 .”
Davis, C. R., Murphy, K. J., Curtis, R. G., & Maher, C. A. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17239137 · Cited by 57
“In 2018, a systematic literature review identified 14 studies involving artificial intelligence (AI) virtual health assistants capable of natural language processing [7].”
BackgroundInfluentialInvestigating Students’ Use of a Mental Health Chatbot to Alleviate Academic Stress
De Nieva, J. O., Joaquin, J. A., Tan, C. B., Marc Te, R. K., & Ong, E. (2020) · 6th International ACM In-Cooperation HCI and UX Conference · doi:10.1145/3431656.3431657 · Cited by 56
“Chatbots and conversational agents have benefited different fields including healthcare [19] and mental health [16, 33, 39].”
BackgroundArtificial Intelligence Technologies in Cardiology
Ledziński, Ł., & Grześk, G. (2023) · Journal of Cardiovascular Development and Disease · doi:10.3390/jcdd10050202 · Cited by 94
“Another aspect of natural language processing is the use of speech recognition and question-answering to develop chatbots for patients [33].”
Ding, H., Simmich, J., Vaezipour, A., Andrews, N. E., & Russell, T. G. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad222 · Cited by 72
Loughnane, C., Laiti, J., O’Donovan, R., & Dunne, P. J. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1536416 · Cited by 76
Chan, C. K. Y. (2025) · Behavioral Sciences · doi:10.3390/bs15030287 · Cited by 87
“AI-integrated tools could offer real-time responses, improve accessibility, and act as an alternative to traditional practices (Fiske et al., 2019; Gutierrez et al., 2024; Laranjo et al., 2018).”
A Guide to Chatbots for COVID-19 Screening at Pediatric Health Care Facilities
Espinoza, J., Crown, K., & Kulkarni, O. (2020) · JMIR Public Health and Surveillance · doi:10.2196/18808 · Cited by 58
“Despite being relatively new, chatbots have already been adapted for a broad range of purposes in health care, including patient triage, clinical decision support for provider, directing patients and staff to appropriate resources, and even mental health applications, such as cognitive behavioral therapy and suicide i…”
BackgroundNoble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., et al. (2022) · JMIR Research Protocols · doi:10.2196/33717 · Cited by 53
“Chatbot performance will also be evaluated based on additional technical measures identified in reflection of other evaluative works within the field of chatbots in health to allow for the cross-comparability of the findings [56,92,95-97], including an analysis of intent classification accuracy scores, entity recognit…”
BackgroundMethodInfluentialReview of artificial intelligence‐based question‐answering systems in healthcare
Budler, L. C., Gosak, L., & Stiglic, G. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 52
Innovations to improve access to musculoskeletal care
Chehade, M. J., Yadav, L., Kopansky-Giles, D. R., Merolli, M., Palmer, E., Jayatilaka, A., & Slater, H. (2020) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2020.101559 · Cited by 78
Conversational health agents: a personalized large language model-powered agent framework
Abbasian, M., Azimi, I., Rahmani, A. M., & Jain, R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf067 · Cited by 52
“17 However, they merely focus on the conversational aspects, offering limited agent capabilities such as basic text-based chat interfaces and lacking multi-step problem-solving capabilities.”
Hey Google, Do You Have a Personality? Designing Personality and Personas for Conversational Agents
Pradhan, A., & Lazar, A. (2021) · Proceedings of the 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469607 · Cited by 50
“Conversational agents have long been used in healthcare [16], e-learning [14] or for social companionship purposes [29].”
BackgroundBarnett, A., Savic, M., Pienaar, K., Carter, A., Warren, N., Sandral, E., Manning, V., & Lubman, D. I. (2021) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2020.102910 · Cited by 50
What Do We Know About the Use of Chatbots for Public Health?
Gabarrón, E., Larbi, D., Denecke, K., & Årsand, E. (2020) · Studies in health technology and informatics · doi:10.3233/shti200270 · Cited by 54
Coiera, E., & Liu, S. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100860 · Cited by 48
“RecentreviewsofAIinhealthincludereviewsofmachinelearning for diagnosis 85 and conversational agents, 86 and they conclude that research in the area is inconsistently reported and disconnected from the needs of end-users.”
BackgroundSelf-citationExtensive Review on the Role of Machine Learning for Multifactorial Genetic Disorders Prediction
Solomon, D. D., Sonia, S., Kumar, K., Kanwar, K., Iyer, S. S., & Kumar, M. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09996-9 · Cited by 72
“Natural language processing and machine learning are used by these assistants to interpret and reply to user enquiries [103, 104].”
What generative AI means for trust in health communications
Dunn, A. G., Shih, I., Ayre, J., & Spallek, H. (2023) · Journal of Communication in Healthcare · doi:10.1080/17538068.2023.2277489 · Cited by 48
“There is limited evidence of their safety and e ff ectiveness in healthcare [6].”
BackgroundSelf-citationMartinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M.-H. R., Kowatsch, T., Atun, R., Michie, S., & Tudor Car, L. (2022) · Journal of Medical Internet Research · doi:10.2196/39243 · Cited by 49
Han, R., Todd, A., Wardak, S., Partridge, S. R., & Raeside, R. (2023) · JMIR Human Factors · doi:10.2196/43227 · Cited by 64
“A systematic review conducted by Laranjo et al [37] demonstrated that conversational agents are most commonly used in mental health management, resulting in reduced depression symptoms, improved narrative skills scores in autism, and suicide prevention [37].”
BackgroundKiuchi, K., Otsu, K., & Hayashi, Y. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2286528 · Cited by 63
“…language input and equipping them with human-like response capabilities (Almalki and Azeez 2020; Amiri and Kara-hanna 2022; Chew and Achananuparp 2022; Kovacek and Chow 2021; Laranjo et al. 2018; Mbunge et al. 2022; Perez, Daradoumis, and Puig 2020; Siddique and Chow 2021; J. Wang et al., 2021).”
Karamanidou, C., Natsiavas, P., Koumakis, L., Marias, K., Schera, F., Schäfer, M., Payne, S. A., & Maramis, C. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00015 · Cited by 51
Green, E. P., Lai, Y., Pearson, N., Rajasekharan, S., Rauws, M., Joerin, A., Kwobah, E., Musyimi, C., Jones, R. M., Bhat, C., et al. (2020) · doi:10.2196/preprints.17895 · Cited by 49
“Although there has been a proliferation of conversational agents for health in recent years [40], the evidence base is small [41].”
BackgroundLiu, L., & Duffy, V. G. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-022-00956-0 · Cited by 64
Keller, R., Hartmann, S., Teepe, G. W., Lohse, K.-M., Alattas, A., Tudor Car, L., Müller-Riemenschneider, F., von Wangenheim, F., Mair, J. L., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/33348 · Cited by 46
“CAs, also known as chatbots, are computer systems that imitate human conversation using text or spoken language and can offer personalized human-like interactions [15-18].”
BackgroundEvaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2021) · arXiv · doi:10.48550/arxiv.2105.00071 · Cited by 47
Griffin, A. C., Khairat, S., Bailey, S. C., & Chung, A. E. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad073 · Cited by 46
Cano, S. P., González, C. S. G., Gil, R., & Albiol-Pérez, S. (2021) · Sensors · doi:10.3390/s21155166 · Cited by 79
“Chatbots are being used as emotional support in healthcare [53] and mental health [54].”
MethodSinha, C., Cheng, A. L., & Kadaba, M. (2022) · JMIR Formative Research · doi:10.2196/37302 · Cited by 51
“The CA in our study used machine learning and AI methods to simulate human-like behaviors and support [10,24].”
MethodPerformance of AI chatbots on controversial topics in oral medicine, pathology, and radiology
Mohammad‐Rahimi, H., Khoury, Z. H., Alamdari, M. I., Rokhshad, R., Motie, P., Parsa, A., Tavares, T., Sciubba, J. J., Price, J. B., & Sultan, A. S. (2024) · Oral Surgery Oral Medicine Oral Pathology and Oral Radiology · doi:10.1016/j.oooo.2024.01.015 · Cited by 57
Enhancing health care through medical cognitive virtual agents
Mishra, S., Chaudhury, P., Tripathy, H. K., Sahoo, K. S., Jhanjhi, N. Z., Elnour, A. A. H., & Abdelmaboud, A. (2024) · Digital Health · doi:10.1177/20552076241256732 · Cited by 50
“24,75,76 Customized monitoring-centric MCVA.”
Artificial Intelligence for Participatory Health: Applications, Impact, and Future Implications
Denecke, K., Gabarrón, E., Grainger, R., Konstantinidis, S. T., Lau, A. Y. S., Rivera-Romero, O., Miron‐Shatz, T., & Merolli, M. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677902 · Cited by 58
“Only one of the 22 papers reviewed technologies that involved interaction with patients or clinicians and examined the capabilities of conversational agents for health-related purposes [21].”
BackgroundMethodInfluentialSelf-citationEvaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00506 · Cited by 47
“, healthcare (Laranjo et al., 2018; Jovanović et al., 2021) and education (Yang and Evans, 2019; Kochmar et al.”
BackgroundSaad, S. B., & Choura, F. (2022) · European Journal of Marketing · doi:10.1108/ejm-11-2021-0892 · Cited by 61
Dwyer, T., Hoit, G., Burns, D., Higgins, J., Chang, J., Whelan, D., Kiroplis, I., & Chahal, J. (2023) · Arthroscopy, Sports Medicine, and Rehabilitation · doi:10.1016/j.asmr.2023.01.020 · Cited by 45
Transforming healthcare with chatbots: Uses and applications—A scoping review
Barreda, M., Cantarero, D., Coca, D., Delgado, A., Lanza‐León, P., Lera, J., Montalbán, R., & Pérez, F. (2025) · Digital Health · doi:10.1177/20552076251319174 · Cited by 72
“” This way of de fi ning chatbots was based on the studies of Laranjo et al. 8 and Oh et al. 9 This development can help create the potential to improve health outcomes, potentially alleviating some of the burdens on healthcare providers and systems from being the sole voices of public health…”
Brar Prayaga, R., Agrawal, R., Nguyen, B., Jeong, E. W., Noble, H. K., Paster, A., & Prayaga, R. S. (2019) · JMIR mHealth and uHealth · doi:10.2196/15771 · Cited by 45
“More specifically, conversational AI (or conversational agents) can encourage health care consumers to engage with systems that imitate human conversations using text [23,24].”
BackgroundPeng, M. L., Wickersham, J. A., Altice, F. L., Shrestha, R., Azwa, I., Zhou, X., Halim, M. A. A., Ikhtiaruddin, W. M., Tee, V., Kamarulzaman, A., et al. (2022) · JMIR Formative Research · doi:10.2196/42055 · Cited by 44
“Following the advances in natural language processing (NLP) and artificial intelligence (AI), AI chatbots, broadly referring to computer programs with minimal design interfaces embedded with AI to simulate conversation with human users, have been developed as mHealth strategies to support patient care and identified a…”
BackgroundBrewer, R. N. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519642 · Cited by 43
“Voice assistants can also be helpful in one’s home, by providing verbal access to symptom checkers to receive a diagnosis [68] or analyzing speech data to monitor health conditions [40].”
Background
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.