Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 601–700 of 1,371
Zhaopeng, X., Fei, Y., Mustafa, Q. Y. A., Ting, G., Jennifer, W., & Lixin, S. (2019) · Studies in Health Technology and Informatics · doi:10.3233/shti190661 · Cited by 9
“A recent systematic review on conversational agents in healthcare has shown that ICAs has addressed health issues related to psychotherapy support, education, self-monitoring, and data collection for consumers (e.g., patients), care-giver, or healthcare professionals [3].”
BackgroundBridging the Digital Divide: AI Solutions for Health Literacy in Underserved Populations
Marzo, R. R. (2024) · Advances in business strategy and competitive advantage book series · doi:10.4018/979-8-3693-6720-9.ch006 · Cited by 10
Han, H. J., Mendu, S., Jaworski, B. K., Owen, J. E., & Abdullah, S. (2024) · Digital Health · doi:10.1177/20552076241286133 · Cited by 10
“18,37 Speci fi cally, limited work has focused on designing CAs to support longitudinal self-management of individuals with PTSD.”
BackgroundKelly, A., Noctor, E., & van de Ven, P. W. J. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.10.363 · Cited by 14
Macêdo, P. L. P., Madeira, R. N., Santos, P. A., Mota, P. R., Alves, B., & Pereira, C. M. (2024) · Applied Sciences · doi:10.3390/app15010223 · Cited by 12
Karataş, Ö., Demirci, S., Pota, K., & Tuna, S. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14051747 · Cited by 8
“Of The obtained responses were evaluated using a scale adapted from the method by Magruder et al. [9].”
Altom, D. S., Taha, A. I. A., Hussein, A. A. A. M., Elshiekh, M. A. I., Abdelmajed, A. H., Ibrahim, F. I. A., Mohammed, S., & Tifoor, M. M. E. E. (2025) · Cureus · doi:10.7759/cureus.81001 · Cited by 16
“Other recent evaluations concentrated on conversational assistants for a particular health issue, such as mental health [23]; the broad usage of chatbots in healthcare [24]; or certain aspects of them, including technological architectures or customization [25,26].”
Yusuf, H., Money, A., & Daylamani-Zad, D. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13755-7 · Cited by 19
“Within the domain of human-com - puter interaction (HCI), AI conversational agents have emerged as a key development, providing tools that simulate natural conversation through image, text, or spoken lan - guage (Laranjo et al., 2018 ).”
Team dynamics in human-AI collaboration: effects on confidence, satisfaction, and accountability
Yousefi, M., Shahi, A., Sharifi, M., J Jorge Romera, A., Hoermann, S., & Piumsomboon, T. (2025) · Proceedings of the 27th International Conference on Multimodal Interaction · doi:10.1145/3716553.3750776 · Cited by 7
“While these agents can enhance outcomes [28], their integration introduces complex psychological challenges beyond performance metrics, raising critical questions about self-confidence, satisfaction, and accountability in team-agent collaboration effectiveness.”
ChatGPT in urogynecology: Comparing large language model responses to human experts
Rotem, R., Simon, C., Rottenstreich, M., O’Reilly, B., Weintraub, A. Y., & O’Sullivan, O. E. (2025) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.70085 · Cited by 11
Zhang, X., Zayed, A. M., Hamrin, J. R., Özgür, A. G., & Kuoppamäki, S. (2025) · Journal of Medical Internet Research · doi:10.2196/78829 · Cited by 14
“Conversational artificial intelligence (AI) technologies can facilitate connectivity between health care providers and patients [6], which is expected to alleviate strain on health care systems by automating routine tasks [7].”
Schachner, T., Gross, C., Hasl, A., von Wangenheim, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/22919 · Cited by 8
“In the context of chronic diseases, a rising number of medical interventions is already based on the application of CAs [24,28,30,55-57].”
BackgroundWhat's Up With These Conversational Health Agents? From Users' Critiques to Implications for Design
Maharjan, R., Doherty, K., Rohani, D. A., Bækgaard, P., & Bardram, J. E. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.840232 · Cited by 10
“This has led in turn to increased commercial and research interest in these systems’ potential to support wellbeing (2–6).”
BackgroundParvathavarthine, C. R., Krishna, M. K. P., Janaki, C. S., Sophia, M., & Chandar, S. N. (2022) · International Journal of Health Sciences · doi:10.53730/ijhs.v6ns8.13571 · Cited by 8
“In this scenario no jobs are lost, rather, roles are redefined, humans are displaced to tasks needing a human element [11].”
An AI powered system to enhance self‐reflection practice in coaching
Mamaghani, M. J., Amirhosseini, M. H., & Hayes, A. G. (2023) · Cognitive Computation and Systems · doi:10.1049/ccs2.12087 · Cited by 8
Cuciniello, M., Amorese, T., Greco, C., Callejas, Z., Vogel, C. M., Cordasco, G., & Esposito, A. A. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/8858268 · Cited by 7
“…to get in touch faster, but thanks to the advances in machine learning, achieved in recent years in particular in neural networks, today it is possible to use voice-based technologies to assist health professionals [4] and provide diagnostic support to seniors in managing their daily routine [5].”
BackgroundKnowledge-Enhanced Conversational Agents
Caffaro, F., & Rizzo, G. (2024) · Journal of Computational Science and Technology · doi:10.1007/s11390-024-2883-4 · Cited by 10
Conversational Agents to Support Pain Management: A Scoping Review
Souza, F. L., Bowman, H., Yang, F., Hesam‐Shariati, N., Linke, J., Gilanyi, Y. L., Jones, M. D., Z‐Pinto, R., McAuley, J. H., & Rizzo, R. R. N. (2025) · European Journal of Pain · doi:10.1002/ejp.70016 · Cited by 8
“(Laranjo et al. 2018).”
Chagas, B. A., Ferreguetti, K., Ferreira, T. C., Marcolino, M. S., Ribeiro, L. B., Pagano, A. S., Reis, Z. S. N., Prates, R. O., Meira, W., & Ribeiro, A. L. P. (2021) · CLEI electronic journal · doi:10.19153/cleiej.24.3.6 · Cited by 10
“The chatbot must provide accurate medical information, especially considering that information about COVID-19 has been continually evolving, which means that updates and changes need to be frequently performed [9], [14] and need to fight misinformation as well [15]–[17].”
BackgroundTowards Spoken Medical Prescription Understanding
Kocabiyikoglu, A. C., Portet, F., Blanchon, H., & Babouchkine, J.-M. (2019) · International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped.2019.8906646 · Cited by 8
“Although there is a large body of work on automatic biomedical information extraction from clinical texts [20] and on dialogue systems for health care [21], [22], work about automatic processing of oral medical prescriptions are rare.”
BackgroundNeuraz, A., Llanos, L. C., Burgun, A., & Rosset, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09417 · Cited by 9
“There is a growing research interest on conversational interfaces for biomedical natural language processing [Laranjo et al., 2018].”
InfluentialBusiness process changes on the implementation of artificial intelligence
Adorno, O. D. A. (2020) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.12.2020.tde-08042021-011316 · Cited by 10
Tailoring coaching conversations with virtual health coaches
Beinema, T. C. (2021) · doi:10.3990/1.9789036552608 · Cited by 8
Talk with Ted: An embodied conversational agent for caregivers
Curumsing, M. K., Rivera‐Villicana, J., Vouliotis, A., Burns, K., Babaei, M., Petrovich, T., Mouzakis, K., & Vasa, R. (2024) · Gerontology & Geriatrics Education · doi:10.1080/02701960.2024.2302584 · Cited by 8
“Different studies have investigated the use of CAs, in particular, embodied conversational agents (ECAs) as educational tools for medical students and clinicians (Dupuy et al., 2020; Kenny & Parsons, 2011; Laranjo et al., 2018).”
A text-based conversational agent for asthma support: Mixed-methods feasibility study
Cook, D., Peters, D., Moradbakhti, L., Su, T., Re, M. D., Schuller, B. W., Quint, J. K., Wong, E., & Calvo, R. A. (2024) · Digital Health · doi:10.1177/20552076241258276 · Cited by 12
“19,20 More narrowly, previous work combining the two – using mobile chatbots for asthma care – includes three studies investigating conversational agents for young people with asthma.”
The role of firm AI capabilities in generative AI-pair coding
Bughin, J. (2024) · Journal of Decision Systems · doi:10.1080/12460125.2024.2428187 · Cited by 6
Çolakoğlu, S., Durmus, M., Polat, Z. P., Yildiz, A., & Sezgın, E. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02202-2 · Cited by 9
“Studies also report that users perceive CAs as non-judgmental and accessible, which may improve access to health information via digital platforms [ 18 ].”
Topdağı, B., & Kavaz, T. (2025) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2025.06.030 · Cited by 8
Dragut, A.-C., Lacuesta, R., Gallardo, J., & Rubio, J. M. B. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-025-01246-y · Cited by 6
“However, the latter also face significant challenges that hinder their growth, particularly the need for a substantial collection of data (datasets) to train the systems in order to learn and simulate human behavior [10].”
Zamora, T., Salas, P., Zuñiga, S., Botello, E., & Andía, M. E. (2025) · Journal of Clinical Orthopaedics and Trauma · doi:10.1016/j.jcot.2025.103161 · Cited by 9
Chung, J., Winship, J., Parsons, P. L., Falls, K., & Bleich, M. R. (2022) · Journal of Gerontological Nursing · doi:10.3928/00989134-20220908-05 · Cited by 6
FIDES: An ontology-based approach for making machine learning systems accountable
Fernández, I., Aceta, C., Gilabert, E., & Esnaola-Gonzalez, I. (2023) · Journal of Web Semantics · doi:10.1016/j.websem.2023.100808 · Cited by 14
Hu, S., Zhou, H., Hergul, M., Gritta, M., Zhang, G., Iacobacci, I., Vulić, I., & Korhonen, A. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00609 · Cited by 39
“T O D technology has been proven useful across a wide Table 1: Summary of multilingual T O D datasets that support multiple languages and T O D tasks (including E2E learning), with more details concerning each dimension of comparison available in § 2.”
A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems
Hu, S., Zhou, H., Yuan, M., Gritta, M., Zhang, G., Iacobacci, I., Korhonen, A., & Vulić, I. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.422 · Cited by 16
Fullaondo, A., Erreguerena, I., & de Manuel, E. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10810-w · Cited by 10
“…retinopathy monitoring), tasks where errors do not have serious consequences (flagging an at-risk population for vaccination), or situations where medical professionals are not available but a machine can do a good job (using a chatbot to show a patient how to give an insulin injection) [97, 98].”
BackgroundAssessing the Quality and Reliability of AI-Generated Responses to Common Hypertension Queries
Vinufrancis, A., Hussein, H. A., Patel, H. V., Nizami, A., Singh, A. A., Nunez, B., & Abdel-Aal, A. M. (2024) · Cureus · doi:10.7759/cureus.66041 · Cited by 8
“It is noteworthy that while the positive aspects of AI in healthcare are evident, the lack of recognition for free-text responses in health information could present potential patient safety risks without the implementation of proper measures and human oversight [15].”
BackgroundMan, S. S., Wen, H., Chiu, K. T., Wang, F., & Chan, A. H. S. (2024) · Healthcare · doi:10.3390/healthcare12171775 · Cited by 11
Igarashi, T., Iijima, K., Nitta, K., & Chen, Y. (2024) · Healthcare · doi:10.3390/healthcare12181821 · Cited by 10
“Conversational AI agents are among the many digital technologies being implemented in healthcare to improve the availability of healthcare services and address current healthcare challenges such as the shortage of healthcare providers, which impacts accessibility [37,38].”
Backgroundvan Vliet, M. H. M., Versluis, A., Chavannes, N. H., Scheltinga, B. L., Albers, N., Penfornis, K. M., Baccinelli, W., & Meijer, E. (2024) · Digital Health · doi:10.1177/20552076241300020 · Cited by 8
“10,14,19 Combining mHealth interventions with the support of a virtual coach is suggested to increase user engagement and effectiveness while still having the advantages of mobile-delivered interventions.”
Bello, S. A., Oyedele, L. O., Akanbi, L., & Bello, A.-L. (2024) · Digital engineering. · doi:10.1016/j.dte.2024.100031 · Cited by 9
Masuda, Y., Piest, J. P. S., Jain, R., Shepard, D. S., Nakamura, O., Toma, T., & Shirasaka, S. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-8598-8_16 · Cited by 7
Bramanti, A., Corallo, A., Clemente, G., Greco, L., Garofano, M., Giordano, M., Pascarelli, C., Mitrano, G., Palo, M. P. D., Spirito, F. D., et al. (2025) · Healthcare · doi:10.3390/healthcare13050517 · Cited by 10
“Unlike VAs, which primarily rely on voice commands and responses, CAs can incorporate text-based interactions and more advanced dialogue management to provide tailored healthcare support [5,12].”
Phrase-level pairwise topic modeling to uncover helpful peer responses to online suicidal crises
Jiang, M., Ammerman, B. A., Zeng, Q., Jacobucci, R., & Brodersen, A. S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0513-5 · Cited by 9
Unsupervised Text Feature Extraction for Academic Chatbot using Constrained FP-Growth
Alias, S. (2021) · ASM Science Journal · doi:10.32802/asmscj.2020.576 · Cited by 7
Towards a decision support system for radiotherapy business continuity in a pandemic crisis
Reuter-Oppermann, M., Müller-Polyzou, R., & Georgiadis, A. (2021) · Journal of Decision System · doi:10.1080/12460125.2021.1947946 · Cited by 7
“Design Science Research according to Hevner (2007) (Laranjo et al., 2018; Montenegro et al., 2019).”
BackgroundUn chatbot para asistir a las necesidades de información en tiempos de COVID-19
Peña-Torres, J. A., Alegría, S. A. G., Pastrana, C. A. A., & Bucheli, V. (2021) · Ingeniería y Competitividad · doi:10.25100/iyc.v24i1.11004 · Cited by 12
The NHS digital clinical safety strategy
Neves, A. L. (2021) · BMJ · doi:10.1136/bmj.n2981 · Cited by 8
Conversational Agents in Healthcare: A Variability Perspective
May, R., & Denecke, K. (2024) · International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS) · doi:10.1145/3634713.3634717 · Cited by 6
“Moreover, they have the ability to provide information, respond to queries, or help with various tasks [34, 36].”
BackgroundInfluentialScientific Mapping of Chatbot Literature: A Bibliometric Analysis
Tanwar, M., & Verma, H. V. (2024) · International Journal of Mathematical Engineering and Management Sciences · doi:10.33889/ijmems.2024.9.2.017 · Cited by 12
PerMEASS - Personal Mental Health Virtual Assistant with Novel Ambient Intelligence Integration.
Kolenik, T., Gjoreski, M., & Gams, M. (2020) · Cited by 7
Chatzimina, M., Papadaki, H. Α., Pontikoglou, C. G., Koumakis, L., Kostas Marias, A., & Tsiknakis, M. (2021) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi50953.2021.9508587 · Cited by 6
An Information Behaviour-Based Approach to Virtual Doctor Design
Sin, J., & Munteanu, C. (2019) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3338286.3344391 · Cited by 6
“However, the use of VAs in telemedicine to represent a real doctor is also only a recently emerging development [11], but this possibility has seen growing interest from all ends of the pipeline [12, 15].”
BackgroundTherapy as an NLP Task: Comparing LLMs and Human Peers Behaviors in CBT Sessions
Iftikhar, Z., Ransom, S., Xiao, A., Nugent, N., & Huang, J. (2024) · arXiv · doi:10.48550/arxiv.2409.02244 · Cited by 6
Designing an AI Chatbot for Team-Based Diabetes Care: An Iterative Human-in-the-Loop Approach
Tseng, Y.-C., Chen, S., Mah, K.-H., & Chen, Y.-C. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-93736-1_17 · Cited by 5
Sánchez-Ortuño, M. M., Pécune, F., Coelho, J., Micoulaud‐Franchi, J., Salles, N., Auriacombe, M., Serre, F., Levavasseur, Y., de Sevin, É., Sagaspe, P., et al. (2024) · JMIR Mental Health · doi:10.2196/51022 · Cited by 8
Espinoza, F., Cook, D., Re, M. D., Cuba-Fuentes, M. S., Butler, C., & Calvo, R. A. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae057 · Cited by 11
Towards a Domain Expert Evaluation Framework for Conversational Search in Healthcare
Degachi, C., Dhar, U., Niforatos, E., & Kortuem, G. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719675 · Cited by 12
“Conversational agents, conversational search, and question - answering tools have been deployed for a variety of healthcare applications including diagnosis, monitoring, patient education, and information retrieval [8, 13, 15, 21, 35].”
Huang, H. C., & Chuang, H. W. (2025) · Digital · doi:10.3390/digital5020013 · Cited by 7
Technological enhancements in personalized dietary management for chronic conditions
Tahtouh, T., Salman, H., Eissa, N., Nassar, N. A., Maghaydah, S., Alhalabi, M. T., Yaghi, M., Gad, A., Abdallah, D., Elberry, S., et al. (2025) · Biomedical Engineering Advances · doi:10.1016/j.bea.2025.100181 · Cited by 10
Fetrati, H., Chan, G., & Orji, R. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3737619 · Cited by 7
“…the rise of chatbots as promising tools in various healthcare applications, such as diagnosis, treatment, monitoring, and patient rehabilitation [1, 23, 40], research on their use for sexual health management, counseling, and education - particularly for African populations - remains limited [17].”
Rose, C. J., Bidonde, J., Ringsten, M., Glanville, J., Berg, R. C., Cooper, C., Muller, A. E., Bergsund, H. B., Meneses-Echavez, J. F., & Potrebny, T. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02631-0 · Cited by 5
“ChatGPT (OpenAI, San Francisco, California, USA) is a conversational agent based on an LLM from the GPT-3.”
Ormeño-Arriagada, P., Márquez, G., Taramasco, C., Gatica, G., Vásconez, J. P., & Navarro, E. (2025) · Applied Sciences · doi:10.3390/app151910792 · Cited by 7
Litchfield, I. J., Delanerolle, G., Harper, L., & Dunning, S. (2025) · Health Expectations · doi:10.1111/hex.70523 · Cited by 6
“Participants familiar with digital technologies were comfortable with the concept of AI and its use in health care, reflecting existing evidence of favourable patient perspectives on AI health tools [49] including their use in accessing care [50].”
Application of chatbots in chronic disease management: A scoping review
Hou, J., Lin, S., Teng, P., Han, Y., Luo, Y., & He, G. (2026) · Digital Health · doi:10.1177/20552076251411287 · Cited by 8
“Finally, strengthening regulatory and privacy protection frameworks by implementing rigorous privacy-preserving protocols and robust data security mechanisms to build patient trust.”
AI affective computing and behavioral health
Farsadaki, V., & Griffy‐Brown, C. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1692728 · Cited by 10
Digital Companions for Well-being: Challenges and Opportunities
Nieves, J. C., Osorio, M., Rojas-Velázquez, D., Magallanes, Y., & Brännström, A. (2024) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-219336 · Cited by 5
“…there are surveys that analyze DC for healthcare purposes oriented to review the characteristics, current applications, and evaluation measures [22]; to provide a systematic review of the most influ-ential user studies focused on development, human perception, and interactions [30]; or to…”
Guimarães, G. R., Silva, C. S., Silva, C. S., Figueiredo, R. G., de Pesquisa, U. G., Gomes, C. M., Gomes, C. M., & de Bessa, J. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21050580 · Cited by 5
“More recently, chatbots, which combine AI with messaging interfaces, have emerged as precise tools for generating direct responses [17,18].”
BackgroundA Review of Sensor-Based Interventions for Supporting Patient Adherence to Inhalation Therapy
Ma, J., Sun, X., & Liu, B. (2024) · Patient Preference and Adherence · doi:10.2147/ppa.s485553 · Cited by 6
Quiroz, M. Q. G., Saltos, G. D. C., & Ávila, B. A. L. (2025) · Universitas · doi:10.17163/uni.n42.2025.07 · Cited by 6
“Al operar bajo reglas predefinidas, estos sistemas ofrecen respuestas consistentes y predeci-bles, siendo especialmente útiles en tareas repetitivas y estructuradas, como los servicios de atención al cliente (Laranjo et al. , 2018).”
Test Case Generation for Dialogflow Task-Based Chatbots
Rapisarda, R. G., Ginelli, D., Clerissi, D., & Mariani, L. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962471 · Cited by 5
“So far, a plethora of methods have focused on performance, usability, design metrics, and guidelines [10], [37], [38].”
Adolphe, M., Pech, M., Sawayama, M., Maurel, D., Delmas, A., Oudeyer, P., & Sauzeon, H. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316860 · Cited by 18
An Evolutionary Bootstrapping Development Approach for a Mental Health Conversational Agent
Househ, M. S., Schneider, J., Kashif, A., Alam, T., Al‐Thani, D., Ali, S. M., Fernández-Luque, L., Qaraqe, M., Alfuquha, A., & Shekhar, S. (2019) · Studies in health technology and informatics · doi:10.3233/shti190060 · Cited by 9
Designing an Adaptive Embodied Conversational Agent for Health Literacy: a User Study
Egede, J., Trigo, M. J. G., Hazzard, A., Porcheron, M., Bodiaj, E., Fischer, J. E., Greenhalgh, C., & Valstar, M. (2021) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3472306.3478350 · Cited by 9
“ECAs are increasingly employed in healthcare settings (e.g., [17, 19, 33]) across a number of specialisms, such as healthy eating [9], guiding treatment choices [30], and post-traumatic stress [34].”
BackgroundRobust Intent Classification Using Bayesian LSTM for Clinical Conversational Agents (CAs)
Aftab, H., Gautam, V., Hawkins, R., Alexander, R., & Habli, I. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-06368-8_8 · Cited by 6
Digital Human Representations for Health Behavior Change: A Structured Literature Review
Adam, M. T. P., Dreyer, S., Gimpel, H., Olenberger, C., & Fraunhofer, F. I. T. (2022) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00171 · Cited by 6
A Voice App Design for Heart Failure Self-management: Proof-of-Concept Implementation Study
Barbaric, A., Munteanu, C., Ross, H. J., & Cafazzo, J. A. (2022) · JMIR Formative Research · doi:10.2196/40021 · Cited by 8
“However, the use of conversational agents for health-related purposes is an emerging field of research [7], and early evidence suggests that they may also be effective for the self-management of chronic diseases [8].”
BackgroundAI-Based Personalized Virtual Therapist for Alcohol Relapse
Win, M. N., Han, L. W., Kumar, E. K. K. S. C., Keat, T. Y., & Ravana, S. D. (2022) · Enthusiastic International Journal of Applied Statistics and Data Science · doi:10.20885/enthusiastic.vol2.iss2.art3 · Cited by 6
Automated Healthcare System Using AI Based Chatbot
Mendon, A., Patil, M., Gupta, Y., Kadakia, V., & Doshi, H. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-0071-8_15 · Cited by 5
Chatbots: la evolución de la atención al cliente en la era digital.
Bautista, O. V. (2023) · Con-Ciencia Boletín Científico de la Escuela Preparatoria No. 3 · doi:10.29057/prepa3.v10i20.10690 · Cited by 3
General Characteristics and Design Taxonomy of Chatbots for COVID-19: Systematic Review
Lim, W. A., Custodio, R., Sunga, M., Amoranto, A. J., & Sarmiento, R. F. (2023) · Journal of Medical Internet Research · doi:10.2196/43112 · Cited by 7
“Other uses of chatbots at the time of the COVID-19 pandemic were in the field of education, such as Iggy and Pounce [14]; business and employment, such as Benefits Bot [15]; mental health, such as Woebot [16]; and customer service, such as the Rapid Response Virtual Agent [17].”
Multilingual Chatbots to Collect Patient-Reported Outcomes
Rojc, M., Ariöz, U., Šafran, V., & Mlakar, I. (2023) · IntechOpen eBooks · doi:10.5772/intechopen.111865 · Cited by 8
Kötting, L., Derksen, C., Keller, F. M., & Lippke, S. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/44701 · Cited by 7
“This further illustrates the need to incorporate elements regarding the social aspect of learning as well as further chances to translate theoretical knowledge into practice within a natural setting [60].”
BackgroundIslam, M. T., & Zhou, E. (2023) · International Journal of Research in Business and Social Science (2147-4478) · doi:10.20525/ijrbs.v12i9.3078 · Cited by 9
“These systems engage in user communication through many means such as speech, text, facial recognition, and gestures(Laranjo et al., 2018), enabling user involvement through natural language(Stieglitz, Mirbabaie, Ross, & Neuberger, 2018).”
BackgroundMendes, A. S., Blas, H. S. S., Robledo, F. P., Paz, J. F. D., & González, G. V. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01328-6 · Cited by 6
“In their systematic review, a pivotal contribution is made by [33], underscoring conversational agents’ nuanced roles in augmenting patient and provider interactions, enhancing adherence, and facilitating remote healthcare delivery.”
Introduction to Chatbot AI Applications
Bialkova, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-56471-0_1 · Cited by 5
Supporting dementia caregivers in Peru through chatbots: generative AI vs structured conversations.
Espinoza, F., Cook, D., Butler, C., & Calvo, R. A. (2023) · Electronic workshops in computing · doi:10.14236/ewic/bcshci2023.11 · Cited by 9
Lewis, B. A., Napolitano, M. A., Buman, M. P., Williams, D. M., & Nigg, C. R. (2024) · Journal of Behavioral Medicine · doi:10.1007/s10865-024-00533-y · Cited by 6
“Chatbots are conversational agents that seek to replicate human communication through speech, text, and visual forms (Aggarwal et al., 2023; Laranjo et al., 2018).”
Optimizing Chart Review Efficiency in Pressure Injury Evaluation Using ChatGPT
Friedman, R., Lisk, R., Cordero-Bermudez, K., Singh, S., Ghani, S., Gillette, B. M., Gorenstein, S. A., & Chiu, E. S. (2025) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004275 · Cited by 5
Mobile Conversational Agents for Stroke Rehabilitation Therapy
Griol, D., & Callejas, Z. (2019) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2019.00104 · Cited by 6
“The range of possible applications of conversational interfaces in Ambient Assisted Living (AAL) has been considerably extended during the last two decades [3].”
BackgroundDigital Confessions: Exploring the Role of Chatbots in Self-Disclosure
van der Lee, C., Croes, E. A. J., de Wit, J., & Antheunis, M. L. (2019) · Research portal (Tilburg University) · Cited by 5
Characterizing Human vs. Automated Coaching: Preliminary Results
Mitchell, E. G., Maimone, R., & Mamykina, L. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3383081 · Cited by 5
“Conversational agents in health are often rule-based, and do not yet incorporate more advanced, data-driven dialog modeling [9].”
BackgroundIsmail, H. O., Moses, A. R., Tadrus, M., Mohamed, E. A., & Jones, L. S. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.13908 · Cited by 5
Tell Me About Your Day: Designing a Conversational Agent for Time and Stress Management
Ferland, L., Sauve, J., Lucke, M., Nie, R., Khadar, M., Pakhomov, S., & Gini, M. L. (2020) · Studies in computational intelligence · doi:10.1007/978-3-030-53352-6_28 · Cited by 5
Factors Influencing AI Implementation Decision in Indian Healthcare Industry: A Qualitative Inquiry
Jain, V., Singh, N., Pradhan, S., & Gupta, P. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-64849-7_56 · Cited by 7
How artificial intelligence can help us ‘Choose Wisely’
Mehta, N., Born, K. B., & Fine, B. (2021) · Bioelectronic Medicine · doi:10.1186/s42234-021-00066-8 · Cited by 7
“…agents or ‘ chatbots ’ (computer programs trained to mimic human conversation), which are increasingly being used to deliver evidence-based information to patients when they need it, to begin early discussions of which tests and treatments are needed for their symptoms (Laranjo et al., 2018).”
BackgroundA Therapeutic Dialogue Agent for Polish Language
Zygadło, A. (2021) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw52867.2021.9666281 · Cited by 6
Luxton, D. D., & Hudlická, E. (2021) · Advances in neuroethics · doi:10.1007/978-3-030-74188-4_4 · Cited by 23
Bonilla, K., Gaitan, B., Sanders, J., Khenglawt, N., & Martin-Hammond, A. M. (2021) · PubMed · Cited by 17
Gupta, I., Eugenio, B. D., Salunke, D., Boyd, A. D., Allen‐Meares, P., Dickens, C., & Garcia, O. (2020) · doi:10.18653/v1/2020.nlpmc-1.6 · Cited by 10
“multiple-choice questions only) to processing full sentences and providing medically reliable information (Laranjo et al., 2018).”
BackgroundInfluentialHuang, T.-R., Liu, Y., Hsu, S.-M., Goh, J. O. S., Chang, Y., Yeh, S., & Fu, L. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00716-y · Cited by 6
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.