Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 401–500 of 1,371
Perez-Pino, A., Yadav, S. K., Upadhyay, M., Cardarelli, L., & Tadinada, A. (2023) · The Angle Orthodontist · doi:10.2319/100922-691.1 · Cited by 22
Framework for Guiding the Development of High-Quality Conversational Agents in Healthcare
Denecke, K. (2023) · Healthcare · doi:10.3390/healthcare11081061 · Cited by 25
“It has been shown that rather technical aspects of health agents or aspects highly depending on their technical realization are not assessed and reported or only to a limited extent [7].”
BackgroundVoice-Based Virtual-Controlled Intelligent Personal Assistants
Yadav, S. P., Gupta, A. K., Nascimento, C. D. S., de Albuquerque, V. H. C., Naruka, M. S., & Chauhan, S. S. (2023) · International Conference on Computational Intelligence, Communication Technology and Networking (CICTN) · doi:10.1109/cictn57981.2023.10141447 · Cited by 21
Chatbots for Sexual Health Improvement: A Systematic Review
Fetrati, H., Chan, G., & Orji, R. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2376808 · Cited by 22
“…to be effective by researchers in a broad range of healthcare applications, including diagnosis, treatment, monitoring, and rehabilitation of patients with different conditions (Aggarwal et al., 2023; Laranjo et al., 2018; Phiri & Munoriyarwa, 2023; Tudor Car et al., 2020; Wilson & Marasoiu, 2022).”
Hou, G., Li, X., & Wang, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04232-6 · Cited by 24
“On the one hand, users question the professionalism of virtual health agents and do not trust them (Laranjo et al. 2018).”
Intelligent Virtual Assistant for Promoting Behaviour Change in Older People with T2D
Balsa, J., Neves, P., Félix, I. B., Guerreiro, M. P., Alves, P., Carmo, M. B., Marques, D., Dias, A. E., Henriques, M. A., & Cláudio, A. P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30241-2_32 · Cited by 19
Cognitive plausibility in voice-based AI health counselors
Kannampallil, T., Smyth, J. M., Jones, S., Payne, P., & Ma, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0278-7 · Cited by 18
CUI@CSCW: Collaborating through Conversational User Interfaces
Porcheron, M., Clark, L., Jones, M., Candello, H. C. D. S. P., Cowan, B. R., Murad, C., Sin, J., Aylett, M. P., Lee, M., Munteanu, C., et al. (2020) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3406865.3418587 · Cited by 17
“Ongoing challenges exist in understanding patient safety, measuring health outcomes and providing standardised evaluation methods [10], which are beginning to be tackled in recent workshops [9].”
BackgroundOn the Generation of Medical Dialogs for COVID-19
Zhou, M., Li, Z., Tan, B., Zeng, G., Yang, W., He, X., Ju, Z., Chakravorty, S., Chen, S., Yang, X., et al. (2021) · doi:10.18653/v1/2021.acl-short.112 · Cited by 34
“Please refer to (Laranjo et al., 2018) for a comprehensive review.”
BackgroundAssistive Technologies for Supporting the Wellbeing of Older Adults
Dratsiou, I., Varella, A., Romanopoulou, E. D., Villacañas, Ó., Cooper, S., Isaris, P., Serras, M., Unzueta, L., Silva, T., Zurkuhlen, A., et al. (2022) · Technologies · doi:10.3390/technologies10010008 · Cited by 24
Could artificial intelligence make doctors obsolete?*
Goldhahn, J., Rampton, V., & Spinas, G. A. (2019) · Bulletin des Médecins Suisses · doi:10.4414/bms.2019.17596 · Cited by 16
PROs in the wild: Assessing the validity of patient reported outcomes in an electronic registry
Cabitza, F., Dui, L. G., & Banfi, G. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.01.009 · Cited by 18
Lin, J.-S. (2024) · International Journal of Advertising · doi:10.1080/02650487.2024.2410559 · Cited by 26
“Considering those trends, researchers have examined the usefulness of chatbots in different service sectors, including banking, hospitality, health care, and entertainment (e.g. Eren 2021; Laranjo et al. 2018; Sajjadi et al. 2019; Van Hooijdonk and Liebrecht 2021).”
Wang, S., Fatima, N., Shahbaz, M., & Asif, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-38179-2 · Cited by 24
“Chatbots are now widely used across industries such as healthcare 36 , education 37 , and corporate support 29 .”
The Medical Authority of AI: A Study of AI-enabled Consumer-Facing Health Technology
You, Y., Kou, Y., Ding, X., & Gui, X. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445657 · Cited by 25
“If users blindly trust the diagnoses from consumer-facing AI health technologies, they may risk their lives [40], since these systems may generate inaccurate diagnoses and cause unintended consequences [63].”
BackgroundDAISY: An Implementation of Five Core Principles for Transparent and Accountable Conversational AI
Wahde, M., & Virgolin, M. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2081762 · Cited by 19
“…intelligence (hereafter: conversational AI) is a rapidly growing field, with many relevant applications in health and well-being, education, customer service, tourism, personal digital assistants, and so on; see, for instance, the surveys by Laranjo et al. (2018) and Wahde and Virgolin (2022).”
BackgroundEagle, T., Blau, C., Bales, S., Desai, N., Li, V., & Whittaker, S. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3488057 · Cited by 21
“Few Randomized Clinical Trials (RCTs) have been conducted [17, 28, 35], in part because this is a time-intensive undertaking complicated by rapid changes in technology.”
BackgroundLangevin, R., Berry, A. B. L., Zhang, J., Fockele, C. E., Anderson, L., Hsieh, D. T., Hartzler, A. L., Duber, H. C., & Hsieh, G. (2023) · Applied Clinical Informatics · doi:10.1055/a-2035-5342 · Cited by 18
Siddiqi, D. A., Miraj, F., Raza, H., Hussain, O. A., Munir, M., Dharma, V. K., Shah, M. T., Habib, A., & Chandir, S. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105288 · Cited by 24
Suryanto, T. L. M., Wibawa, A. P., Hariyono, H., & Nafalski, A. (2023) · International Journal of Robotics and Control Systems · doi:10.31763/ijrcs.v3i4.1195 · Cited by 34
Wang, X., Abubaker, S., Babalola, G., & Jesso, S. T. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3637149 · Cited by 17
“Chatbots could be used to engage patients in natural di-alogues at various touchpoints during their visit or stay, promote higher response rates, and provide real-time assistance [6].”
BackgroundKolenik, T., Schiepek, G. K., & Gams, M. (2024) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s417695 · Cited by 35
Jelassi, M., Matteli, K., Khalfallah, H. B., & Demongeot, J. (2024) · Information · doi:10.3390/info15120813 · Cited by 21
Algorithmic transparency of conversational agents
Hepenstal, S., Kodagoda, N., Zhang, L., Paudyal, P., & Wong, B. L. W. (2019) · Middlesex University Research Repository (Middlesex University Of London) · Cited by 24
Predicting PTSS in general population during COVID-19 pandemic: The mediating role of health anxiety
Coloma‐Carmona, A., & Carballo, J. L. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.07.032 · Cited by 18
Initial Experience with a COVID-19 Screening Chatbot Before Radiology Appointments
Wang, W. T., Tan, N., Hanson, J. A., Crubaugh, C. A., & Hara, A. K. (2022) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-022-00650-7 · Cited by 22
“Mobile phones have many applications in health care, including increasing access to care; enhancing efficiency of service delivery; improving diagnosis, treatment, and rehabilitation; and supporting public health programs [2].”
BackgroundDupuy, L., Micoulaud‐Franchi, J., & Philip, P. (2020) · Journal of Sleep Research · doi:10.1111/jsr.13094 · Cited by 17
“…diminishing the variability between professional interventions, providing 24/7 and easy-to-access support and monitoring of patients, and by managing huge volumes of medical data (Henson, Wisniewski, Hollis, Keshavan, & Torous, 2019; Laranjo et al., 2018; Provoost, Lau, Ruwaard, & Riper, 2017).”
BackgroundArrabales, R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/nfas4 · Cited by 29
“Understanding (NLU) [24], Deep Learning [25] and Conversational Interfaces [26,27,28] is astonishing, we think the idea of having a fully automated and capable psychotherapist is way too ambitious today, almost as it was back in the 60’s.”
Understanding, Explaining, and Utilizing Medical Artificial IntelligencePreprint
Cadario, R., Longoni, C., & Morewedge, C. K. (2021) · doi:10.31234/osf.io/4kwap · Cited by 16
Alexa depression and anxiety self-tests: a preliminary analysis of user experience and trust
Quiroz, J. C., Bongolan, T., & Ijaz, K. (2020) · Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers · doi:10.1145/3410530.3414374 · Cited by 16
“The proliferation of conversational agents has made them attractive for health applications [11] and mental health [18].”
BackgroundThe Role of Conversational AI in Ageing and Dementia Care at Home: A Participatory Study
Lima, M. R. D., Horrocks, S., Daniels, S., Lamptey, M., Harrison, M., & Vaidyanathan, R. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309459 · Cited by 24
“The need for adaptation to user needs and cognitive abilities, privacy concerns on voice data gathering, and challenges in speech recognition have been identified as key barriers to overcome [16], [21].”
BackgroundRuggiano, N., Brown, E. L., Clarke, P., Hristidis, V., Roberts, L., Framil, C. V., Allala, S. C., Hurley, S., Kopcsik, C., Daquin, J. C., et al. (2024) · JMIR Aging · doi:10.2196/57308 · Cited by 22
Nickel, K., & Meyer, C. (2025) · Journal of Consumer Behaviour · doi:10.1002/cb.2475 · Cited by 20
Esmaeilzadeh, P., Hassanein, K., & Head, M. M. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2477754 · Cited by 21
Huynh, A., Roy, T. J., Jackson, K. N., Lee, A. G., Liaw, W. R., & Hossain, M. M. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106204 · Cited by 28
Srivastava, B. (2021) · Patterns · doi:10.1016/j.patter.2021.100308 · Cited by 26
“37 However, despite their popularity, it is experimentally unclear if any of the tools provided substantive or better support than human providers during COVID-19.”
BackgroundLaranjo, L., Shaw, T. J., Trivedi, R., Thomas, S. P., Charlston, E., Klimis, H., Thiagalingam, A., Kumar, S., Tan, T. C., Nguyen, T. N., et al. (2022) · JMIR Research Protocols · doi:10.2196/34470 · Cited by 14
“…have been applied in different health domains such as mental health support and chronic disease management to enable a conversational interaction with patients and promote engagement with health interventions with the aim of increasing intervention acceptability, use, and effectiveness [22,25-28].”
BackgroundInfluentialSelf-citationBerka, J., Balata, J., Jonker, C. M., Míkovec, Z., van Riemsdijk, M. B., & Tielman, M. L. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2059925 · Cited by 23
“However, these systems still have many limitations to be solved (Laranjo et al., 2018).”
BackgroundBrewer, R. N. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24854 · Cited by 21
“For example, people can use conversational agents for diagnosis, prevention, intervention delivery, and simulation for patients, physicians, and students (Laranjo et al., 2018; Montenegro et al., 2019).”
Kim, Y. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2316373 · Cited by 18
“Nonetheless, there has been an escalating scholarly attention towards the application of ABV in the healthcare sector (Fan et al., 2021; Laranjo et al., 2018; van der Lee et al., 2019), given its potential to facilitate better interactions with humans particularly concerning sensitive subject…”
Revolutionizing Healthcare: The Transformative Impact of Artificial Intelligence
Govindaraj, M., Anitha Kumari, D., Khan, P., Krishnan, R., Gnanasekaran, C., & Lawrence, J. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-3731-8.ch003 · Cited by 18
LLM-mediated domain-specific voice agents: the case of TextileBot
Zhong, S., Gatti, E., Hardwick, J., Ribul, M., Cho, Y., & Obrist, M. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2456667 · Cited by 22
Conversational Error Analysis in Human-Agent Interaction
Aneja, D., McDuff, D., & Czerwinski, M. (2020) · Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3383652.3423901 · Cited by 15
“Our work builds on a rich background of research into intelligent, embod-ied agents, robotics and error analyses [3, 5–8, 10, 14, 16, 17, 21– 25, 27].”
BackgroundSocial robotic application to support active and healthy ageing
Cooper, S., Fava, A. D., Villacañas, Ó., Silva, T., Fernández-Carbajales, V., Unzueta, L., Serras, M., Marchionni, L., & Ferro, F. (2021) · IEEE RO-MAN · doi:10.1109/ro-man50785.2021.9515432 · Cited by 21
On the Generation of Medical Dialogues for COVID-19Preprint
Yang, W., Zeng, G., Tan, B., Ju, Z., Chakravorty, S., He, X., Chen, S., Yang, X., Wu, Q., Yu, Z., et al. (2020) · medRxiv · doi:10.1101/2020.05.08.20095810 · Cited by 15
“Please refer to (Laranjo et al., 2018) for a comprehensive review.”
Wang, Y., Dai, Y., Chen, S., Wang, L., & Hoorn, J. F. (2023) · Systems · doi:10.3390/systems11080425 · Cited by 22
(Why) Do We Trust AI?: A Case of AI-based Health Chatbots
Prakash, A. V., & Das, S. (2024) · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · doi:10.3127/ajis.v28.4235 · Cited by 30
Interactive Conversational Agents for Perinatal Health: A Mixed Methods Systematic Review
Amil, S., Da, S. M. A. R., Plaisimond, J., Roch, G., Sasseville, M., Bergeron, F., & Gagnon, M. (2025) · Healthcare · doi:10.3390/healthcare13040363 · Cited by 40
“With the development of increasingly powerful and connected devices, smartphone chatbots are now widely used by consumers for everyday tasks such as information retrieval [14].”
Oh, Y. J., Liang, K.-H., Kim, D. D., Zhang, X., Yu, Z., Fukuoka, Y., & Zhang, J. (2025) · Digital Health · doi:10.1177/20552076251324445 · Cited by 24
“7,8 Chatbots have the potential to offer cost-effective, accessible, sustainable, and personalized health interventions tailored to individual needs.”
Zhu, X., Cheerman, H., Cheng, M., Kiami, S. R., Chukoskie, L., & McGivney, E. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719693 · Cited by 29
“Previous literature has highlighted the potential of LLMs in educational and social VR environments [15, 29] as well as the advancement of ECAs in clinical VR systems [6, 13].”
Dindorf, C., Dully, J., Bartaguiz, E., Menges, T., Reidick, C., Seibert, J., & Fröhlich, M. (2025) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2025.1548980 · Cited by 25
“Mitigating this issue involves integrating adaptive personalization mechanisms that leverage real-time user data to harmonize practical guidance and socioemotional assistance, following the approach demonstrated in AI-driven healthcare platforms (74).”
Brinsley, J., Singh, B., & Maher, C. A. (2023) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2023.04.023 · Cited by 18
Mancone, S., Diotaiuti, P., Valente, G., Corrado, S., Bellizzi, F., Vilarino, G. T., & Andrade, A. (2023) · Behavioral Sciences · doi:10.3390/bs13070550 · Cited by 14
Khorev, V. S., Kiselev, A. R., Badarin, A., Antipov, V. M., Drapkina, O. M., Kurkin, S., & Hramov, A. E. (2024) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-024-01289-x · Cited by 18
Natural Language Processing Technologies for Public Health in Africa: Scoping Review
Hu, S., Oppong, A., Mogo, E., Barford, A., Occhini, G., Collins, C., & Korhonen, A. (2025) · Journal of Medical Internet Research · doi:10.2196/68720 · Cited by 36
Çelik, İ., Muukkonen, H., & Siklander, P. (2025) · Policy Futures in Education · doi:10.1177/14782103251348551 · Cited by 29
“In other words, teachers with negative attitudes towards chatbots are less likely to trust in the decision of chatbots in terms of privacy and educational appropriateness (Laranjo et al., 2018).”
Preliminary Findings of using Chat-bots as a Course FAQ Tool
Ch’ng, S. I., Yeong, L. S., & Ang, X.-Y. (2019) · doi:10.1109/ic3e47558.2019.8971786 · Cited by 14
“The advances in natural language processing and availability of code-free tools have led to the increase of agents used to tackle routine conversations in various fields such as health[3]–[5], businesses[6]–[8] and education [9]–[13].”
BackgroundEmploying Conversational Agents in Palliative Care: A Feasibility Study and Preliminary Assessment
Chatzimina, M., Koumakis, L., Marias, K., & Tsiknakis, M. (2019) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2019.00095 · Cited by 18
“Based on the systematic review of Laranjo et al [19], 14 conversational agents were identified in the healthcare domain, supporting different types of technology such as mobile devices, web, telephone, SMS or personal computers.”
Conversational Agents for Health and Well-being Across the Life Course: Protocol for an Evidence Map
Guerreiro, M. P., Angelini, L., Henriques, H. R., Kamali, M. E., Baixinho, C. L., Balsa, J., Félix, I. B., Khaled, O. A., Carmo, M. B., Cláudio, A. P., et al. (2021) · JMIR Research Protocols · doi:10.2196/26680 · Cited by 17
“To comprehensively identify relevant keywords, we resorted to using a purposive sample of 13 literature reviews [6,7,9,10,18,20-29] and a review protocol [30] related to conversational agents for health and well-being.”
BackgroundMethodGualda-Gea, J. J., Barón-Miras, L. E., Bertran, M. J., Vilella, A., Rocamora, I. T., & Prat, A. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1529305 · Cited by 23
Shankar, R., Bundele, A., Yap, A. E., & Mukhopadhyay, A. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1553494 · Cited by 16
“AI chatbots are computer programs that simulate human conversation using natural language processing (NLP) techniques (12).”
Chen, R., Zhang, S., Zheng, Y., Yu, Q., & Wang, C. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1599241 · Cited by 16
Eiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 21
“At the same time, risks such as algorithmic bias, limited explainability, and the need for human oversight remain critical considerations for safe implementation (204, 205).”
Békés, V., & Doorn, K. A. (2026) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70220 · Cited by 21
“Many of these chatbots used to be based on relatively simple dialogue systems (Laranjo et al. 2018); however, in recent years, these chatbots have become more human-like and effective (Feng et al. 2022; Feng et al. 2025), and acceptable to patients (Ng and Zhang 2025) as well as health…”
Njogu, J. N., Jaworski, G., Oduor, C., Chea, A., Malmqvist, A., & Rothschild, C. W. (2023) · Sexual and Reproductive Health Matters · doi:10.1080/26410397.2023.2269008 · Cited by 18
Conversational Agents in Palliative Care: Potential Benefits, Risks, and Next Steps
Schenker, Y., Abdullah, S., Arnold, R. M., & Schmitz, K. H. (2024) · Journal of Palliative Medicine · doi:10.1089/jpm.2023.0534 · Cited by 16
“3,9,10 Today’s conversational agents may be simpler to use than other available mobile health interventions.”
Song, T., Pabst, F., Eck, U., & Navab, N. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549181 · Cited by 29
“However, as reviewed by Laranjo et al. [43], the use of conversational agents with unconstrained natural language input capabilities in healthcare is still in the early stages of investigation.”
Integrating a Voice User Interface into a Virtual Therapy Platform
Liu, Y., Wang, L., Kearns, W. R., Wagner, L., Raiti, J., Wang, Y., & Yuwen, W. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451595 · Cited by 17
BotCovid: Development and Evaluation of a Chatbot to Combat Misinformation about COVID-19 in Brazil
Roque, G. D. S. L., Cavalcanti, A. R. D. S., do Nascimento, J. W. A., de Souza, R. R., & Queiroz, S. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9658693 · Cited by 13
“A chatbot is highly valuable as it can provide a single authoritative answer to most questions asked by users and presents concise information from reliable sources, which can be less oppressive than the long list of results from web search engines or social media[6].”
BackgroundA code-mixed task-oriented dialog dataset for medical domain
Dowlagar, S., & Mamidi, R. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101449 · Cited by 23
Schillings, C., Meißner, E., Erb, B., Schultchen, D., Bendig, E., & Pollatos, O. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1046202 · Cited by 23
“There is still a lack of standard measures and randomized controlled trials of chatbot-based interventions in the mental health area (55, 68, 38, 35).”
BackgroundDevelopment of a practical training method for a healthcare artificial intelligence (AI) chatbot
Lin, J., Joseph, T., Parga-Belinkie, J. J., Mandel, A., Schumacher, R., Neumann, K., Scalise, L., Gaulton, J., Christ, L., Leitner, K., et al. (2021) · BMJ Innovations · doi:10.1136/bmjinnov-2020-000530 · Cited by 13
Chuan, C., & Morgan, S. E. (2020) · ACM Transactions on Computing for Healthcare · doi:10.1145/3403575 · Cited by 15
“Interestingly, only 2 articles out of the 40 are included in Laranjo et al.’s [2018] review.”
BackgroundMozafari, N., Schwede, M., Hammerschmidt, M., & Weiger, W. H. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.525 · Cited by 23
“With regards to the setting of our study, prior literature suggests that both warmth and competence perceptions are relevant for robot acceptance in a medical context [66].”
Evaluation of Cancer Survivors’ Experience of Using AI-Based Conversational Tools: Qualitative Study
Khairat, S., Mehraby, H., Masoumi, S., Coffel, M., Rockey-Bartlett, C., Huang, A., Wood, W. A., & Basch, E. (2025) · JMIR Cancer · doi:10.2196/77390 · Cited by 16
Han, H. J., Mendu, S., Jaworski, B. K., Owen, J. E., & Abdullah, S. (2023) · JMIR Formative Research · doi:10.2196/45894 · Cited by 14
“While there has been an increasing interest in using CAs for mental health support, there is a lack of understanding regarding how CAs can be designed for sustained user engagement and adherence [39,40].”
BackgroundRodriguez, D. V., Chen, J., Viswanadham, R. V. N., Lawrence, K. S., & Mann, D. (2024) · JMIR AI · doi:10.2196/47122 · Cited by 13
“…chatbots (AI chatbots), conversational agents that mimic human interaction through written, oral, and visual communication channels with a user [1,2], have demonstrated efficacy in health-behavior change interventions among a large and diverse population [3-6 Prior work from this team involved…”
BackgroundSelf-citationRonneberg, C. R., Lv, N., Ajilore, O., Kannampallil, T., Smyth, J. M., Kumar, V., Barve, A., Garcia, C., Dosala, S., Wittels, N. E., et al. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107574 · Cited by 17
“Many text-based conversational applications [16] have emerged for depression and anxiety counseling, but only a small minority have been empirically evaluated [17].”
Chatbots talk Strabismus: Can AI become the new patient Educator?
Yılmaz, İ. E., Berhuni, M., Özcan, Z. Ö., & Doğan, L. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105592 · Cited by 14
Nelson, J., Kaplan, J., Simerly, G., Nutter, N., Edson-Heussi, A., Woodham, B., & Broman‐Fulks, J. J. (2025) · Current Psychology · doi:10.1007/s12144-025-07320-1 · Cited by 24
“Further, Laranjo et al. (2018) suggest that when the clinical viability of agents, such as chatbots, are being assessed, their capacity to assure end-user safety is often not included as a criterion.”
Digital technologies in genetic counseling: Recommendations for a morally sound integration
van Lingen, M. N., Giesbertz, N. A. A., & Jongsma, K. R. (2025) · Genetics in Medicine · doi:10.1016/j.gim.2025.101370 · Cited by 16
Social Media Chatbot for Increasing Physical Activity: Usability Study
Larbi, D., Gabarrón, E., & Denecke, K. (2021) · Studies in health technology and informatics · doi:10.3233/shti210604 · Cited by 16
“Although the use of chatbots for health-related purposes is still an emerging field [8,9], its benefits related to increase in physical activity and user satisfaction have already been shown [10-12].”
BackgroundMinding the AI: Ethical Challenges and Practice for AI Mental Health Care Tools
Martinez‐Martin, N. (2021) · Advances in neuroethics · doi:10.1007/978-3-030-74188-4_8 · Cited by 31
What to Discuss?—A Blueprint Topic Model for Health Coaching Dialogues With Conversational Agents
Beinema, T. C., den Akker, H. O., Hermens, H. J., & van Velsen, L. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2041884 · Cited by 19
“These CAs are “ computer systems that imitate natural conversation with human users through images and written or spoken language ” (Laranjo et al., 2018).”
BackgroundUsing Large Language Models to Shape Social Robots’ Speech.
Salcedo, J. S., Fernández‐Rodicio, E., Galván, L. M., Castro‐González, Á., Castillo, J. C., & Salichs, M. A. (2023) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2023.07.008 · Cited by 18
“INTELLIGENT conversational agents are increasingly being integrated into public-facing tasks such as customer service tasks, including troubleshooting and providing information; assistive chatbots have been used in multiple fields [1].”
BackgroundEquivalence of chatbot and paper-and-pencil versions of the De Jong Gierveld loneliness scale
Miedes, A. C., Belmonte, Ó., Castillo, A., Gascó, A., Sansano‐Sansano, E., & Montoliu, R. (2020) · Current Psychology · doi:10.1007/s12144-020-01117-0 · Cited by 15
Population subgroup differences in the use of a COVID-19 chatbot
Schubel, L., Wesley, D. B., Booker, E. A., Lock, J., & Ratwani, R. M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00405-8 · Cited by 13
Han, H. J., Mendu, S., Jaworski, B. K., Owen, J. E., & Abdullah, S. (2021) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3460418.3479332 · Cited by 18
“However, as recent studies [23, 33] have highlighted, evidence on the efficacy of CAs is limited.”
BackgroundDesigning A Virtual Talking Companion to Support the Social-Emotional Learning of Children with ASD
Gagan, I. T. M., Matias, M. A. M. E., Tan, I., Vinco, C. M., Ong, E., & Resurreccion, R. R. (2022) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3501712.3535287 · Cited by 16
“Conversational agents (CA) are virtual companions that can simulate text or verbal conversations with humans [22, 34].”
BackgroundCS-KG 2.0: A Large-scale Knowledge Graph of Computer Science
Dessí, D., Osborne, F., Buscaldi, D., Reforgiato Recupero, D., & Motta, E. (2025) · Scientific Data · doi:10.1038/s41597-025-05200-8 · Cited by 17
“…methods for smart and tailored literature searches 1–3 , assisting in or even automating the creation of literature reviews 4 , enhancing academic writing and refer-encing 5,6 , automatically formulating novel hypotheses 7,8 , developing specialized conversational agents 9,10 , and much more.”
Abdulrahman, A., & Richards, D. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5090056 · Cited by 11
“Further, the safety of such open input CAs is a serious issue that has not been properly evaluated yet [40].”
BackgroundJolibois, S., Ito, A., & Nose, T. (2025) · Applied Sciences · doi:10.3390/app15084256 · Cited by 16
Mukadam, A., Suresh, S., & Jacobs, C. (2025) · Cureus · doi:10.7759/cureus.84381 · Cited by 23
Role of Chatbots in School Education
Lata, M., & Kumar, V. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-7873-1.ch008 · Cited by 11
User and Provider Experiences With Health Education Chatbots: Qualitative Systematic Review
Choi, К.-E. (., & Fitzek, S. (2025) · JMIR Human Factors · doi:10.2196/60205 · Cited by 19
“Chatbots are software applications designed for 2-way dialogue that simulate human conversation through text or speech and are increasingly integrated into health care systems to deliver health education and behavior-change interventions [1,2].”
Kapoor, D., Garg, D., & Tadakamadla, S. K. (2025) · Frontiers in Oral Health · doi:10.3389/froh.2025.1652422 · Cited by 14
“The lack of robust experimental designs in many studies suggests a need for more rigorous trials to establish the clinical utility and safety pro fi le of AI-based conversational tools in healthcare (27).”
InfluentialShankar, R., Devi, F., Ang, E. N. K., & Er, J. B. T. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-099875 · Cited by 15
“30 Despite the potential benefits, the adoption of AI-driven solutions in nursing practice faces several challenges.”
Gao, Y., Dai, Y., Zhang, G., Guo, H., Hao, A., & Li, S. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103585 · Cited by 17
Socialni odnosi, animizem, antropomorfizem in interakcija z UI
Babić, N. Č. (2022) · doi:10.18690/um.ff.11.2022.12 · Cited by 11
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.