Conversational agents in healthcare: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index; 14 of the 36 sources its claims cite were checked for support.
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Overview
CoChat Summary
TL;DR
This systematic review found that conversational agents with unconstrained natural language input were still rarely studied in healthcare: 17 articles covering 14 agents, mostly evaluated with quasi-experimental designs. Evidence of efficacy and safety was limited, with only one RCT showing reduced depression symptoms (effect size d = 0.44, p = .04).
Key findings
- The search retrieved 1513 citations; 17 articles evaluating 14 different conversational agents met inclusion criteria.
- Study designs were mainly weak for efficacy claims: 2 RCTs, 1 cross-sectional study, and the rest quasi-experimental. The paper notes that the RCTs had moderate to high risk of bias.
- Dialogue management was mostly finite-state (6 agents / 8 studies) or frame-based (7 agents / 8 studies); agent-based dialogue management appeared in 1 agent.
- The only RCT evaluating efficacy found a significant reduction in depression symptoms with effect size d = 0.44, p = .04; patient safety was rarely evaluated.
Methods
- Systematic review of studies of conversational agents using any unconstrained natural language input for health-related purposes; protocol registered at PROSPERO CRD42017065917 and the review followed PRISMA.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in April 2017, updated in February 2018; included primary studies of consumers, caregivers, or healthcare professionals that tested the full system with human users and reported evaluation measures.
- Screening was done by independent reviewers with Cohen’s kappa for agreement; because of heterogeneity, the authors conducted a narrative synthesis rather than a meta-analysis.
Limitations
- The paper states it focused only on agents with unconstrained natural language input, excluding constrained-input systems that are also relevant to healthcare.
- The paper states that the small number of included studies, heterogeneity of agents, and predominance of quasi-experimental pilot studies limited its ability to conduct a meta-analysis.
- Evident from the text: reporting was inconsistent, making eligibility assessment and synthesis difficult, and several studies lacked clear funding/conflict-of-interest reporting.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 3 Not valid · 13 Not checked · 25 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
§ Conversational agents in healthcare: a systematic review > Results > Evaluation measures
What the sources say
- Supportedcites [22] Philip, 2017, Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders, Sci Rep source
The Method (Recorded data in the study; page not given) says patients completed both interviews in randomized order, one with the ECA and one with the psychiatrist. The Results (Global performance of ECA diagnosis of MDD; page not given) report overall sensitivity of 49% and specificity of 93% against the psychiatrist’s diagnosis. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We found that only one study evaluated the efficacy of a conversational agent on health outcomes using adequate study design methods (RCT) and validated questionnaires.”
§ Conversational agents in healthcare: a systematic review > DISCUSSION > Standards for reporting the evaluation of conversational agents in healthcare
What the sources say
- Supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health source
The Results report that participants were randomized to Woebot or an information-control group, and the Methods > Measures section identifies the PHQ-9 and GAD-7 as validated questionnaires. This confirms that the cited paper is an RCT evaluating a conversational agent with validated health-outcome measures. “Only one study” describes the citing authors’ review finding, not a claim made by this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Over the last two decades, a solid body of evidence has shown the potential benefits of using embodied conversational agents for health-related purposes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Results and Discussion report benefits from this conversational-agent intervention, particularly increased fruit and vegetable consumption compared with the control group. The Conclusion also describes the intervention as effective at changing health behavior. The paper does not establish the claim’s broader characterization of a solid body of evidence accumulated over two decades. (LLM, conf=0.86)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes prior research on embodied computer agents, and the Discussion conclusion reports that a virtual coach helped maintain activity in overweight participants. This supports potential health benefits, but the paper does not establish a solid body of evidence spanning two decades or benefits across health-related purposes generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04).”
§ Conversational agents in healthcare: a systematic review > Abstract > Results
What the sources say
- Partly supportedcites [19] Fitzpatrick, 2017, Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy) report a significant reduction in depression symptoms for the Woebot group relative to the information control group, with d=0.44 and a Bonferroni-corrected P=.04. The Discussion (Principal Results) calls this, to the authors’ knowledge, the first randomized trial of a nonembodied text-based conversational agent designed for therapeutic use; it does not establish that it was the only RCT evaluating any conversational agent. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several randomized controlled trials of interventions involving embodied conversational agents have shown significant improvements in physical activity, fruit and vegetable consumption, and accessibility to online health information, among other outcomes.”
§ Conversational agents in healthcare: a systematic review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] Bickmore, 2013, A randomized controlled trial of an automated exercise coach for older adults, J Am Geriatr Soc source
- Partly supportedcites [4] Bickmore, 2013, Automated interventions for multiple health behaviors using conversational agents, Patient Educ Couns sourceExperimental — accuracy not yet measured
The Abstract (Methods) describes one randomized trial, not several. The Results (§3.1–3.3) report a significant improvement in fruit and vegetable consumption and faster growth in walking steps for the physical-activity group, but no significant difference in self-reported physical activity. Our copy does not report an outcome concerning accessibility to online health information. (LLM, conf=0.90)
- Partly supportedcites [5] Watson, 2012, An internet-based virtual coach to promote physical activity adherence in overweight adults: randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites [6] Edwards, 2013, Use of an interactive computer agent to support breastfeeding, Matern Child Health J source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
17 more claims · 2 with their cited sources checked
Create a free account to see all 51 claims and every source verdict.
- Probably not a substantial claim. 12
- It may state two separate claims as one. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previously conducted reviews [5,18,19] did not assess the effectiveness and safety of chatbots in mental health.”
From Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis (2020) · cites this paper as [18]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most studies reviewed in 2018 [14] were limited to task-oriented conversational agents to support patients and clinicians in highly specific scenarios (e.g., information retrieval and predefined clinical interview), restricting user input to predetermined utterances.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These databases were chosen as they cover relevant aspects in the fields of medicine, technology, and interdisciplinary research and have also been used in other systematic reviews covering similar topics [7,8].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [32]
Experimental — accuracy not yet measured
62 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“This systematic review is compliant with the PRISMA statement.(18)”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“49,50 Implications for healthcare, public health, and future research Patient safety was rarely evaluated in the included studies.”
BackgroundEvaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 2×
“…of a conversational system from a health research perspective was considered to involve any health-related results present in the included studies, including process and outcome measures as defined by Donabedian; 16 for example, effectiveness in symptom reduction, diagnostic accuracy, or referrals.”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first well-established chatbot of this kind—ELIZA—was programmed in 1966 to simulate a text-based conversation with a psychotherapist.(2)”
MethodA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“10,56,57 Therefore, the use of conversational agents with unconstrained natural language input capabilities and other artificial intelligence applications in healthcare needs to be carefully monitored.”
BackgroundSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“…telehealth (CONSORT-EHEALTH), 46 the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement, 47 and the Standards for Reporting Diagnostic accuracy studies (STARD), 48 among others from the Enhancing the Quality and Transparency Of health Research (EQUATOR) network.”
MethodDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms.(19) Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
Influential
Research works printed but not linked: 2
- Radziwill, 2017, arXiv Prepr, 1704
- Coiera, 2017, First compute no harm, BMJ Opin
Cited by
Items 201–300 of 1,371
Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations
Coope, S., Farghly, T., Gerz, D., Vulić, I., & Henderson, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.11 · Cited by 76
“, 2017), and also in domains such as healthcare (Laranjo et al., 2018) or entertainment (Fraser et al.”
BackgroundMeyer, N., Schwede, M., Hammerschmidt, M., & Weiger, W. H. (2022) · Electronic Markets · doi:10.1007/s12525-022-00613-4 · Cited by 51
“Regarding the setting of our study, prior literature suggests that both warmth and competence perceptions are relevant for robot acceptance in a medical context (Laranjo et al., 2018).”
BackgroundShah, H. A., & Househ, M. S. (2023) · Interactive Journal of Medical Research · doi:10.2196/45197 · Cited by 70
“The ability to connect with others is also reported to be associated with well-being achieved through using communication technologies [47].”
BackgroundA framework of diversity, equity, and inclusion safeguards for chatbots
Abdelhalim, E., Anazodo, K. S., Gali, N., & Robson, K. (2024) · Business Horizons · doi:10.1016/j.bushor.2024.03.003 · Cited by 60
“Chatbots can be designed to communicate based on constrained logic (i.e. rule-based, distinct multiple choice), but they are typically designed to communicate via unconstrained language (i.e. human-to-human-like, natural) (Laranjo et al., 2018).”
He, L., Balaji, D., Wiers, R. W. H. J., Antheunis, M. L., & Krahmer, E. (2022) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntac281 · Cited by 61
Integrating Conversational Agents and Knowledge Graphs Within the Scholarly Domain
Meloni, A., Angioni, S., Salatino, A. A., Osborne, F., Recupero, D. R., & Motta, E. (2023) · IEEE Access · doi:10.1109/access.2023.3253388 · Cited by 67
Park, Y., Kim, J., Jiang, Q., & Kim, K. H. (2024) · Journal of Global Scholars of Marketing Science · doi:10.1080/21639159.2024.2362654 · Cited by 76
“Chatbots that can personalize chatbots to provide customized responses and adapt to user preferences and behaviors are more useful to users (Laranjo et al., 2018 Kim & Yang, 2018).”
The AI Future of Emergency Medicine
Petrella, R. J. (2024) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2024.01.031 · Cited by 43
Are chatbots the new relationship experts? Insights from three studies
Vowels, L. M. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100077 · Cited by 42
Living Memories: AI-Generated Characters as Digital Mementos
Pataranutaporn, P., Danry, V., Blanchard, L., Thakral, L., Ohsugi, N., Maes, P., & Sra, M. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584065 · Cited by 42
“Examples of conversational agents (CAs) include: chatbots for casual conversation or question-answer systems; embodied agents (e.g., virtual avatars or agents) for face-to-face conversation; and conversational interfaces such as Apple Siri or Amazon Alexa [16, 24, 36, 40].”
BackgroundConversational AI and Vaccine Communication: Systematic Review of the Evidence
Passanante, A., Pertwee, E., Lin, L. K., Lee, K. Y., Wu, J. T. K., & Larson, H. J. (2023) · Journal of Medical Internet Research · doi:10.2196/42758 · Cited by 57
“The dominance of relatively simple, rules-based bots is consistent with research on health chatbots more generally [1,4,10].”
InfluentialKunitsu, Y. (2023) · JMIR Medical Education · doi:10.2196/48452 · Cited by 43
“More recently, AI chatbots (also known as interactive AI) have been invented and are being used in medicine to automatically converse with human text and voice input [4-6].”
BackgroundAutomated conversational agents for post-intervention follow-up: a systematic review
Geoghegan, L., Scarborough, A., Wormald, J. C. R., Harrison, C. J., Collins, D. P., Gardiner, M. D., Bruce, J., & Rodrigues, J. N. (2021) · BJS Open · doi:10.1093/bjsopen/zrab070 · Cited by 70
Supporting mental health self-care discovery through a chatbot
Moilanen, J., van Berkel, N., Visuri, A., Gadiraju, U., van der Maden, W., & Hosio, S. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1034724 · Cited by 41
“Initial versions of chatbots operated purely through text-based communication, aiming to provide intelligent and human-like replies to its users (11).”
BackgroundWu, P. F., Summers, C., Panesar, A., Kaura, A., & Zhang, L. (2024) · JMIR Human Factors · doi:10.2196/51086 · Cited by 54
“The potential benefits offered by these technologies, such as enhanced health care accessibility [4,36], cost reduction [15], and improved patient outcomes [37], are too substantial to disregard.”
BackgroundDesigning Conversational AI for Aging: A Systematic Review of Older Adults' Perceptions and Needs
Yuan-hui, H., Zhou, Q., & Piper, A. M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713578 · Cited by 70
“In Laranjo et al.’s review [88], they suggested that user experience assessments were often inconsistent across studies, lacking standardized guidelines that would help interpret results across studies.”
deepBioWSD: effective deep neural word sense disambiguation of biomedical text data
Pesaranghader, A., Matwin, S., Sokolova, M., & Pesaranghader, A. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy189 · Cited by 53
Voice Interface Technology Adoption by Patients With Heart Failure: Pilot Comparison Study
Apergi, L. A., Bjarnadóttir, M. V., Baras, J. S., Golden, B., Anderson, K. M., Chou, J., & Shara, N. M. (2021) · JMIR mhealth and uhealth · doi:10.2196/24646 · Cited by 43
“Conversational agents have been used in numerous health care settings, with the literature extensively focusing on mental health applications [18,19].”
Participatory Development and Pilot Testing of an Adolescent Health Promotion Chatbot
Maenhout, L., Peuters, C., Cardon, G., Compernolle, S., Crombez, G., & DeSmet, A. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.724779 · Cited by 54
“This mismatch is a limitation from the choice to use a Natural Language Processor (NLP), in comparison to constrained input used in the majority of interventions where the input is rule-based, giving people different answer-options to choose from in order to shape the conversation (29, 34).”
BackgroundMethodInfluentialDeveloping and Sustaining an Effective and Resilient Oncology Careforce: Opportunities for Action
Takvorian, S. U., Balogh, E. P., Nass, S. J., Valentin, V. L., Hoffman-Hōgg, L., Oyer, R. A., Carlson, R. W., Meropol, N. J., Sheldon, L. K., & Shulman, L. N. (2019) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djz239 · Cited by 46
Doctor-patient interactions in the age of AI: navigating innovation and expertise
Hryciw, B. N., Fortin, Z., Ghossein, J., & Kyeremanteng, K. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1241508 · Cited by 40
You, W., Comins, C. A., Jarrett, B. A., Young, K., Guddera, V., Phetlhu, D. R., Mulumba, N., Mcingana, M., Hausler, H., Baral, S., et al. (2020) · mHealth · doi:10.21037/mhealth.2019.12.07 · Cited by 40
Smart conversational agents for the detection of neuropsychiatric disorders: A systematic review
Pacheco-Lorenzo, M. R., Valladares-Rodríguez, S. M., Anido-Rifón, L. E., & Fernández-Iglesias, M. J. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103632 · Cited by 40
Chatbots for Smoking Cessation: Scoping Review
Whittaker, R., Dobson, R., & Garner, K. (2022) · Journal of Medical Internet Research · doi:10.2196/35556 · Cited by 55
“In recent times, chatbots have been used in health care for supporting clinicians in diagnosis and helping individuals manage chronic illnesses [13].”
Communicating with Machines: Conversational Agents with Personality and the Role of Extraversion
Ahmad, R., Siemon, D., & Robra-Bissantz, S. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.492 · Cited by 45
“Another context, in which CAs play an increasingly important role is in health and medical care, supporting consumers with mental health challenges, or assisting patients and elderly individuals in their living environments [32].”
BackgroundThe AI Doctor Is In: A Survey of Task-Oriented Dialogue Systems for Healthcare Applications
Valizadeh, M., & Parde, N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.458 · Cited by 101
“, 2019) or general healthcare (Laranjo et al., 2018; Kearns et al., 2019) settings.”
BackgroundInfluentialTalking technology: exploring chatbots as a tool for cataract patient education
Yılmaz, İ. E., & Doğan, L. (2024) · Clinical and Experimental Optometry · doi:10.1080/08164622.2023.2298812 · Cited by 42
“7,20 Even fewer studies discussed the ethical or social consequences and challenges of integrating chatbots into patient education.”
Understanding Conversational and Expressive Style in a Multimodal Embodied Conversational Agent
Aneja, D., Hoegen, R., McDuff, D., & Czerwinski, M. P. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445708 · Cited by 62
“Our work builds on a rich background of research into intelligent, embodied agents [4, 12, 14, 23, 24, 26, 29].”
BackgroundKowatsch, T., Lohse, K.-M., Erb, V., Schittenhelm, L., Galliker, H., Lehner, R., & Huang, E. M. (2021) · Journal of Medical Internet Research · doi:10.2196/23612 · Cited by 39
“Our review of remote patient monitoring tools and current scientific work (Multimedia Appendix 1 [16,29,39,42-66]) suggests that there is untapped potential in addressing this problem, too.”
BackgroundConversational Agents for Health and Wellbeing
Kocaballi, A. B., Quiroz, J. C., Laranjo, L., Rezazadegan, D., Kocielnik, R., Clark, L., Liao, Q. V., Park, S. Y., Moore, R. J., & Miner, A. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3375154 · Cited by 38
“Another review study focusing on personalization of healthcare conversational agents found that most of the studies implemented the personalization features without a theoretical or evidence-based support [13].”
BackgroundSelf-citationPersuasive Technology for Mental Health: One Step Closer to (Mental Health Care) Equality?
Kolenik, T., & Gams, M. (2021) · IEEE Technology and Society Magazine · doi:10.1109/mts.2021.3056288 · Cited by 52
Kolenik, T., & Gams, M. (2021) · Electronics · doi:10.3390/electronics10111250 · Cited by 55
“Reviews on this topic are favorable [11–16, 40 ], agreeing”
BackgroundDhinagaran, D. A., Martinengo, L., Ho, M. R., Joty, S., Kowatsch, T., Atun, R. A., & Car, L. T. (2022) · JMIR mhealth and uhealth · doi:10.2196/38740 · Cited by 41
“To ensure the validity of the results, the process must use a robust methodology that is adequate for the intervention design [15].”
BackgroundMethodEvaluating the Potential of Artificial Intelligence in Orthopedic Surgery for Value-based Healthcare
Tariq, A., Gill, A. Y., & Hussain, H. K. (2023) · International Journal of Multidisciplinary Sciences and Arts · doi:10.47709/ijmdsa.v2i1.2394 · Cited by 37
“By enabling personalised treatment plans, strengthening surgical precision, improving diagnostic accuracy, and optimizing post-operative rehabilitation, artificial intelligence has emerged as a potent tool in achieving the goals of value-based care [5].”
BackgroundAbubakar, A. M., Gupta, D., & Parida, S. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.04.087 · Cited by 44
A conversational recommender system for diagnosis using fuzzy rules
Cordero, P., Enciso, M., López-Rodríguez, D., & Mora, Á. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113449 · Cited by 43
Ireland, D., Bradford, D., Szepe, E., Lynch, E., Martyn, M., Hansen, D., & Gaff, C. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2020.11.007 · Cited by 37
Kocielnik, R., Langevin, R., George, J. S., Akenaga, S., Wang, A., Jones, D. P., Argyle, A., Fockele, C., Anderson, L., Hsieh, D. T., et al. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469599 · Cited by 37
“Despite this growing interest, recent reviews have shown that our understanding of CUI performance and user preferences towards them is still lacking [29, 35, 47].”
BackgroundUser Perceptions of Extraversion in Chatbots after Repeated Use
Völkel, S. T., Schoedel, R., Kaya, L., & Mayer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502058 · Cited by 53
“In light of these shortcomings, CAs have the potential to open up new frontiers in mental health treatment [59, 64, 72, 115] as they offer users help regardless of time and location, at low cost, and with less fear of being judged [15, 64, 69, 71].”
BackgroundUlrich, S., Gantenbein, A. R., Zuber, V., Von Wyl, A., Kowatsch, T., & Künzli, H. (2024) · Journal of Medical Internet Research · doi:10.2196/50132 · Cited by 36
“Reminders (Figure 1C) are an effective way of improving engagement, especially when they address specific needs [76,77]; refer to Multimedia Appendix 4 [49,56,68,78-81] for the detailed aspects of the engagements implemented.”
Martinengo, L., Lin, X., Jabir, A. I., Kowatsch, T., Atun, R. A., Car, J., & Car, L. T. (2023) · Journal of Medical Internet Research · doi:10.2196/50767 · Cited by 45
“We compiled these categories; added a category, dialogue initiation, from the systematic review by Laranjo et al [18]; and removed the domain category as it was not specific to health care.”
Coerced Change-talk with Conversational Agents Promotes Confidence in Behavior Change
Olafsson, S., O'Leary, T., & Bickmore, T. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329202 · Cited by 36
“The same review found that approximately 70% of the conversational agents suffered from problems with language understanding and/or dialog management [16], threatening user safety [17].”
BackgroundLeveraging conversational technology to answer common COVID-19 questions
McKillop, M. M., South, B. R., Preininger, A. M., Mason, M., & Jackson, G. P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa316 · Cited by 38
“Core natural language capabilities include: (1) understanding input, (2) classifying topics, (3) state management and maintaining a structured dialog (eg, functions to support dynamically collecting multiple pieces of information, digressions for allowing users to change topics without losing their place in the conver…”
BackgroundRazumovskaia, E., Glavaš, G., Majewska, O., Ponti, E. M., Korhonen, A., & Vulić, I. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13083 · Cited by 81
“, 2020), or (non-emergency) healthcare (Laranjo et al., 2018; Denecke et al., 2019).”
BackgroundKelly, A., Noctor, E., Ryan, L., & van de Ven, P. W. J. (2025) · Journal of Medical Internet Research · doi:10.2196/70131 · Cited by 60
“Conversational agents have been successfully implemented in a variety of health care settings playing both educational and supportive roles in chronic disease management [16,17].”
Acceptance of an Informational Antituberculosis Chatbot Among Korean Adults: Mixed Methods Research
Kim, A. J., Yang, J., Jang, Y., & Baek, J. S. (2021) · JMIR mHealth and uHealth · doi:10.2196/26424 · Cited by 35
“Chatbots Chatbots are a conversational agent, a software program that interacts with natural language, and have emerged as a new form of mHealth service [9,10].”
BackgroundBartle, V., Lyu, J., El Shabazz-Thompson, F., Oh, Y., Chen, A. A., Chang, Y.-J., Holstein, K., & Dell, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517683 · Cited by 35
“A cluster of studies has examined IVA use by older adults and/or patients, including for selfcare [14, 18, 40, 48], self-management of mental health [1, 24, 53, 82],”
BackgroundPre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05006 · Cited by 34
“Dialogue Systems (DSs) in the biomedical domain has attracted continuous attention due to the utility applications ( e.g. , virtual health consultants and therapists) [119].”
BackgroundEscobar-Viera, C. G., Porta, G., Coulter, R. W. S., Martina, J., Goldbach, J., & Rollman, B. L. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100668 · Cited by 34
Hong, G., Smith, M., & Lin, S. (2022) · JMIR Formative Research · doi:10.2196/37028 · Cited by 35
“Various types of conversational agents have emerged, including chatbots, embodied conversational agents (avatars), and voice assistants, all of which mimic human conversation using text and/or spoken language [7].”
BackgroundLima, M. R. D., Su, T., Jouaiti, M., Wairagkar, M., Malhotra, P., Soreq, E., Barnaghi, P. M., & Vaidyanathan, R. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3290833 · Cited by 47
“There has been emerging interest in applying conversational AI technology in healthcare applications [24], including for home support of older populations [23].”
BackgroundBaron, R., & Haick, H. (2024) · ACS Sensors · doi:10.1021/acssensors.4c00636 · Cited by 41
Enhancing AI Chatbot Responses in Health Care: The SMART Prompt Structure in Head and Neck Surgery
Vaira, L. A., Lechien, J. R., Abbate, V., Gabriele, G., Frosolini, A., Vito, A. D., Maniaci, A., Mayo‐Yáñez, M., Boscolo‐Rizzo, P., Saibene, A. M., et al. (2025) · OTO Open · doi:10.1002/oto2.70075 · Cited by 40
Responsible CVD screening with a blockchain assisted chatbot powered by explainable AI
Muneer, S., Abbas, S., Shah, A. A., Alharbi, M., Aldossary, H., Fatima, A., Ghazal, T. M., & Khan, M. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-96715-y · Cited by 55
“The authors 39 highlighted that AI chatbots, also known as conversational agents, utilize dialog systems to engage in natural language conversations with users through speech, text, or a combination of both.”
Vik: A Chatbot to Support Patients with Chronic Diseases
Chaix, B., Guillemassé, A., Nectoux, P., Delamon, G., & Brouard, B. (2020) · Health · doi:10.4236/health.2020.127058 · Cited by 40
“[8] conducted a systematic review of conversational agents in healthcare and showed that the use of conversational agents with unconstrained natural language input capabilities for health-related purposes was an emerging field of research.”
BackgroundRasouli, S., Ghafurian, M., Nilsen, E. S., & Dautenhahn, K. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108072 · Cited by 45
Zhang, D., & Zhao, X. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108359 · Cited by 39
Economics and Equity of Large Language Models: Health Care Perspective
Nagarajan, R., Kondo, M., Salas, F., Sezgın, E., Yao, Y., Klotzman, V., Godambe, S. A., Khan, N., Limon, A., Stephenson, G. S., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/64226 · Cited by 43
Diwanji, V. S., Geana, M., Pei, J., Nguyen, N. H. T., Izhar, N., & Chaif, R. H. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2454954 · Cited by 41
“However, studies have found mixed results regarding chatbot effectiveness in vaccine promotion (Alagha & Helbing, 2019; Laranjo et al., 2018; J. Zhang et al., 2020).”
Hernandez, J. P. T. (2019) · The Journal of Medical Investigation · doi:10.2152/jmi.66.24 · Cited by 33
Hybrid intelligence in hospitals: towards a research agenda for collaboration
Mirbabaie, M., Stieglitz, S., & Frick, N. R. J. (2021) · Electronic Markets · doi:10.1007/s12525-021-00457-4 · Cited by 33
Cho, Y., Rai, S., Ungar, L., Sedoc, J., & Guntuku, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.698 · Cited by 33
Natural language processing for cognitive therapy: Extracting schemas from thought records
Burger, F., Neerincx, M. A., & Brinkman, W. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257832 · Cited by 44
“As two recent literature reviews show, these developments are slowly finding their way into CAs for health care [9, 10].”
BackgroundConversational Agents for Body Weight Management: Systematic Review
Noh, E., Won, J., Jo, S., Hahm, D., & Lee, H. (2023) · Journal of Medical Internet Research · doi:10.2196/42238 · Cited by 41
“CAs that used any unrestricted natural language were also included as they were considered more interactive than simple CAs with predefined answer options [22,23].”
Lupetti, M. L., Hagens, E., van der Maden, W., Steegers‐Theunissen, R. P. M., & Rousian, M. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3597128 · Cited by 42
“Another major–yet less addressed– concern is safety [30].”
BackgroundMethodInfluentialTherapeutic Chatbots as Cognitive-Affective Artifacts
Grodniewicz, J. P., & Hohol, M. (2024) · Topoi · doi:10.1007/s11245-024-10018-x · Cited by 40
“Nevertheless, the interactions still remain restricted to narrowly-delineated topics, and aim to deal with only a few well-specified tasks (Laranjo et al. 2018).”
BackgroundInfluentialGül, Ş., Erdemir, İ., Hancı, V., Aydoğmuş, E., & Erkoç, Y. S. (2024) · Medicine · doi:10.1097/md.0000000000038009 · Cited by 48
Human vs. AI counseling: College students' perspectives
Kuhail, M. A., Alturki, N. M., Thomas, J., & Alkhalifa, A. K. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100534 · Cited by 61
Hi, Can I Help? Exploring How to Design a Mental Health Chatbot for Youths
Høiland, C. G., Følstad, A., & Karahasanović, A. (2020) · Human Technology · doi:10.17011/ht/urn.202008245640 · Cited by 51
“Research on chatbots in the health domain typically addresses performance (Laranjo et al., 2018) and user acceptance (Laumer, Maier, & Gubler, 2019) rather than the design of health chatbots.”
BackgroundEvaluation Metrics for Health Chatbots: A Delphi Study
Denecke, K., Abd-Alrazaq, A. A., Househ, M. S., & Warren, J. (2021) · Methods of Information in Medicine · doi:10.1055/s-0041-1736664 · Cited by 32
Pithpornchaiyakul, S., Naorungroj, S., Pupong, K., & Hunsrisakhun, J. (2022) · Journal of Medical Internet Research · doi:10.2196/39218 · Cited by 48
“The technology could be a set of rule-based algorithms or machine learning techniques such as natural language processing to automate some parts of the dialogue [19].”
Content validation and usability of a chatbot of guidelines for wound dressing
da Silva Lima Roque, G., Roque de Souza, R., Araújo do Nascimento, J. W., de Campos Filho, A. S., de Melo Queiroz, S. R., & Ramos Vieira Santos, I. C. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104473 · Cited by 31
Griffin, A. C., Xing, Z., Mikles, S. P., Bailey, S., Khairat, S., Arguello, J., Wang, Y., & Chung, A. E. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab021 · Cited by 31
Talking Mental Health: a Battle of Wits Between Humans and AI
Lopes, E., Jain, G., Carlbring, P., & Pareek, S. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00359-6 · Cited by 36
“One significant issue is the risk of bias in AI and conversational agents, which could perpetuate stereotypes and discrimination against certain populations (Kaddari et al., 2020; Laranjo et al., 2018).”
Entenberg, G. A., Areas, M., Roussos, A., Maglio, A. L., Thrall, J., Escoredo, M., & Bunge, E. L. (2021) · Social Sciences · doi:10.3390/socsci10110426 · Cited by 39
Chua, J. Y. X., Choolani, M. A., Chee, C. Y. I., Chan, Y. H., Lalor, J., Chong, Y. S., & Shorey, S. (2023) · Journal of Midwifery & Women s Health · doi:10.1111/jmwh.13472 · Cited by 43
Ludin, N., Holt-Quick, C., Hopkins, S., Stasiak, K., Hetrick, S., Warren, J., & Cargo, T. (2022) · Journal of Medical Internet Research · doi:10.2196/38743 · Cited by 28
“A systematic review of conversational agents in health care found mental health to be the most common area of application [13].”
Bucher, A., Blazek, E. S., & Symons, C. T. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.007 · Cited by 48
“33 However, other patient-directed applications of AI to change behavior have been limited.”
Wang, X., Griffith, J., Adler, D. A., Castillo, J., Choudhury, T., & Wang, F. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713852 · Cited by 52
Usability of Chatbots: A Systematic Mapping Study
Ren, R., Castro, J. W., Acuña, S. T., & de Lara, J. (2019) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2019-029 · Cited by 42
“We found only three systematic reviews related to chatbots [9][10][11].”
BackgroundRobinson, N., & Kavanagh, D. J. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102700 · Cited by 35
Text-Based Emotion Recognition in English and Polish for Therapeutic Chatbot
Zygadło, A., Kozłowski, M., & Janicki, A. (2021) · Applied Sciences · doi:10.3390/app112110146 · Cited by 32
“Application of AI in mental disorder therapies frequently takes the form of dialogue systems [2,3], which can be divided into two categories.”
BackgroundElshan, E., Ebel, P., Söllner, M., & Leimeister, J. M. (2023) · Journal of Management Information Systems · doi:10.1080/07421222.2023.2172776 · Cited by 41
“For instance, a therapeutically successful conversation in healthcare is dependent on reflective listening or a reflection of emotions back to the patient to demonstrate understanding, resulting in connection and involvement [67].”
BackgroundJanols, R., Sandlund, M., Lindgren, H., & Pettersson, B. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.988470 · Cited by 37
Schillings, C., Meißner, E., Erb, B., Bendig, E., Schultchen, D., & Pollatos, O. (2024) · JMIR Mental Health · doi:10.2196/50454 · Cited by 61
“Importantly, randomized controlled trials (RCTs) in the context of mental health are sparse and inconsistent [12,20,23-25] and there is a lack of research on the efficacy of chatbot-based interventions [20,23,24], especially for emotion regulation and interoception [26,27].”
BackgroundAI Chatbots for Psychological Health for Health Professionals: Scoping Review
Baek, G., Cha, C., & Han, J.-H. (2025) · JMIR Human Factors · doi:10.2196/67682 · Cited by 54
“Such a variety of research approaches is crucial for validating the efficacy and safety of AI chatbot technology, enabling iterative improvements and a deeper understanding of how health professionals interact with AI chatbots [25].”
From Questions to Insightful Answers: Building an Informed Chatbot for University Resources
Neupane, S., Hossain, E., Keith, J., Tripathi, H., Ghiasi, F., Golilarz, N. A., Amirlatifi, A., Mittal, S., & Rahimi, S. (2024) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10892994 · Cited by 68
“…from the higher education sector, chatbots are being increasingly adopted across a diverse range of industries and contexts including healthcare [7], [8], cybersecurity [9], [10], retail [11], and hospitality [12] among others due to their ability to emulate human conversations, automate…”
An Ontology-Based Conversation System for Knowledge Bases
Quamar, A., Lei, C., Miller, D., Özcan, F., Kreulen, J. T., Moore, R. J., & Efthymiou, V. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3386139 · Cited by 32
“An in-depth study of the conversation agent in healthcare can be found in [6, 17].”
BackgroundMicroexpressions in digital humans: perceived affect, sincerity, and trustworthiness
Tastemirova, A., Schneider, J., Kruse, L. C., Heinzle, S., & Brocke, J. V. (2022) · Electronic Markets · doi:10.1007/s12525-022-00563-x · Cited by 40
“Although researchers saw the potential benefits of CAs, particularly in healthcare, these agents were only able to accept limited user inputs, such as multiple-choice options (Laranjo et al., 2018).”
BackgroundArshad, H. B., Butt, S., Khan, S. U., Javed, Z., & Nasir, K. (2023) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcvj.1290 · Cited by 35
Srinivasan, S., & Sharma, V. (2025) · Wiley eBooks · doi:10.1002/9781394278695.ch6 · Cited by 55
Hoffman, B. D., Oppert, M. L., & Owen, M. S. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100086 · Cited by 56
What drives the corporate payoffs of using generative artificial intelligence?
Bughin, J. (2024) · Structural Change and Economic Dynamics · doi:10.1016/j.strueco.2024.09.011 · Cited by 40
Tong, A. C. Y., Wong, K. T. Y., Chung, W. W. T., & Mak, W. W. S. (2025) · Journal of Medical Internet Research · doi:10.2196/70436 · Cited by 56
Ollier, J., Neff, S., Dworschak, C., Sejdiji, A., Santhanam, P., Keller, R., Xiao, G., Asisof, A., Rüegger, D., Bérubé, C., et al. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.625640 · Cited by 32
“Lastly, individuals move to the (10) welcome back/goodbye dialogue where individuals can choose to: (i) continue coaching with another topic selection, (ii) set a date for the next coaching session, (iii) choose to “wake up” the coach to continue coaching at a non-scheduled time (e.”
BackgroundMaharjan, R., Doherty, K., Rohani, D. A., Bækgaard, P., & Bardram, J. E. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484508 · Cited by 29
“…CAs remain in many ways nascent technologies, many HCI and healthcare researchers have already begun to explore CAs’ potential to support mental health and wellbeing in a variety of contexts and in various forms, from diagnosis to symptom monitoring, treatment and intervention [31, 44, 49, 84].”
BackgroundMoriuchi, E. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00277-z · Cited by 30
“Recent studies found preliminary evidence that chatbots may reduce mental health symptoms, but this positive outcome has not been tested in long-term outcomes (Laranjo et al., 2018; Vaidyam et al., 2019).”
BackgroundHanif, A., Herman, H., Mudinillah, A., & Rahmi, P. W. L. (2023) · International Journal of Membrane Science and Technology · doi:10.15379/ijmst.v10i2.1207 · Cited by 58
“Students are required to be able to understand and answer the questions independently displayed in the quiz (Laranjo et al., 2018).”
BackgroundThe first AI ‐based Chatbot to promote HIV self‐management: A mixed methods usability study
Ma, Y., Achiche, S., Tu, G., Vicente, S., Lessard, D., Engler, K., Lemire, B., Laymouna, M. A., de Pokomandy, A., Cox, J., et al. (2024) · HIV Medicine · doi:10.1111/hiv.13720 · Cited by 35
Towards the Development of a Trustworthy Chatbot for Mental Health Applications
Kraus, M., Seldschopf, P., & Minker, W. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67835-7_30 · Cited by 39
Metadata
- Authors
- Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Laranjo, Liliana
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-11
- Volume
- 25
- Issue
- 9
- Pages
- 1248-1258
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC6118869
- OpenAlex
- W2843010082
- Cited by
- 1,388
- References
- 60
- Citations by year
- 2026: 291 · 2025: 246 · 2024: 182 · 2023: 182 · 2022: 151 · 2021: 143 · 2020: 124 · 2019: 62 · 2018: 6
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- National Health and Medical Research Council (APP1134919)
- Centre for Research Excellence in Digital Health (APP1054146)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, healthcare chatbots, natural language input, dialogue management, self-care support, depression symptom reduction, patient safety, evaluation metrics
- MeSH terms
- Artificial Intelligence, Communication, Delivery of Health Care, Natural Language Processing, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.