Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 141 of the 141 references it cites were found in a registry or an index; 39 of the 147 sources its claims cite were checked for support.
Abstract
Background: Conversational agents, also known as chatbots, are computer programs designed to simulate human text or verbal conversations. They are increasingly used in a range of fields, including health care. By enabling better accessibility, personalization, and efficiency, conversational agents have the potential to improve patient care. Objective: This study aimed to review the current applications, gaps, and challenges in the literature on conversational agents in health care and provide recommendations for their future research, design, and application. Methods: We performed a scoping review. A broad literature search was performed in MEDLINE (Medical Literature Analysis and Retrieval System Online; Ovid), EMBASE (Excerpta Medica database; Ovid), PubMed, Scopus, and Cochrane Central with the search terms “conversational agents,” “conversational AI,” “chatbots,” and associated synonyms. We also searched the gray literature using sources such as the OCLC (Online Computer Library Center) WorldCat database and ResearchGate in April 2019. Reference lists of relevant articles were checked for further articles. Screening and data extraction were performed in parallel by 2 reviewers. The included evidence was analyzed narratively by employing the principles of thematic analysis. Results: The literature search yielded 47 study reports (45 articles and 2 ongoing clinical trials) that matched the inclusion criteria. The identified conversational agents were largely delivered via smartphone apps (n=23) and used free text only as the main input (n=19) and output (n=30) modality. Case studies describing chatbot development (n=18) were the most prevalent, and only 11 randomized controlled trials were identified. The 3 most commonly reported conversational agent applications in the literature were treatment and monitoring, health care service support, and patient education. Conclusions: The literature on conversational agents in health care is largely descriptive and aimed at treatment and monitoring and health service support. It mostly reports on text-based, artificial intelligence–driven, and smartphone app–delivered conversational agents. There is an urgent need for a robust evaluation of diverse health care conversational agents’ formats, focusing on their acceptability, safety, and effectiveness.
Overview
CoChat Summary
TL;DR
This scoping review mapped 47 reports (45 studies and 2 ongoing trials) on conversational agents in health care, finding mostly text-based, AI-driven, smartphone app-delivered agents. The literature is largely descriptive and concentrated in treatment/monitoring, health service support, and patient education, with an urgent need for robust evaluation of acceptability, safety, and effectiveness.
Key findings
- The search yielded 47 reports; agents were largely delivered via smartphone apps (n=23), used free text only as the main input (n=19) and output (n=30) modality, and were most often studied through case studies (n=18), with only 11 randomized controlled trials.
- The 3 most commonly reported applications were treatment and monitoring, health care service support, and patient education; 40 studies were from high-income countries and 6 from low- and middle-income countries, with no studies from a low-income country.
- Evaluation data were generally positive: Babylon triage/diagnosis agents were reported as more accurate, faster, and safer than doctors and nurses; Ghosh et al and Danda et al reported diagnostic precision of 82% and 86%; Tess reduced anxiety and depression by 18% and 13%; a breast cancer chatbot had 94% overall satisfaction; 26 studies commented on acceptability.
- Publication counts increased from 3 in 2015 to 5 in 2016, 10 in 2017, and 23 in 2018, but the authors conclude the literature remains in its infancy and lacks robust evaluations.
Methods
- Scoping review following Arksey and O’Malley guidance updated by Peters et al; searched April 2019 in MEDLINE, EMBASE, PubMed, Scopus, and Cochrane Central, plus gray literature sources including OCLC WorldCat, ResearchGate, Google Scholar, OpenGrey, and the first 10 pages of Google, using 63 search terms and reference-list checking.
- Included primary research studies that evaluated and reported findings on a conversational agent implemented for a health care–specific purpose; excluded proposals, opinion pieces, poorly reported chatbot assessments, and embodied/relational/animated conversational agents.
- Two reviewers independently screened and extracted data; findings were narratively synthesized and thematically analyzed, with personality codes adapted from de Haan et al.
Limitations
- Stated: the novelty of the field and terminology may have omitted unpublished studies from niche conferences; theme classification may not be all-inclusive and agents with multiple themes were mostly classified by dominant application; excluding poorly reported data may have missed some agents; the personality framework is exploratory and adapted for this review.
- Stated/evident: no measurements of cost, efficiency, or productivity were identified, and there was a lack of data on adverse effects; evidence from middle-income countries was scarce and no studies came from a low-income country.
- Evident: the predominance of small case studies and only 11 randomized controlled trials limits robust evaluation; most agents were app-based, which the text notes is often associated with high dropout rates and low utilization.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Valid · 2 Not valid · 61 Not checked · 70 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Eleven studies reported on the accuracy of conversational agents [44,58,60,66,68,69,71,74,76,77,82] (Multimedia Appendix 4).”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Conversational Agent Evaluation
What the sources say
- Not checked yetcites [44] BallatiFCornoFde RussisL'Hey Siri, do you understand me?': Virtual Assistants and Dysarthria7th International Workshop on the Reliability of Intelligent Environments2018WoRIE'18June 25-28, 2018Rome, Italy
- Not checked yetcites [58] MiddletonKButtMHammerlaNHamblinSMehtaKParsaASorting out symptoms: design and evaluation of the 'babylon check' automated triage systemCornell University2020-07-22https://arxiv.org/abs/1606.02041
- Not checked yetcites [60] RazzakiSBakerAPerovYMiddletonKBaxterJMullarkeyDSangarDTaliercioMButtMMajeedADoRosarioAMahoneyMJohriSA comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosisCornell University2020-07-22https://arxiv.org/abs/1806.10698
- Not checked yetcites [66] Huang, J, 2015, International Conference on Health Information Science source
- Not checked yetcites [68] source
- Supportedcites [69] source
Our copy of Aquabot explicitly reports accuracy for its conversational agent: Section IV/B 'Diagnosis Accuracy' (p. 7) states that aquabot's diagnoses were verified by a human psychologist and percentage accuracy computed, with Table III giving 85%, 86.64% and 87.2% for achluophobia age groups, and the abstract (p. 1) reporting 88% overall accuracy against human psychologist diagnoses. The 'Percentage accuracy' subsection (p. 3) likewise defines the accuracy measure used. So this work is indeed a study reporting on the accuracy of a conversational agent, which is all the citation [44] is offered for within the eleven-study list. (LLM, conf=0.85)
- Not checked yetcites [71] DandaPSrivastavaBMLShrivastavaMVaidya: A Spoken Dialog System for Health DomainProceedings of the 13th International Conference on Natural Language Processing2015International Conference on Natural Language Processing2016Varanasi, India
- Not checked yetcites [74] Ghosh, S, 2018, Stud Health Technol Inform
- Not checked yetcites [76] source
- Not checked yetcites [77] Ni, L, 2017, Knowledge and Systems Sciences
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Two studies discussed the accuracy of 2 conversational agents in making diagnoses in children and adolescents [66,69].”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Conversational Agent Evaluation
What the sources say
- Not checked yetcites [66] Huang, J, 2015, International Conference on Health Information Science source
- Partly supportedcites [69] sourceExperimental — accuracy not yet measured
In 'B. Diagnosis Accuracy' (p. 7) the paper reports percentage accuracy of Aquabot's autism diagnoses against a human psychologist for three groups of children (ages 1-3, 4-6, and 7 or more, answered by parents/caretakers), and the Abstract (p. 1) states an overall accuracy of 88 percent versus the human psychologist — so the source does discuss the diagnostic accuracy of a conversational agent in children. However, the only other accuracy data (Table III, same section) is for achluophobia in participants aged 18-21, 22-25 and 26-28, i.e. adults; our copy contains no adolescent sample, so the 'and adolescents' part of the claim is not supported by this source. The claim's framing as one of 'two studies' is carried by the companion citation, not judged here. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The effectiveness of health care conversational agents was assessed in 8 studies [47,52,57,61,70,75,81,84].”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Conversational Agent Evaluation
What the sources say
- Not checked yetcites [47] Stasinaki, A, 2018, Swiss Medical Weekly
- Not checked yetcites [52] source
- Not checked yetcites [57] source
- Supportedcites [61] source
This citation identifies Wysa as one of the eight studies, rather than asking the Wysa paper to establish the total of eight. The paper’s Results and Discussion > Principal Findings assess the agent’s effectiveness using changes in self-reported depression symptoms; those passages have no page numbers in our copy. (LLM, conf=0.92)
- Not checked yetcites [70] source
- Supportedcites [75] source
The Technical report describes an evaluation of the health care chatbot Tess and reports outcomes from its preliminary caregiver launch, including helpfulness and perceived support. This supports citing the paper as one of the eight studies assessing conversational-agent effectiveness; the count of eight refers to the citing document’s set of references, not a claim made by this paper. (LLM, conf=0.88)
- Supportedcites [81] source
The Methods section says this study assessed whether the conversational agent Tess could reduce depression and anxiety symptoms. The Discussion > Principal Findings reports symptom outcomes from that assessment. This source therefore qualifies as one of the cited effectiveness studies; the count of eight describes the citing paper's group of citations, not a finding attributed to this individual trial. (LLM, conf=0.92)
- Supportedcites [84] source
The Methods (Main Study) describe assessing conversational agents’ responses to health-related questions, and the Discussion reports their performance. This paper is therefore one of the studies identified by the citation; the count of eight refers to the citing paper’s group of studies, not to this source alone. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In addition, 67.7% of users found the app usage to be helpful and encouraging [61].”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Conversational Agent Evaluation
What the sources say
- Partly supportedcites [61] sourceExperimental — accuracy not yet measured
The Abstract (Results) and Results > Qualitative Analysis state that 67.7% of user-provided feedback RESPONSES found the app experience helpful and encouraging — specifically 191/282 responses, supplied by 75 of the 95 users who gave feedback. The citing sentence attributes 67.7% to 'users', changing the unit of analysis: the source's 67.7% is a proportion of responses (and, in the thematic breakdown, of those favourable responses 97.4% cited helpfulness), not a proportion of users. The direction, figure and 'helpful and encouraging' characterisation are supported; the denominator is not. (LLM, conf=0.80)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Miner et al [84] compared Apple’s Siri, Microsoft’s Cortana, Samsung’s S Voice, and Google Now on their abilities to respond to questions about mental health, interpersonal violence, and physical health.”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Conversational Agent Evaluation
What the sources say
- Supportedcites [84] source
The Abstract > Objective (p. 1) states the aim was 'to describe the responses of 4 widely used conversational agents (Siri [Apple], Google Now, S Voice [Samsung], and Cortana [Microsoft]) to a standardized panel of questions related to mental health, interpersonal violence, and physical health,' matching all four named agents and all three topic areas. The RESULTS sections (Tables 2-4) and Conclusions carry out and summarize that side-by-side comparison, so 'compared ... on their abilities to respond' is an accurate paraphrase. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
66 more claims · 14 with their cited sources checked
Create a free account to see all 157 claims and to verify the 108 references still open.
- It may state two separate claims as one. 61
- Probably not a substantial claim. 38
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“On the same note, conversational agents have been proven a valuable tool to deliver digital health interventions [7-9].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Car et al [16] conducted a scoping review on conversational agents in health care. They did not report on any virtual agents such as those depicted in Figure 1, as their results were restricted to smartphone apps.”
From Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review (2022) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the current conversational agent is the first (to the best of our knowledge) that takes over the role of a scalable social actor framed as a scalable assistant of a health care professional that mediates communication among various relevant stakeholders in the context of chronic disease management.”
From Conversational Agents as Mediating Social Actors in Chronic Disease Management Involving Health Care Professionals, Patients, and Family Members: Multisite Single-Arm Feasibility Study (2021) · cites this paper as [98]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar conclusions were drawn by reviews conducted with the adult population in clinical psychology and healthcare with respect to the status of CAs technological capabilities, showing a rapid development in terms of dialog systems employed but a slower progress related to other technological capabilities such as type of representation and communication14,20”
From Use of automated conversational agents in improving young population mental health: a scoping review (2024) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This contrasts with research conducted on subsets of CAs or with adults, that identified mainly pilot uncontrolled studies investigating their feasibility and usability20.”
From Use of automated conversational agents in improving young population mental health: a scoping review (2024) · cites this paper as [20]
Experimental — accuracy not yet measured
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Characteristics of Included Studies
“20 case studies [44,48,51,61-63,66,69,71, 73-79,82,84,85,89]”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Characteristics of Included Studies
“2 ongoing trials [51,54]”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Results > Characteristics of Included Studies
“Moreover, 8 studies originated from Asian countries: Philippines [65], China [66], Japan [67,68], Pakistan [69], India [70,71], and Hong Kong [72].”
§ Conversational Agents in Health Care: Scoping Review and Conceptual Analysis > Discussion > Principal Findings
“Although our review identified 12 articles with a geographical focus in Asia, the evidence stemming from middle-income countries was scarce, and there were no studies from a low-income country.”
Citations
Cites
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 1×
“We adopted methodological guidance from an updated version of the Arksey and O’Malley framework with suggestions proposed by Peters et al [40] in 2015 to conduct our scoping review.”
MethodELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first conversational agent ELIZA was developed by Weizenbaum [12] in 1966, with ELIZA taking on the role of a person-centered Rogerian psychotherapist (Figure 1).”
MethodELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“A recent systematic review on the effectiveness of ECAs and other conversational agents noted a lack of an established method for evaluating health care conversational agents in health care and a dearth of data on adverse effects [32].”
BackgroundInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 9×
“Moreover, 19 studies allowed free text user inputs [45,48,51,56,57,60,61,66,69,70,72,74,77,78,80,81,85,86,89], and 4 studies used both fixed and free text user inputs [53,64,65,73].”
BackgroundMethodInfluentialChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 1×
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
BackgroundMobile Text Messaging for Health: A Systematic Review of Reviews
Hall, A. K., Cole-Lewis, H., & Bernhardt, J. M. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122855 · Cited by 815 · cited 2×
“A series of systematic reviews on the use of text messaging for different health disorders have shown that text messaging is an effective and acceptable health care intervention [28,29].”
BackgroundNadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810 · cited 6×
“In the study by Nadarzynski et al [59] , users favored the conversational agent because of its ubiquity as a convenient smartphone app and its ability to perform remote services such as video consultation, potentially alleviating any inhibitions users may have around discussing sexual health in…”
BackgroundMethodInfluentialFulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715 · cited 7×
“Moreover, 19 studies allowed free text user inputs [45,48,51,56,57,60,61,66,69,70,72,74,77,78,80,81,85,86,89], and 4 studies used both fixed and free text user inputs [53,64,65,73].”
BackgroundMethodInfluential
Research works printed but not linked: 42
- 1992, Profiles Healthc Mark, 40
- Friedman, E, 1981, Hospitals, 55, 105
- de HaanHSnijderJvan NimwegenCBeunRChatbot Personality and Customer SatisfactionInfo Support Research20182020-07-18https://research.infosupport.com/wp-content/uploads/Chatbot-Personality-and-Customer-Satisfaction-Bachelor-Thesis-Information-Sciences-Hayco-de-Haan.pdf
- BallatiFCornoFde RussisL'Hey Siri, do you understand me?': Virtual Assistants and Dysarthria7th International Workshop on the Reliability of Intelligent Environments2018WoRIE'18June 25-28, 2018Rome, Italy
- Stasinaki, A, 2018, Swiss Medical Weekly, 148, 10s
- Heldt, K, 2018, Obesity Facts, 214
- L'Allemand, D, 2018, Obesity Reviews, 102
- RazzakiSBakerAPerovYMiddletonKBaxterJMullarkeyDSangarDTaliercioMButtMMajeedADoRosarioAMahoneyMJohriSA comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosisCornell University2020-07-22https://arxiv.org/abs/1806.10698
- Griol, D, 2015, Artificial Computation in Biology and Medicine: International Work-Conference on the Interplay Between Natural andArtificial Computation, IWINAC 2015, Elche, Spain, June 1-5, 2015, Proceedings, Part I
- DandaPSrivastavaBMLShrivastavaMVaidya: A Spoken Dialog System for Health DomainProceedings of the 13th International Conference on Natural Language Processing2015International Conference on Natural Language Processing2016Varanasi, India
- Ghosh, S, 2018, Stud Health Technol Inform, 252, 51
- Ni, L, 2017, Knowledge and Systems Sciences
- GhandehariounAMcDuffDCzerwinskiMRowanKEMMA: An Emotionally Intelligent Personal Assistant for Improving WellbeingResearchgate2020-07-22https://www.researchgate.net/publication/330035444_EMMA_An_Emotionally_Intelligent_Personal_Assistant_for_Improving_Wellbeing
- CoieraEPaper Review: the Babylon ChatbotWordpress2020-07-22https://coiera.com/2018/06/29/paper-review-the-babylon-chatbot/
- Chatbots Meet eHealth: Automatizing HealthcareUniversity of Naples2020-07-22http://ceur-ws.org/Vol-1982/paper6.pdf
- 2016, Persuasive Strategies To Improve Driving Behaviour Of Elderly Drivers By A Feedback Approach
- Cooper, A, 2018, Stud Health Technol Inform, 252, 63
- Dharwadkar, R, 2018, Int J Comp Trends Technol, 60, -
- FadhilADiaconuMGabrielliSVillafioritaACoachAI: A conversational UI assisted e-coaching platformCornell Univeristy20172020-07-22https://arxiv.org/abs/1904.11961
- Beyond Patient Monitoring: Conversational Agents Role in Telemedicine & Healthcare Support For Home-Living Elderly IndividualsCornell University2020-07-22https://arxiv.org/abs/1803.06000
- Can a Chatbot Determine My Diet?: Addressing Challenges of Chatbot Application for Meal RecommendationCornell Univeristy2020-07-22https://arxiv.org/abs/1802.09100
- A Conversational Interface to Improve Medication Adherence: Towards AI Support in Patient's TreatmentCornell University2020-07-22https://arxiv.org/abs/1803.09844
- CARDIAC: An intelligent conversational assistant for chronic heart failure patient heath monitoringResearchgate2020-07-22https://www.researchgate.net/publication/228374471_CARDIAC_An_intelligent_conversational_assistant_for_chronic_heart_failure_patient_heath_monitoring
- Conversational System to Assist the User when Accessing Web Sources in the Medical DomainResearchGate2020-07-22https://www.researchgate.net/publication/261031810_Conversational_System_to_Assist_the_User_when_Accessing_Web_Sources_in_the_Medical_Domain
- Cooper, A, 2018, Stud Health Technol Inform, 252, 63
- Oh, KJ, 2017, Stud Health Technol Inform, 245, 1235
- A novel approach for medical assistance using trained chatbotResearchGate2020-07-22https://www.researchgate.net/publication/318474956_A_novel_approach_for_medical_assistance_using_trained_chatbot
- Chatbot Dimensions that Matter: Lessons from the TrenchesWeb Engineering2020-07-22https://link.springer.com/chapter/10.1007/978-3-319-91662-0_9 · DOI
- Automated Medical ChatbotSSRN2020-07-22https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3090881
- SleepBot: encouraging sleep hygiene using an intelligent chatbotResearchGate2020-07-22https://www.researchgate.net/publication/331428159_SleepBot_encouraging_sleep_hygiene_using_an_intelligent_chatbot
- HomeNL: Homecare Assistance in Natural Language. An Intelligent Conversational Agent for Hypertensive Patients ManagementCentre pour la Communication Scientifique Directe2020-07-22https://hal.archives-ouvertes.fr/inria-00519752/
- Chatbots and Conversational Interfaces: Three Domains of UseCEUR Workshop Proceedings2020-07-22http://ceur-ws.org/Vol-2101/paper8.pdf
- Towards Fully Automated Psychotherapy for Adults - BAS - Behavioral Activation Scheduling Via Web and Mobile PhoneSemantic Scholar2020-07-22https://www.semanticscholar.org/paper/Towards-Fully-Automated-Psychotherapy-for-Adults-Griffioen-Both-Cuijpers/43b3c78317a273c7ec46c1696370bf68e42b30fb
- Rizzo, AA, 2011, Stud Health Technol Inform, 163, 503
- Dr. Vdoc: A Medical Chatbot that Acts as a Virtual DoctorResearch & Reviews: Journal of Medical Science and Technology2020-07-22http://medicaljournals.stmjournals.in/index.php/RRJoMST/article/view/30
- Coach Me: A Platform For Promoting Healthy LifestyleResearchGate2020-07-22https://www.researchgate.net/publication/307573372_Coach_Me_A_Platform_For_Promoting_Healthy_Lifestyle
- Azevedo, RF, 2018, AMIA Annu Symp Proc, 2018, 185
- Denecke, K, 2019, Stud Health Technol Inform, 259, 77
- Designing for Health ChatbotsCornell University2020-07-22https://arxiv.org/abs/1902.09022
- Mindbot: A Social-Based Medical Virtual AssistantaIEEEXplore2020-07-22https://ieeexplore.ieee.org/document/7776377?reload=true
- Intelligent chatbot for analysis and diagnosis of the psychiatric disordersResearchGate2020-07-22https://www.researchgate.net/publication/329416982_INTELLIGENT_CHATBOT_FOR_ANALYSIS_AND_DIAGNOSIS_OF_THE_PSYCHIATRIC_DISORDERS
- Chatbots and the new world of HCIInteractions2020-07-22https://interactions.acm.org/archive/view/july-august-2017/chatbots-and-the-new-world-of-hci
Cited by
Interacting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
“Concerning the platform, chatbots can be deployed via messaging apps such as Telegram, Facebook Messenger, and Slack (Car et al., 2020), standalone web or phone applications, or integrated into smart devices such as television sets.”
BackgroundPrivacy-preserving artificial intelligence in healthcare: Techniques and applications
Khalid, N., Qayyum, A., Bilal, M., Al-Fuqaha, A., & Qadir, J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106848 · Cited by 581
Mariani, M. M., Hashemi, N., & Wirtz, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113838 · Cited by 343
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Metadata
- Authors
- Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R.
- Affiliations
- Nanyang Technological University (SG)
- University of St.Gallen (CH)
- Harvard University (US)
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-07
- Volume
- 22
- Issue
- 8
- Pages
- e17158
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7442948
- OpenAlex
- W3048100966
- Semantic Scholar
- dd47dd54dfe333e49805ede37d4e7a060241b3ba
- Cited by
- 553
- References
- 139
- Citations by year
- 2026: 109 · 2025: 102 · 2024: 93 · 2023: 106 · 2022: 87 · 2021: 53 · 2020: 3
- FWCI
- 4.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- other-oa
- Locations
- Journal of Medical Internet Research (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Alexandria (UniSG) (University of St.Gallen) (acceptedVersion)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- ETH Zürich Research Collection (cc-by)
- Funders
- National Research Foundation
- Nanyang Technological University
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- chatbots, conversational AI, health care applications, patient education, mobile application, text-based interaction, chatbot evaluation
- MeSH terms
- Communication, Delivery of Health Care, Humans, Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
