The Personalization of Conversational Agents in Health Care: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index; 8 of the 18 sources its claims cite were checked for support.
Abstract
BACKGROUND: The personalization of conversational agents with natural language user interfaces is seeing increasing use in health care applications, shaping the content, structure, or purpose of the dialogue between humans and conversational agents. OBJECTIVE: The goal of this systematic review was to understand the ways in which personalization has been used with conversational agents in health care and characterize the methods of its implementation. METHODS: We searched on PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library using a predefined search strategy. The studies were included if they: (1) were primary research studies that focused on consumers, caregivers, or health care professionals; (2) involved a conversational agent with an unconstrained natural language interface; (3) tested the system with human subjects; and (4) implemented personalization features. RESULTS: The search found 1958 publications. After abstract and full-text screening, 13 studies were included in the review. Common examples of personalized content included feedback, daily health reports, alerts, warnings, and recommendations. The personalization features were implemented without a theoretical framework of customization and with limited evaluation of its impact. While conversational agents with personalization features were reported to improve user satisfaction, user engagement and dialogue quality, the role of personalization in improving health outcomes was not assessed directly. CONCLUSIONS: Most of the studies in our review implemented the personalization features without theoretical or evidence-based support for them and did not leverage the recent developments in other domains of personalization. Future research could incorporate personalization as a distinct design factor with a more careful consideration of its impact on health outcomes and its implications on patient safety, privacy, and decision-making.
Overview
CoChat Summary
## TL;DR
This systematic review found only 13 health care conversational-agent studies with personalization features, and most personalized content rather than conversational style. The paper concludes that personalization was rarely theory-based or directly evaluated for health outcomes.
## Key findings
- The search identified 1958 publications in total; after screening, 13 studies were included.
- Personalization was most often used for content delivery: feedback, daily health reports, alerts, warnings, recommendations, reminders, multimedia, and personalized questions.
- Across the 13 studies, 8 supported patients and 5 supported both patients and clinicians; all used individuated personalization, and 1 study also used categorical personalization for novice vs expert users.
- Only 2 studies directly assessed personalization itself; one reported that 85% (29/34) found tailored feedback helpful, and another rated customized feedback 0.3 on a –2 to +2 Likert scale as the most successful feature.
## Methods
- Systematic review of health care conversational agents with unconstrained natural language input and personalization features.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in March 2019, with no publication-year or language restriction.
- Included primary studies on consumers, caregivers, or health care professionals that tested a conversational agent with human users and implemented personalization; screening/data extraction were done independently by two researchers, with Cohen kappa used for agreement.
## Limitations
- The authors state the results are limited by how much the included studies reported their personalization features.
- The review focused only on CAs with unconstrained natural language input, so the findings may not extend to constrained systems; this is stated in the paper.
- Evident from the text: outcomes in the included studies were often attributable to the overall system rather than personalization alone, making it hard to isolate personalization effects.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
5 Valid · 0 Not valid · 6 Not checked · 32 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The effects of personalization have been evaluated in various ways by measuring aspects like efficiency in terms of the number and duration of interactions [11,20], user satisfaction, relevance, and understandability [20], information quality presented [21], and appropriateness of system responses [10].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Introduction > Personalization in Conversational Agents
What the sources say
- Partly supportedcites [11] sourceExperimental — accuracy not yet measured
Thompson et al. (2004) do evaluate personalization by measuring efficiency — 'the average number of interactions needed to find a restaurant accepted by the user' and 'the time taken for each conversation' (4.1 Experimental Variables, p. 18) — and user satisfaction, via rejection rate, hit rate (the percentage of conversations in which the first item presented was acceptable, i.e. a relevance-style measure) and a post-study questionnaire (4.1, p. 18; Appendix A, p. 29). However, our copy contains no measure of 'understandability' or of 'information quality presented'; appropriateness appears only as a general goal of personalization ('to increase the quality and appropriateness of both the interaction and the result(s)', 2.1 Personalization, p. 3), not as an evaluated dimension. So the list of six evaluation aspects exceeds what this single source reports. (LLM, conf=0.78)
- Supportedcites [20] source
Section 6 (Evaluation II—User Interaction Study) says the paper measured efficiency by dialog duration and also assessed user satisfaction. The User Satisfaction Ratings and Results sections report measures of relevance and understandability. Information quality and response appropriateness are attached to other citations in the citing sentence, not to this paper. (LLM, conf=0.92)
- Supportedcites [21] source
In §5.1 (Experimental design for tailoring and mode experiment) our copy defines and elicits a five-point Likert judgement of the informativeness/'information quality' of tailored system utterances, recorded as the measure InformationQuality, and §5.2 reports the tailoring result on that measure (paired t-test, t(383)=1.76, P<.05). The citation [21] in the printed sentence is attached specifically to 'information quality presented', which is exactly this paper's evaluation variable; the other listed aspects (efficiency, satisfaction, appropriateness) are credited to different citations, and §6 indeed notes task completion, time and user satisfaction as future work rather than measures here, so nothing attributed to this source is unsupported. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Learning from a history of previous conversations plays a key role in ensuring the continuity of health communications that take place over multiple interactions over time [31].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Introduction > Personalization in Health Care and Medicine
What the sources say
- Supportedcites [31] source
Section 3.3, “Continuity over multiple interactions,” says that health communication applications require repeated interactions over time and must retain information between sessions so later dialog can be tailored to earlier conversations. This supports the claim’s paraphrase about using conversation history to maintain continuity. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using CAs with unconstrained natural language input can be risky [66].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Discussion > Principal Results
What the sources say
- Supportedcites [66] source
The Discussion’s Principal Findings say that patients and consumers should not rely on conversational assistants using unconstrained natural language input for actionable medical advice, because responses could lead to harm. The claim accurately conveys that risk, though the paper examines medical-information use specifically. (LLM, conf=0.93)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The use of CAs with unconstrained language input in health care is still limited, but there has been a notable increase in the number of studies in recent years.”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Discussion > Principal Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The personalization features were implemented without a theoretical framework of customization and with limited evaluation of its impact.”
- Also stated in: § Conclusions · plain
“While the CAs with personalization features were reported to improve user satisfaction, user engagement, and dialogue quality, little evaluation was performed to measure the extent of personalization and its role in improving health outcomes.”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Conclusions · plain
26 more claims
Create a free account to see all 43 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 6
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In mental health CAs, the use of user profiles or user models to support personalized and adaptive features and the assessment of personalization is still in its infancy [79].”
From Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials (2023) · cites this paper as [79]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Other recent reviews focused on conversational agents for either a specific health condition such as mental health [44], the general application of chatbots in health care [1], or specific features thereof such as personalization [45] or technical architectures [11].”
From Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review (2020) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“Despite the large body of research concerning the application of conversational agents in health care, most reviews have limited their focus to a particular health area, agent type, or function [10,19-22].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Personalization of conversational agents has documented benefits60, but there is a growing concern about the harms posed by the anthropomorphization of AI.”
From A psychometric framework for evaluating and shaping personality traits in large language models (2025) · cites this paper as [60]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587 · cited 1×
“Moreover, other theories not specific to personalization may prove useful for personalization purposes, such as the Theory of Planned Behavior [71].”
BackgroundThe PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 1×
“03) and significant differences in the posi• Questionnaires to measure depression (PHQ-9a) [48], anxiety (GAD-7b) [49], and affect • To improve depression and anxiety symptoms • To provide more engaging and convenient user experitive and negative affects (P=.”
BackgroundDevelopment and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“03) and significant differences in the posi• Questionnaires to measure depression (PHQ-9a) [48], anxiety (GAD-7b) [49], and affect • To improve depression and anxiety symptoms • To provide more engaging and convenient user experitive and negative affects (P=.”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“Information needed for personalization was provided explicitly by the users in seven studies [35,37-40, 44, 45], and obtained implicitly by the system in one study [36]”
BackgroundMethodInfluentialReferring as a collaborative process
Clark, H. H., & Wilkes-Gibbs, D. (1986) · Cognition · doi:10.1016/0010-0277(86)90010-7 · Cited by 2,401 · cited 1×
“Personalized and adaptive system behavior in conversational systems can improve user comprehension [16], user satisfaction [17], task efficiency [18], and the likelihood of behavior change [19].”
BackgroundDoes tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136 · cited 1×
“Studies of personalization in health care and medicine have been increasing in number since the early 2000s [22], with growing evidence showing their effectiveness [23-26].”
BackgroundMeasuring mindfulness—The Freiburg Mindfulness Inventory (FMI)
Walach, H., Buchheld, N., Buttenmüller, V., Kleinknecht, N., & Schmidt, S. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2005.11.025 · Cited by 1,475 · cited 1×
“07; sm) • Questionnaires to measure health awareness [51], mindfulness (FMIg) [52], and reflection • To trigger deeper reflection, which would increase motivation, empowerment, and adoption of new behavior • Prolonged use of CA (additional two weeks) by half of the participants (16/33) with an avg (RQh) [53] of 98.”
BackgroundConversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“A recent systematic review in this area examined technical performance, user experience, and health-related outcomes and found that most studies had not employed standardized evaluation methods or had failed to address aspects of patient safety [2].”
BackgroundSelf-citationThe filter bubble: how the new personalized web is changing what we read and how we think
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0926 · Cited by 1,319 · cited 1×
“For example, a recent research paper drew attention to the limitations of implicit and explicit personalization [61]: while implicit personalization with its often-imperceptible user models and hidden assumptions can result in biased decision-making [62], over-reliance on system suggestions [63], and filter bubbles [6…”
BackgroundAwad, N. F., & Krishnan, M. S. (2006) · MIS Quarterly · doi:10.2307/25148715 · Cited by 1,252 · cited 1×
“…most of the studies in our review implemented personalization features without being informed by the advancements in other domains of personalization (eg, more automated personalization methods [12,60] or the implications of personalization on privacy, safety, and decision-making [61,62,70]).”
BackgroundInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 7×
“Across all the studies, data explicitly entered by the users included personal goals [35,37,46,47], symptoms and medications [37,44,45], measurement of vital signs [39,40], knowledge level on a specific topic [38], and daily practices [38].”
BackgroundMethodInfluentialChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 2×
“There have also been other recent reviews on health care conversational agents [3-5].”
BackgroundMethodUnderstanding tailoring in communicating about health
Hawkins, R. P., Kreuter, M., Resnicow, K., Fishbein, M., & Dijkstra, A. (2008) · Health Education Research · doi:10.1093/her/cyn004 · Cited by 934 · cited 1×
“Studies of personalization in health care and medicine have been increasing in number since the early 2000s [22], with growing evidence showing their effectiveness [23-26].”
BackgroundDevelopment of a Questionnaire to Measure the Level of Reflective Thinking
Kember, D., Leung, D. Y. P., Jones, A., Loke, A. Y., McKay, J., Sinclair, K., Tse, H., Webb, C., Yuet Wong, F. K., Wong, M., et al. (2000) · Assessment & Evaluation in Higher Education · doi:10.1080/713611442 · Cited by 812 · cited 1×
“07; sm) • Questionnaires to measure health awareness [51], mindfulness (FMIg) [52], and reflection • To trigger deeper reflection, which would increase motivation, empowerment, and adoption of new behavior • Prolonged use of CA (additional two weeks) by half of the participants (16/33) with an avg (RQh) [53] of 98.”
BackgroundFulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715 · cited 2×
“While most studies used quasi-experimental study designs, only two used randomized controlled trials [35,44].”
MethodMcTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260288 · Cited by 579
Spoken dialogue technology: enabling the conversational user interface
McTear, M. F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505285 · Cited by 571
Kroeze, W., Werkman, A., & Brug, J. (2006) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3103_2 · Cited by 570 · cited 1×
“Studies of personalization in health care and medicine have been increasing in number since the early 2000s [22], with growing evidence showing their effectiveness [23-26].”
BackgroundMcTear, M. F. (2004) · Springer eBooks · doi:10.1007/978-0-85729-414-2 · Cited by 566 · cited 1×
“feature computer-generated visual virtual characters capable of both verbal and nonverbal communication, and commonly available smart conversational interfaces such as Apple’s Siri, Google’s Google Assistant, Samsung’s Bixby, and Microsoft’s Cortana [1,33,34].”
BackgroundEmbodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433 · cited 1×
“In line with our study, a recent scoping review of psychology-focused embodied conversational agents reported that only a few studies employed user models to personalize user-system interactions [68].”
ResultSecurity and Usability: Designing Secure Systems that People Can Use
Cranor, L. F., & Garfinkel, S. (2005) · Cited by 431
Fan, H., & Poole, M. S. (2006) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919392.2006.9681199 · Cited by 404 · cited 8×
“Informed by the recent theoretical developments in personalization [7], a broader understanding of personalization in health care [22,29], and an increasing interest in health care CAs [3-5], this study aims to review the use of personalization in health care CAs and characterize the methods that…”
BackgroundMethodInfluentialDemystifying Reflection: A Study of Pedagogical Strategies that Encourage Reflective Journal Writing
Spalding, E., & Wilson, A. (2002) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1111/1467-9620.00208 · Cited by 331 · cited 2×
“…[61]: while implicit personalization with its often-imperceptible user models and hidden assumptions can result in biased decision-making [62], over-reliance on system suggestions [63], and filter bubbles [64], explicit personalization may involve very formulaic and superficial choices…”
BackgroundSurvey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322 · cited 2×
“…in personalization [7], a broader understanding of personalization in health care [22,29], and an increasing interest in health care CAs [3-5], this study aims to review the use of personalization in health care CAs and characterize the methods that have been applied to implement this…”
BackgroundMethodBickmore, T. W., Trinh, H., Olafsson, S., O'Leary, T. K., Asadi, R., Rickles, N. M., & Cruz, R. (2018) · Journal of Medical Internet Research · doi:10.2196/11510 · Cited by 308 · cited 1×
“Using CAs with unconstrained natural language input can be risky [66].”
BackgroundCritiquing-based recommenders: survey and emerging trends
Chen, L., & Pu, P. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9108-6 · Cited by 281 · cited 1×
“Personalization in CAs can be achieved implicitly by processing past interactions with users [11,13] or explicitly by user-entered information at the set-up time [8] or using ongoing confirmation style input [14].”
BackgroundTheory of Personalization of Appearance: Why Users Personalize Their PCs and Mobile Phones
Blom, J., & Monk, A. (2003) · Human-Computer Interaction · doi:10.1207/s15327051hci1803_1 · Cited by 256 · cited 1×
“The studies provided various forms of personalized content, however, they were implemented without being supported by any prior evidence showing their effectiveness or any theoretical frameworks underpinning personalization [7,56,57].”
BackgroundHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242 · cited 2×
“Learning from a history of previous conversations plays a key role in ensuring the continuity of health communications that take place over multiple interactions over time [31].”
BackgroundA Personalized System for Conversational Recommendations
Thompson, C. A., Goker, M. H., & Langley, P. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1318 · Cited by 223
Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity
Kocielnik, R., Xiao, L., Avrahami, D., & Hsieh, G. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3214273 · Cited by 221 · cited 5×
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundInfluentialRevere, D., & Dunbar, P. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080062 · Cited by 208
Using Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199 · cited 1×
“Another recent mapping study on health chatbots for behavior change found personalization to be one of the most appreciated technical enablers [69].”
BackgroundTailored Health Communication to Change Lifestyle Behaviors
Noar, S. M., Grant Harrington, N., Van Stee, S. K., & Shemanski Aldrich, R. (2011) · American Journal of Lifestyle Medicine · doi:10.1177/1559827610387255 · Cited by 183 · cited 1×
“Studies of personalization in health care and medicine have been increasing in number since the early 2000s [22], with growing evidence showing their effectiveness [23-26].”
BackgroundConversational Case-Based Reasoning
Aha, D. W., Breslow, L. A., & Muñoz-Avila, H. (2001) · Applied Intelligence · doi:10.1023/a:1008346807097 · Cited by 182 · cited 1×
“Personalization in CAs can be achieved implicitly by processing past interactions with users [11,13] or explicitly by user-entered information at the set-up time [8] or using ongoing confirmation style input [14].”
BackgroundReadings in Intelligent User Interfaces
Maybury, M. T., & Wahlster, W. (1998) · Medical Entomology and Zoology · Cited by 162
Designing and Evaluating an Adaptive Spoken Dialogue System
Litman, D. J., & Pan, S. (2002) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1015036910358 · Cited by 160 · cited 3×
“This foundational work on personalized CAs has been followed by a range of works focusing on dialogue management [9], personalized messages [10], recommender systems [11], and adaptive systems [12].”
BackgroundTanaka, H., Negoro, H., Iwasaka, H., & Nakamura, S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0182151 · Cited by 145 · cited 3×
“Personalized content included: (1) feedback on mood states [35], narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on…”
BackgroundMethodModelling both the Context and the User
Jameson, A. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170025 · Cited by 135 · cited 1×
“Various contextual factors such as location and time may also be integrated with user models to support more adaptive information and services [72].”
BackgroundGeneration and evaluation of user tailored responses in multimodal dialogue
Walker, M. A., Whittaker, S. J., Stent, A., Maloor, P., Moore, J., Johnston, M., & Vasireddy, G. (2004) · Cognitive Science · doi:10.1016/j.cogsci.2004.06.002 · Cited by 125 · cited 1×
“The effects of personalization have been evaluated in various ways by measuring aspects like efficiency in terms of the number and duration of interactions [11,20], user satisfaction, relevance, and understandability [20], information quality presented [21], and appropriateness of system responses [10].”
BackgroundMotivations in personalisation behaviour
Oulasvirta, A., & Blom, J. (2008) · Interacting with Computers · doi:10.1016/j.intcom.2007.06.002 · Cited by 117 · cited 1×
“The studies provided various forms of personalized content, however, they were implemented without being supported by any prior evidence showing their effectiveness or any theoretical frameworks underpinning personalization [7,56,57].”
Background’Personalized Medicine’: What’S in a Name?
Pokorska-Bocci, A., Stewart, A., Sagoo, G. S., Hall, A., Kroese, M., & Burton, H. (2014) · Personalized Medicine · doi:10.2217/pme.13.107 · Cited by 114 · cited 2×
“Informed by the recent theoretical developments in personalization [7], a broader understanding of personalization in health care [22,29], and an increasing interest in health care CAs [3-5], this study aims to review the use of personalization in health care CAs and characterize the methods that have been applied to…”
BackgroundMethodAN AUTOMATIC DIALOG SIMULATION TECHNIQUE TO DEVELOP AND EVALUATE INTERACTIVE CONVERSATIONAL AGENTS
Griol, D., Carbó, J., & Molina, J. M. (2013) · Applied Artificial Intelligence · doi:10.1080/08839514.2013.835230 · Cited by 109 · cited 1×
“The purposes of providing personalized content and conversations were to: (1) improve user engagement [35,37,38] and dialogue quality [42,43,54]; (2) provide timely feedback [39,40], adaptive user support [41], and adaptive training [36,38]; and, (3) support self-reflection [45,46].”
BackgroundDoes health informatics have a replication crisis?
Coiera, E., Ammenwerth, E., Georgiou, A., & Magrabi, F. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy028 · Cited by 106 · cited 1×
“Considering the recent emphasis on the role of replication in health informatics [55], the lack of technical details on conversational systems used in the studies is a major obstacle impeding replicability.”
BackgroundSelf-citationDo consumers know what they want?
Riquelme, H. E. (2001) · Journal of Consumer Marketing · doi:10.1108/07363760110398772 · Cited by 105 · cited 1×
“…can result in biased decision-making [62], over-reliance on system suggestions [63], and filter bubbles [64], explicit personalization may involve very formulaic and superficial choices for users who may not be well-equipped to customize the presented choices in a satisfactory manner [65].”
BackgroundVirtual training and coaching of health behavior: Example from mindfulness meditation training
Hudlicka, E. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.007 · Cited by 104 · cited 9×
“One study employed a virtual coach to teach mindfulness and meditation [38].”
BackgroundMethodInfluentialMobile phone-based asthma self-management aid for adolescents (mASMAA): a feasibility study
Rhee, H., Allen, J., Mammen, J., & Swift, M. (2014) · Patient Preference and Adherence · doi:10.2147/ppa.s53504 · Cited by 96 · cited 4×
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundMethodInfluentialLee, M. K., Kim, J., Forlizzi, J., & Kiesler, S. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807552 · Cited by 76 · cited 3×
“…most of the studies in our review implemented personalization features without being informed by the advancements in other domains of personalization (eg, more automated personalization methods [12,60] or the implications of personalization on privacy, safety, and decision-making [61,62,70]).”
BackgroundAutomated spoken dialogue system for hypertensive patient home management
Giorgino, T., Azzini, I., Rognoni, C., Quaglini, S., Stefanelli, M., Gretter, R., & Falavigna, D. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.04.026 · Cited by 69
Empirically Evaluating an Adaptable Spoken Dialogue System
Litman, D. J., & Pan, S. (1999) · CISM International Centre for Mechanical Sciences · doi:10.1007/978-3-7091-2490-1_6 · Cited by 67 · cited 1×
“Previous research has shown that adaptive conversational strategies can improve system performance, usability, and efficiency [58,59].”
BackgroundSillice, M. A., Morokoff, P. J., Ferszt, G., Bickmore, T., Bock, B. C., Lantini, R., & Velicer, W. F. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.7640 · Cited by 56 · cited 8×
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundInfluentialEvaluation of Spoken Dialogue Technology for Real-Time Health Data Collection
Levin, E., & Levin, A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e30 · Cited by 54 · cited 7×
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundMethodInfluentialAn empirical study of the influence of user tailoring on evaluative argument effectiveness
Carenini, G., & Moore, J. D. (2001) · Cited by 40
Kaleidoscope model of diabetes care: time for a rethink?
Barnard, K. D., Lloyd, C. E., Dyson, P. A., Davies, M. J., O'Neil, S., Naresh, K., Lawton, J., Ziegler, R., & Holt, R. I. G. (2014) · Diabetic Medicine · doi:10.1111/dme.12400 · Cited by 40 · cited 2×
“Informed by the recent theoretical developments in personalization [7], a broader understanding of personalization in health care [22,29], and an increasing interest in health care CAs [3-5], this study aims to review the use of personalization in health care CAs and characterize the methods that…”
BackgroundA Strategy for Information Presentation in Spoken Dialog Systems
Demberg, V., Winterboer, A., & Moore, J. D. (2011) · Computational Linguistics · doi:10.1162/coli_a_00064 · Cited by 34 · cited 2×
“Furthermore, personalization can be an essential system feature for voice interfaces due to the limitations in presenting large amounts of information through a voice-only modality [20].”
BackgroundCesuroğlu, T., Syurina, E. V., FERON, F. J. M., & Krumeich, A. J. S. M. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010243 · Cited by 33 · cited 2×
“One important limitation in the health care personalization literature is equating it to genomics-supported efforts in medicine [27].”
BackgroundAutomated Phone Capture of Diabetes Patients Readings with Consultant Monitoring via the Web
Harper, R., Nicholl, P., McTear, M., Wallace, J., Black, L.-A., & Kearney, P. (2008) · 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008) · doi:10.1109/ecbs.2008.31 · Cited by 29 · cited 3×
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundAcquisition and Use of Long-Term Memory for Personalized Dialog Systems
Kim, Y. H., Bang, J., Choi, J., Ryu, S., Koo, S., & Lee, G. G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15557-9_8 · Cited by 28 · cited 3×
“This foundational work on personalized CAs has been followed by a range of works focusing on dialogue management [9], personalized messages [10], recommender systems [11], and adaptive systems [12].”
BackgroundAn automatic dialogue generation platform for personalized dialogue applications
Pargellis, A. N., Kuo, H.-K. J., & Lee, C. (2003) · Speech Communication · doi:10.1016/j.specom.2003.10.003 · Cited by 27 · cited 1×
“This foundational work on personalized CAs has been followed by a range of works focusing on dialogue management [9], personalized messages [10], recommender systems [11], and adaptive systems [12].”
BackgroundAppraisal of a Conversational Artefact and Its Utility in Remote Patient Monitoring
Black, L. A., McTear, M., Black, N., Harper, R., & Lemon, M. (2005) · 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05) · doi:10.1109/cbms.2005.33 · Cited by 27 · cited 5×
“Information needed for personalization was provided explicitly by the users in seven studies [35,37-40, 44, 45], and obtained implicitly by the system in one study [36]”
BackgroundMethodInfluentialAutomated Spoken Dialog System for Home Care and Data Acquisition from Chronic Patients
Ivano, A., Daniele, F., Toni, G., Roberto, G., Silvana, Q., Carla, R., & Mario, S. (2003) · Studies in Health Technology and Informatics · doi:10.3233/978-1-60750-939-4-146 · Cited by 13 · cited 8×
“The purposes of providing personalized content and conversations were to: (1) improve user engagement [35,37,38] and dialogue quality [42,43,54]; (2) provide timely feedback [39,40], adaptive user support [41], and adaptive training [36,38]; and, (3) support self-reflection [45,46].”
BackgroundMethodInfluentialDynamic user level and utility measurement for adaptive dialog in a help-desk system
Maloor, P., & Chai, J. Y. (2000) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1117736.1117747 · Cited by 9 · cited 2×
“…to health care CAs, such as implicitly detecting users’ level of expertise and thus adjusting the complexity of the terms used and the dialogue path to be taken [60], or configuring the level of system initiative and confirmation strategies when a user faces difficulties in performing a task [12].”
BackgroundThe True Meaning of Personalized Medicine
Coiera, E. W. (2012) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1639423 · Cited by 2 · cited 1×
“Genomic markers are only one dimension of personalization that helps to recognize the uniqueness of individuals and make their medicine personalized [27,28].”
BackgroundSelf-citation
Research works printed but not linked: 8
- Cambridge dictionaries online20152019-09-16Cambridge University Presshttp://dictionary.cambridge.org
- Coiera, E, 2012, Yearb Med Inform, 7, 4
- Radziwill, NM, 2017, arXiv preprint, 1
- 10.2196/jmir.8.4.e30 · DOI · Paper page
- Azzini, I, 2003, Stud Health Technol Inform, 95, 146
- Chu-CarrollJNickersonJSEvaluating automatic dialogue strategy adaptation for a spoken dialogue system2000North American Chapter of the Association for Computational Linguistics ConferenceApril 29 - May 04, 2000Seattle, WashingtonAssociation for Computational Linguistics202209
- Carr, N, 2015, The glass cage: Where automation is taking us
- 10.1007/s10916-019-1237-1 · DOI · Paper page
Cited by
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
BackgroundThe Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
“Despite the large body of research concerning the application of conversational agents in health care, most reviews have limited their focus to a particular health area, agent type, or function [10,19-22].”
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301
“This topic is still in its infancy [81].”
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
“…through text, image, audio, or video messaging with human users on platforms such as websites, smartphone apps, or stand-alone computer software [1-47 The evolution of chatbots represents a significant technological leap, transitioning from reliance on predefined, rule-based scripted…”
Metadata
- Authors
- Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Ministerio de Salud (AR)
- Corresponding author
- Kocaballi, Ahmet Baki
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-11-07
- Volume
- 21
- Issue
- 11
- Pages
- e15360
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6873147
- OpenAlex
- W2972203331
- Semantic Scholar
- c99dffde110ac8a193caa027af1172372a92e896
- Cited by
- 332
- References
- 65
- Citations by year
- 2026: 57 · 2025: 64 · 2024: 47 · 2023: 56 · 2022: 38 · 2021: 48 · 2020: 21 · 2019: 1
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion, other-oa)
- Greater South Information System
- Funders
- Directorate for Computer and Information Science and Engineering
- Medical Research Council
- National Health and Medical Research Council (1134919)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, personalization, health care, natural language interfaces, personalized feedback, user satisfaction, user engagement, dialogue quality, patient safety, privacy, decision support
- MeSH terms
- Delivery of Health Care, Humans, Precision Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
