The Personalization of Conversational Agents in Health Care: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index; 8 of the 18 sources its claims cite were checked for support.
Abstract
BACKGROUND: The personalization of conversational agents with natural language user interfaces is seeing increasing use in health care applications, shaping the content, structure, or purpose of the dialogue between humans and conversational agents. OBJECTIVE: The goal of this systematic review was to understand the ways in which personalization has been used with conversational agents in health care and characterize the methods of its implementation. METHODS: We searched on PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library using a predefined search strategy. The studies were included if they: (1) were primary research studies that focused on consumers, caregivers, or health care professionals; (2) involved a conversational agent with an unconstrained natural language interface; (3) tested the system with human subjects; and (4) implemented personalization features. RESULTS: The search found 1958 publications. After abstract and full-text screening, 13 studies were included in the review. Common examples of personalized content included feedback, daily health reports, alerts, warnings, and recommendations. The personalization features were implemented without a theoretical framework of customization and with limited evaluation of its impact. While conversational agents with personalization features were reported to improve user satisfaction, user engagement and dialogue quality, the role of personalization in improving health outcomes was not assessed directly. CONCLUSIONS: Most of the studies in our review implemented the personalization features without theoretical or evidence-based support for them and did not leverage the recent developments in other domains of personalization. Future research could incorporate personalization as a distinct design factor with a more careful consideration of its impact on health outcomes and its implications on patient safety, privacy, and decision-making.
Overview
CoChat Summary
## TL;DR
This systematic review found only 13 health care conversational-agent studies with personalization features, and most personalized content rather than conversational style. The paper concludes that personalization was rarely theory-based or directly evaluated for health outcomes.
## Key findings
- The search identified 1958 publications in total; after screening, 13 studies were included.
- Personalization was most often used for content delivery: feedback, daily health reports, alerts, warnings, recommendations, reminders, multimedia, and personalized questions.
- Across the 13 studies, 8 supported patients and 5 supported both patients and clinicians; all used individuated personalization, and 1 study also used categorical personalization for novice vs expert users.
- Only 2 studies directly assessed personalization itself; one reported that 85% (29/34) found tailored feedback helpful, and another rated customized feedback 0.3 on a –2 to +2 Likert scale as the most successful feature.
## Methods
- Systematic review of health care conversational agents with unconstrained natural language input and personalization features.
- Searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library in March 2019, with no publication-year or language restriction.
- Included primary studies on consumers, caregivers, or health care professionals that tested a conversational agent with human users and implemented personalization; screening/data extraction were done independently by two researchers, with Cohen kappa used for agreement.
## Limitations
- The authors state the results are limited by how much the included studies reported their personalization features.
- The review focused only on CAs with unconstrained natural language input, so the findings may not extend to constrained systems; this is stated in the paper.
- Evident from the text: outcomes in the included studies were often attributable to the overall system rather than personalization alone, making it hard to isolate personalization effects.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
5 Valid · 0 Not valid · 6 Not checked · 32 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The effects of personalization have been evaluated in various ways by measuring aspects like efficiency in terms of the number and duration of interactions [11,20], user satisfaction, relevance, and understandability [20], information quality presented [21], and appropriateness of system responses [10].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Introduction > Personalization in Conversational Agents
What the sources say
- Partly supportedcites [11] sourceExperimental — accuracy not yet measured
Thompson et al. (2004) do evaluate personalization by measuring efficiency — 'the average number of interactions needed to find a restaurant accepted by the user' and 'the time taken for each conversation' (4.1 Experimental Variables, p. 18) — and user satisfaction, via rejection rate, hit rate (the percentage of conversations in which the first item presented was acceptable, i.e. a relevance-style measure) and a post-study questionnaire (4.1, p. 18; Appendix A, p. 29). However, our copy contains no measure of 'understandability' or of 'information quality presented'; appropriateness appears only as a general goal of personalization ('to increase the quality and appropriateness of both the interaction and the result(s)', 2.1 Personalization, p. 3), not as an evaluated dimension. So the list of six evaluation aspects exceeds what this single source reports. (LLM, conf=0.78)
- Supportedcites [20] source
Section 6 (Evaluation II—User Interaction Study) says the paper measured efficiency by dialog duration and also assessed user satisfaction. The User Satisfaction Ratings and Results sections report measures of relevance and understandability. Information quality and response appropriateness are attached to other citations in the citing sentence, not to this paper. (LLM, conf=0.92)
- Supportedcites [21] source
In §5.1 (Experimental design for tailoring and mode experiment) our copy defines and elicits a five-point Likert judgement of the informativeness/'information quality' of tailored system utterances, recorded as the measure InformationQuality, and §5.2 reports the tailoring result on that measure (paired t-test, t(383)=1.76, P<.05). The citation [21] in the printed sentence is attached specifically to 'information quality presented', which is exactly this paper's evaluation variable; the other listed aspects (efficiency, satisfaction, appropriateness) are credited to different citations, and §6 indeed notes task completion, time and user satisfaction as future work rather than measures here, so nothing attributed to this source is unsupported. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Learning from a history of previous conversations plays a key role in ensuring the continuity of health communications that take place over multiple interactions over time [31].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Introduction > Personalization in Health Care and Medicine
What the sources say
- Supportedcites [31] source
Section 3.3, “Continuity over multiple interactions,” says that health communication applications require repeated interactions over time and must retain information between sessions so later dialog can be tailored to earlier conversations. This supports the claim’s paraphrase about using conversation history to maintain continuity. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using CAs with unconstrained natural language input can be risky [66].”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Discussion > Principal Results
What the sources say
- Supportedcites [66] source
The Discussion’s Principal Findings say that patients and consumers should not rely on conversational assistants using unconstrained natural language input for actionable medical advice, because responses could lead to harm. The claim accurately conveys that risk, though the paper examines medical-information use specifically. (LLM, conf=0.93)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The use of CAs with unconstrained language input in health care is still limited, but there has been a notable increase in the number of studies in recent years.”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Discussion > Principal Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The personalization features were implemented without a theoretical framework of customization and with limited evaluation of its impact.”
- Also stated in: § Conclusions · plain
“While the CAs with personalization features were reported to improve user satisfaction, user engagement, and dialogue quality, little evaluation was performed to measure the extent of personalization and its role in improving health outcomes.”
§ The Personalization of Conversational Agents in Health Care: Systematic Review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Conclusions · plain
26 more claims
Create a free account to see all 43 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 6
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In mental health CAs, the use of user profiles or user models to support personalized and adaptive features and the assessment of personalization is still in its infancy [79].”
From Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials (2023) · cites this paper as [79]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Other recent reviews focused on conversational agents for either a specific health condition such as mental health [44], the general application of chatbots in health care [1], or specific features thereof such as personalization [45] or technical architectures [11].”
From Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review (2020) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“Despite the large body of research concerning the application of conversational agents in health care, most reviews have limited their focus to a particular health area, agent type, or function [10,19-22].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Personalization of conversational agents has documented benefits60, but there is a growing concern about the harms posed by the anthropomorphization of AI.”
From A psychometric framework for evaluating and shaping personality traits in large language models (2025) · cites this paper as [60]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587 · cited 1×
“Moreover, other theories not specific to personalization may prove useful for personalization purposes, such as the Theory of Planned Behavior [71].”
BackgroundThe PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 1×
“03) and significant differences in the posi• Questionnaires to measure depression (PHQ-9a) [48], anxiety (GAD-7b) [49], and affect • To improve depression and anxiety symptoms • To provide more engaging and convenient user experitive and negative affects (P=.”
BackgroundDevelopment and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“03) and significant differences in the posi• Questionnaires to measure depression (PHQ-9a) [48], anxiety (GAD-7b) [49], and affect • To improve depression and anxiety symptoms • To provide more engaging and convenient user experitive and negative affects (P=.”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 7×
“Information needed for personalization was provided explicitly by the users in seven studies [35,37-40, 44, 45], and obtained implicitly by the system in one study [36]”
BackgroundMethodInfluentialReferring as a collaborative process
Clark, H. H., & Wilkes-Gibbs, D. (1986) · Cognition · doi:10.1016/0010-0277(86)90010-7 · Cited by 2,401 · cited 1×
“Personalized and adaptive system behavior in conversational systems can improve user comprehension [16], user satisfaction [17], task efficiency [18], and the likelihood of behavior change [19].”
BackgroundDoes tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136 · cited 1×
“Studies of personalization in health care and medicine have been increasing in number since the early 2000s [22], with growing evidence showing their effectiveness [23-26].”
BackgroundMeasuring mindfulness—The Freiburg Mindfulness Inventory (FMI)
Walach, H., Buchheld, N., Buttenmüller, V., Kleinknecht, N., & Schmidt, S. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2005.11.025 · Cited by 1,475 · cited 1×
“07; sm) • Questionnaires to measure health awareness [51], mindfulness (FMIg) [52], and reflection • To trigger deeper reflection, which would increase motivation, empowerment, and adoption of new behavior • Prolonged use of CA (additional two weeks) by half of the participants (16/33) with an avg (RQh) [53] of 98.”
BackgroundConversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“A recent systematic review in this area examined technical performance, user experience, and health-related outcomes and found that most studies had not employed standardized evaluation methods or had failed to address aspects of patient safety [2].”
BackgroundSelf-citationThe filter bubble: how the new personalized web is changing what we read and how we think
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0926 · Cited by 1,319 · cited 1×
“For example, a recent research paper drew attention to the limitations of implicit and explicit personalization [61]: while implicit personalization with its often-imperceptible user models and hidden assumptions can result in biased decision-making [62], over-reliance on system suggestions [63], and filter bubbles [6…”
Background
Research works printed but not linked: 8
- Cambridge dictionaries online20152019-09-16Cambridge University Presshttp://dictionary.cambridge.org
- Coiera, E, 2012, Yearb Med Inform, 7, 4
- Radziwill, NM, 2017, arXiv preprint, 1
- 10.2196/jmir.8.4.e30 · DOI · Paper page
- Azzini, I, 2003, Stud Health Technol Inform, 95, 146
- Chu-CarrollJNickersonJSEvaluating automatic dialogue strategy adaptation for a spoken dialogue system2000North American Chapter of the Association for Computational Linguistics ConferenceApril 29 - May 04, 2000Seattle, WashingtonAssociation for Computational Linguistics202209
- Carr, N, 2015, The glass cage: Where automation is taking us
- 10.1007/s10916-019-1237-1 · DOI · Paper page
Cited by
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
“Existing reviews on conversational agents focus on a certain subtype of agents such as virtual coaches [31-33] or embodied conversational agents (ECAs) [34] or on specific functionalities of these agents such as behavior change [35] or mental health applications [36,37].”
BackgroundThe Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
“Despite the large body of research concerning the application of conversational agents in health care, most reviews have limited their focus to a particular health area, agent type, or function [10,19-22].”
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301
“This topic is still in its infancy [81].”
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
“…through text, image, audio, or video messaging with human users on platforms such as websites, smartphone apps, or stand-alone computer software [1-47 The evolution of chatbots represents a significant technological leap, transitioning from reliance on predefined, rule-based scripted…”
Schachner, T., Keller, R., & v Wangenheim, F. (2020) · Journal of Medical Internet Research · doi:10.2196/20701 · Cited by 267
“These databases were chosen as they cover relevant aspects in medicine and technology and have been used in other systematic literature reviews covering similar topics [1,45].”
BackgroundMethodResultInfluentialHauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210
“Furthermore, a review reported that conversational agent-based personalized interventions improved satisfaction, engagement, and dialog quality, and that outcome evaluations were often neglected [112].”
BackgroundHe, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213
“In mental health CAs, the use of user profiles or user models to support personalized and adaptive features and the assessment of personalization is still in its infancy [79].”
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
He, Y., Yang, L., Zhu, X., Wu, B., Zhang, S., Qian, C., & Tian, T. (2022) · Journal of Medical Internet Research · doi:10.2196/40719 · Cited by 178
“The utilization of user profiles or user models to support personalized and adaptive features, and assessments for personalization are still limited in mental health chatbots [89].”
Artificial Intelligence for Chatbots in Mental Health: Opportunities and Challenges
Denecke, K., Abd-Alrazaq, A., & Househ, M. (2021) · Lecture Notes in Bioengineering · doi:10.1007/978-3-030-67303-1_10 · Cited by 177
Tong, H. L., Quiroz, J. C., Kocaballi, A. B., Fat, S. C. M., Dao, K. P., Gehringer, H., Chow, C. K., & Laranjo, L. (2021) · Preventive Medicine · doi:10.1016/j.ypmed.2021.106532 · Cited by 162
Self-citationDesigning Personality-Adaptive Conversational Agents for Mental Health Care
Ahmad, R., Siemon, D., Gnewuch, U., & Robra-Bissantz, S. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10254-9 · Cited by 130
“Though this topic is still in its infancy (Kocaballi et al., 2019), there has been an increased interest in studies addressing the aspect of personality adaptivity in CAs.”
BackgroundInfluentialvan Lopik, K., Sinclair, M., Sharpe, R. G., CONWAY, P. P., & West, A. A. (2020) · Computers in Industry · doi:10.1016/j.compind.2020.103208 · Cited by 138
Wang, H., Gupta, S., Singhal, A., Muttreja, P., Singh, S., Sharma, P., & Piterova, A. (2022) · Journal of Medical Internet Research · doi:10.2196/29969 · Cited by 111
“Not surprisingly, AI chatbot health apps are burgeoning [18-21], and they have unique advantages for addressing sensitive and taboo issues such as SRH [22].”
BackgroundPersonality Traits in Large Language Models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Abdulhai, M., Faust, A., & Matarić, M. (2023) · Research Square · doi:10.21203/rs.3.rs-3296728/v1 · Cited by 134
Kowatsch, T., Schachner, T., Harperink, S., Barata, F., Dittler, U., Xiao, G., Stanger, C., v Wangenheim, F., Fleisch, E., Oswald, H., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25060 · Cited by 103
“Although there have been recent review papers discussing the use of conversational agents in health care [63,96-101], the current conversational agent is the first (to the best of our knowledge) that takes over the role of a scalable social actor framed as a scalable assistant of a health care professional that mediat…”
UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
Zheng, Q., Tang, Y., Liu, Y., Liu, W., & Huang, Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501855 · Cited by 100
“Others are more specifc, such as studying CAs’ emotional intelligence [127], personalization [80], trust-building [142], and human-likeness [170].”
BackgroundEvaluation of the Current State of Chatbots for Digital Health: Scoping Review
Xue, J., Zhang, B., Zhao, Y., Zhang, Q., Zheng, C., Jiang, J., Li, H., Liu, N., Li, Z., Fu, W., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/47217 · Cited by 129
“Some of these features were derived from the existing literature [14,17,18], whereas others were newly developed for this study.”
The Use and Promise of Conversational Agents in Digital Health
Dingler, T., Kwasnicka, D., Wei, J., Gong, E., & Oldenburg, B. (2021) · Yearbook of Medical Informatics · doi:10.1055/s-0041-1726510 · Cited by 81
“Conversational agents are also increasingly designed to increase the program's engagement and personalization, either as an authority and knowledgeable identity as a virtual health professional or coach or as an informal human-like friend and peer (32,33).”
BackgroundLoveys, K., Sagar, M., Pickering, I., & Broadbent, E. (2021) · JMIR Mental Health · doi:10.2196/31586 · Cited by 86
“Some research suggests that greater personalization of CAs (eg, through feedback, daily health reports, and recommendations) may improve acceptability and user engagement [72].”
Zhu, Y., Janssen, M., Wang, R., & Liu, Y. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1988236 · Cited by 106
(2022) · doi:10.2196/32630 · Cited by 83
“This strengthens the recommendation that it is worth the extra effort to integrate even simple customization and personalization options [71,75].”
BackgroundMorse, K. E., Ostberg, N. P., Jones, V. G., & Chan, A. S. (2020) · Journal of Medical Internet Research · doi:10.2196/20549 · Cited by 85
“One potential approach is a digital symptom checker, which is an artificial intelligence (AI)–supported software tool that uses a conversational “chatbot” format to ask questions about a patient’s symptoms and returns a list of likely diagnoses to support self-diagnosis and appropriate triage [3].”
MethodAutomated vs. Human Health Coaching: Exploring Participant and Practitioner Experiences
Mitchell, E. G., Maimone, R., Cassells, A. N., Tobin, J. N., Davidson, P., Smaldone, A. M., & Mamykina, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449173 · Cited by 88
“In health, conversational agents are often scripted or rule-based [50,54].”
BackgroundZhu, Y., Wang, R., & Pu, C. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221090031 · Cited by 77
“This point has been supported by many empirical studies on AI-based applications.(52,53) In this study, personalization as a functional value can identify specific psychological problems accurately and offering personalized therapies or services.”
ResultPromoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review
Luo, T. C., Aguilera, A., Lyles, C. R., & Figueroa, C. A. (2021) · Journal of Medical Internet Research · doi:10.2196/25486 · Cited by 68
“…other reviews’ evaluations of health care conversational agents, which show that natural language processing and machine learning are underused, high-quality evidence and attention to patient safety are lacking, and study methods and evaluation measures are often inconsistently reported [8,20,21].”
InfluentialConsent-GPT: is it ethical to delegate procedural consent to conversational AI?
Allen, J. W., Earp, B. D., Koplin, J. J., & Wilkinson, D. J. C. (2023) · Journal of Medical Ethics · doi:10.1136/jme-2023-109347 · Cited by 79
“Key to the success of consent delegation to LLMs will be their ability to fulfil the ethical functions and clinical criteria for informed consent.”
BackgroundOr, C. K., Liu, K., So, M. K. P., Cheung, B., Yam, L. Y. C., Tiwari, A., Lau, Y. F. E., Lau, T., Hui, P. S. G., Cheng, H. C., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16769 · Cited by 72
“The incremental information and knowledge acquired thereby can then be applied to enhance TSN user experience and safety, increase compliance, and induce behavioral change toward more ordered (ie, lower entropy) and healthier living on the part of the patient [47,48].”
MethodComputer-Controlled Virtual Humans in Patient-Facing Systems: Systematic Review and Meta-Analysis
Chattopadhyay, D., Ma, T., Sharifi, H., & Martyn-Nemeth, P. A. (2020) · Journal of Medical Internet Research · doi:10.2196/18839 · Cited by 68
“Kocaballi et al [40] reported a systematic review of how conversational agents can be personalized.”
BackgroundEvaluation of chatbot-delivered interventions for self-management of depression: Content analysis.
Martinengo, L., Lum, E., & Car, J. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.09.028 · Cited by 67
Irfan, B., Kuoppamäki, S., Hosseini, A., & Skantze, G. (2025) · Autonomous Robots · doi:10.1007/s10514-025-10190-y · Cited by 108
Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges
Motger, Q., Franch, X., & Marco, J. (2023) · ACM Computing Surveys · doi:10.1145/3527450 · Cited by 68
“, user profiles [88], third-party services [90]); (2) exploring and categorizing adaptive mechanisms (e.”
BackgroundMethodInfluentialLiu, Y., Yan, W., Hu, B., Li, Z., & Lai, Y. L. (2022) · Digital Health · doi:10.1177/20552076221129718 · Cited by 90
“41 With regard to source expertise, it is a term that refers to the extent to which the individuals perceive the source to have enough competence and knowledge to provide convincing arguments.”
BackgroundMa, Z., Mei, Y., Long, Y., Su, Z., & Gajos, K. Z. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642482 · Cited by 68
To, Q. G., Green, C., & Vandelanotte, C. (2021) · JMIR mHealth and uHealth · doi:10.2196/28577 · Cited by 68
“Recent reviews indicate that health behavior change interventions using chatbots have mostly focused on mental health [17,18].”
BackgroundBlümel, J. H., Zaki, M., & Bohné, T. (2023) · Journal of Service Theory and Practice · doi:10.1108/jstp-03-2023-0098 · Cited by 101
Rodriguez‐Arrastia, M., Martinez‐Ortigosa, A., Ruiz‐Gonzalez, C., Ropero‐Padilla, C., Roman, P., & Sanchez‐Labraca, N. (2022) · Journal of Nursing Management · doi:10.1111/jonm.13630 · Cited by 65
Jabir, A. I., Martinengo, L., Lin, X., Torous, J., Subramaniam, M., & Tudor Car, L. (2023) · Journal of Medical Internet Research · doi:10.2196/44548 · Cited by 63
“This may include objective counts of error-handling messages sent in addition to user subjective experience of the dialogues or CAs in general [2].”
de Cock, C., Milne-Ives, M., van Velthoven, M. H., Alturkistani, A., Lam, C., & Meinert, E. (2020) · JMIR Research Protocols · doi:10.2196/16934 · Cited by 62
“Personalization features have also been integrated into conversational agents to improve user satisfaction, user engagement, and dialogue quality [19].”
BackgroundSensors and Devices Guided by Artificial Intelligence for Personalized Pain Medicine
Xing, Y., Yang, K., Lu, A., Mackie, K., & Guo, F. (2024) · Cyborg and Bionic Systems · doi:10.34133/cbsystems.0160 · Cited by 77
“Additionally, although these devices offer multilingual communication flexibility through LLMs, their technical complexity can be daunting for some users, especially those less familiar with advanced technologies [57].”
BackgroundChan, C. K. Y. (2025) · Behavioral Sciences · doi:10.3390/bs15030287 · Cited by 77
“Students’ reliance on AI can be further exacerbated by the personalisation features that enable it to offer advice and guidance tailored for clients’ needs (Kocaballi et al., 2019).”
Review of artificial intelligence‐based question‐answering systems in healthcare
Budler, L. C., Gosak, L., & Stiglic, G. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 52
Araujo, T., & Bol, N. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100030 · Cited by 50
Kiuchi, K., Otsu, K., & Hayashi, Y. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2286528 · Cited by 62
“The integration of chatbots and coaching with automated patient monitoring and real-time assessment (Tsiouris et al. 2020) and the development of theory-based per-sonalisation (Denecke and May 2023; Kocaballi et al. 2019) are also expected to increase the e ff ectiveness of CA for health promotion.”
Nelekar, S., Abdulrahman, A., Gupta, M., & Richards, D. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13174 · Cited by 47
Liu, N., Pu, Q., Shi, Y., Zhang, S., & Qiu, L. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2074667 · Cited by 52
“Conversational agents that can provide customized information can improve user satisfaction, user engagement, and dialog quality (Kocaballi et al., 2019).”
BackgroundBalaji, D., He, L., Giani, S., Bosse, T., Wiers, R., & de Bruijn, G.-J. (2022) · Sexual Health · doi:10.1071/sh22016 · Cited by 44
Research on digital technology use in cardiology: bibliometric analysis
Yeung, A. W. K., Kulnik, S. T., Parvanov, E. D., Fassl, A., Eibensteiner, F., Völkl-Kernstock, S., Kletecka-Pulker, M., Crutzen, R., Gutenberg, J., Höppchen, I., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/36086 · Cited by 44
“Further potentially transformative technologies are conversational interfaces [34-36], developments that enable localized and individualized production through 3D printing [37,38], biochemical composition [39], or personal genomics [40].”
BackgroundChavez-Yenter, D., Kimball, K. E., Kohlmann, W., Lorenz Chambers, R., Bradshaw, R. L., Espinel, W. F., Flynn, M., Gammon, A., Goldberg, E., Hagerty, K. J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/29447 · Cited by 43
“…the acceptability and usability of conversational agents in multiple different contexts (behavior change, mental health, adherence, and genomics) [8-14 , To our knowledge, this is the only study that has characterized the use of a conversational agent in a genomic setting, adding to the…”
Background(2023) · Journal of Pharmaceutical Policy and Practice · doi:10.1186/s40545-023-00624-2 · Cited by 42
“However, the success of this technology depends on the knowledge and experience of the pharmacists who use it [7, 8].”
BackgroundKankanhalli, A., Xia, Q., & Zhao, X. (2021) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00152 · Cited by 51
Kang, B., & Hong, M. (2024) · JMIR Medical Informatics · doi:10.2196/63538 · Cited by 65
“As we navigate the rapidly evolving landscape of AI and its potential to revolutionize mental health support, it is crucial to explore innovative solutions that can bridge the gap between technology and human empathy [8].”
Participatory Development and Pilot Testing of an Adolescent Health Promotion Chatbot
Maenhout, L., Peuters, C., Cardon, G., Compernolle, S., Crombez, G., & DeSmet, A. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.724779 · Cited by 53
“Current chatbot literature has mainly studied user experience (33, 37, 45–52), the effect of chatbots on certain (health) outcomes (19, 25, 39, 40), important characteristics to include (44, 53–55) or challenges to overcome (34, 35, 56, 57).”
BackgroundIssom, D.-Z., Hardy-Dessources, M.-D., Romana, M., Hartvigsen, G., & Lovis, C. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.600333 · Cited by 39
Talking technology: exploring chatbots as a tool for cataract patient education
Yılmaz, İ. E., & Doğan, L. (2024) · Clinical and Experimental Optometry · doi:10.1080/08164622.2023.2298812 · Cited by 42
Conversational Agent for Healthy Lifestyle Behavior Change: Web-Based Feasibility Study
Dhinagaran, D. A., Sathish, T., Soong, A., Theng, Y.-L., Best, J., & Tudor Car, L. (2021) · JMIR Formative Research · doi:10.2196/27956 · Cited by 39
“The heightened accessibility, personalization, and efficiency that conversational agents offer highlight the potential for conversational agents to improve patient care [11-13].”
BackgroundChow, J. C. L., & Li, K. (2025) · JMIR Cancer · doi:10.2196/66633 · Cited by 46
Conversational Agents for Health and Wellbeing
Kocaballi, A. B., Quiroz, J. C., Laranjo, L., Rezazadegan, D., Kocielnik, R., Clark, L., Liao, Q. V., Park, S. Y., Moore, R. J., & Miner, A. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3375154 · Cited by 38
Self-citationHutmacher, F., & Appel, M. (2022) · Review of General Psychology · doi:10.1177/10892680221105663 · Cited by 59
“Other relevant domains include, but are not limited to, education (e.g., intelligent tutoring systems, Tetzlaff et al., 2021), marketing (e.g., personalized advertising, Walrave et al., 2016) or health communication (e.g., conversational agents, Kocaballi et al., 2019).”
BackgroundUser Perceptions of Extraversion in Chatbots after Repeated Use
Völkel, S. T., Schoedel, R., Kaya, L., & Mayer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502058 · Cited by 53
Griffin, A. C., Xing, Z., Mikles, S. P., Bailey, S., Khairat, S., Arguello, J., Wang, Y., & Chung, A. E. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab021 · Cited by 31
“Age (mean1⁄4 59, SD1⁄4 11) (years) 45–54 6 (40) 55–64 4 (27) 65þ 5 (33) Gender Female 8 (53) Male 7 (47) Race White or Caucasian 10 (66) Black or African American 4 (27) Other 1 (7) Ethnicity Not Latino/Latina 14 (93) Latino/Latina 1 (7) Education Less than college 6 (40) College graduate or more 9 (60) Household inco…”
BackgroundUnderstanding User Perceptions of Proactive Smart Speakers
Wei, J., Dingler, T., & Kostakos, V. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494965 · Cited by 33
“…factor that determines user experience with proactive speakers, further studies can explore two directions for conversation starters: (1) context-aware utterances [45] or personalized utterances [31], and (2) compare the Earcon starter with the utterance starter that both require user consent.”
BackgroundAsthana, S., Im, J., Chen, Z., & Banovic, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642180 · Cited by 34
Conversational Agents for Body Weight Management: Systematic Review
Noh, E., Won, J., Jo, S., Hahm, D., & Lee, H. (2023) · Journal of Medical Internet Research · doi:10.2196/42238 · Cited by 41
“One of the studies that were finally excluded involved CAs without natural language input capability [36], and another did not use CAs for the purpose of interacting with users in dialogue [37].”
Lupetti, M. L., Hagens, E., van der Maden, W., Steegers‐Theunissen, R. P. M., & Rousian, M. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3597128 · Cited by 42
“As such, a growing body of research is now invested in understanding what features, best design practices and evaluation metrics would ensure successful applications of CAs in healthcare [8, 24, 30, 38].”
BackgroundConsumers' responses to personalized service from medical artificial intelligence and human doctors
Zhang, Y., Tan, W., & Lee, E. (2023) · Psychology and Marketing · doi:10.1002/mar.21911 · Cited by 41
Evaluation Metrics for Health Chatbots: A Delphi Study
Denecke, K., Abd-Alrazaq, A. A., Househ, M. S., & Warren, J. (2021) · Methods of Information in Medicine · doi:10.1055/s-0041-1736664 · Cited by 32
Infusing behavior science into large language models for activity coaching
Hegde, N., Vardhan, M., Nathani, D., Rosenzweig, E., Speed, C. A., Karthikesalingam, A., & Seneviratne, M. G. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000431 · Cited by 44
Plotkina, L., & Ramalu, S. S. (2024) · Journal of Management Development · doi:10.1108/jmd-06-2024-0182 · Cited by 44
Bucher, A., Blazek, E. S., & Symons, C. T. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.007 · Cited by 48
“28 e 30 Outside of mental health care, health care chatbots have also been used for symptom assessment and monitoring, 31 care referrals, 32 and patient education.”
Wang, X., Griffith, J., Adler, D. A., Castillo, J., Choudhury, T., & Wang, F. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713852 · Cited by 52
TRICALS: creating a highway toward a cure
van Eijk, R. P. A., Kliest, T., McDermott, C. J., Roes, K. C. B., Damme, P. V., Chiò, A., Weber, M., Ingre, C., Corcia, P., Povedano, M., et al. (2020) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2020.1788092 · Cited by 32
Stara, V., Soraci, L., Takano, E., Kondo, I., Möller, J., Maranesi, E., Luzi, R., Riccardi, G. R., Browne, R., Dacunha, S., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/41035 · Cited by 31
“It is indeed one of the most critical issues that emerged in other studies [38-40].”
A psychometric framework for evaluating and shaping personality traits in large language models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Romero, P., Abdulhai, M., Faust, A., & Matarić, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01115-6 · Cited by 30
The Role of AI-Based Chatbots in Public Health Emergencies: A Narrative Review
Branda, F., Stella, M., Ceccarelli, C., Cabitza, F., Ceccarelli, G., Maruotti, A., Ciccozzi, M., & Scarpa, F. (2025) · Future Internet · doi:10.3390/fi17040145 · Cited by 50
“Second, the integration of AI chatbots into existing healthcare systems has shown tangible benefits, such as reducing the workload on healthcare professionals and improving patient outcomes through timely information dissemination [9].”
Rampioni, M., Moșoi, A. A., Rossi, L., Moraru, S.-A., Rosenberg, D., & Stara, V. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147489 · Cited by 31
“For example, personalization is primarily used for tailoring content through feedback, daily health reports, alerts, warnings, and recommendations; nevertheless, this recognized added value is not yet considered a distinctive design factor [82].”
BackgroundVossen, W., Szymanski, M., & Verbert, K. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645195 · Cited by 36
“A systemic review on ways to personalize a chatbot in a healthcare environment found that the use of personalization was mainly limited to tailoring the content delivered by the chatbot [18].”
BackgroundInfluentialSezgın, E., Kocaballi, A. B., Dolcé, M., Skeens, M. A., Militello, L. K., Huang, Y., Stevens, J. H., & Kemper, A. R. (2024) · JMIR Human Factors · doi:10.2196/57114 · Cited by 38
“Conversational design can be strategically geared toward providing more inclusive and personalized need assessment [44-46].”
Self-citationChatbots and mental health: a scoping review of reviews
Mayor, E. (2025) · Current Psychology · doi:10.1007/s12144-025-08094-2 · Cited by 49
“Kocaballi et al. (2019) describe two types of personalization in healthcare chatbots: implicit and explicit: “In implicit personalization, information needed for user models is obtained automatically through the analysis of observed user activities and interactions with the sys-tem.”
Maharjan, R., Doherty, K., Rohani, D. A., Bækgaard, P., & Bardram, J. E. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484508 · Cited by 29
“Studies have shown that speech, as a primary mode of communication, can engage users in more natural and human-to-human-like conversations, suggesting the potential of these systems to improve user engagement and self-report response quality while fostering more honest and insightful forms of self-disclosure [23, 50]…”
BackgroundAssessing data gathering of chatbot based symptom checkers - a clinical vignettes study
Ben-Shabat, N., Sharvit, G., Meimis, B., Ben Joya, D., Sloma, A., Kiderman, D., Shabat, A., Tsur, A. M., Watad, A., & Amital, H. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104897 · Cited by 27
“Most advanced symptom checkers use a conversational “ chatbot ” format to collect information from the patient and then return an output of likely diagnoses and triage advice [16].”
BackgroundMah, K., Loke, L., & Hespanhol, L. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3471932 · Cited by 33
“Conversational agents using voice or other modalities of output and feedback could be designed for this purpose [52, 56].”
BackgroundWeeks, R., Sangha, P., Cooper, L., Sedoc, J., White, S., Gretz, S., Toledo, A., Lahav, D., Hartner, A.-M., Martin, N., et al. (2022) · JMIR Human Factors · doi:10.2196/40533 · Cited by 40
“Many other health chatbots provide personalized content and conversations to improve user engagement, dialog quality, and self-reflection [51].”
Conversational agents for depression screening: A systematic review
Otero-González, I., Pacheco-Lorenzo, M. R., Iglesias, M. J. F., & Anido, L. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105272 · Cited by 34
Li, Z., Liang, M., Lc, R., & Luo, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642479 · Cited by 37
“Similar fndings were shown in prior work that leveraged chatbot as a refection companion to increase individuals’ awareness of their daily activities [40–42].”
Maharjan, R., Rohani, D. A., Bækgaard, P., Bardram, J., & Doherty, K. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469600 · Cited by 25
“The growing trend in ownership of smart speaker devices including Amazon’s Echo and Google’s Home [46] has led to increased interest in these systems’ potential to support healthcare [25, 27, 28, 31, 44].”
BackgroundSantini, S., Stara, V., Galassi, F., Merizzi, A., Schneider, C., Schwammer, S., Stolte, E., & Kropf, J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18189681 · Cited by 31
“Nevertheless, the personalization of ECAs will be crucial for future development in these fields [66].”
BackgroundA survey on agents applications in healthcare: Opportunities, challenges and trends
Sulis, E., Mariani, S., & Montagna, S. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107525 · Cited by 30
Cotter, L. M., Shah, D. V., Brown, K., Mares, M., Landucci, G., Saunders, S., Johnston, D. C., Pe‐Romashko, K., Gustafson, D. H., Maus, A., et al. (2024) · JMIR Aging · doi:10.2196/56923 · Cited by 35
“User-personalized conversations can also increase user satisfaction and general engagement [35].”
BackgroundMarqués‐Sánchez, P., Benítez‐Andrades, J. A., Sánchez, M. D. C., & Ramos, N. A. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-042773 · Cited by 45
Gross, C., Schachner, T., Hasl, A., Kohlbrenner, D., Clarenbach, C. F., von Wangenheim, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/26643 · Cited by 23
“Despite numerous design considerations [9] for health care CAs, such as personalized recommendations [10] and anthropomorphic cues [11], it is still unclear which CA-delivered interaction styles chronically ill patients prefer and whether the preference has an impact on CA-related perceptions (eg, working alliance) an…”
BackgroundA Digital Coach to Promote Emotion Regulation Skills
Hopman, K., Richards, D., & Norberg, M. M. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7060057 · Cited by 36
“This design aimed to ensure patient safety and mitigation of harmful, incorrect, or invalid ECA responses due to natural language processing errors [44].”
BackgroundSmartphone Applications to Prevent Type 2 Diabetes: A Systematic Review and Meta-Analysis
Jahan, E., Almansour, R., Ijaz, K., Baptista, S. N., Giordan, L. B., Ronto, R., Zaman, S. J., O’Hagan, E. T., & Laranjo, L. (2024) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2024.01.008 · Cited by 29
Self-citationVirtual Customer Assistants in finance: From state of the art and practices to design guidelines
Iovine, A., Narducci, F., Musto, C., de Gemmis, M., & Semeraro, G. M. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100534 · Cited by 29
Using a chat-based informed consent tool in large-scale genomic research
Savage, S. K., LoTempio, J. E., Smith, E. D., Andrew, E. H., Mas, G., Kahn-Kirby, A. H., Délot, E. C., Cohen, A. J., Pitsava, G., Nussbaum, R. L., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad181 · Cited by 19
Use of artificial intelligence in last mile delivery
Jucha, P. (2021) · SHS Web of Conferences · doi:10.1051/shsconf/20219204011 · Cited by 37
Conversational Agents for Elderly Interaction
Pinto, N., França, J. B. D. S., Sousa, H. P., Vivacqua, A. S., & García, A. C. B. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437883 · Cited by 29
“…main characteristics, applications, evaluation measures [5], architectures, data types [10], ways and methods for implementation of personalization [9], illnesses tackled and agents’ capabilities [3], screening, treatments, diagnosis of mental health [11], and the effects of design features [6] in…”
BackgroundMethodResultConversational Physical Activity Coaches for Spanish and English Speaking Women: A User Design Study
Figueroa, C. A., Luo, T. C., Jacobo, A., Munoz, A., Manuel, M., Chan, D., Canny, J., & Aguilera, A. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.747153 · Cited by 29
“The field of digital health has seen an increase in interest in conversational agents, or chatbots, to help individuals pursue healthy lifestyles (9).”
BackgroundFridolin: participatory design and evaluation of a nutrition chatbot for older adults
Weber, P. P., Mahmood, F., Ahmadi, M., von Jan, V., Ludwig, T. G., & Wieching, R. (2023) · i-com · doi:10.1515/icom-2022-0042 · Cited by 22
Metadata
- Authors
- Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Ministerio de Salud (AR)
- Corresponding author
- Kocaballi, Ahmet Baki
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-11-07
- Volume
- 21
- Issue
- 11
- Pages
- e15360
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6873147
- OpenAlex
- W2972203331
- Semantic Scholar
- c99dffde110ac8a193caa027af1172372a92e896
- Cited by
- 332
- References
- 65
- Citations by year
- 2026: 57 · 2025: 64 · 2024: 47 · 2023: 56 · 2022: 38 · 2021: 48 · 2020: 21 · 2019: 1
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion, other-oa)
- Greater South Information System
- Funders
- Directorate for Computer and Information Science and Engineering
- Medical Research Council
- National Health and Medical Research Council (1134919)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, personalization, health care, natural language interfaces, personalized feedback, user satisfaction, user engagement, dialogue quality, patient safety, privacy, decision support
- MeSH terms
- Delivery of Health Care, Humans, Precision Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
