Conversational Agents in Health Care: Scoping Review of Their Behavior Change Techniques and Underpinning Theory
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Background: Conversational agents (CAs) are increasingly used in health care to deliver behavior change interventions. Their evaluation often includes categorizing the behavior change techniques (BCTs) using a classification system of which the BCT Taxonomy v1 (BCTTv1) is one of the most common. Previous studies have presented descriptive summaries of behavior change interventions delivered by CAs, but no in-depth study reporting the use of BCTs in these interventions has been published to date. Objective: This review aims to describe behavior change interventions delivered by CAs and to identify the BCTs and theories guiding their design. Methods: We searched PubMed, Embase, Cochrane’s Central Register of Controlled Trials, and the first 10 pages of Google and Google Scholar in April 2021. We included primary, experimental studies evaluating a behavior change intervention delivered by a CA. BCTs coding followed the BCTTv1. Two independent reviewers selected the studies and extracted the data. Descriptive analysis and frequent itemset mining to identify BCT clusters were performed. Results: We included 47 studies reporting on mental health (n=19, 40%), chronic disorders (n=14, 30%), and lifestyle change (n=14, 30%) interventions. There were 20/47 embodied CAs (43%) and 27/47 CAs (57%) represented a female character. Most CAs were rule based (34/47, 72%). Experimental interventions included 63 BCTs, (mean 9 BCTs; range 2-21 BCTs), while comparisons included 32 BCTs (mean 2 BCTs; range 2-17 BCTs). Most interventions included BCTs 4.1 “Instruction on how to perform a behavior” (34/47, 72%), 3.3 “Social support” (emotional; 27/47, 57%), and 1.2 “Problem solving” (24/47, 51%). A total of 12/47 studies (26%) were informed by a behavior change theory, mainly the Transtheoretical Model and the Social Cognitive Theory. Studies using the same behavior change theory included different BCTs. Conclusions: There is a need for the more explicit use of behavior change theories and improved reporting of BCTs in CA interventions to enhance the analysis of intervention effectiveness and improve the reproducibility of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Self-citationGuidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 5×
“%) were RCTs [6,11,33,35-37, 39-41, 44,45, 49”
InfluentialWebb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 1×
“Our findings align with previous systematic reviews reporting that similar BCTs were frequently incorporated into effective lifestyle change interventions [82], or into digitally delivered interventions [15].”
Self-citationThe role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387
Mental health literacy: empowering the community to take action for better mental health
Jorm, A. F. (2012) · American Psychologist · doi:10.1037/a0025957 · Cited by 1,783 · cited 1×
“…1.1) and reviews (BCT 1.5), problem solving (BCT 1.2), and feedback (BCT 2.2), may be aligned with general principles of patient participation in decision making [85], as well as highlight the importance of health education [86,87], particularly relevant in self-initiated digital interventions.”
InfluentialKwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1151372 · Cited by 1,476
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Samdal, G. B., Eide, G. E., Barth, T., Williams, G., & Meland, E. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0494-y · Cited by 788
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Michie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680
Self-citationThe Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · cited 1×
“In general, health care CAs appear to be effective in improving individuals’ outcomes [11,12] and are acceptable to users, who often describe them as friendly and trustworthy.”
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
Self-citationFreeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M., & Nickless, A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30226-8 · Cited by 377
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
A randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 4×
“Comparison interventions included a nurse-led instruction mirroring the CA intervention [50], physical activity monitoring using a pedometer [63], provision of information [57,58], treatment as usual [51-53], and waitlist controls [54,55].”
InfluentialGreer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265 · cited 2×
“Multimedia Appendix 3 presents a summary of the studies included in this review [6,11, 32-79 32-79].”
Effectiveness of an Empathic Chatbot in Combating Adverse Effects of Social Exclusion on Mood
de Gennaro, M., Krumhuber, E. G., & Lucas, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03061 · Cited by 265
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · cited 3×
“Four CAs (Carmen [74-76], Tanya [52,53,68], Tess [37,62], and Todaki [41,43]) were reported in 2 papers each, and 2 CAs (Gabby [70-73] and MYLO [34,38,39]) were reported in 3 manuscripts.”
Depp, C. A., Ceglowski, J., Wang, V. C., Yaghouti, F., Mausbach, B. T., Thompson, W. K., & Granholm, E. L. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.053 · Cited by 215 · cited 3×
“%) were RCTs [6,33-37, 39, 41,45,46].”
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · cited 6×
“Other studies focused on asthma [61], atrial fibrillation [52,53], HIV [49], hypertension [50], insomnia [60], irritable bowel syndrome [55], and prostate cancer [59].”
InfluentialSelf-citationAutomated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206
Using Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199 · cited 1×
“…as a systematic review reporting on the use of BCTs in effective digital diabetes prevention interventions [15], a mapping review offering a description of the current uses of CAs for behavior change [16], and a scoping review describing the use of embodied CAs to support healthy lifestyle [17].”
Gilbert, S., Mehl, A., Baluch, A., Cawley, C., Challiner, J., Fraser, H., Millen, E., Montazeri, M., Multmeier, J., Pick, F., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040269 · Cited by 183 · cited 1×
“…needs, such as providing timely information [5], supporting mental health disorder management [6,7], assisting with triage in clinical settings [8,9], supporting chronic disease self-management, or delivering lifestyle change interventions, such as physical activity [10] and dietary changes,…”
Van Rhoon, L., Byrne, M., Morrissey, E., Murphy, J., & McSharry, J. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620914427 · Cited by 182
Watson, A., Bickmore, T., Cange, A., Kulshreshtha, A., & Kvedar, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1629 · Cited by 180 · cited 4×
“%) targeted a metabolic disorder including obesity (n=1) [63], prediabetes (n=1) [62], or type 2 diabetes (n=2) [51,56].”
InfluentialMaher, C. A., Davis, C. R., Curtis, R. G., Short, C. E., & Murphy, K. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/17558 · Cited by 165 · cited 2×
“%) study was a single-group pretest-posttest trial [65,66], while most studies (11/14, 79”
Gong, E., Baptista, S., Russell, A., Scuffham, P., Riddell, M., Speight, J., Bird, D., Williams, E., Lotfaliany, M., & Oldenburg, B. (2020) · Journal of Medical Internet Research · doi:10.2196/20322 · Cited by 159 · cited 3×
“Comparison interventions included a nurse-led instruction mirroring the CA intervention [50], physical activity monitoring using a pedometer [63], provision of information [57,58], treatment as usual [51-53], and waitlist controls [54,55].”
Stephens, T. N., Joerin, A., Rauws, M., & Werk, L. N. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz043 · Cited by 150
Gardiner, P. M., McCue, K. D., Negash, L. M., Cheng, T., White, L. F., Yinusa-Nyahkoon, L., Jack, B. W., & Bickmore, T. W. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.04.015 · Cited by 139 · cited 1×
“%) included interventions to support lifestyle modification [11,64-79], particularly increasing physical activity (10/14, 71%), either as the sole intervention (n=6) [64,69,74-77, 79] or in combination Among this, 1/14 (7”
Perski, O., Crane, D., Beard, E., & Brown, J. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619880676 · Cited by 135
Burton, C., Szentagotai Tatar, A., McKinstry, B., Matheson, C., Matu, S., Moldovan, R., Macnab, M., Farrow, E., David, D., Pagliari, C., et al. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15609793 · Cited by 125 · cited 2×
“[34,35,38-40, 45,”
Oh, J., Jang, S., Kim, H., & Kim, J.-J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104171 · Cited by 124 · cited 1×
“[34,35,38-40, 45,”
Gaffney, H., Mansell, W., Edwards, R., & Wright, J. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581300060x · Cited by 122 · cited 3×
“[34,35,38-40, 45,”
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · cited 1×
“…as a systematic review reporting on the use of BCTs in effective digital diabetes prevention interventions [15], a mapping review offering a description of the current uses of CAs for behavior change [16], and a scoping review describing the use of embodied CAs to support healthy lifestyle [17].”
Miller, S., Gilbert, S., Virani, V., & Wicks, P. (2020) · JMIR Human Factors · doi:10.2196/19713 · Cited by 117 · cited 1×
“…needs, such as providing timely information [5], supporting mental health disorder management [6,7], assisting with triage in clinical settings [8,9], supporting chronic disease self-management, or delivering lifestyle change interventions, such as physical activity [10] and dietary changes,…”
King, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114
Suganuma, S., Sakamoto, D., & Shimoyama, H. (2018) · JMIR Mental Health · doi:10.2196/10454 · Cited by 112 · cited 1×
“[6,32-47,79,80], All except 2 interventions [44,47] included a control group, and 10/19 studies (53”
Bird, T., Mansell, W., Wright, J., Gaffney, H., & Tai, S. (2018) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465817000820 · Cited by 109 · cited 2×
“%) were RCTs [6,33-37, 39, 41,45,46].”
Virtual training and coaching of health behavior: Example from mindfulness meditation training
Hudlicka, E. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.007 · Cited by 104 · cited 1×
“[6,32-47,79,80], All except 2 interventions [44,47] included a control group, and 10/19 studies (53”
Eisele, A., Schagg, D., Krämer, L. V., Bengel, J., & Göhner, W. (2019) · Patient Education and Counseling · doi:10.1016/j.pec.2018.09.018 · Cited by 104 · cited 1×
“…management [6,7], assisting with triage in clinical settings [8,9], supporting chronic disease self-management, or delivering lifestyle change interventions, such as physical activity [10] and dietary changes, that increasingly incorporate elements of behavior change in the intervention design.”
Kowatsch, T., Schachner, T., Harperink, S., Barata, F., Dittler, U., Xiao, G., Stanger, C., v Wangenheim, F., Fleisch, E., Oswald, H., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25060 · Cited by 103 · cited 1×
“Other studies focused on asthma [61], atrial fibrillation [52,53], HIV [49], hypertension [50], insomnia [60], irritable bowel syndrome [55], and prostate cancer [59].”
Self-citationReducing preconception risks among African American women with conversational agent technology
Jack, B., Bickmore, T., Hempstead, M., Yinusa-Nyahkoon, L., Sadikova, E., Mitchell, S., Gardiner, P., Adigun, F., Penti, B., Schulman, D., et al. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.04.140327 · Cited by 99
Kramer, J.-N., Künzler, F., Mishra, V., Smith, S. N., Kotz, D., Scholz, U., Fleisch, E., & Kowatsch, T. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa002 · Cited by 84 · cited 3×
“%) studies [65,71-76, 78, 79] The use of theories aimed to guide the design of the intervention or to monitor participants’ stages of change as they progressed through the intervention, as exemplified by 3 studies [71-73 , 78] using the Transtheoretical Model and 1”
Self-citationPiao, M., Ryu, H., Lee, H., & Kim, J. (2020) · JMIR mHealth and uHealth · doi:10.2196/15085 · Cited by 75 · cited 2×
“%) studies [65,71-76, 78, 79] The use of theories aimed to guide the design of the intervention or to monitor participants’ stages of change as they progressed through the intervention, as exemplified by 3 studies [71-73 , 78] using the Transtheoretical Model and 1”
Friederichs, S., Bolman, C., Oenema, A., Guyaux, J., & Lechner, L. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2974 · Cited by 69 · cited 4×
“Four CAs (Carmen [74-76], Tanya [52,53,68], Tess [37,62], and Todaki [41,43]) were reported in 2 papers each, and 2 CAs (Gabby [70-73] and MYLO [34,38,39]) were reported in 3 manuscripts.”
InfluentialBennion, M. R., Hardy, G. E., Moore, R. K., Kellett, S., & Millings, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16794 · Cited by 68 · cited 4×
“%) were RCTs [6,33-37, 39, 41,45,46].”
InfluentialOwens, O. L., Felder, T., Tavakoli, A. S., Revels, A. A., Friedman, D. B., Hughes-Halbert, C., & Hébert, J. R. (2019) · American Journal of Health Promotion · doi:10.1177/0890117118786866 · Cited by 65
Use of an interactive computer agent to support breastfeeding
Edwards, R. A., Bickmore, T., Jenkins, L., Foley, M., & Manjourides, J. (2013) · Maternal and Child Health Journal · doi:10.1007/s10995-013-1222-0 · Cited by 63
The Atrial Fibrillation Health Literacy Information Technology System: Pilot Assessment
Magnani, J. W., Schlusser, C. L., Kimani, E., Rollman, B. L., Paasche-Orlow, M. K., & Bickmore, T. W. (2017) · JMIR Cardio · doi:10.2196/cardio.8543 · Cited by 46 · cited 4×
“[51,52,54].”
InfluentialAli, R., Hoque, E., Duberstein, P., Schubert, L., Razavi, S. Z., Kane, B., Silva, C., Daks, J. S., Huang, M., & Van Orden, K. (2021) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2020.11.004 · Cited by 38 · cited 2×
“[34,35,38-40, 45,”
Bendig, E., Erb, B., Meißner, E., Bauereiß, N., & Baumeister, H. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100377 · Cited by 24 · cited 2×
“%) were RCTs [6,33-37, 39, 41,45,46].”
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Supporting Sustainable Health Behavior Change: The Whole Is Greater Than the Sum of Its Parts
Matthews, J. A., Matthews, S., Faries, M. D., & Wolever, R. Q. (2024) · Mayo Clinic Proceedings: Innovations, Quality & Outcomes · doi:10.1016/j.mayocpiqo.2023.10.002 · Cited by 64
Cho, Y., Rai, S., Ungar, L., Sedoc, J., & Guntuku, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.698 · Cited by 33
Schläpfer, S., Schneider, F., Santhanam, P., Eicher, M., Kowatsch, T., Witt, C. M., & Barth, J. (2024) · JMIR Cancer · doi:10.2196/52386 · Cited by 14
Self-citation
Metadata
- Authors
- Martinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M.-H. R., Kowatsch, T., Atun, R., Michie, S., & Tudor Car, L.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-03
- Volume
- 24
- Issue
- 10
- Pages
- e39243
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4293027534
- Cited by
- 49
- References
- 54
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.