Factors Influencing the Acceptability, Acceptance, and Adoption of Conversational Agents in Health Care: Integrative Review
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Background: Conversational agents (CAs), also known as chatbots, are digital dialog systems that enable people to have a text-based, speech-based, or nonverbal conversation with a computer or another machine based on natural language via an interface. The use of CAs offers new opportunities and various benefits for health care. However, they are not yet ubiquitous in daily practice. Nevertheless, research regarding the implementation of CAs in health care has grown tremendously in recent years. Objective: This review aims to present a synthesis of the factors that facilitate or hinder the implementation of CAs from the perspectives of patients and health care professionals. Specifically, it focuses on the early implementation outcomes of acceptability, acceptance, and adoption as cornerstones of later implementation success. Methods: We performed an integrative review. To identify relevant literature, a broad literature search was conducted in June 2021 with no date limits and using all fields in PubMed, Cochrane Library, Web of Science, LIVIVO, and PsycINFO. To keep the review current, another search was conducted in March 2022. To identify as many eligible primary sources as possible, we used a snowballing approach by searching reference lists and conducted a hand search. Factors influencing the acceptability, acceptance, and adoption of CAs in health care were coded through parallel deductive and inductive approaches, which were informed by current technology acceptance and adoption models. Finally, the factors were synthesized in a thematic map. Results: Overall, 76 studies were included in this review. We identified influencing factors related to 4 core Unified Theory of Acceptance and Use of Technology (UTAUT) and Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) factors (performance expectancy, effort expectancy, facilitating conditions, and hedonic motivation), with most studies underlining the relevance of performance and effort expectancy. To meet the particularities of the health care context, we redefined the UTAUT2 factors social influence, habit, and price value. We identified 6 other influencing factors: perceived risk, trust, anthropomorphism, health issue, working alliance, and user characteristics. Overall, we identified 10 factors influencing acceptability, acceptance, and adoption among health care professionals (performance expectancy, effort expectancy, facilitating conditions, social influence, price value, perceived risk, trust, anthropomorphism, working alliance, and user characteristics) and 13 factors influencing acceptability, acceptance, and adoption among patients (additionally hedonic motivation, habit, and health issue). Conclusions: This review shows manifold factors influencing the acceptability, acceptance, and adoption of CAs in health care. Knowledge of these factors is fundamental for implementation planning. Therefore, the findings of this review can serve as a basis for future studies to develop appropriate implementation strategies. Furthermore, this review provides an empirical test of current technology acceptance and adoption models and identifies areas where additional research is necessary. Trial Registration: PROSPERO CRD42022343690; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=343690
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
The integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“This should enable users to better understand the information displayed and its origin and then decide whether to trust the technology’s recommendation [134].”
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700 · cited 1×
“The search strategy was cross-checked with the Guideline Statement for Electronic Search Strategies [73].”
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737
Integrative review: what is it? How to do it?
Souza, M. T. D., Silva, M. D. D., & Carvalho, R. D. (2010) · Einstein (São Paulo) · doi:10.1590/s1679-45082010rw1134 · Cited by 3,883
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Toward a hierarchical model of intrinsic and extrinsic motivation
Vallerand, R. J. (1997) · Advances in experimental social psychology · doi:10.1016/s0065-2601(08)60019-2 · Cited by 3,198
Assessing IT Usage: The Role of Prior Experience
Taylor, S., & Todd, P. (1995) · MIS Quarterly · doi:10.2307/249633 · Cited by 2,891
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 3×
“A light-hearted, fun, and friendly personality was valued [56,78,93,105].”
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 2×
“One promising technology is conversational agents (CAs), also known as chatbots [3,4].”
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333 · cited 3×
“In addition, systems should have a sense of humor as well as empathy and talk to the user about the present relationship to maintain it [34].”
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“A rapid review is a form of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce evidence-based information in a timely manner [155].”
Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model
Heerink, M., Kröse, B., Evers, V., & Wielinga, B. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0068-5 · Cited by 1,229
Who Sees Human?: The Stability and Importance of Individual Differences in Anthropomorphism
Waytz, A., Cacioppo, J., & Epley, N. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610369336 · Cited by 1,228
Trust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185 · cited 2×
“Whereas trust in the provider refers to patients’ beliefs about the provider’s benevolence, integrity, and competence, trust in the technology refers to patients’ beliefs about the system’s benevolence, functionality, helpfulness, and reliability [126,133].”
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 2×
“Overall, both health care professionals and patients clearly recognize the benefits of CAs in health care, which has already been shown in a number of studies [41,128].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 3×
“One promising technology is conversational agents (CAs), also known as chatbots [3,4].”
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977 · cited 3×
“In addition, studies demonstrated that the health care provided by a CA is comparable with that provided by human physicians [44,45].”
Inference of attitudes from nonverbal communication in two channels.
Mehrabian, A., & Ferris, S. R. (1967) · Journal of Consulting Psychology · doi:10.1037/h0024648 · Cited by 952
Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810 · cited 10×
“Mild health problems were found to increase the acceptability, acceptance, and adoption rate of CAs; however, for more serious problems, patients were less willing to use a CA and preferred to be treated or advised by a human [54,57,79,83,89,97,107].”
InfluentialBrandtzaeg, P. B., & Følstad, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70284-1_30 · Cited by 788 · cited 2×
“Furthermore, their ability to communicate in multiple languages has been discussed [1,39].”
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Internet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595 · cited 3×
“Furthermore, their ability to communicate in multiple languages has been discussed [1,39].”
McTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594
Chaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553 · cited 3×
“Furthermore, systems that allow acoustic communication can also be used by patients with low or no literacy skills [40,148].”
Survey on Chatbot Design Techniques in Speech Conversation Systems
A., S., & John, D. (2015) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2015.060712 · Cited by 479
Innovation Adoption: A Review of Theories and Constructs
Wisdom, J. P., Chor, K. H. B., Hoagwood, K. E., & Horwitz, S. M. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0486-4 · Cited by 451 · cited 2×
“These studies were assigned to the term “adoption” [47].”
Predicting the intentions to use chatbots for travel and tourism
Melián-González, S., Gutiérrez-Taño, D., & Bulchand-Gidumal, J. (2021) · Current Issues in Tourism · doi:10.1080/13683500.2019.1706457 · Cited by 406 · cited 1×
“Moreover, previous work on CAs has already indicated that perceived anthropomorphism can influence CA acceptability, acceptance, and adoption [130].”
Physicians’ perceptions of chatbots in health Care: cross-sectional web-based survey
Palanica, A., Flaschner, P., Thommandram, A., Li, M., & Fossat, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/12887 · Cited by 384 · cited 10×
“In particular, the freedom of time and space for patients when using a CA and the real-time feedback provided during home exercises were seen as major advantages [26,29,76,77,85].”
Influential'It's just like you talk to a friend': relational agents for older adults
Bickmore, T. W., Caruso, L., Clough-Gorr, K., & Heeren, T. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2005.09.002 · Cited by 341 · cited 10×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
InfluentialReporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301 · cited 1×
“Overall, both health care professionals and patients clearly recognize the benefits of CAs in health care, which has already been shown in a number of studies [41,128].”
Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents
Bickmore, T. W., Pfeifer, L. M., & Jack, B. W. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518891 · Cited by 289 · cited 2×
“Nonverbal cues such as facial expressions, gestures, posture, and body movements have a significant impact on guided communication, as they convey empathy, thereby strengthening the therapeutic alliance and trust relationship between patients and CAs [30,33,34,43].”
Conversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Greer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265 · cited 1×
“…[25] • Heart disease [18,83,112] • HIV [14] • Adiposities [26] • Smoking cessation [113] • Substance misuse [93,114] • Sickle cell disease [115] • Drug information and risk minimization measures by physicians [116] Rehabilitation • Mental health [38,88,117] • Cancer [117,118] • Pregnancy care [88]”
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · cited 3×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226 · cited 1×
“For quality appraisal, we followed the guidelines for rapid reviews [153,154].”
Martinez-Martin, N., & Kreitmair, K. (2018) · JMIR Mental Health · doi:10.2196/mental.9423 · Cited by 221 · cited 1×
“The literature on digital health applications also frequently discussed whether patient safety is compromised [141] and who is responsible if the CA misdiagnoses someone [4].”
Maintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · cited 4×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
InfluentialCrutzen, R., Peters, G.-J. Y., Portugal, S. D., Fisser, E. M., & Grolleman, J. J. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.09.002 · Cited by 205 · cited 1×
“Mental health [23,88] • Family health history [10,20,94] • Pregnancy care [88,95] • Health adviser and promoter [81,91] • Vaccination [96] • Sexual health advice [57,97] • Health care for children [98] • Healthy lifestyle behavior [28,99] • Exercise and sun protection [19] • Tuberculosis [92] •…”
Toward a Psychological Science of Advanced Technology Design for Older Adults
Rogers, W. A., & Fisk, A. D. (2010) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/gbq065 · Cited by 204 · cited 1×
“It has already been demonstrated that the environment in which the interaction occurs influences technological acceptability, acceptance, and adoption [127,156].”
Klos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L. (2021) · JMIR Formative Research · doi:10.2196/20678 · Cited by 200 · cited 2×
“Moreover, increasing use made the interaction with the CA more familiar, which affected both the trust relationship and the therapeutic relationship between a patient and a CA [15,16,19,79,106].”
Design Features of Embodied Conversational Agents in eHealth: a Literature Review
ter Stal, S., Kramer, L. L., Tabak, M., op den Akker, H., & Hermens, H. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102409 · Cited by 188 · cited 2×
“The broader literature also criticized the fact that, to date, most studies have examined the use of CAs in controlled environments rather than in real-world contexts [148,157].”
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
Digital mental health apps and the therapeutic alliance: initial review
Henson, P., Wisniewski, H., Hollis, C., Keshavan, M., & Torous, J. (2019) · BJPsych Open · doi:10.1192/bjo.2018.86 · Cited by 152 · cited 1×
“Therefore, it is suggested that trust in health CAs should always be systematically assessed XSL • FO RenderX before deployment. and validated scales to measure trust are lacking, especially in medicine [138].”
Oh, J., Jang, S., Kim, H., & Kim, J.-J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104171 · Cited by 124 · cited 4×
“…from the included studies also suggested that many users rated the performance expectancy of CAs as low because they felt that the technology was not yet sophisticated enough to address complex health issues or detect symptoms of less common health conditions or diseases [54-56,79 ,97 ,103 ,104 ].”
InfluentialFirst Impressions in Human--Agent Virtual Encounters
Cafaro, A., Vilhjálmsson, H. H., & Bickmore, T. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2940325 · Cited by 120 · cited 1×
“Static features include the appearance of the system, and dynamic features include the verbal and nonverbal behaviors of the system [136].”
Prochaska, J. J., Vogel, E. A., Chieng, A., Baiocchi, M., Maglalang, D. D., Pajarito, S., Weingardt, K. R., Darcy, A., & Robinson, A. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2021.108986 · Cited by 113 · cited 5×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
Influentialter Stal, S., Tabak, M., op den Akker, H., Beinema, T., & Hermens, H. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1699744 · Cited by 102
Scholten, M. R., Kelders, S. M., & Van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7351 · Cited by 97 · cited 1×
“Some studies even showed that the empathic abilities of CAs can be compared with those of a real person [149].”
Mobile phone-based asthma self-management aid for adolescents (mASMAA): a feasibility study
Rhee, H., Allen, J., Mammen, J., & Swift, M. (2014) · Patient Preference and Adherence · doi:10.2147/ppa.s53504 · Cited by 96
Easton, K., Potter, S., Bec, R., Bennion, M., Christensen, H., Grindell, C., Mirheidari, B., Weich, S., de Witte, L., Wolstenholme, D., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12996 · Cited by 88 · cited 7×
“In addition, the system should have the ability to interact with other digital services and home devices, such as calendars, smart home technology, and existing medical devices or applications [21,24,26,28,55,113,120].”
InfluentialMartínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79 · cited 4×
“…[25] • Heart disease [18,83,112] • HIV [14] • Adiposities [26] • Smoking cessation [113] • Substance misuse [93,114] • Sickle cell disease [115] • Drug information and risk minimization measures by physicians [116] Rehabilitation • Mental health [38,88,117] • Cancer [117,118] • Pregnancy care [88]”
InfluentialAssistive Conversational Agent for Health Coaching: A Validation Study
Fadhil, A., Wang, Y., & Reiterer, H. (2019) · Methods of Information in Medicine · doi:10.1055/s-0039-1688757 · Cited by 77 · cited 1×
“Mental health [23,88] • Family health history [10,20,94] • Pregnancy care [88,95] • Health adviser and promoter [81,91] • Vaccination [96] • Sexual health advice [57,97] • Health care for children [98] • Healthy lifestyle behavior [28,99] • Exercise and sun protection [19] • Tuberculosis [92] •…”
Bennion, M. R., Hardy, G. E., Moore, R. K., Kellett, S., & Millings, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16794 · Cited by 68
To, Q. G., Green, C., & Vandelanotte, C. (2021) · JMIR mHealth and uHealth · doi:10.2196/28577 · Cited by 68 · cited 1×
“…• Health care for children [98] • Healthy lifestyle behavior [28,99] • Exercise and sun protection [19] • Tuberculosis [92] • Physical activity [100] • Cancer [90] • • Pregnancy care [110] • Genetic counseling [111] • Chronic pain [82] • Diabetes [17,78] • Sleeping concerns [25] • Heart…”
User reactions to COVID-19 screening chatbots from reputable providers
Dennis, A. R., Kim, A., Raimi, R., & Ayabakan, S. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa167 · Cited by 59
Sillice, M. A., Morokoff, P. J., Ferszt, G., Bickmore, T., Bock, B. C., Lantini, R., & Velicer, W. F. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.7640 · Cited by 56 · cited 10×
“%) long-term study conducted for >12 months [19] and 2 (3”
InfluentialBray, L., Sharpe, A., Gichuru, P., Fortune, P.-M., Blake, L., & Appleton, V. (2020) · Journal of Medical Internet Research · doi:10.2196/17367 · Cited by 50 · cited 1×
“…• Pregnancy care [88,95] • Health adviser and promoter [81,91] • Vaccination [96] • Sexual health advice [57,97] • Health care for children [98] • Healthy lifestyle behavior [28,99] • Exercise and sun protection [19] • Tuberculosis [92] • Physical activity [100] • Cancer [90] • • Pregnancy…”
The Atrial Fibrillation Health Literacy Information Technology System: Pilot Assessment
Magnani, J. W., Schlusser, C. L., Kimani, E., Rollman, B. L., Paasche-Orlow, M. K., & Bickmore, T. W. (2017) · JMIR Cardio · doi:10.2196/cardio.8543 · Cited by 46 · cited 2×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
Dworkin, M., Chakraborty, A., Lee, S., Monahan, C., Hightow-Weidman, L., Garofalo, R., Qato, D., & Jimenez, A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10211 · Cited by 43
Chatbot Acceptance: A Latent Profile Analysis on Individuals' Trust in Conversational Agents
Müller, L., Mattke, J., Maier, C., Weitzel, T., & Graser, H. (2019) · Proceedings of the 2019 on Computers and People Research Conference · doi:10.1145/3322385.3322392 · Cited by 42
Issom, D.-Z., Hardy-Dessources, M.-D., Romana, M., Hartvigsen, G., & Lovis, C. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.600333 · Cited by 39 · cited 3×
“Some patients reported that they experienced judgment and blame for their conditions from real people [19,21, 42,54,56,77-79, 90, 93-95 93-95, 97, 102,107, 108, 115].”
Kowatsch, T., Lohse, K.-M., Erb, V., Schittenhelm, L., Galliker, H., Lehner, R., & Huang, E. M. (2021) · Journal of Medical Internet Research · doi:10.2196/23612 · Cited by 39
Stara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/25891 · Cited by 36
Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study
ter Stal, S., Broekhuis, M., van Velsen, L., Hermens, H., & Tabak, M. (2020) · JMIR Human Factors · doi:10.2196/19987 · Cited by 36 · cited 9×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
InfluentialUsability and acceptability assessment of an empathic virtual agent to prevent major depression
Bresó, A., Martínez‐Miranda, J., Botella, C., Baños, R. M., & García‐Gómez, J. M. (2016) · Expert Systems · doi:10.1111/exsy.12151 · Cited by 36 · cited 10×
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
InfluentialThe Use of Smart Speakers in Care Home Residents: Implementation Study
Edwards, K. J., Jones, R. B., Shenton, D., Page, T., Maramba, I., Warren, A., Fraser, F., Križaj, T., Coombe, T., Cowls, H., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/26767 · Cited by 32 · cited 10×
“Moreover, the technology should be easily connected and combined with other devices [85,116].”
InfluentialBendig, E., Erb, B., Meißner, E., Bauereiß, N., & Baumeister, H. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100377 · Cited by 24 · cited 8×
“%) of the 76 studies, “acceptability,” “acceptance,” “adoption,” or a synonym was part of the research question or primary research objective [13,21, 22,27,55,56,76,83,89,90].”
InfluentialBaptista, S., Wadley, G., Bird, D., Oldenburg, B., Speight, J., & The My Diabetes Coach Research Group (2020) · JMIR mHealth and uHealth · doi:10.2196/17038 · Cited by 3 · cited 10×
“Similar to how an authoritarian health care professional would be less accepted by patients, if the CA was perceived as an authority figure, the system was less accepted by patients [78].”
Influential
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Lee, H. S., Wright, C., Ferranto, J., Buttimer, J., Palmer, C. E., Welchman, A., Mazor, K. M., Fisher, K. A., Smelson, D., O’Connor, L., et al. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1505024 · Cited by 55
Peng, C., Zhang, S., Wen, F., & Liu, K. (2025) · Current Psychology · doi:10.1007/s12144-024-06809-5 · Cited by 42
Jiang, X.-H., Yuan, X.-H., Zhao, H., & Peng, J.-S. (2025) · Journal of Medical Internet Research · doi:10.2196/76968 · Cited by 10
Metadata
- Authors
- Wutz, M., Hermes, M., Winter, V., & Köberlein-Neu, J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-09-26
- Volume
- 25
- Pages
- e46548
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4383824240
- Cited by
- 99
- References
- 77
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.