Effectiveness and acceptability of conversational agents for sexual health promotion: a systematic review and meta-analysis
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Digital health interventions for sexual health promotion have evolved considerably alongside innovations in technology. Despite these efforts, studies have shown that they do not consistently result in the desired sexual health outcomes. This could be attributed to low levels of user engagement, which can hinder digital health intervention effectiveness, as users do not engage with the system enough to be exposed to the intervention components. It has been suggested that conversational agents (automated two-way communication systems e.g. Alexa) have the potential to overcome the limitations of prior systems and promote user engagement through the increased interactivity offered by bidirectional, natural language-based interactions. The present review, therefore, provides an overview of the effectiveness and user acceptability of conversational agents for sexual health promotion. A systematic search of seven databases provided 4534 records, and after screening, 31 articles were included in this review. A narrative synthesis of results was conducted for effectiveness and acceptability outcomes, with the former supplemented by a meta-analysis conducted on a subset of studies. Findings provide preliminary support for the effectiveness of conversational agents for promoting sexual health, particularly treatment adherence. These conversational agents were found to be easy to use and useful, and importantly, resulted in high levels of satisfaction, use and intentions to reuse, whereas user evaluations regarding the quality of information left room for improvement. The results can inform subsequent efforts to design and evaluate these interventions, and offer insight into additional user experience constructs identified outside of current technology acceptance models, which can be incorporated into future theoretical developments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
Privacy in the age of medical big data
Price, W. N., & Cohen, I. G. (2019) · Nature Medicine · doi:10.1038/s41591-018-0272-7 · Cited by 1,522
AI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Go, E., & Sundar, S. S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.01.020 · Cited by 1,089
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048
Does the technology acceptance model predict actual use? A systematic literature review
Turner, M., Kitchenham, B., Brereton, P., Charters, S., & Budgen, D. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2009.11.005 · Cited by 851
Evaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Understanding the attitude and intention to use smartphone chatbots for shopping
Kasilingam, D. L. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101280 · Cited by 636
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
Brouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455
Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot
Liu, B., & Sundar, S. S. (2018) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0110 · Cited by 447
Tsai, W.-H. S., Liu, Y., & Chuan, C.-H. (2021) · Journal of Research in Interactive Marketing · doi:10.1108/jrim-12-2019-0200 · Cited by 394
Evaluating and Informing the Design of Chatbots
Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196735 · Cited by 376
The Personalization of Conversational Agents in Health Care: Systematic Review
Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/15360 · Cited by 332
"Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage
Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196772 · Cited by 327
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322
SMS STI: A Review of the Uses of Mobile Phone Text Messaging in Sexual Health
Lim, M. S. C., Hocking, J. S., Hellard, M. E., & Aitken, C. K. (2008) · International Journal of STD & AIDS · doi:10.1258/ijsa.2007.007264 · Cited by 293
Croes, E. A. J., & Antheunis, M. L. (2021) · Journal of Social and Personal Relationships · doi:10.1177/0265407520959463 · Cited by 291
Conversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Effectiveness of an Empathic Chatbot in Combating Adverse Effects of Social Exclusion on Mood
de Gennaro, M., Krumhuber, E. G., & Lucas, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03061 · Cited by 265
MAINTAINING ENGAGEMENT IN LONG-TERM INTERVENTIONS WITH RELATIONAL AGENTS
Bickmore, T., Schulman, D., & Yin, L. (2010) · Applied Artificial Intelligence · doi:10.1080/08839514.2010.492259 · Cited by 246
mHealth for HIV Treatment & Prevention: A Systematic Review of the Literature
Catalani, C., Philbrick, W., Fraser, H., Mechael, & Israelski, D. M. (2013) · The Open AIDS Journal · doi:10.2174/1874613620130812003 · Cited by 230
Crutzen, R., Peters, G.-J. Y., Portugal, S. D., Fisser, E. M., & Grolleman, J. J. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.09.002 · Cited by 205
Using Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199 · cited 4×
“Furthermore, CAs particularly hold promise as a more innovative way to communicate with younger users 44,45 given their high digital literacy and familiarity with chat applications.”
InfluentialMa, P. H. X., Chan, Z. C. Y., & Loke, A. Y. (2017) · AIDS and Behavior · doi:10.1007/s10461-017-1818-2 · Cited by 180
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
I'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Cole-Lewis, H., Ezeanochie, N., & Turgiss, J. (2019) · JMIR Formative Research · doi:10.2196/14052 · Cited by 155
Bérubé, C., Schachner, T., Keller, R., Fleisch, E., v Wangenheim, F., Barata, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/25933 · Cited by 133
Scope and effectiveness of mobile phone messaging for HIV/AIDS care: A systematic review
Velthoven, M. H. M. M. T. V., Brusamento, S., Majeed, A., & Car, J. (2013) · Psychology, Health & Medicine · doi:10.1080/13548506.2012.701310 · Cited by 96
de Cosmo, L. M., Piper, L., & Di Vittorio, A. (2021) · Italian Journal of Marketing · doi:10.1007/s43039-021-00020-1 · Cited by 82
Pot, M., Paulussen, T. G., Ruiter, R. A., Eekhout, I., de Melker, H. E., Spoelstra, M. E., & van Keulen, H. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7449 · Cited by 62 · cited 4×
“HPV vaccine attitude and uptake was the subject of three studies, targeting either mothers 59,78 or young adults 79 .”
InfluentialThe potential of conversational agents to provide a rapid HIV counseling and testing services
van Heerden, A., Ntinga, X., & Vilakazi, K. (2017) · 2017 International Conference on the Frontiers and Advances in Data Science (FADS) · doi:10.1109/fads.2017.8253198 · Cited by 57
Park, H., & Lee, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445133 · Cited by 44
Dworkin, M., Chakraborty, A., Lee, S., Monahan, C., Hightow-Weidman, L., Garofalo, R., Qato, D., & Jimenez, A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10211 · Cited by 43
Design of a Culturally-Informed Virtual Human for Educating Hispanic Women about Cervical Cancer
Mendu, S., Boukhechba, M., Gordon, J. R., Datta, D., Molina, E., Arroyo, G., Proctor, S. K., Wells, K. J., & Barnes, L. E. (2018) · Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3240925.3240968 · Cited by 28
Amith, M., Lin, R., Cunningham, R., Wu, Q. L., Savas, L. S., Gong, Y., Boom, J. A., Tang, L., & Tao, C. (2020) · arXiv · doi:10.48550/arxiv.2001.02306 · Cited by 14
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024
Döring, N., Le, T. D., Vowels, L. M., Vowels, M. J., & Marcantonio, T. L. (2024) · Current Sexual Health Reports · doi:10.1007/s11930-024-00397-y · Cited by 65
Bragazzi, N. L., Crapanzano, A., Converti, M., Zerbetto, R., & Khamisy-Farah, R. (2023) · Journal of Medical Internet Research · doi:10.2196/52091 · Cited by 54
Liew, T. W., Tan, S.-M., Yoo, N. E., Gan, C. L., & Lee, Y. Y. (2023) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2023.100323 · Cited by 33
Metadata
- Authors
- Balaji, D., He, L., Giani, S., Bosse, T., Wiers, R., & de Bruijn, G.-J.
- Venue
- Sexual Health
- Publisher
- CSIRO Publishing
- Published
- 2022-07-22
- Volume
- 19
- Issue
- 5
- Pages
- 391-405
- ISSN
- 1448-5028 (ISSN-L)
- 1449-8987
- OpenAlex
- W4286541694
- Cited by
- 44
- References
- 38
- FWCI
- 1.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.