Formative Evaluation of the Acceptance of HIV Prevention Artificial Intelligence Chatbots By Men Who Have Sex With Men in Malaysia: Focus Group Study
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Background: Mobile technologies are being increasingly developed to support the practice of medicine, nursing, and public health, including HIV testing and prevention. Chatbots using artificial intelligence (AI) are novel mobile health strategies that can promote HIV testing and prevention among men who have sex with men (MSM) in Malaysia, a hard-to-reach population at elevated risk of HIV, yet little is known about the features that are important to this key population. Objective: The aim of this study was to identify the barriers to and facilitators of Malaysian MSM’s acceptance of an AI chatbot designed to assist in HIV testing and prevention in relation to its perceived benefits, limitations, and preferred features among potential users. Methods: We conducted 5 structured web-based focus group interviews with 31 MSM in Malaysia between July 2021 and September 2021. The interviews were first recorded, transcribed, coded, and thematically analyzed using NVivo (version 9; QSR International). Subsequently, the unified theory of acceptance and use of technology was used to guide data analysis to map emerging themes related to the barriers to and facilitators of chatbot acceptance onto its 4 domains: performance expectancy, effort expectancy, facilitating conditions, and social influence. Results: Multiple barriers and facilitators influencing MSM’s acceptance of an AI chatbot were identified for each domain. Performance expectancy (ie, the perceived usefulness of the AI chatbot) was influenced by MSM’s concerns about the AI chatbot’s ability to deliver accurate information, its effectiveness in information dissemination and problem-solving, and its ability to provide emotional support and raise health awareness. Convenience, cost, and technical errors influenced the AI chatbot’s effort expectancy (ie, the perceived ease of use). Efficient linkage to health care professionals and HIV self-testing was reported as a facilitating condition of MSM’s receptiveness to using an AI chatbot to access HIV testing. Participants stated that social influence (ie, sociopolitical climate) factors influencing the acceptance of mobile technology that addressed HIV in Malaysia included privacy concerns, pervasive stigma against homosexuality, and the criminalization of same-sex sexual behaviors. Key design strategies that could enhance MSM’s acceptance of an HIV prevention AI chatbot included an anonymous user setting; embedding the chatbot in MSM-friendly web-based platforms; and providing user-guiding questions and options related to HIV testing, prevention, and treatment. Conclusions: This study provides important insights into key features and potential implementation strategies central to designing an AI chatbot as a culturally sensitive digital health tool to prevent stigmatized health conditions in vulnerable and systematically marginalized populations. Such features not only are crucial to designing effective user-centered and culturally situated mobile health interventions for MSM in Malaysia but also illuminate the importance of incorporating social stigma considerations into health technology implementation strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several of the investigated chatbots address HIV prevention in countries such as Brazil [63] and Malaysia [60,64] and in populations such as MSM (i.e., men who have sex with men) or transgender youth.”
From The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024 (2024) · cites this paper as [64]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Kallio, H., Pietilä, A., Johnson, M., & Kangasniemi, M. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.13031 · Cited by 4,295
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1×
“Following the advances in natural language processing (NLP) and artificial intelligence (AI), AI chatbots, broadly referring to computer programs with minimal design interfaces embedded with AI to simulate conversation with human users, have been developed as mHealth strategies to support patient care and identified a…”
BackgroundFocus group discussion: a tool for health and medical research.
Wong, L. P. (2008) · PubMed · Cited by 801
Kijsanayotin, B., Pannarunothai, S., & Speedie, S. M. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.12.005 · Cited by 746
Adoption of ICT in a government organization in a developing country: An empirical study
Gupta, B., Dasgupta, S., & Gupta, A. (2008) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2007.12.004 · Cited by 579
Xu, L., Sanders, L., Li, K., & Chow, J. C. L. (2021) · JMIR Cancer · doi:10.2196/27850 · Cited by 571 · cited 1×
“A 2021 systematic review of the application of AI chatbots in health care and oncology accentuated the potential of integrating AI chatbots into clinical practice to reduce costs, improve patient outcomes, and enhance health practitioners’work efficiencies [20].”
BackgroundAdoption of social media for public relations by nonprofit organizations
Curtis, L., Edwards, C., Fraser, K. L., Gudelsky, S., Holmquist, J., Thornton, K., & Sweetser, K. D. (2010) · Public Relations Review · doi:10.1016/j.pubrev.2009.10.003 · Cited by 441
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440 · cited 1×
“of AI chatbots was particularly significant compared with conventional mHealth interventions [21].”
BackgroundGeneralizability in qualitative research: a tale of two traditions
Carminati, L. (2018) · Qualitative Health Research · doi:10.1177/1049732318788379 · Cited by 401
Who Influences Whom? Analyzing Workplace Referents’ Social Influence on it Adoption and Non-Adoption
Eckhardt, A., Laumer, S., & Weitzel, T. (2009) · Journal of Information Technology · doi:10.1057/jit.2008.31 · Cited by 287
Schachner, T., Keller, R., & v Wangenheim, F. (2020) · Journal of Medical Internet Research · doi:10.2196/20701 · Cited by 267 · cited 1×
“Chatbots are software-based programs that imitate human conversational agents to interact with users [18].”
BackgroundDiNenno, E. A., Prejean, J., Irwin, K., Delaney, K. P., Bowles, K., Martin, T., Tailor, A., Dumitru, G., Mullins, M. M., Hutchinson, A. B., et al. (2017) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6631a3 · Cited by 238
Substance use and sexual transmission risk behavior of HIV-positive men who have sex with men
Purcell, D. W., Parsons, J. T., Halkitis, P. N., Mizuno, Y., & Woods, W. J. (2001) · Journal of Substance Abuse · doi:10.1016/s0899-3289(01)00072-4 · Cited by 228
Chaix, B., Bibault, J.-E., Pienkowski, A., Delamon, G., Guillemassé, A., Nectoux, P., & Brouard, B. (2019) · JMIR Cancer · doi:10.2196/12856 · Cited by 227
Charismatic leadership and user acceptance of information technology
Neufeld, D. J., Dong, L., & Higgins, C. (2007) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000682 · Cited by 204
Parviainen, J., & Rantala, J. (2022) · Medicine, Health Care and Philosophy · doi:10.1007/s11019-021-10049-w · Cited by 146
mHealth Interventions To Support Self-Management In HIV: A Systematic Review
Cooper, V., Clatworthy, J., Whetham, J., & Consortium, E. (2017) · The Open AIDS Journal · doi:10.2174/1874613601711010119 · Cited by 139
EXAMINING HEALTHCARE PROFESSIONALS' ACCEPTANCE OF ELECTRONIC MEDICAL RECORDS USING UTAUT
(2008) · Issues In Information Systems · doi:10.48009/2_iis_2008_396-401 · Cited by 137
Poteat, T., Diouf, D., Drame, F., Ndaw, M., Traore, C., Dhaliwal, M., Beyrer, C., & Baral, S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028760 · Cited by 133
Chatbot use cases in the Covid-19 public health response
Amiri, P., & Karahanna, E. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac014 · Cited by 129
Information and communication technologies in the life of university freshmen: An analysis of change
Verhoeven, J. C., Heerwegh, D., & Wit, K. D. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.12.002 · Cited by 120
Sewell, J., Cambiano, V., Speakman, A., Lampe, F. C., Phillips, A. N., Stuart, D., Gilson, R. J. C., Asboe, D., Nwokolo, N. C., Clarke, A. E., et al. (2019) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2019.03.021 · Cited by 113
Resistance to change and the adoption of digital libraries: An integrative model
Nov, O., & Ye, C. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21068 · Cited by 108
SlimMe, a Chatbot With Artificial Empathy for Personal Weight Management: System Design and Finding
Rahmanti, A. R., Yang, H., Bintoro, B. S., Nursetyo, A. A., Muhtar, M. S., Syed-Abdul, S., & Li, Y. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2022.870775 · Cited by 93
Nadri, H., Rahimi, B., Afshar, H. L., Samadbeik, M., & Garavand, A. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1641595 · Cited by 92
Udo, G. G., Bagchi, K. K., & Maity, M. (2014) · Journal of Business Ethics · doi:10.1007/s10551-014-2484-1 · Cited by 86
Lim, S. H., Cheung, D. H., Guadamuz, T. E., Wei, C., Koe, S., & Altice, F. L. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.02.040 · Cited by 71
Self-citationEarnshaw, V. A., Jin, H., Wickersham, J. A., Kamarulzaman, A., John, J., Lim, S. H., & Altice, F. L. (2015) · AIDS and Behavior · doi:10.1007/s10461-015-1168-x · Cited by 54
Self-citationBaral, S., Turner, R. M., Lyons, C. E., Howell, S., Honermann, B., Garner, A., Hess, R., III, Diouf, D., Ayala, G., Sullivan, P. S., et al. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.9321 · Cited by 54
Bourne, A. H., Cassolato, M., Wei, C. K. T., Wang, B., Pang, J., Lim, S. H., Azwa, I., Yee, I., & Mburu, G. (2017) · Journal of the International AIDS Society · doi:10.7448/ias.20.1.21899 · Cited by 51
Self-citationPai, N. P., Esmail, A., Saha‐Chaudhuri, P., Oelofse, S., Pretorius, M., Marathe, G., Daher, J., Smallwood, M., Karatzas, N., Fadul, M., et al. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-006032 · Cited by 44
Acceptance of an Informational Antituberculosis Chatbot Among Korean Adults: Mixed Methods Research
Kim, A. J., Yang, J., Jang, Y., & Baek, J. S. (2021) · JMIR mHealth and uHealth · doi:10.2196/26424 · Cited by 35
Duthely, L. M., & Covarrubias, A. P. S. (2020) · Frontiers in Communication · doi:10.3389/fcomm.2020.530164 · Cited by 33
CROI 2019: advances in HIV prevention and plans to end the epidemic.
Buchbinder, S., & Liu, A. (2019) · Europe PMC (PubMed Central) · Cited by 29
Loos, J., Manirankunda, L., Platteau, T., Albers, L., Fransen, K., Vermoesen, T., Namanya, F., & Nöstlinger, C. (2016) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.5519 · Cited by 26
Wood, O. R., Garofalo, R., Kuhns, L. M., Scherr, T., Zetina, A. P. M., Rodriguez, R. G., Nash, N., Cervantes, M., & Schnall, R. (2021) · BMC Public Health · doi:10.1186/s12889-021-12015-w · Cited by 22
HIV-Syphilis Co-infection Among MSM in Malaysia
DiDomizio, E. E. (2019) · Cited by 2
Research works printed but not linked: 4
- HIV in Men Who Have Sex with MenThe Lancet20127202022-05-21https://www.thelancet.com/series/hiv-in-men-who-have-sex-with-men
- Buchbinder, SP, 2019, Top Antivir Med, 27, 8
- Wong, LP, 2008, Singapore Med J, 49, 256
- MayerPVollandDThiesseFFleischEUser Acceptance of 'Smart Products': An Empirical InvestigationWirtschaftinformatik Proceedings20112020-12-10https://www.researchgate.net/publication/221200885_User_Acceptance_of_'Smart_Products'_An_Empirical_Investigation
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024
Döring, N., Le, T. D., Vowels, L. M., Vowels, M. J., & Marcantonio, T. L. (2024) · Current Sexual Health Reports · doi:10.1007/s11930-024-00397-y · Cited by 65
Cheah, M. H., Gan, Y. N., Altice, F. L., Wickersham, J. A., Shrestha, R., Salleh, N. A. M., Ng, K. S., Azwa, I., Balakrishnan, V., Kamarulzaman, A., et al. (2024) · JMIR Human Factors · doi:10.2196/52055 · Cited by 53
“From our previous formative research, we know that factors facilitating the acceptance of an HIV prevention AI chatbot include providing useful information and having the capacity to solve problems [13].”
BackgroundMethodResultInfluentialSelf-citationChatbots for HIV Prevention and Care: a Narrative Review
van Heerden, A., Bosman, S., Swendeman, D. T., & Comulada, W. (2023) · Current HIV/AIDS Reports · doi:10.1007/s11904-023-00681-x · Cited by 40
Metadata
- Authors
- Peng, M. L., Wickersham, J. A., Altice, F. L., Shrestha, R., Azwa, I., Zhou, X., Halim, M. A. A., Ikhtiaruddin, W. M., Tee, V., Kamarulzaman, A., & Ni, Z.
- Affiliations
- Yale University (US)
- University of Connecticut (US)
- University of Malaya (MY)
- Corresponding author
- Ni, Zhao
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-06
- Volume
- 6
- Issue
- 10
- Pages
- e42055
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC9585446
- OpenAlex
- W4302762917
- Cited by
- 44
- References
- 42
- Citations by year
- 2026: 11 · 2025: 16 · 2024: 10 · 2023: 7
- FWCI
- 9.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Institutes of Health (UL1TR001863)
- National Institute on Drug Abuse (K01DA051346)
- National Institute of Allergy and Infectious Diseases (R21AI152927)
- Fogarty International Center (R33TW011663, R33TW011665, R21TW011665, R21TW011663)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- HIV prevention, AI chatbots, men who have sex with men, technology acceptance, UTAUT, HIV self-testing, mobile health, barriers and facilitators, HIV testing, social stigma, privacy concerns, Malaysia, key populations, emotional support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.