CoChat

Testing the Feasibility and Acceptability of Using an Artificial Intelligence Chatbot to Promote HIV Testing and Pre-Exposure Prophylaxis in Malaysia: Mixed Methods Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Abstract

Background: The HIV epidemic continues to grow fastest among men who have sex with men (MSM) in Malaysia in the presence of stigma and discrimination. Engaging MSM on the internet using chatbots supported through artificial intelligence (AI) can potentially help HIV prevention efforts. We previously identified the benefits, limitations, and preferred features of HIV prevention AI chatbots and developed an AI chatbot prototype that is now tested for feasibility and acceptability. Objective: This study aims to test the feasibility and acceptability of an AI chatbot in promoting the uptake of HIV testing and pre-exposure prophylaxis (PrEP) in MSM. Methods: We conducted beta testing with 14 MSM from February to April 2022 using Zoom (Zoom Video Communications, Inc). Beta testing involved 3 steps: a 45-minute human-chatbot interaction using the think-aloud method, a 35-minute semistructured interview, and a 10-minute web-based survey. The first 2 steps were recorded, transcribed verbatim, and analyzed using the Unified Theory of Acceptance and Use of Technology. Emerging themes from the qualitative data were mapped on the 4 domains of the Unified Theory of Acceptance and Use of Technology: performance expectancy, effort expectancy, facilitating conditions, and social influence. Results: Most participants (13/14, 93%) perceived the chatbot to be useful because it provided comprehensive information on HIV testing and PrEP (performance expectancy). All participants indicated that the chatbot was easy to use because of its simple, straightforward design and quick, friendly responses (effort expectancy). Moreover, 93% (13/14) of the participants rated the overall chatbot quality as high, and all participants perceived the chatbot as a helpful tool and would refer it to others. Approximately 79% (11/14) of the participants agreed they would continue using the chatbot. They suggested adding a local language (ie, Bahasa Malaysia) to customize the chatbot to the Malaysian context (facilitating condition) and suggested that the chatbot should also incorporate more information on mental health, HIV risk assessment, and consequences of HIV. In terms of social influence, all participants perceived the chatbot as helpful in avoiding stigma-inducing interactions and thus could increase the frequency of HIV testing and PrEP uptake among MSM. Conclusions: The current AI chatbot is feasible and acceptable to promote the uptake of HIV testing and PrEP. To ensure the successful implementation and dissemination of AI chatbots in Malaysia, they should be customized to communicate in Bahasa Malaysia and upgraded to provide other HIV-related information to improve usability, such as mental health support, risk assessment for sexually transmitted infections, AIDS treatment, and the consequences of contracting HIV.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/52055

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Study procedure. MIST: Malaysian Implementation Science Training; RA: research assistant.
Figure 1 Study procedure. MIST: Malaysian Implementation Science Training; RA: research assistant.CC BY · PubMed Central
Figure 2 Feasibility ratings of the chatbot.
Figure 2 Feasibility ratings of the chatbot.CC BY · PubMed Central
Figure 3 System Usability Scale outcomes.
Figure 3 System Usability Scale outcomes.CC BY · PubMed Central
Figure 4 Adjusted Chatbot Usability Scale outcomes.
Figure 4 Adjusted Chatbot Usability Scale outcomes.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 61

Metadata

Authors
Cheah, M. H., Gan, Y. N., Altice, F. L., Wickersham, J. A., Shrestha, R., Salleh, N. A. M., Ng, K. S., Azwa, I., Balakrishnan, V., Kamarulzaman, A., & Ni, Z.
Affiliations
  • University of Malaya (MY)
  • Yale University (US)
  • University of Connecticut (US)
  • Monash University Malaysia (MY)
Corresponding author
Ni, Zhao
Venue
JMIR Human Factors
Published
2024-01-26
Volume
11
Pages
e52055
ISSN
2292-9495 (ISSN-L)
OpenAlex
W4391254127
Cited by
53
References
26
Citations by year
2026: 24 · 2025: 23 · 2024: 6
FWCI
18.33
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Human Factors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Monash University Research Portal (Monash University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Yale University
  • National Institutes of Health (UL1TR001863)
  • National Institute of Allergy and Infectious Diseases (R21AI152927)
  • Fogarty International Center (R33TW011663, D43TW011324, R21TW011663)
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
AI chatbots, HIV testing, pre-exposure prophylaxis, men who have sex with men, HIV prevention, feasibility and acceptability, Unified Theory of Acceptance and Use of Technology, beta testing, think-aloud, HIV stigma, digital health interventions, Malaysia, mental health support, HIV risk assessment, social influence, performance expectancy, effort expectancy
MeSH terms
Sexual and Gender Minorities, HIV Testing, Acquired Immunodeficiency Syndrome, Artificial Intelligence, Feasibility Studies, Humans, Malaysia, Male, Patient Acceptance of Health Care, HIV Infections, Homosexuality, Male, Pre-Exposure Prophylaxis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.