The potential of conversational agents to provide a rapid HIV counseling and testing services
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
In low-and middle-income countries where demand for health services outstrips the available supply of skilled labor, advances in information and communication technologies have already been shown to hold promise. While much of the mHealth literature continues to explore mature technologies such as text message and web portals, continual advancement in machine learning opens innovative new areas of exploration for public health practitioners. This paper explores one such possibility, a conversational agent, able to guide users through an HIV counseling and testing session. Using commercially available software (http://api.ai), an agent was designed and built according to the Center for Disease Control's guidelines for the provision of HIV counseling and testing in a non-clinical setting. The agent was linked to the Telegram chat client (http://telegram.org) and 10 testers were invited to participate in a simulated HIV counseling interaction. Six testers found that talking to the agent felt natural, and equivalent to chatting to a human. Seven said they would feel comfortable taking a real HIV test with the agent. Key concerns with the current agent were the use of overly formal language, the speed at which the agent responded (too fast) and the agent either misunderstanding or not understanding the tester. Positive sentiment towards the agent included the fact that testers felt like the session was more private and anonymous, and avoided the need for them to visit a public health facility and stand in a long queue to get tested.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, the conversational agent in the study by van Heerden et al [78] was well received when used as a counseling tool because it was given an avatar-like profile image and the conversation was embedded in a familiar chat interface, which users associated with talking to another human being.”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [78]
In the citing paper
“A further 3 studies were concerned with sexual health and/or HIV management [45,59,78].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [78]
In the citing paper
“With phone, mobile, and online platforms being widely accessible, conversational agents can support populations with limited access to health care or poor health literacy [16,17].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [16]
In the citing paper
“The widespread availability of the digital platforms through which these conversational agents operate enables populations with limited health provision or health literacy to access these services”
From Effectiveness of Conversational Agents (Virtual Assistants) in Health Care: Protocol for a Systematic Review (2020) · cites this paper as [14]
In the citing paper
“The investigated uses for these systems include triage, diagnostics, counseling, health promotion, and training of health care professionals [1,4,11-16].”
From Effectiveness of Conversational Agents (Virtual Assistants) in Health Care: Protocol for a Systematic Review (2020) · cites this paper as [14]
Citations
Cites
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727 · cited 1×
“The potential impact of rapidly advancing technology on the future of employment has some scholars worried and others not [1], [2].”
BackgroundVinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Research Commentary—The Digital Transformation of Healthcare: Current Status and the Road Ahead
Agarwal, R., Gao, G. (., DesRoches, C., & Jha, A. K. (2010) · Information Systems Research · doi:10.1287/isre.1100.0327 · Cited by 952
Health and Health Care in South Africa — 20 Years after Mandela
Mayosi, B. M., & Benatar, S. R. (2014) · New England Journal of Medicine · doi:10.1056/nejmsr1405012 · Cited by 533
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · cited 1×
“Exploration of conversational agents in a health care setting suggest that users are accepting [14] of, and can form a working alliance with [15], embodied conversational agents.”
BackgroundSharma, M., Ying, R., Tarr, G., & Barnabas, R. (2015) · Nature · doi:10.1038/nature16044 · Cited by 491 · cited 1×
“This could be a particularly useful model for men who are well known to be less frequent users of public health facilities due to issues of privacy, clinics not being male friendly spaces and the waiting times required during working hours [18].”
BackgroundAlthoff, T., Clark, K., & Leskovec, J. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00111 · Cited by 322 · cited 2×
“2 million messages sent by 408 counselors, [11] were able to construct a model able to predict, with an accuracy of 59%, the likelihood of a counseling session ending positively, after reviewing the first 20% of a conversation between a client and counselor.”
BackgroundResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218
Strauss, M., Rhodes, D., & George, G. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0922-0 · Cited by 98
Makusha, T., Knight, L., Taegtmeyer, M., Tulloch, O., Davids, A., Lim, J., Peck, R. B., & van Rooyen, H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0122783 · Cited by 98
Behavioral Health Care and Technology: Using Science-Based Innovations to Transform Practice
(2014) · doi:10.1093/med/9780199314027.001.0001 · Cited by 67 · cited 1×
“Further, the potential of technology-based self-service channels and digital health interventions to support patients in their everyday life is beginning to be documented [12], [13].”
BackgroundThe Labor Market for Health Workers in Africa
Soucat, A., & Scheffler, R. (2013) · World Bank, Washington, DC eBooks · doi:10.1596/978-0-8213-9555-4 · Cited by 64
Kwapong, G. D., Boateng, D., Agyei-Baffour, P., & Addy, E. A. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-267 · Cited by 63
The Political Economy of AIDS in Africa
Poku, N. K. (2017) · Routledge eBooks · doi:10.4324/9781315237756 · Cited by 60
van Heerden, A., Harris, D. M., van Rooyen, H., Barnabas, R. V., Ramanathan, N., Ngcobo, N., Mpiyakhe, Z., & Comulada, W. S. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.04.046 · Cited by 41 · cited 1×
“Home and community based HIV testing are well established areas of research and best practices described in this literature could provide a solid foundation for the hand-over to care component of the agent [19].”
BackgroundThe Labor Market for Health Workers in Africa : New Look at the CrisisPreprint
Soucat, A. L. B., & Scheffler, R. M. (2013) · RePEc: Research Papers in Economics · Cited by 34
Home self-testing for HIV: AIDS exceptionalism gone wrong
Richter, M. L., Venter, F., & Gray, A. (2010) · South African Medical Journal · doi:10.7196/samj.4198 · Cited by 32
Acceptability of Embodied Conversational Agent in a Health Care Context
Micoulaud‐Franchi, J., Sagaspe, P., de Sevin, É., Bioulac, S., Sauteraud, A., & Philip, P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47665-0_45 · Cited by 28
Research works printed but not linked: 2
- 2016, Implementing HIV Testing in Nonclinical Settings A Guide for HIV Testing Providers
- bessen, 2017, Automation and Jobs: Technology Boosts Employment, Boston
Cited by
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
“Moreover, 19 studies allowed free text user inputs [45,48,51,56,57,60,61,66,69,70,72,74,77,78,80,81,85,86,89], and 4 studies used both fixed and free text user inputs [53,64,65,73].”
BackgroundMethodInfluentialThe Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
“With phone, mobile, and online platforms being widely accessible, conversational agents can support populations with limited access to health care or poor health literacy [16,17].”
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322
A critical review of state‐of‐the‐art chatbot designs and applications
Luo, B., Lau, R. Y. K., Li, C., & Si, Y. (2022) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1434 · Cited by 224
“When a virtual agent developed by Van Heerden et al. (2017) was used to guide counseling sessions before HIV tests, the test takers said they felt comfortable talking with chatbots as the chatbots offered more privacy than humans.”
MethodUsing Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199
“This permits to respond to patients in need, Bespecially when they feel trapped at certain point during their treatment^; and – [53], where authors suggest for chatbots dealing with very sensitive health- conditions like AIDS, the need for users to Brequest to talk to a trained counselor" at any time, and that the bot…”
BackgroundInfluential
Metadata
- Authors
- van Heerden, A., Ntinga, X., & Vilakazi, K.
- Affiliations
- Human Sciences Research Council (ZA)
- Venue
- 2017 International Conference on the Frontiers and Advances in Data Science (FADS)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 80-85
- OpenAlex
- W2784186660
- Cited by
- 57
- References
- 18
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 7 · 2023: 9 · 2022: 10 · 2021: 10 · 2020: 6 · 2019: 4
- FWCI
- 18.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on the Frontiers and Advances in Data Science (FADS) (publishedVersion)
- Funders
- Centers for Disease Control and Prevention
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Infectious Diseases › HIV/AIDS Research and Interventions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- chatbots, HIV counseling and testing, mobile health, Telegram chatbot, low- and middle-income countries, user acceptance, privacy and anonymity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.