Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Background: Artificial intelligence (AI) is increasingly being used in healthcare. Here, AI-based chatbot systems can act as automated conversational agents, capable of promoting health, providing education, and potentially prompting behaviour change. Exploring the motivation to use health chatbots is required to predict uptake; however, few studies to date have explored their acceptability. This research aimed to explore participants’ willingness to engage with AI-led health chatbots. Methods: The study incorporated semi-structured interviews (N-29) which informed the development of an online survey (N-216) advertised via social media. Interviews were recorded, transcribed verbatim and analysed thematically. A survey of 24 items explored demographic and attitudinal variables, including acceptability and perceived utility. The quantitative data were analysed using binary regressions with a single categorical predictor. Results: Three broad themes: ‘Understanding of chatbots’, ‘AI hesitancy’ and ‘Motivations for health chatbots’ were identified, outlining concerns about accuracy, cyber-security, and the inability of AI-led services to empathise. The survey showed moderate acceptability (67%), correlated negatively with perceived poorer IT skills OR = 0.32 [CI 95% :0.13–0.78] and dislike for talking to computers OR = 0.77 [CI 95% :0.60–0.99] as well as positively correlated with perceived utility OR = 5.10 [CI 95% :3.08–8.43], positive attitude OR = 2.71 [CI 95% :1.77–4.16] and perceived trustworthiness OR = 1.92 [CI 95% :1.13–3.25]. Conclusion: Most internet users would be receptive to using health chatbots, although hesitancy regarding this technology is likely to compromise engagement. Intervention designers focusing on AI-led health chatbots need to employ user-centred and theory-based approaches addressing patients’ concerns and optimising user experience in order to achieve the best uptake and utilisation. Patients’ perspectives, motivation and capabilities need to be taken into account when developing and assessing the effectiveness of health chatbots.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A further 3 studies were concerned with sexual health and/or HIV management [45,59,78].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In some studies, patients reported the need to assess the usefulness of the AI before using it and had concerns around the quality and accuracy of the output, thereby questioning the value of AI as a whole [39,42,52-55].”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Lack of accuracy; doubts about unsafe results; privacy breaches; patients’ perceptions and acceptance of automation; and uncertainty about developers’ reliability, availability, usability, and perceived usefulness were found to be obstacles to gaining trust [39,42,47,50,53,54,69,70].”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The lack of accuracy of AI output was also considered to pose a potential risk of harm by both clinicians and patients, as, in some cases where the algorithm may output false negative results, it may provide an incorrect sense of reassurance and cause a delay in treatment.”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Data security was identified as a major contributor toward hesitancy, with concerns around cybersecurity relating to both training and testing data as well as fear of trackers and spyware obtaining unsolicited data [39,41,42,45,48,77].”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1×
“Thematic analysis 27 was conducted on qualitative data to identify common patterns and trends.”
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837 · cited 1×
“AI has been applied in medicine and various healthcare services such as diagnostic imaging and genetic diagnosis, as well as clinical laboratory, screening and health communications.(2,3) These systems aid physicians by providing pertinent medical information in order to reduce diagnostic or therapeutic errors, and al…”
BackgroundSekhon, M., Cartwright, M., & Francis, J. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2031-8 · Cited by 3,938 · cited 1×
“The acceptability of a healthcare intervention is a multi-faceted construct based on a range of dimensions including burden, values, effectiveness, cognition, and emotional responses.(22) A study of 100 physicians in the US concluded that although the majority believed chatbots could assist with scheduling doctors’ ap…”
BackgroundThe practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Vaccine hesitancy: An overview
Dubé, E., Laberge, C., Guay, M., Bramadat, P., Roy, R., & Bettinger, J. A. (2013) · Human Vaccines & Immunotherapeutics · doi:10.4161/hv.24657 · Cited by 2,172
Yardley, L., Morrison, L., Bradbury, K., & Muller, I. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4055 · Cited by 1,442 · cited 1×
“30 These approaches require a thorough investigation into the awareness, comprehension and motivation for the use of novel health interventions.”
BackgroundThe ethics of artificial intelligence
Bostrom, N., & Yudkowsky, E. (2014) · The Cambridge Handbook of Artificial Intelligence · doi:10.1017/cbo9781139046855.020 · Cited by 918
Mixing methods in a qualitatively driven way
Mason, J. (2006) · Qualitative Research · doi:10.1177/1468794106058866 · Cited by 828 · cited 1×
“We used a mixed-methods approach(24) to assist in creative knowledge generation of a multi-layered issue.(25) Specifically, we incorporated face-to-face semi-structured interviews and an online survey format to explore the motivations for the use of chatbots in healthcare.”
MethodCommunities of Practice: A Research Paradigm for the Mixed Methods Approach
Denscombe, M. (2008) · Journal of Mixed Methods Research · doi:10.1177/1558689808316807 · Cited by 713 · cited 1×
“We used a mixed-methods approach 24 to assist in creative knowledge generation of a multi-layered issue.”
MethodHo, A., Hancock, J., & Miner, A. S. (2018) · Journal of Communication · doi:10.1093/joc/jqy026 · Cited by 629 · cited 1×
“This is in line with previous research showing that users might be as likely to disclose emotional and factual information to a chatbot as they do to a human partner.(31) The perceived understanding, disclosure intimacy and cognitive reappraisal were similar in conversations conducted with chatbots and humans, indicat…”
ResultPhysicians’ perceptions of chatbots in health Care: cross-sectional web-based survey
Palanica, A., Flaschner, P., Thommandram, A., Li, M., & Fossat, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/12887 · Cited by 384
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322 · cited 1×
“11 For example, chatbots can provide instant responses to health-related enquiries from patients while looking for specific patterns of symptoms in predicting disease, as presented by the internet-based Doc-Bot delivered via mobile phone or a Messenger-based chatbot for outpatient and translational…”
BackgroundOh, K.-J., Lee, D., Ko, B., & Choi, H.-J. (2017) · 2017 18th IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2017.64 · Cited by 285
Morris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273 · cited 1×
“21 There is little research on health chatbot acceptability and motivations for its use.”
BackgroundHoermann, S., McCabe, K. L., Milne, D. N., & Calvo, R. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7023 · Cited by 263
Crutzen, R., Peters, G.-J. Y., Portugal, S. D., Fisser, E. M., & Grolleman, J. J. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.09.002 · Cited by 205 · cited 1×
“13 The users had positive views on the chatbot with emphasis on its anonymity as well as the quality and the speed of receiving information in comparison to popular search engines.”
BackgroundWard, R. (2013) · Health Policy and Technology · doi:10.1016/j.hlpt.2013.07.002 · Cited by 171 · cited 1×
“According to the Diffusion of Innovation theories, the implementation of new technologies is a process in which the adoption is dependent on widespread awareness, understanding and utilisation.(29) Adopters are generally divided into innovators, early adopters, majority users and laggards.”
MethodI'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Addressing challenges in promoting healthy lifestyles: the al-chatbot approach
Fadhil, A., & Gabrielli, S. (2017) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3154862.3154914 · Cited by 156
Pharmabot: A Pediatric Generic Medicine Consultant Chatbot
Comendador, B. E. V., Francisco, B. M. B., Medenilla, J. S., Nacion, S. M. T., & Serac, T. B. E. (2015) · Journal of Automation and Control Engineering · doi:10.12720/joace.3.2.137-140 · Cited by 150 · cited 1×
“5 8 The chatbot technology allows for such activities as specific health surveys, setting up personal health-related reminders, communication with clinical teams, booking appointments, retrieving and analysing health data or the translation of diagnostic patterns taking into account behavioural…”
BackgroundSuganuma, S., Sakamoto, D., & Shimoyama, H. (2018) · JMIR Mental Health · doi:10.2196/10454 · Cited by 112 · cited 1×
“19 For example, Ly et al. demonstrated the effectiveness of a chatbot based on cognitive behavioural therapy and positive psychology interactions in the non-clinical population.”
BackgroundGrolleman, J., van Dijk, B., Nijholt, A., & van Emst, A. J. (2006) · Lecture notes in computer science · doi:10.1007/11755494_19 · Cited by 75 · cited 1×
“The acceptability rate in the present study is comparable to the acceptability level of 49% within a Dutch cohort offered use of a chatbot for smoking cessation.(16) Nevertheless, Laufer has already argued that the social acceptability of AI systems is compromised by the ambiguous status of ‘artificial’, which has neg…”
ResultA Conversational Agent for an Online Mental Health Intervention
Elmasri, D., & Maeder, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-47103-7_24 · Cited by 68
Quro: Facilitating User Symptom Check Using a Personalised Chatbot-Oriented Dialogue System
Ghosh, S., Bhatia, S., & Bhatia, A. (2018) · Studies in health technology and informatics · doi:10.3233/978-1-61499-890-7-51 · Cited by 60
Abashev, A., Grigoryev, R. A., Grigorian, K., & Boyko, V. (2016) · BioNanoScience · doi:10.1007/s12668-016-0376-9 · Cited by 45 · cited 1×
“The chatbot technology allows for such activities as specific health surveys, setting up personal health-related reminders, communication with clinical teams, booking appointments, retrieving and analysing health data or the translation of diagnostic patterns taking into account behavioural indicators such as physical…”
BackgroundNHS long term plan: Care to be shifted away from hospitals in “21st century” service model
Iacobucci, G. (2019) · BMJ · doi:10.1136/bmj.l85 · Cited by 31 · cited 1×
“digitalisation of healthcare services in the UK offers access to large pools of clinical data such as medical notes, electronic records, physical and laboratory examination or patient demographic and behavioural characteristics.(4) It is anticipated that by 2024, every patient in England would have digital access to p…”
BackgroundMobile based healthcare management using artificial intelligence
Tripathy, A. K., Carvalho, R., Pawaskar, K., Yadav, S. P., & Yadav, V. K. (2015) · International Conference on Technologies for Sustainable Development (ICTSD) · doi:10.1109/ictsd.2015.7095895 · Cited by 30 · cited 1×
“12 They can be tailored to specific populations, health conditions or behaviours.”
BackgroundThe Role of Agent Technologies in Personalized Medicine
Ivanović, M. D., & Semnic, M. D. (2018) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai.2018.8599421 · Cited by 22 · cited 1×
“Chatbots, as part of AI devices, are natural language processing systems acting as a virtual conversational agent mimicking human interactions.(5) While this technology is still in its developmental phase, health chatbots could potentially increase access to healthcare, improve doctor–patient and clinic–patient commun…”
Background
Research works printed but not linked: 4
- Ghosh S, 2018, Stud Health Technol Inform, 252, 51
- Razzaki S, 2018, arXiv preprint arXiv, 1806, 10698
- Gehl RW., 2014, Transformations, 24, 56
- Laufer R., 2000, Artif Intell Crit Concept, 4, 343
Cited by
Ethical and regulatory challenges of AI technologies in healthcare: A narrative review
Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26297 · Cited by 1,229
A Review of the Role of Artificial Intelligence in Healthcare
Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu, A. V., Al Muhanna, D., & Al-Muhanna, F. A. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13060951 · Cited by 915
Rapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
Do AI chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
“In the study by Nadarzynski et al [59] , users favored the conversational agent because of its ubiquity as a convenient smartphone app and its ability to perform remote services such as video consultation, potentially alleviating any inhibitions users may have around discussing sexual health in…”
BackgroundMethodInfluential
Metadata
- Authors
- Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D.
- Affiliations
- University of Westminster (GB)
- University College London (GB)
- University of Southampton (GB)
- Corresponding author
- Nadarzynski, Tom
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2019-01
- Volume
- 5
- Pages
- 2055207619871808-2055207619871808
- ISSN
- 2055-2076 (ISSN-L)
- PMC
- PMC6704417
- OpenAlex
- W2969468266
- Cited by
- 810
- References
- 29
- Citations by year
- 2026: 120 · 2025: 184 · 2024: 153 · 2023: 144 · 2022: 88 · 2021: 81 · 2020: 40
- FWCI
- 16.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Digital Health (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- WestminsterResearch (University of Westminster) (acceptedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Southampton
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- healthcare chatbots, artificial intelligence in healthcare, technology acceptability, user motivation, perceived usefulness, trustworthiness, empathy gap, information technology skills, user-centered design, patient engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.