Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
BACKGROUND A virtual conversational agent is a program that typically utilizes artificial intelligence technology to mimic human interactions. Many robust and high-quality clinical trials have been conducted to test the effectiveness of conversational agent-based interventions. However, there is a lack of systematic reviews of randomized controlled trials that evaluate the effects of artificial intelligence-driven conversational agents in healthcare interventions. OBJECTIVE To examine the feasibility and effectiveness of conversational agent-based interventions evaluated by randomized controlled trials in the healthcare context, as well as to evaluate the information quality of artificial intelligence-driven conversational agents. DESIGN A systematic review. DATA SOURCE A systematic search of relevant literature published in English in Scopus, Pubmed, Embase, PsycINFO, Cochrane Library, Information Science & Technology, and Web of Science, was performed. Only randomized controlled trials from the inception of the databases until May 2022 were included. REVIEW METHODS Two reviewers independently selected the articles according to the inclusion and exclusion criteria. Study findings were narratively synthesized and summarized. The studies' risk of bias was evaluated using the Risk of Bias 2.0 tool. The Silberg Scale was used to evaluate the quality of the conversational agent system utilized in each reviewed study. RESULTS Twenty-one studies were included in the data synthesis. The recruitment rates ranged from 34% to 100% (mean = 84%), and completion rates ranged from 40% to 100% (mean = 83%). A moderate to high level of intervention acceptability was reported. The intervention approaches included health counseling and education (n = 8), cognitive-behavioral interventions (n = 7), storytelling (n = 1), acceptance and commitment therapy (n = 1), and coping skills training (n = 1). Findings indicated inconsistent effects on improving participants' physical activity and function, healthy lifestyle modifications, knowledge of the diseases, and mental health and psychosocial outcomes. The overall risk of bias varied from low risk (n = 6) to high risk (n = 7) across the studies. The mean Silberg score of included studies was 5.4/9, with a standard deviation of 1.6. CONCLUSION Our review findings indicated that conversational agent-based interventions were feasible, acceptable, and had positive effects on physical functioning, healthy lifestyle, mental health and psychosocial outcomes. Conversational agents can provide low-threshold access to healthcare services. They can serve as remote medical assistants to support patients' recovery or health promotion needs before or after medical treatments. The conversational agent-based interventions can also play adjunctive roles and be integrated into current healthcare systems, which could improve the comprehensiveness of services and make more efficient use of physicians' and nurses' time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
A governance model for the application of AI in health care
Reddy, S., Allan, S., Coghlan, S., & Cooper, P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz192 · Cited by 979
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977
Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
Meyerowitz-Katz, G., Ravi, S., Arnolda, L., Feng, X., Maberly, G., & Astell-Burt, T. (2020) · Journal of Medical Internet Research · doi:10.2196/20283 · Cited by 561
Research works printed but not linked: 19
- Ashrafian, 2015, A novel modification of the turing test for artificial intelligence and robotics in healthcare, Int. J. Med. Rob. Comput. Assisted Surg., 11, 38, 10.1002/rcs.1570 · DOI
- Bibault, 2019, A chatbot versus physicians to provide information for patients with breast cancer: blind, randomized controlled noninferiority trial, J. Med. Internet Res., 21, 10.2196/15787 · DOI · Paper page
- Chen, 2022, Applying the smartphone-based chatbot in clinical nursing education, Nurse Educ., 47, E29, 10.1097/NNE.0000000000001131 · DOI
- Dosovitsky, 2021, Bonding with bot: user feedback on a chatbot for social isolation, Front. Digit. Health, 3
- Echeazarra, 2021, Tensiobot: a chatbot assistant for self-managed in-house blood pressure checking, J. Med. Syst., 45, 54, 10.1007/s10916-021-01730-x · DOI · Paper page
- Graham, 2019, Artificial intelligence for mental health and mental illnesses: an overview, Curr. Psychiatry Rep., 21, 116, 10.1007/s11920-019-1094-0 · DOI · Paper page
- Griffiths, 2000, Quality of web based information on treatment of depression: cross sectional survey, BMJ, 321, 1511, 10.1136/bmj.321.7275.1511 · DOI · Paper page
- Hernandez, 2019, Network diffusion and technology acceptance of a nurse chatbot for chronic disease self-management support : a theoretical perspective, J. Med. Investig., 66, 24, 10.2152/jmi.66.24 · DOI · Paper page
- Higgins, 2016, A revised tool for assessing risk of bias in randomized trials, Cochrane Database Syst. Rev., 10, 29
- Hunt, 2021, Efficacy of zemedy, a mobile digital therapeutic for the self-management of irritable bowel syndrome: crossover randomized controlled trial, JMIR Mhealth Uhealth, 9, 10.2196/26152 · DOI · Paper page
- Jack, 2020, Improving the health of young African American women in the preconception period using health information technology: a randomised controlled trial, Lancet Digit Health, 2, e475, 10.1016/S2589-7500(20)30189-8 · DOI · Paper page
- Jang, 2021, Mobile app-based chatbot to deliver cognitive behavioral therapy and psychoeducation for adults with attention deficit: a development and feasibility/usability study, Int. J. Med. Inform., 150, 10.1016/j.ijmedinf.2021.104440 · DOI · Paper page
- Maeda, 2020, Promoting fertility awareness and preconception health using a chatbot: a randomized controlled trial, Reprod. BioMed. Online, 41, 1133, 10.1016/j.rbmo.2020.09.006 · DOI · Paper page
- Manuvinakurike, 2014, Automated indexing of internet stories for health behavior change: weight loss attitude pilot study, J. Med. Internet Res., 16, 10.2196/jmir.3702 · DOI · Paper page
- Oh, 2021, A systematic review of artificial intelligence chatbots for promoting physical activity, healthy diet, and weight loss, Int. J. Behav. Nutr. Phys. Act., 18, 1, 10.1186/s12966-021-01224-6 · DOI · Paper page
- Page, 2021, The prisma 2020 statement: an updated guideline for reporting systematic reviews, BMJ, 372
- Robinson, 2019, Psychosocial health interventions by social robots: systematic review of randomized controlled trials, J. Med. Internet Res., 21, 10.2196/13203 · DOI · Paper page
- Zhang, 2016, Analysis of the information quality of bariatric surgery smartphone applications using the silberg scale, Obes. Surg., 26, 163, 10.1007/s11695-015-1890-5 · DOI
- Zhang, 2017, Current status of postnatal depression smartphone applications available on application stores: an information quality analysis, BMJ Open, 7, 10.1136/bmjopen-2016-015655 · DOI · Paper page
Cited by
Artificial intelligence agents in healthcare research: A scoping review
Njei, B., Al-Ajlouni, Y. A., Sidney Kanmounye, U., Boateng, S., Loic Nguefang, G., Njei, N., Hamouri, S., & Al-Ajlouni, A. F. (2026) · PLOS One · doi:10.1371/journal.pone.0342182 · Cited by 27
“In healthcare, AI agents represent a distinct class of computational entities characterized by semi-autonomy, context awareness, and adaptive learning capabilities that enable them to interact dynamically with clinical environments and patient data [2].”
Li, K., Wu, S., Zhang, Y., Zhu, B., Qi, Z., Hou, S., & Wang, W. (2026) · Journal of Clinical Nursing · doi:10.1111/jocn.70020 · Cited by 10
Self-citationKwan, Y. K., Lau, Y., Ang, W. W., & Lau, S. T. (2024) · Nicotine and Tobacco Research · doi:10.1093/ntr/ntad145 · Cited by 9
Agentic artificial intelligence is the future of cancer detection and diagnosis
Rahman, S., Hosain, M. T., Fahad, N., Morol, M. K., & Hossen, M. J. (2026) · Array · doi:10.1016/j.array.2025.100676 · Cited by 4
Metadata
- Authors
- Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D.
- Venue
- International Journal of Nursing Studies
- Publisher
- Elsevier BV
- Published
- 2023-07
- Volume
- 143
- Pages
- 104494
- ISSN
- 0020-7489 (ISSN-L)
- OpenAlex
- W4362606292
- Cited by
- 67
- References
- 27
- FWCI
- 2.29
- Type
- journal article
- Language
- en
- Update notices
- erratum (2025-10-01)
- Open access
- closed
- Licence
- Funders
- Hong Kong Polytechnic University
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials. https://app.cochat.ai/papers/10.1016/j.ijnurstu.2023.104494
- The paper
- Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D. (2023). Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials. International Journal of Nursing Studies. https://doi.org/10.1016/j.ijnurstu.2023.104494
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.