CoChat

Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials

Li, Yan, Liang, Surui, Zhu, Bingqian, Liu, Xu, Li, Jing, Chen, Dapeng, Qin, Jing, Bressington, Dan · 2023 · International Journal of Nursing Studies
Cited by 67

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

BACKGROUND A virtual conversational agent is a program that typically utilizes artificial intelligence technology to mimic human interactions. Many robust and high-quality clinical trials have been conducted to test the effectiveness of conversational agent-based interventions. However, there is a lack of systematic reviews of randomized controlled trials that evaluate the effects of artificial intelligence-driven conversational agents in healthcare interventions. OBJECTIVE To examine the feasibility and effectiveness of conversational agent-based interventions evaluated by randomized controlled trials in the healthcare context, as well as to evaluate the information quality of artificial intelligence-driven conversational agents. DESIGN A systematic review. DATA SOURCE A systematic search of relevant literature published in English in Scopus, Pubmed, Embase, PsycINFO, Cochrane Library, Information Science & Technology, and Web of Science, was performed. Only randomized controlled trials from the inception of the databases until May 2022 were included. REVIEW METHODS Two reviewers independently selected the articles according to the inclusion and exclusion criteria. Study findings were narratively synthesized and summarized. The studies' risk of bias was evaluated using the Risk of Bias 2.0 tool. The Silberg Scale was used to evaluate the quality of the conversational agent system utilized in each reviewed study. RESULTS Twenty-one studies were included in the data synthesis. The recruitment rates ranged from 34% to 100% (mean = 84%), and completion rates ranged from 40% to 100% (mean = 83%). A moderate to high level of intervention acceptability was reported. The intervention approaches included health counseling and education (n = 8), cognitive-behavioral interventions (n = 7), storytelling (n = 1), acceptance and commitment therapy (n = 1), and coping skills training (n = 1). Findings indicated inconsistent effects on improving participants' physical activity and function, healthy lifestyle modifications, knowledge of the diseases, and mental health and psychosocial outcomes. The overall risk of bias varied from low risk (n = 6) to high risk (n = 7) across the studies. The mean Silberg score of included studies was 5.4/9, with a standard deviation of 1.6. CONCLUSION Our review findings indicated that conversational agent-based interventions were feasible, acceptable, and had positive effects on physical functioning, healthy lifestyle, mental health and psychosocial outcomes. Conversational agents can provide low-threshold access to healthcare services. They can serve as remote medical assistants to support patients' recovery or health promotion needs before or after medical treatments. The conversational agent-based interventions can also play adjunctive roles and be integrated into current healthcare systems, which could improve the comprehensiveness of services and make more efficient use of physicians' and nurses' time.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.ijnurstu.2023.104494

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 27 references

Research works printed but not linked: 19

  1. Ashrafian, 2015, A novel modification of the turing test for artificial intelligence and robotics in healthcare, Int. J. Med. Rob. Comput. Assisted Surg., 11, 38, 10.1002/rcs.1570 · DOI
  2. Bibault, 2019, A chatbot versus physicians to provide information for patients with breast cancer: blind, randomized controlled noninferiority trial, J. Med. Internet Res., 21, 10.2196/15787 · DOI · Paper page
  3. Chen, 2022, Applying the smartphone-based chatbot in clinical nursing education, Nurse Educ., 47, E29, 10.1097/NNE.0000000000001131 · DOI
  4. Dosovitsky, 2021, Bonding with bot: user feedback on a chatbot for social isolation, Front. Digit. Health, 3
  5. Echeazarra, 2021, Tensiobot: a chatbot assistant for self-managed in-house blood pressure checking, J. Med. Syst., 45, 54, 10.1007/s10916-021-01730-x · DOI · Paper page
  6. Graham, 2019, Artificial intelligence for mental health and mental illnesses: an overview, Curr. Psychiatry Rep., 21, 116, 10.1007/s11920-019-1094-0 · DOI · Paper page
  7. Griffiths, 2000, Quality of web based information on treatment of depression: cross sectional survey, BMJ, 321, 1511, 10.1136/bmj.321.7275.1511 · DOI · Paper page
  8. Hernandez, 2019, Network diffusion and technology acceptance of a nurse chatbot for chronic disease self-management support : a theoretical perspective, J. Med. Investig., 66, 24, 10.2152/jmi.66.24 · DOI · Paper page
  9. Higgins, 2016, A revised tool for assessing risk of bias in randomized trials, Cochrane Database Syst. Rev., 10, 29
  10. Hunt, 2021, Efficacy of zemedy, a mobile digital therapeutic for the self-management of irritable bowel syndrome: crossover randomized controlled trial, JMIR Mhealth Uhealth, 9, 10.2196/26152 · DOI · Paper page
  11. Jack, 2020, Improving the health of young African American women in the preconception period using health information technology: a randomised controlled trial, Lancet Digit Health, 2, e475, 10.1016/S2589-7500(20)30189-8 · DOI · Paper page
  12. Jang, 2021, Mobile app-based chatbot to deliver cognitive behavioral therapy and psychoeducation for adults with attention deficit: a development and feasibility/usability study, Int. J. Med. Inform., 150, 10.1016/j.ijmedinf.2021.104440 · DOI · Paper page
  13. Maeda, 2020, Promoting fertility awareness and preconception health using a chatbot: a randomized controlled trial, Reprod. BioMed. Online, 41, 1133, 10.1016/j.rbmo.2020.09.006 · DOI · Paper page
  14. Manuvinakurike, 2014, Automated indexing of internet stories for health behavior change: weight loss attitude pilot study, J. Med. Internet Res., 16, 10.2196/jmir.3702 · DOI · Paper page
  15. Oh, 2021, A systematic review of artificial intelligence chatbots for promoting physical activity, healthy diet, and weight loss, Int. J. Behav. Nutr. Phys. Act., 18, 1, 10.1186/s12966-021-01224-6 · DOI · Paper page
  16. Page, 2021, The prisma 2020 statement: an updated guideline for reporting systematic reviews, BMJ, 372
  17. Robinson, 2019, Psychosocial health interventions by social robots: systematic review of randomized controlled trials, J. Med. Internet Res., 21, 10.2196/13203 · DOI · Paper page
  18. Zhang, 2016, Analysis of the information quality of bariatric surgery smartphone applications using the silberg scale, Obes. Surg., 26, 163, 10.1007/s11695-015-1890-5 · DOI
  19. Zhang, 2017, Current status of postnatal depression smartphone applications available on application stores: an information quality analysis, BMJ Open, 7, 10.1136/bmjopen-2016-015655 · DOI · Paper page

Cited by

See all 67

Metadata

Authors
Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D.
Venue
International Journal of Nursing Studies
Publisher
Elsevier BV
Published
2023-07
Volume
143
Pages
104494
ISSN
0020-7489 (ISSN-L)
OpenAlex
W4362606292
Cited by
67
References
27
FWCI
2.29
Type
journal article
Language
en
Update notices
erratum (2025-10-01)
Open access
closed
Funders
Hong Kong Polytechnic University

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials. https://app.cochat.ai/papers/10.1016/j.ijnurstu.2023.104494
The paper
Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D. (2023). Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials. International Journal of Nursing Studies. https://doi.org/10.1016/j.ijnurstu.2023.104494

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.