The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index.
Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being
Open accessAbstract
Conversational artificial intelligence (AI), particularly AI-based conversational agents (CAs), is gaining traction in mental health care. Despite their growing usage, there is a scarcity of comprehensive evaluations of their impact on mental health and well-being. This systematic review and meta-analysis aims to fill this gap by synthesizing evidence on the effectiveness of AI-based CAs in improving mental health and factors influencing their effectiveness and user experience. Twelve databases were searched for experimental studies of AI-based CAs’ effects on mental illnesses and psychological well-being published before May 26, 2023. Out of 7834 records, 35 eligible studies were identified for systematic review, out of which 15 randomized controlled trials were included for meta-analysis. The meta-analysis revealed that AI-based CAs significantly reduce symptoms of depression (Hedge’s g 0.64 [95% CI 0.17–1.12]) and distress (Hedge’s g 0.7 [95% CI 0.18–1.22]). These effects were more pronounced in CAs that are multimodal, generative AI-based, integrated with mobile/instant messaging apps, and targeting clinical/subclinical and elderly populations. However, CA-based interventions showed no significant improvement in overall psychological well-being (Hedge’s g 0.32 [95% CI –0.13 to 0.78]). User experience with AI-based CAs was largely shaped by the quality of human-AI therapeutic relationships, content engagement, and effective communication. These findings underscore the potential of AI-based CAs in addressing mental health issues. Future research should investigate the underlying mechanisms of their effectiveness, assess long-term effects across various mental health outcomes, and evaluate the safe integration of large language models (LLMs) in mental health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The rapid adoption of generative LLMs (e.g., GPT‐4) reflects broader AI trends, but introduces unique risks in mental health contexts 185 .”
From Charting the evolution of artificial intelligence mental health chatbots from rule‐based systems to large language models: a systematic review (2025) · cites this paper as [185]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although reviews and meta-analyses of LLM-CBs for mental health exist13,14,29,30, as well as scoping reviews on the implementation of LLM-CBs in mental health31,32, their focus is narrowed to applications of LLM-CBs as clinical intervention tools.”
From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the first systematic reviews and meta-analyses demonstrate the potential of LLM-CBs as clinical tools for mental health13,14.”
From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-CBs find increasing use as mental health support tools, both for the general public8–12 and for patients in clinical interventions13,14.”
From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A recent meta-analysis shows that GenAI chatbots outperform rule-based and retrieval-based chatbots in reducing depressive symptoms [13].”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [13]
Experimental — accuracy not yet measured
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · cited 1×
“Inter-rater reliability, assessed using Cohen ’ s Kappa 63 , indicated near-perfect agreement for title/abstract screening (0.9) and full-text review (0.83).”
MethodInfluentialCochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156 · cited 1×
“The study protocol was registered in PROSPERO, CRD 42023392187, and adhered to the Preferred Reporting Items for Systematic reviews and Meta-Analyses 74 (Supplementary Table 9).”
MethodCohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 4×
“…Empathic communication 17,26,28,29,37 ( n = 5) (cid:129) Non-judgmental 33,49 ( n = 2) (cid:129) Accountability (e.g., regular check-ins) 21,26 ( n = 2) (cid:129) Human-like personality 26,49 ( n = 2) (cid:129) Tailored feedback 28 ( n = 1) (cid:129) Relationship 28 ( n = 1) Content ( n =…”
BackgroundInfluentialHow important are the common factors in psychotherapy? An update
Wampold, B. E. (2015) · World Psychiatry · doi:10.1002/wps.20238 · Cited by 1,728 · cited 1×
“…were key determinants of user experience, which corresponds to previous psychotherapy research that identi fi es these common elements (e.g., therapeutic alliance, empathy, and therapist effect) as active ingredients contributing to therapeutic changes across various therapeutic frameworks 61 .”
Charlson, F., van Ommeren, M., Flaxman, A., Cornett, J., Whiteford, H., & Saxena, S. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30934-1 · Cited by 1,702 · cited 1×
“We fi ne-tuned our search strategy based on previous systematic reviews 3,51,62 to locate sources related to AI-based CAs for addressing mental health problems or promoting mental well-being.”
Method
Research works printed but not linked: 2
- Romanovskyi, O., Pidbutska, N. & Knysh, A. Elomia Chatbot: The effectiveness of Artificial Intelligence in the fight for mental health. In COLINs 5th International Conference on Computational Linguistics and Intelligent Systems, 1215–1224 (2021).
- Terblanche, N., Molyn, J., De Haan, E. & Nilsson, V. O. Coaching at scale: Investigating the efficacy of Artificial Intelligence coaching. Int. J. Evid. Based Coach. Mentor 20, 20–36 (2022).
Cited by
“It happened to be the perfect thing”: experiences of generative AI chatbots for mental health
Siddals, S., Torous, J., & Coxon, A. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00097-4 · Cited by 241
Moore, J., Grabb, D., Agnew, W., Klyman, K., Chancellor, S., Ong, D. C., & Haber, N. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732039 · Cited by 204
Saeidnia, H. R., Hashemi Fotami, S. G., Lund, B., & Ghiasi, N. (2024) · Social Sciences · doi:10.3390/socsci13070381 · Cited by 169
Digital interventions in mental health: An overview and future perspectives
Löchner, J., Carlbring, P., Schuller, B. W., Torous, J. B., & Sander, L. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100824 · Cited by 204
Finding love in algorithms: deciphering the emotional contexts of close encounters with AI chatbots
Li, H. Z., & Zhang, R. (2024) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmae015 · Cited by 233
Self-citation
Metadata
- Authors
- Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C.
- Affiliations
- National University of Singapore (SG)
- Carnegie Mellon University (US)
- Northwestern University (US)
- Corresponding author
- Zhang, Renwen
- Venue
- npj Digital Medicine
- Published
- 2023-12-19
- Volume
- 6
- Issue
- 1
- Pages
- 236-236
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC10730549
- OpenAlex
- W4389934892
- Cited by
- 598
- References
- 74
- Citations by year
- 2026: 322 · 2025: 212 · 2024: 64
- FWCI
- 20.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National University of Singapore (A-8000936-01-00)
- National Institute of Mental Health (P50MH119029)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- chatbots, artificial intelligence, mental health, depression, psychological distress, psychological well-being, generative AI, multimodal AI, mobile health apps, older adults, large language models, user experience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being. https://app.cochat.ai/papers/10.1038/s41746-023-00979-5
- The paper
- Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023). Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being. npj Digital Medicine. https://doi.org/10.1038/s41746-023-00979-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.