The DOI matches its Crossref record; 102 of the 109 references it cites were found in a registry or an index; 232 of the 321 sources its claims cite were checked for support.
Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review
Open accessAbstract
Introduction: Online mental healthcare has gained significant attention due to its effectiveness, accessibility, and scalability in the management of mental health symptoms. Despite these advantages over traditional in-person formats, including higher availability and accessibility, issues with low treatment adherence and high dropout rates persist. Artificial intelligence (AI) technologies could help address these issues, through powerful predictive models, language analysis, and intelligent dialogue with users, however the study of these applications remains underexplored. The following mixed methods review aimed to supplement this gap by synthesizing the available evidence on the applications of AI in online mental healthcare. Method: We searched the following databases: MEDLINE, CINAHL, PsycINFO, EMBASE, and Cochrane. This review included peer-reviewed randomized controlled trials, observational studies, non-randomized experimental studies, and case studies that were selected using the PRISMA guidelines. Data regarding pre and post-intervention outcomes and AI applications were extracted and analyzed. A mixed-methods approach encompassing meta-analysis and network meta-analysis was used to analyze pre and post-intervention outcomes, including main effects, depression, anxiety, and study dropouts. We applied the Cochrane risk of bias tool and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) to assess the quality of the evidence. Results: Twenty-nine studies were included revealing a variety of AI applications including triage, psychotherapy delivery, treatment monitoring, therapy engagement support, identification of effective therapy features, and prediction of treatment response, dropout, and adherence. AI-delivered self-guided interventions demonstrated medium to large effects on managing mental health symptoms, with dropout rates comparable to non-AI interventions. The quality of the data was low to very low. Discussion: The review supported the use of AI in enhancing treatment response, adherence, and improvements in online mental healthcare. Nevertheless, given the low quality of the available evidence, this study highlighted the need for additional robust and high-powered studies in this emerging field. Systematic review registration: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=443575, identifier CRD42023443575. Copyright © 2024 Gutierrez, Stephenson, Eadie, Asadpour and Alavi.
Overview
CoChat Summary
## TL;DR
This mixed-methods review found that AI-augmented online mental healthcare interventions were generally promising for reducing mental health symptoms and supporting engagement, but the evidence base was small and low quality. Across 29 studies, AI applications ranged from triage and psychotherapy delivery to predicting dropout and adherence, with self-guided AI interventions often performing well.
## Key findings
- The review included 29 studies and identified AI uses in triage, psychotherapy delivery, treatment monitoring, therapy engagement support, identification of effective therapy features, and prediction of treatment response, dropout, and adherence.
- For AI-augmented interventions, the meta-analysis found a significantly large effect size for overall mental health symptoms, a significant medium effect size for depression, and a significant small effect size for anxiety.
- In the network meta-analysis, AI-self-guided ACT was ranked best for reducing overall mental health symptoms, AI-self-guided eCBT was ranked best for reducing depression, and AI-guided eCBT was ranked best for reducing anxiety; however, the anxiety comparisons were not statistically significant.
- No included studies reported adverse events. For dropout, reported rates ranged from 0% to 61% for online or remote psychotherapy, 4% to 60% for psychoeducation, and 5% to 34% for no intervention; AI-self-guided eCBT had a 14% lesser risk of dropping out than psychoeducation in one significant comparison.
- User satisfaction was generally high: several studies reported AI tools were perceived as helpful and encouraging by around 60% to 90% of users, though around 30% or less found them unhelpful or bothersome.
## Methods
- Mixed-methods systematic review registered in PROSPERO (CRD42023443575) and conducted according to PRISMA and PRISMA-NMA guidance.
- Searched MEDLINE, CINAHL, PsycINFO, EMBASE, and Cochrane for English-language studies published up to October 2023; included RCTs, observational studies, non-randomized experimental studies, and case studies.
- Extracted pre/post outcomes and AI applications; used meta-analysis and network meta-analysis for symptom and dropout outcomes, plus narrative synthesis for machine-learning prediction studies; assessed quality with the Cochrane risk of bias tool and GRADE.
## Limitations
- The paper states that the evidence was low to very low quality under GRADE, with many studies showing high or unclear risk of bias, especially allegiance bias (n=14) and selective reporting (n=8).
- The authors note a major limitation was the scarcity of studies: many interventions/comparators were represented by one study only, which increased imprecision, indirectness, and bias; several NMA comparisons were therefore based on indirect evidence.
- Evident from the text: the review relied largely on Western, English-language studies and mostly female samples, which the authors say may limit generalizability; also, adverse events may be underreported in this literature, so “none reported” does not necessarily mean none occurred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
82 Valid · 9 Not valid · 12 Not checked · 73 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“The studies that ranked high for selective reporting bias tended to report only user satisfaction data and treatment adherence, despite their methods considering the collection and assessment of psychiatric scale data and other effectiveness outcomes (29, 76, 79, 85–88, 92).”
§ Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review > Results > Risk of bias within studies
What the sources say
- Disputedcites [29] Flygare, 2020, Predictors of remission from body dysmorphic disorder after internet-delivered cognitive behavior therapy: A machine learning approach, BMC Psychiatry sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Disputedcites [76] Fulmer, 2018, Using psychological artificial intelligence (tess) to relieve symptoms of depression and anxiety: Randomized controlled trial, JMIR Ment Health sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 1 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Disputedcites [79] Morrison, 2017, The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial, PloS One sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [85] Ewbank, 2021, Understanding the relationship between patient language and outcomes in internet-enabled cognitive behavioural therapy: A deep learning approach to automatic coding of session transcripts, Psychother Res source
- Partly supportedcites [86] Ewbank, 2020, Quantifying the association between psychotherapy content and clinical outcomes using deep learning, JAMA Psychiatry sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.
- Disputedcites [87] Kim, 2021, Machine learning analysis to identify digital behavioral phenotypes for engagement and health outcome efficacy of an mHealth intervention for obesity: Randomized controlled trial, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Disputedcites [88] Lenhard, 2018, Prediction of outcome in internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: A machine learning approach, Int J Methods Psychiatr Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Disputedcites [92] Rodrigo, 2021, Exploratory data mining techniques (decision tree models) for examining the impact of internet-based cognitive behavioral therapy for tinnitus: Machine learning approach, J Med Internet Res sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
plainstates an associationn = 8- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, studies have shown that despite some concerns over the strength of the therapeutic relationship, online mental healthcare has similar effectiveness as in-person options for the management of mental health conditions (11, 24).”
§ Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [11] Bennett, 2020, eHealth to redress psychotherapy access barriers both new and old: A review of reviews and meta-analyses, J Psychother Integr source
- Partly supportedcites [24] McDonald, 2020, Online psychotherapy: trailblazing digital healthcare, BJPsych Bull sourceExperimental — accuracy not yet measured
The ‘Evidence base for online therapies’ section reports improvements with online therapies, particularly CBT, but its comparisons are mainly with treatment-as-usual or waiting-list groups. The ‘Financial costs’ section says many online programmes have been effective; it compares costs, not clinical effectiveness, with face-to-face therapy. The paper therefore supports online treatment's effectiveness but not the claim that it is similarly effective to in-person care. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, the study of the applications of AI in mental healthcare remains in its infancy (6, 20).”
- Also stated in: § Introduction · plain
“In contrast, the application of AI in mental healthcare remains in its infancy (6, 20).”
§ Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [6] Boucher, 2021, Artificially intelligent chatbots in digital mental health interventions: a review, Expert Rev Med Devices source
- Supportedcites [20] Graham, 2019, Artificial intelligence for mental health and mental illnesses: an overview, Curr Psychiatry Rep source
The Abstract’s Recent findings section says most of the 28 reviewed studies are early proof-of-concept work. The Results section, under Limitations of AI and mental health studies, also identifies gaps in clinical validation and readiness for patient care. Together, these support the characterization of research on AI applications in mental healthcare as being in its infancy. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“AI technology can help address these issues by supporting a versatile, scalable, and powerful approach that can analyze and respond to large amounts of data and adapt to individual healthcare needs (6, 17–23).”
§ Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [6] Boucher, 2021, Artificially intelligent chatbots in digital mental health interventions: a review, Expert Rev Med Devices source
- Partly supportedcites [17] Abd-alrazaq, 2019, An overview of the features of chatbots in mental health: A scoping review, Int J Med Inform sourceExperimental — accuracy not yet measured
The Introduction says chatbots may increase access to mental-health interventions, and §4.3.1 says AI chatbots can respond to complex questions and learn from gathered data. That section also says web-based chatbots could reach many users. The paper does not establish that AI chatbots can process and respond to large volumes of data or adapt care to each individual's needs. (LLM, conf=0.85)
- Partly supportedcites [18] Barnett, 2021, Enacting ‘more-than-human’ care: Clients’ and counsellors’ views on the multiple affordances of chatbots in alcohol and other drug counselling, Int J Drug Policy sourceExperimental — accuracy not yet measured
The Introduction says chatbots may bring mental health services to larger audiences, and the Findings describe their potential to tailor alcohol and other drug care to a client’s needs. The paper also describes natural language processing as analysing and responding to human language, but it does not establish the claimed ability to handle large amounts of data; its account of tailored care is a possibility, not a demonstrated capability. Page numbers were unavailable in our copy. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [19] Fonseka, 2019, The utility of artificial intelligence in suicide risk prediction and the management of suicidal behaviors, Aust New Z J Psychiatry source
- Partly supportedcites [20] Graham, 2019, Artificial intelligence for mental health and mental illnesses: an overview, Curr Psychiatry Rep sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) says AI can draw meaning from large, varied data sources, support remote therapeutic sessions, and potentially tailor treatments to individuals. It does not establish that this approach is scalable or specifically resolves the citing document’s online mental-healthcare issues. (LLM, conf=0.83)
- Partly supportedcites [21] Bennett, 2013, Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach, Artif Intell Med sourceExperimental — accuracy not yet measured
Sections 1.1 and 4.1 describe using AI to learn from clinical data and adjust decisions as information changes; Section 2.1 reports evaluation with mental-health patient records. Section 1.2 identifies telemedicine as a potential role, but the paper does not establish that this approach addresses online mental healthcare issues or demonstrate its scalability. (LLM, conf=0.84)
- Partly supportedcites [22] Cresswell, 2020, Investigating the use of data-driven artificial intelligence in computerised decision support systems for health and social care: A systematic review, Health Inform J sourceExperimental — accuracy not yet measured
The Background says data-driven decision-support systems analyze large, complex datasets, and the Descriptive synthesis describes personalized warfarin-dosing recommendations. The paper does not establish that these systems address online mental healthcare issues or that they are scalable; its Policy recommendations caution that evidence of effectiveness remains limited. (LLM, conf=0.86)
- Partly supportedcites [23] Lysaght, 2019, AI-assisted decision-making in healthcare, Asian Bioeth Rev sourceExperimental — accuracy not yet measured
The Background describes AI systems that analyze large datasets and use individual patients’ clinical data to support diagnoses and predict treatment outcomes. It does not address online mental healthcare or establish that this approach is scalable in that setting; those parts of the claim go beyond the paper. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“If carefully implemented, ML can produce results with a precision that can rival or surpass seasoned clinicians (20).”
§ Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review > Introduction
What the sources say
- Supportedcites [20] Graham, 2019, Artificial intelligence for mental health and mental illnesses: an overview, Curr Psychiatry Rep source
The “AI in healthcare” section says AI algorithms can perform as well as or better than experienced clinicians when evaluating medical images. This supports the claim that such performance is possible, though the paper’s example concerns image evaluation rather than all clinical tasks. (LLM, conf=0.88)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
84 more claims · 38 with their cited sources checked
Create a free account to see all 176 claims and every source verdict.
- Probably not a substantial claim. 35
- It may state two separate claims as one. 65
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Research works printed but not linked: 4
- 2018, Mental health in the balance: ending the healthcare disparity in Canada
- 2020, Mental Illness and Addiction: Facts and Statistics
- Covidence Systematic Review Software2022
- Lipsey, 2001, Practical meta-analysis. Practical meta-analysis, ix, 247
Cited by
Can AI replace psychotherapists? Exploring the future of mental health care
Zhang, Z., & Wang, J. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1444382 · Cited by 127
Chan, C. K. Y. (2025) · Behavioral Sciences · doi:10.3390/bs15030287 · Cited by 77
“AI-integrated tools could offer real-time responses, improve accessibility, and act as an alternative to traditional practices (Fiske et al., 2019; Gutierrez et al., 2024; Laranjo et al., 2018).”
Mentalizing Without a Mind: Psychotherapeutic Potential of Generative AI
Yirmiya, K., & Fonagy, P. (2025) · Journal of Medical Internet Research · doi:10.2196/79156 · Cited by 47
“AI technologies offer substantial promise in diagnostics, psychoeducation, mental health first aid, and professional training (Cruz-Gonzalez et al [6]; Gutierrez et al [3]; Yirmiya et al [84]; and Zhong et al [85]).”
Applications of Artificial Intelligence in Psychiatry and Psychology Education: Scoping Review
Prégent, J., Chung, V.-H.-A., Adib, I. E., Désilets, M., & Hudon, A. (2025) · JMIR Medical Education · doi:10.2196/75238 · Cited by 42
Data Privacy, Ethics, and the Role of AI in Customer Relationship Management
Kumar, A., Sharma, A., Dhanka, S., Bist, Y., Maini, S., & Bhatnagar, P. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1867-7.ch013 · Cited by 18
Metadata
- Authors
- Gutierrez, G., Stephenson, C., Eadie, J., Asadpour, K., & Alavi, N.
- Affiliations
- Queen's University (CA)
- Corresponding author
- Alavi, Nazanin
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2024-05-07
- Volume
- 15
- Pages
- 1356773-1356773
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC11106393
- OpenAlex
- W4396704075
- Cited by
- 71
- References
- 109
- Citations by year
- 2026: 28 · 2025: 36 · 2024: 7
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (acceptedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- artificial intelligence, digital mental health interventions, medication adherence, treatment discontinuation, depression, anxiety, AI triage, treatment response prediction, self-guided intervention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review. https://app.cochat.ai/papers/10.3389/fpsyt.2024.1356773
- The paper
- Gutierrez, G., Stephenson, C., Eadie, J., Asadpour, K., & Alavi, N. (2024). Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2024.1356773
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.