CoChat

The Opportunities and Risks of Large Language Models in Mental Health

Open access
Lawrence, Hannah R, Schneider, Renee A, Rubin, Susan B, Matarić, Maja J, McDuff, Daniel J, Jones Bell, Megan · 2024 · JMIR Mental Health

The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index; 9 of the 71 sources its claims cite were checked for support.

Abstract

Global rates of mental health concerns are rising, and there is increasing realization that existing models of mental health care will not adequately expand to meet the demand. With the emergence of large language models (LLMs) has come great optimism regarding their promise to create novel, large-scale solutions to support mental health. Despite their nascence, LLMs have already been applied to mental health–related tasks. In this paper, we summarize the extant literature on efforts to use LLMs to provide mental health education, assessment, and intervention and highlight key opportunities for positive impact in each area. We then highlight risks associated with LLMs’ application to mental health and encourage the adoption of strategies to mitigate these risks. The urgent need for mental health support must be balanced with responsible development, testing, and deployment of mental health LLMs. It is especially critical to ensure that mental health LLMs are fine-tuned for mental health, enhance mental health equity, and adhere to ethical standards and that people, including those with lived experience with mental health concerns, are involved in all stages from development through deployment. Prioritizing these efforts will minimize potential harms to mental health and maximize the likelihood that LLMs will positively impact mental health globally.

Overview

CoChat Summary

TL;DR

This narrative review summarizes early applications of large language models (LLMs) to mental health education, assessment, and intervention, arguing that they offer scalable opportunities but also substantial risks. It recommends domain-specific fine-tuning, equity, ethical safeguards, and human involvement across development, testing, and deployment.

Key findings

  • LLMs show promise in mental health education: ChatGPT responses to postpartum depression questions were rated near ceiling for clinical accuracy (3.93/4) and more aligned with ACOG responses than Bard or Google Search; ChatGPT also improved provider efficiency by 37.5% when generating/editing behavioral health learning content.
  • In assessment, Med-PaLM 2 predicted the correct DSM-5 diagnosis 77.5% of the time and 92.5% when asked for the correct diagnostic category, but it classified possible PTSD with high specificity (0.98) and low sensitivity (0.30) and correctly predicted comorbid diagnosis or diagnostic modifier only 20% of the time.
  • In intervention, chatbots trained in empirically supported treatments show initial evidence of reducing depressive, anxiety, and stress symptoms, but they can be nonpersonalized, forget prior interactions, give nontherapeutic or iatrogenic advice, and inconsistently respond to suicide risk.
  • The paper identifies cross-cutting risks including perpetuating inequalities/stigma, unethical service provision, insufficient reliability, inaccuracy, lack of transparency/explainability, and neglecting human involvement; it argues risks are generally higher for assessment and especially intervention than for education.

Methods

  • Design: narrative review/commentary summarizing extant literature on LLM applications to mental health education, assessment, and intervention, plus proposed risk mitigation strategies.
  • Data/sample: no primary data collection; the paper synthesizes cited studies, examples, and prior reviews, distinguishing general-purpose LLMs (eg, ChatGPT, Gemini) from domain-specific LLMs (eg, Med-LM, Mental-Alpaca, Psy-LLM).
  • Analysis: thematic synthesis across education, assessment, and intervention, with a table assigning qualitative risk levels (lower, medium, higher) for potential harms across those domains.

Limitations

  • The paper states no explicit limitations section.
  • Evident from the text: it is a narrative review without a described systematic search strategy, inclusion criteria, or formal quality appraisal.
  • Evident from the text: many cited LLM studies are preprints or early evaluations, and the risk estimates in Table 1 are qualitative and not empirically validated; the authors note the table is not meant to represent every possible LLM use case.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/59479

Cites

93 of 93 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1. Potential opportunities for LLMs in mental health education. CBT: cognitive behavioral therapy; EST: empirically supported treatment; LLM: large language model.
Figure 1. Potential opportunities for LLMs in mental health education. CBT: cognitive behavioral therapy; EST: empirically supported treatment; LLM: large language model.CC BY · PubMed Central
Figure 2. Potential opportunities for LLMs in mental health assessment. LLM: large language model.
Figure 2. Potential opportunities for LLMs in mental health assessment. LLM: large language model.CC BY · PubMed Central
Figure 3. Potential opportunities for LLMs in mental health intervention. CBT: cognitive behavioral therapy; EBP: evidence-based practice; LLM: large language model.
Figure 3. Potential opportunities for LLMs in mental health intervention. CBT: cognitive behavioral therapy; EBP: evidence-based practice; LLM: large language model.CC BY · PubMed Central
Figure 4. Examples of human involvement across all stages of LLM development through deployment and evaluation. LLM: large language model.
Figure 4. Examples of human involvement across all stages of LLM development through deployment and evaluation. LLM: large language model.CC BY · PubMed Central

Verification

Claims the paper makes

7 Valid · 3 Not valid · 50 Not checked · 28 Own results and interpretations

47 more claims · 2 with their cited sources checked

Create a free account to see all 88 claims and to verify the 62 references still open.

See all claims — free account
  • It may state two separate claims as one. 20
  • Probably not a substantial claim. 21

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

2 retracted

Research works printed but not linked: 5

  1. Kim, Lang Learn Technol, 26
  2. Ma, AMIA Annu Symp Proc, 2023
  3. Primm, Prev Chronic Dis, 7
  4. Koocher GP Keith-Spiegel P . Ethics in Psychology and the Mental Health Professions: Standards and Cases. Oxford University Press; 2008.
  5. Wei J Wang X Schuurmans D et al. Chain-of-thought prompting elicits reasoning in large language models. In: Koyejo S Mohamed S Agarwal A , editors. Advances in Neural Information Processing Systems. Vol35. Curran Associates, Inc; 2022:24824-24837.

Cited by

See all 235

Metadata

Authors
Lawrence, H. R., Schneider, R. A., Rubin, S. B., Matarić, M. J., McDuff, D. J., & Jones Bell, M.
Affiliations
Google (United States) (US)
Venue
JMIR Mental Health
Published
2024-07-29
Volume
11
Pages
e59479-e59479
ISSN
2368-7959 (ISSN-L)
OpenAlex
W4393177920
Cited by
235
References
93
Citations by year
2026: 134 · 2025: 96 · 2024: 5
FWCI
92.23
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
large language models, mental health, mental health education, mental health assessment, mental health interventions, AI risks, ethical AI, mental health equity, lived experience, responsible AI deployment
MeSH terms
Mental Disorders, Humans, Language, Mental Health, Mental Health Services

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.