The DOI matches its Crossref record; 104 of the 104 references it cites were found in a registry or an index.
Large Language Models in Mental Health Care: A Scoping Review
Open accessAbstract
This review aims to deliver a comprehensive analysis of Large Language Models (LLMs) utilization in mental health care, evaluating their effectiveness, identifying challenges, and exploring their potential for future application. A systematic search was performed across multiple databases including PubMed, Web of Science, Google Scholar, arXiv, medRxiv, and PsyArXiv in November 2023. The review includes all types of original research, regardless of peer-review status, published or disseminated between October 1, 2019, and December 2, 2023. Studies were included without language restrictions if they employed LLMs developed after T5 and directly investigated research questions within mental health care settings. Out of an initial 313 articles, 34 were selected based on their relevance to LLMs applications in mental health care and the rigor of their reported outcomes. The review identified various LLMs applications in mental health care, including diagnostics, therapy, and enhancing patient engagement. Key challenges highlighted were related to data availability and reliability, the nuanced handling of mental states, and effective evaluation methods. While LLMs showed promise in improving accuracy and accessibility, significant gaps in clinical applicability and ethical considerations were noted. LLMs hold substantial promise for enhancing mental health care. For their full potential to be realized, emphasis must be placed on developing robust datasets, development and evaluation frameworks, ethical guidelines, and interdisciplinary collaborations to address current limitations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because most generative models are trained on English-language, Western-centric corpora, their outputs risk reinforcing existing epistemic hierarchies and marginalizing non-dominant knowledge systems.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [13]
In the citing paper
“Kay et al. [12] provide a conceptual account of epistemic injustice in generative AI, while Hua et al. extend these concerns in the context of mental health, illustrating how model outputs can reinforce dominant epistemologies and marginalize alternative perspectives [13].”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [13]
In the citing paper
“Related ethical critiques examine how generative systems can reproduce epistemic injustice through the biases and asymmetries encoded in training data.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [13]
In the citing paper
“These risks are compounded by the potential amplification of epistemic injustice, as AI systems trained on dominant linguistic and cultural corpora may marginalize non-Western and non-native English scholarship.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [13]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“This could involve aiding in preliminary assessments for diagnostic processes, facilitating the management of psychiatric disorders, and enhancing therapeutic interventions, such as by helping to improve treatment adherence.”
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157
Research works printed but not linked: 26
- Ji S, Zhang T, Yang K, Ananiadou S, Cambria E. Rethinking Large Language Models in Mental Health Applications. Available from: arXiv:2311.11267. · arXiv
- Ma Z, Mei Y, Su Z. Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support. Available from: arXiv:2307.15810. · arXiv
- Mikolov T, Chen K, Corrado Gs, Dean J. Efficient Estimation of Word Representations in Vector Space. Proceedings of Workshop at ICLR. 2013 01;2013.
- OpenAI. GPT-4 Technical Report. arXiv preprint arXiv:2303.08774. 2023. · arXiv
- Khraisha Q, Put S, Kappenberg J, Warraitch A, Hadfield K. Can large language models replace humans in the systematic review process? Evaluating GPT-4’s efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages.
- Chen Q, Liu D. Dynamic Strategy Chain: Dynamic Zero-Shot CoT for Long Mental Health Support Generation. Available from: arXiv:2308.10444. · arXiv
- Liu JM, Li D, Cao H, Ren T, Liao Z, Wu J. ChatCounselor: a large language models for mental health support. Available from: arXiv:2309.15461. · arXiv
- Yao X, Mikhelson M, Watkins SC, Choi E, Thomaz E, de Barbaro K. Development and Evaluation of Three Chatbots for Postpartum Mood and Anxiety Disorders. Available from: arXiv:2308.07407. · arXiv
- Lee YK, Lee I, Shin M, Bae S, Hahn S. Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models. Available from: arXiv:2311.04915. · arXiv
- Zheng Z, Liao L, Deng Y, Nie L. Building Emotional Support Chatbots in the Era of LLMs. Available from: arXiv:2308.11584. · arXiv
- Vowels LM, Francois-Walcott RRR, Darwiche J. AI in relationship counselling: Evaluating ChatGPT’s therapeutic capabilities in providing relationship advice. Available from: https://www.sciencedirect.com/science/article/pii/S2949882124000380.
- Vowels LM. Are chatbots the new relationship experts? Insights from three studies. Available from: https://www.sciencedirect.com/science/article/pii/S2949882124000379.
- Bucur AM. Utilizing ChatGPT Generated Data to Retrieve Depression Symptoms from Social Media. Available from: arXiv:2307.02313. · arXiv
- Lamichhane B. Evaluation of ChatGPT for NLP-based Mental Health Applications. Available from: arXiv:2303.15727. · arXiv
- American Psychiatric Association A, Association AP, et al. Diagnostic and statistical manual of mental disorders: DSM-IV. vol. 4. Washington, DC: American psychiatric association; 1994.
- Tay Y, Dehghani M, Tran VQ, Garcia X, Wei J, Wang X, et al. UL2: Unifying Language Learning Paradigms. Available from: arXiv:2205.05131. · arXiv
- Ye Q, Liu J, Chong D, Zhou P, Hua Y, Liu A. Qilin-med: Multi-stage knowledge injection advanced medical large language model. arXiv:2310.09089. 2023. · arXiv
- Guo Z, Hua Y. Continuous Training and Fine-tuning for Domain-Specific Language Models in Medical Question Answering. Available from: arXiv:2311.00204. · arXiv
- Cohan A, Desmet B, Yates A, Soldaini L, MacAvaney S, Goharian N. SMHD: a Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditions. In: Bender EM, Derczynski L, Isabelle P, editors. Proceedings of the 27th International Conference on Computational Linguistics. Santa Fe, New Mexico, USA: Association for Computational Linguistics; 2018. p. 1485–1497. Available from: https://aclanthology.org/C18-1126.
- Garg M, Saxena C, Saha S, Krishnan V, Joshi R, Mago V. CAMS: An Annotated Corpus for Causal Analysis of Mental Health Issues in Social Media Posts. In: Calzolari N, Béchet F, Blache P, Choukri K, Cieri C, Declerck T, et al., editors. Proceedings of the Thirteenth Language Resources and Evaluation Conference. Marseille, France: European Language Resources Association; 2022. p. 6387–6396. Available from: https://aclanthology.org/2022.lrec-1.686.
- Ma Z, Mei Y, Su Z. Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support. 2023; arXiv:2307.15810. · arXiv
- Liu S, Zheng C, Demasi O, Sabour S, Li Y, Yu Z, et al. Towards Emotional Support Dialog Systems. In: Zong C, Xia F, Li W, Navigli R, editors. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Online: Association for Computational Linguistics; 2021. p. 3469–3483. Available from: https://aclanthology.org/2021.acl-long.269. · DOI · Paper page
- Li M, Weston J, Roller S.: ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons. Available from: arXiv:1909.03087. · arXiv
- Zhang T, Kishore V, Wu F, Weinberger KQ, Artzi Y. BERTScore: Evaluating Text Generation with BERT. Available from: arXiv:1904.09675. · arXiv
- Yuan W, Neubig G, Liu P. BARTScore: Evaluating Generated Text as Text Generation. Available from: arXiv:2106.11520. · arXiv
- Lin CY. ROUGE: A Package for Automatic Evaluation of Summaries. In: Text Summarization Branches Out. Barcelona, Spain: Association for Computational Linguistics; 2004. p. 74–81. Available from: https://aclanthology.org/W04-1013.
Cited by
Large Language Models for Mental Health Applications: Systematic Review
Guo, Z., Lai, A., Thygesen, J. H., Farrington, J., Keen, T., & Li, K. (2024) · JMIR Mental Health · doi:10.2196/57400 · Cited by 269
“These studies have demonstrated the effectiveness of NLP for tasks such as text categorization and sentiment analysis [47] and provided a broad overview of LLM applications in mental health [48].”
BackgroundA scoping review of large language models for generative tasks in mental health care
Hua, Y., Na, H., Li, Z., Liu, F., Fang, X., Clifton, D., & Torous, J. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01611-4 · Cited by 151
“Increasingly, research is exploring anthropomorphic features such as empathy, politeness, and other human-like traits in these models to enhance their effectiveness in delivering more realistic and supportive mental health care 12 .”
Self-citationFerrario, A., Sedlakova, J., & Trachsel, M. (2024) · JMIR Mental Health · doi:10.2196/56569 · Cited by 61
McBain, R. K., Cantor, J., Zhang, L. A., Baker, O., Zhang, F., Halbisen, A., Kofner, A., Breslau, J. A., Stein, B. D., Mehrotra, A., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/67891 · Cited by 69
“Only a small handful of studies in the peer-reviewed literature have evaluated the competencies of LLMs when addressing individuals who exhibit depressive symptoms and suicidal ideation [11-14].”
Assessing and alleviating state anxiety in large language models
Ben‐Zion, Z., Witte, K., Jagadish, A. K., Duek, O. A., Harpaz‐Rotem, I., Khorsandian, M.-C., Burrer, A., Seifritz, E., Homan, P., Schulz, E., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01512-6 · Cited by 81
Metadata
- Authors
- Hua, Y., Liu, F., Yang, K., Li, Z., Na, H., Sheu, Y.-H., Zhou, P., Moran, L. V., Ananiadou, S., Clifton, D. A., Beam, A., & Torous, J.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- University of Oxford (GB)
- University of Manchester (GB)
- The University of Texas Health Science Center at Houston (US)
- University of Technology Sydney (AU)
- Harvard University (US)
- The Hong Kong University of Science and Technology (Guangzhou) (CN)
- McLean Hospital (US)
- Corresponding author
- Torous, John
- ORCID
- Venue
- Current Treatment Options in Psychiatry
- Published
- 2025-07-25
- Volume
- 12
- Issue
- 1
- ISSN
- 2196-3061 (ISSN-L)
- OpenAlex
- W4412925667
- Cited by
- 92
- References
- 92
- Citations by year
- 2026: 47 · 2025: 30
- FWCI
- 18.70
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Current Treatment Options in Psychiatry (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- large language models, mental health services, AI-assisted diagnosis, AI-assisted therapy, patient engagement, clinical applicability, data availability, evaluation framework, ethical considerations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Large Language Models in Mental Health Care: A Scoping Review. https://app.cochat.ai/papers/10.1007/s40501-025-00363-y
- The paper
- Hua, Y., Liu, F., Yang, K., Li, Z., Na, H., Sheu, Y.-H., Zhou, P., Moran, L. V., Ananiadou, S., Clifton, D. A., Beam, A., & Torous, J. (2025). Large Language Models in Mental Health Care: A Scoping Review. Current Treatment Options in Psychiatry. https://doi.org/10.1007/s40501-025-00363-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.