Applications of large language models in psychiatry: a systematic review
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Background: With their unmatched ability to interpret and engage with human language and context, large language models (LLMs) hint at the potential to bridge AI and human cognitive processes. This review explores the current application of LLMs, such as ChatGPT, in the field of psychiatry. Methods: We followed PRISMA guidelines and searched through PubMed, Embase, Web of Science, and Scopus, up until March 2024. Results: From 771 retrieved articles, we included 16 that directly examine LLMs’ use in psychiatry. LLMs, particularly ChatGPT and GPT-4, showed diverse applications in clinical reasoning, social media, and education within psychiatry. They can assist in diagnosing mental health issues, managing depression, evaluating suicide risk, and supporting education in the field. However, our review also points out their limitations, such as difficulties with complex cases and potential underestimation of suicide risks. Conclusion: Early research in psychiatry reveals LLMs’ versatile applications, from diagnostic support to educational roles. Given the rapid pace of advancement, future investigations are poised to explore the extent to which these models might redefine traditional roles in mental health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
Fiske, A., Henningsen, P., & Buyx, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13216 · Cited by 857 · cited 1×
“ChatGPT ’ s ability to provide preliminary mental health assessments and psychotherapeutic support is a notable advancement (15, 16).”
BackgroundLi, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
ChatGPT outperforms humans in emotional awareness evaluations
Elyoseph, Z., Hadar-Shoval, D., Asraf, K., & Lvovsky, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1199058 · Cited by 324
Artificial Intelligence in Medicine
Beam, A. L., Drazen, J. M., Kohane, I. S., Leong, T.-Y., Manrai, A. K., & Rubin, E. J. (2023) · New England Journal of Medicine · doi:10.1056/nejme2206291 · Cited by 303
Khawaja, Z., & Bélisle-Pipon, J.-C. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1278186 · Cited by 214 · cited 3×
“For instance, ChatGPT can support therapists by offering tailored assistance during various treatment phases, from initial assessment to post-treatment recovery (10 – 12).”
BackgroundTowards Interpretable Mental Health Analysis with Large Language Models
Yang, K., Ji, S., Zhang, T., Xie, Q., Kuang, Z., & Ananiadou, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.370 · Cited by 155 · cited 1×
“In psychiatry, LLMs like ChatGPT can provide accessible mental health services, breaking down geographical, fi nancial, or temporal barriers, which are particularly pronounced in mental health care (4, 9).”
BackgroundArtificial intelligence in the era of ChatGPT - Opportunities and challenges in mental health care
Singh, O. P. (2023) · Indian Journal of Psychiatry · doi:10.4103/indianjpsychiatry.indianjpsychiatry_112_23 · Cited by 131
ChatGPT and mental healthcare: balancing benefits with risks of harms
Blease, C., & Torous, J. (2023) · BMJ Mental Health · doi:10.1136/bmjment-2023-300884 · Cited by 122 · cited 1×
“Despite these capabilities, currently, LLMs do not replace human therapists (8, 18, 19).”
BackgroundBeyond human expertise: the promise and limitations of ChatGPT in suicide risk assessment
Elyoseph, Z., & Levkovich, I. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1213141 · Cited by 116
Spallek, S., Birrell, L., Kershaw, S., Devine, E. K., & Thornton, L. (2023) · JMIR Medical Education · doi:10.2196/51243 · Cited by 77 · cited 1×
“However, when prompts where carefully engineered, the outputs were better aligned with communication guidelines (34). songs related to bipolar disorder, testing both its factual knowledge and creativity.”
BackgroundAppraising the performance of ChatGPT in psychiatry using 100 clinical case vignettes
Franco D’Souza, R., Amanullah, S., Mathew, M., & Surapaneni, K. M. (2023) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2023.103770 · Cited by 77
Sezgin, E., Chekeni, F., Lee, J., & Keim, S. (2023) · Journal of Medical Internet Research · doi:10.2196/49240 · Cited by 65 · cited 3×
“The study highlighted its utility in providing basic information, but also its limitations in citing current, accurate references (24).”
BackgroundKing, D. R., Nanda, G., Stoddard, J., Dempsey, A., Hergert, S., Shore, J. H., & Torous, J. (2023) · Current Psychiatry Reports · doi:10.1007/s11920-023-01477-x · Cited by 63
Safety of Large Language Models in Addressing Depression
Heston, T. F. (2023) · Cureus · doi:10.7759/cureus.50729 · Cited by 61 · cited 1×
“5 recommended human support at moderate depression levels but only insisted on human intervention at severe levels, underscoring the need for cautious application in high-risk scenarios (25).”
BackgroundSarkar, S., Gaur, M., Chen, L. K., Garg, M., & Srivastava, B. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1229805 · Cited by 38 · cited 1×
“For instance, ChatGPT can support therapists by offering tailored assistance during various treatment phases, from initial assessment to post-treatment recovery (10 – 12).”
Background
Cited by
Omar, M., Sorin, V., Agbareia, R., Apakama, D. U., Soroush, A., Sakhuja, A., Freeman, R., Horowitz, C. R., Richardson, L. D., Nadkarni, G. N., et al. (2025) · International Journal for Equity in Health · doi:10.1186/s12939-025-02419-0 · Cited by 110
Self-citationLinardon, J., Messer, M., Anderson, C., Liu, C., McClure, Z., Jarman, H. K., Goldberg, S. B., & Torous, J. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301787 · Cited by 10
From statistics to deep learning: Using large language models in psychiatric research
Hua, Y., Beam, A., Chibnik, L. B., & Torous, J. (2025) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70007 · Cited by 8
Teachers vs. Chat GPT: identifying and naming acts of online sexual abuse
Dolev-Cohen, M., & Henry, N. (2025) · Information, Communication & Society · doi:10.1080/1369118x.2025.2492585 · Cited by 8
“For instance, a meta-analysis on ChatGPT’s applications in psychiatry demonstrated its utility in diagnosing mental health issues, managing depression, evaluating suicide risk, and enhancing educational outcomes in the field (Omar et al., 2024).”
Assessing the impact of safety guardrails on large language models using irritability metrics
Teferra, B. G., Johny, N., Huang, S., Rueda, A., Kamaleddin, M. A., Dunlop, K., Zhang, Y., Jha, M., Sharma, D., & Bhat, V. (2026) · npj Digital Medicine · doi:10.1038/s41746-025-02333-3 · Cited by 5
Metadata
- Authors
- Omar, M., Soffer, S., Charney, A. W., Landi, I., Nadkarni, G. N., & Klang, E.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2024-06-24
- Volume
- 15
- Pages
- 1422807-1422807
- ISSN
- 1664-0640 (ISSN-L)
- OpenAlex
- W4399977125
- Cited by
- 84
- References
- 19
- FWCI
- 2.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.