Opportunities and risks of large language models in psychiatry
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
The integration of large language models (LLMs) into mental healthcare and research heralds a potentially transformative shift, one offering enhanced access to care, efficient data collection, and innovative therapeutic tools. This paper reviews the development, function, and burgeoning use of LLMs in psychiatry, highlighting their potential to enhance mental healthcare through improved diagnostic accuracy, personalized care, and streamlined administrative processes. It is also acknowledged that LLMs introduce challenges related to computational demands, potential for misinterpretation, and ethical concerns, necessitating the development of pragmatic frameworks to ensure their safe deployment. We explore both the promise of LLMs in enriching psychiatric care and research through examples such as predictive analytics and therapy chatbots and risks including labor substitution, privacy concerns, and the necessity for responsible AI practices. We conclude by advocating for processes to develop responsible guardrails, including red-teaming, multi-stakeholder-oriented safety, and ethical guidelines/frameworks, to mitigate risks and harness the full potential of LLMs for advancing mental health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“Progress in these methods has occurred in recent decades [6 – 14], particularly with the development of simpli fi ed network architecture (i.e., transformers) capable of rapidly and ef fi ciently conducting parallel processing of sequential data such as text [15].”
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330 · cited 1×
“One signi fi cant risk associated with the general capacities of LLMs is that they not only make human labor more ef fi cient, they can substitute for that labor [21].”
A guide to machine learning for biologists
Greener, J. G., Kandathil, S. M., Moffat, L., & Jones, D. T. (2022) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-021-00407-0 · Cited by 2,127 · cited 1×
“Machine learning constitutes a wide range of statistical methods [13], including those for estimating parameters and specifying connection structures in arti fi cial neural networks [12].”
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093 · cited 1×
“LLMs [37] hold marked potential for mental healthcare and research [38], primarily due to the central role language plays in the description, manifestation of, and treatment for mental health disorders.”
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Research works printed but not linked: 33
- Russell SJ, Norvig P. Artificial intelligence: a modern approach. 4th Edition ed. Pearson Series in Artificial Intelligence. Pearson; 2021.
- Schmidhuber J. Annotated History of Modern AI and Deep Learning. 2022:75. Technical Report IDSIA-22-22 (v2). https://arxiv.org/ftp/arxiv/papers/2212/2212.11279.pdf
- Taroni A. 90 years of the Ising model. Nat Phys. 2015;11:997–997. https://doi.org/10.1038/nphys3595 · DOI
- Amari SI. Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Trans Comput. 1972;C-21:1197–206. https://doi.org/10.1109/T-C.1972.223477 · DOI · Paper page
- Wolfram S. What Is ChatGPT Doing… and Why Does It Work? Stephen Wolfram; 2023. · DOI · Paper page
- Vaswani, A, Shazeer, N, Parmar, N, Uszkoreit, J, Jones, L, Gomez, AN, et al. Attention is all you need. arXiv. 2017. https://doi.org/10.48550/arXiv.1706.03762 · DOI · Paper page
- OpenAi. GPT-4 Technical Report. arXiv. 2023. 3/27/2023. https://doi.org/10.48550/arXiv.2303.08774 · DOI · Paper page
- Agrawal A, Gans J, Goldfarb A. Power and prediction: the disruptive economics of artificial intelligence. Harvard Business Review Press; 2022.
- Jiang LY, Liu XC, Nejatian NP, Nasir-Moin M, Wang D, Abidin A, et al. Health system-scale language models are all-purpose prediction engines. Nature. 2023;619:357–62. https://doi.org/10.1038/s41586-023-06160-y · DOI · Paper page
- Obradovich N, Johnson T, Paulus MP. Managerial and Organizational Challenges in the Age of AI. JAMA Psychiatry. 2024;81:219–20. https://doi.org/10.1001/jamapsychiatry.2023.5247 · DOI
- Braghieri L, Levy RE, Makarin A. Social media and mental health. Am Econ. Rev. 2022;112:3660–93. https://doi.org/10.1257/aer.20211218 · DOI · Paper page
- Solaiman, I, Talat, Z, Agnew, W, Ahmad, L, Baker, D, Blodgett, SL, et al. Evaluating the Social Impact of Generative AI Systems in Systems and Society. arXiv. 2023:cs.CY. https://doi.org/10.48550/arXiv.2306.05949 · arXiv · doi:10.48550/arxiv.2306.05949 · Paper page
- Parikh RB, Teeple S, Navathe AS. Addressing bias in artificial intelligence in health care. JAMA. 2019;322:2377–8. · DOI · Paper page
- Crossnohere NL, Elsaid M, Paskett J, Bose-Brill S, Bridges JFP. Guidelines for Artificial Intelligence in Medicine: Literature Review and Content Analysis of Frameworks. J Med Internet Res. 2022;24:e36823. https://doi.org/10.2196/36823 · DOI
- Volkow ND, Gordon JA, Koob GF. Choosing appropriate language to reduce the stigma around mental illness and substance use disorders. Neuropsychopharmacology. 2021;46:2230–2. https://doi.org/10.1038/s41386-021-01069-4 · DOI · Paper page
- Lamichhane B. Evaluation of ChatGPT for NLP-based Mental Health Applications. 2023. https://doi.org/10.48550/arXiv.2303.15727, https://arxiv.org/abs/2303.15727 · arXiv · doi:10.48550/arxiv.2303.15727 · Paper page
- Kannampallil T, Ajilore OA, Lv N, Smyth JM, Wittels NE, Ronneberg CR, et al. Effects of a virtual voice-based coach delivering problem-solving treatment on emotional distress and brain function: a pilot RCT in depression and anxiety. Transl Psychiatry. 2023;13:166. https://doi.org/10.1038/s41398-023-02462-x · DOI
- Yang K, Ji S, Zhang T, Xie Q, Kuang Z, Ananiadou S. Towards Interpretable Mental Health Analysis with ChatGPT. 2023. https://doi.org/10.48550/arXiv.2304.03347, https://arxiv.org/abs/2304.03347 · DOI
- Amin MM, Cambria E, Schuller BW. Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT. 2023. https://doi.org/10.48550/arXiv.2303.03186, https://arxiv.org/abs/2303.03186 · arXiv · doi:10.48550/arxiv.2303.03186 · Paper page
- Peng C, Yang X, Yu Z, Bian J, Hogan WR, Wu Y. Clinical concept and relation extraction using prompt-based machine reading comprehension. Journal of the American Medical Informatics Association : JAMIA. Jun 14 2023; https://doi.org/10.1093/jamia/ocad107 · DOI
- Shortreed SM, Walker RL, Johnson E, Wellman R, Cruz M, Ziebell R, et al. Complex modeling with detailed temporal predictors does not improve health records-based suicide risk prediction. NPJ Digit Med. 2023;6:47. https://doi.org/10.1038/s41746-023-00772-4.23 · doi:10.1038/s41746-023-00772-4.23
- Rollwage M, Juchems K, Habicht J, Carrington B, Hauser T, Harper R. Conversational AI facilitates mental health assessments and is associated with improved recovery rates. medRxiv. 2022:2022.11.03.22281887. https://doi.org/10.1101/2022.11.03.22281887 · DOI
- Echeazarra L, Pereira J, Saracho R. TensioBot: a chatbot assistant for self-managed in-house blood pressure checking. J Med Syst. 2021;45:54. https://doi.org/10.1007/s10916-021-01730-x · DOI · Paper page
- Maeda E, Miyata A, Boivin J, Nomura K, Kumazawa Y, Shirasawa H, et al. Promoting fertility awareness and preconception health using a chatbot: a randomized controlled trial. Reprod Biomed Online. 2020;41:1133–43. https://doi.org/10.1016/j.rbmo.2020.09.006 · DOI · Paper page
- Perlis RH. Research Letter: Application of GPT-4 to select next-step antidepressant treatment in major depression. medRxiv. 2023; https://doi.org/10.1101/2023.04.14.23288595 · DOI · Paper page
- Perlis RH, Goldberg JF, Ostacher MJ, Schneck CD. Clinical decision support for bipolar depression using large language models. Neuropsychopharmacology 2024; https://doi.org/10.1038/s41386-024-01841-2 · DOI · Paper page
- van Heerden AC, Pozuelo JR, Kohrt BA. Global Mental Health Services and the Impact of Artificial Intelligence-Powered Large Language Models. JAMA Psychiatry. 2023; https://doi.org/10.1001/jamapsychiatry.2023.1253 · DOI · Paper page
- Johnson T, Obradovich N. Evidence of behavior consistent with self-interest and altruism in an artificially intelligent agent. arXiv. 2023:cs.AI. 1/5/2023. https://doi.org/10.48550/arXiv.2301.02330, https://arxiv.org/abs/2301.02330 · DOI
- Passi S, Vorvoreanu M. Overreliance on AI: Literature review. AETHER: AI Ethics and Effects in Engineering and Research. 2022:1–23. · doi:10.1007/978-981-97-8440-0_98-1
- Perlis RH, Fihn SD. Evaluating the Application of Large Language Models in Clinical Research Contexts. JAMA Netw Open. 2023;6:e2335924. https://doi.org/10.1001/jamanetworkopen.2023.35924 · DOI · Paper page
- Goldberg, CB, Adams, L, Blumenthal, D, Brennan, PF, Brown, N, Butte, AJ, et al. To do no harm - and the most good - with AI in health care. Nat Med. 2024; https://doi.org/10.1038/s41591-024-02853-7 · DOI
- OpenAI Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Leoni Aleman F, et al GPT-4 Technical Report. arXiv. 2023. https://doi.org/10.48550/arXiv.2303.08774 · DOI · Paper page
- Ge S, Zhou C, Hou R, Khabsa M, Wang YC, Wang Q, et al. MART: Improving LLM Safety with Multi-round Automatic Red-Teaming. arXiv. 2023. http://arxiv.org/abs/2311.07689 · arXiv
Cited by
AI Chatbots for Mental Health: A Scoping Review of Effectiveness, Feasibility, and Applications
Casu, M., Triscari, S., Battiato, S., Guarnera, L., & Caponnetto, P. (2024) · Applied Sciences · doi:10.3390/app14135889 · Cited by 186
Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations
Wang, L., Bhanushali, T., Huang, Z., Yang, J., Badami, S., & Hightow-Weidman, L. (2025) · JMIR Mental Health · doi:10.2196/70014 · Cited by 73
“The training of a mental health professional usually starts with a foundational knowledge base of psychopathology and clinical treatment, which LLM, with its vast amount of data, presumably already possesses [15].”
Stade, E. C., Eichstaedt, J. C., Kim, J. P., & Wiltsey Stirman, S. (2025) · Technology, Mind, and Behavior · doi:10.1037/tmb0000163 · Cited by 23
Large language models as mental health providers
Rousmaniere, T., Goldberg, S. B., & Torous, J. (2026) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00269-x · Cited by 22
From statistics to deep learning: Using large language models in psychiatric research
Hua, Y., Beam, A., Chibnik, L. B., & Torous, J. (2025) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70007 · Cited by 8
Metadata
- Authors
- Obradovich, N., Khalsa, S. S., Khan, W. U., Suh, J., Perlis, R. H., Ajilore, O., & Paulus, M. P.
- Venue
- NPP—Digital Psychiatry and Neuroscience
- Published
- 2024-05-24
- Volume
- 2
- Issue
- 1
- ISSN
- 2948-1570 (ISSN-L)
- OpenAlex
- W4398766485
- Cited by
- 79
- References
- 36
- FWCI
- 6.33
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- The William K. Warren Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Opportunities and risks of large language models in psychiatry. https://app.cochat.ai/papers/10.1038/s44277-024-00010-z
- The paper
- Obradovich, N., Khalsa, S. S., Khan, W. U., Suh, J., Perlis, R. H., Ajilore, O., & Paulus, M. P. (2024). Opportunities and risks of large language models in psychiatry. NPP—Digital Psychiatry and Neuroscience. https://doi.org/10.1038/s44277-024-00010-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.