CoChat
Sign Up
PreprintCited by 78Digital Mental Health InterventionsArtificial Intelligence in Healthcare and EducationEthics and Social Impacts of AI

Benefits and Harms of Large Language Models in Digital Mental Health

Open access
De Choudhury, Munmun, Pendse, Sachin R., Kumar, Neha·2023·arXiv
DOI 10.48550/arxiv.2311.14693arXiv 2311.14693
Open this paper in CoChat — free accountOpen PDF

Abstract

The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for valuable insights into patient experiences, promising early, proactive interventions, as well as personalized treatment plans. Recent developments in generative artificial intelligence, particularly large language models (LLMs), show promise in leading digital mental health to uncharted territory. Patients are arriving at doctors' appointments with information sourced from chatbots, state-of-the-art LLMs are being incorporated in medical software and EHR systems, and chatbots from an ever-increasing number of startups promise to serve as AI companions, friends, and partners. This article presents contemporary perspectives on the opportunities and risks posed by LLMs in the design, development, and implementation of digital mental health tools. We adopt an ecological framework and draw on the affordances offered by LLMs to discuss four application areas -- care-seeking behaviors from individuals in need of care, community care provision, institutional and medical care provision, and larger care ecologies at the societal level. We engage in a thoughtful consideration of whether and how LLM-based technologies could or should be employed for enhancing mental health. The benefits and harms our article surfaces could serve to help shape future research, advocacy, and regulatory efforts focused on creating more responsible, user-friendly, equitable, and secure LLM-based tools for mental health treatment and intervention.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2311.14693

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 156 · Cited by 78

Part of this paper’s reference list could not be split into single entries.

Research works printed but not linked: 55

  1. Moura, I., Teles, A., Viana, D., Marques, J., Coutinho, L. & Silva, F. Digital phenotyping of mental health using multimodal sensing of multiple situations of interest: A systematic literature review. Journal of Biomedical Informatics, 104278 (2022).
  2. Chancellor, S. & De Choudhury, M. Methods in predictive techniques for mental health status on social media: a critical review. NPJ digital medicine 3, 43 (2020).
  3. De Choudhury, M., Counts, S. & Horvitz, E. Predicting postpartum changes in emotion and behavior via social media in Proceedings of the SIGCHI conference on human factors in computing systems (2013), 3267-3276.
  4. De Choudhury, M., Kiciman, E., Dredze, M., Coppersmith, G. & Kumar, M. Discovering shifts to suicidal ideation from mental health content in social media in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (2016), 2098-2110.
  5. Pendse, S. R., Nkemelu, D., Bidwell, N. J., Jadhav, S., Pathare, S., De Choudhury, M. & Kumar, N. From treatment to healing: envisioning a decolonial digital mental health in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (2022), 1-23.
  6. Bossewitch, J., Brown, L. X., Gooding, P. M., Harris, L., Horton, J., Katterl, S., Myrick, K., Ubozoh, K. & Vasquez Encalada, A. Digital Futures in Mind: Reflecting on Technological Experiments in Mental Health & Crisis Support. Available at SSRN 4215994 (2022).
  7. Thieme, A., Belgrave, D. & Doherty, G. Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 1-53 (2020).
  8. Ernala, S. K., Rizvi, A. F., Birnbaum, M. L., Kane, J. M. & De Choudhury, M. Linguis- tic markers indicating therapeutic outcomes of social media disclosures of schizophrenia. Proceedings of the ACM on Human-Computer Interaction 1, 1-27 (2017).
  9. Crasto, R., Dias, L., Miranda, D. & Kayande, D. CareBot: A Mental Health ChatBot in 2021 2nd International Conference for Emerging Technology (INCET) [Internet]. [cited 2023 Mar (IEEE, Belagavi, India, 2021), 1-5.
  10. O'Leary, K. Human-AI collaboration boosts mental health support. Nat Med. https : //www.nature.com/articles/d41591-023-00022-w (2023).
  11. Zack, T., Lehman, E., Suzgun, M., Rodriguez, J. A., Celi, L. A., Gichoya, J., Jurafsky, D., Szolovits, P., Bates, D. W., Abdulnour, R.-E. E., et al. Coding Inequity: Assessing GPT- 4's Potential for Perpetuating Racial and Gender Biases in Healthcare. medRxiv, 2023-07 (2023).
  12. Omiye, J. A., Lester, J., Spichak, S., Rotemberg, V. & Daneshjou, R. Beyond the hype: large language models propagate race-based medicine. medRxiv, 2023-07 (2023).
  13. Zhou, J., Zhang, Y., Luo, Q., Parker, A. G. & De Choudhury, M. Synthetic lies: Under- standing ai-generated misinformation and evaluating algorithmic and human solutions in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (2023), 1-20.
  14. Bender, E. M., Gebru, T., McMillan-Major, A. & Shmitchell, S. On the dangers of stochastic parrots: Can language models be too big? in Proceedings of the 2021 ACM conference on fairness, accountability, and transparency (2021), 610-623.
  15. Colby, K. M., Watt, J. B. & Gilbert, J. P. A computer method of psychotherapy: Preliminary communication. The Journal of Nervous and Mental Disease 142, 148-152 (1966).
  16. Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S. & Torous, J. B. Chat- bots and conversational agents in mental health: a review of the psychiatric landscape. The Canadian Journal of Psychiatry 64, 456-464 (2019).
  17. Vallée, J., Shareck, M., Kestens, Y. & Frohlich, K. L. Everyday geography and service ac- cessibility: the contours of disadvantage in relation to mental health. Annals of the American Association of Geographers 112, 931-947 (2022).
  18. Rochford, B., Pendse, S., Kumar, N. & De Choudhury, M. Leveraging symptom search data to understand disparities in US mental health care: demographic analysis of search engine trace data. JMIR Mental Health 10, e43253 (2023).
  19. Scrutton, A. P. in The Routledge handbook of epistemic injustice 347-355 (Routledge, 2017).
  20. Pendse, S. R., Kumar, N. & De Choudhury, M. Marginalization and the Construction of Mental Illness Narratives Online: Foregrounding Institutions in Technology-Mediated Care. Proceedings of the ACM on Human-Computer Interaction 7, 1-30 (2023).
  21. Butler, A. C., Chapman, J. E., Forman, E. M. & Beck, A. T. The empirical status of cognitive- behavioral therapy: A review of meta-analyses. Clinical psychology review 26, 17-31 (2006).
  22. Black, V. E. De-humanizing Care: An Ethnography of Mental Health Artificial Intelligence PhD thesis (University of California, Berkeley, 2023).
  23. Stanhope, V., Barrenger, S. L., Salzer, M. S. & Marcus, S. C. Examining the relationship between choice, therapeutic alliance and outcomes in mental health services. Journal of Personalized Medicine 3, 191-202 (2013).
  24. Gladstein, G. A. Nonverbal communication and counseling/psychotherapy: A review. The Counseling Psychologist 4, 34-57 (1974).
  25. Greenberg, L. S. & Pascual-Leone, A. Emotion in psychotherapy: A practice-friendly re- search review. Journal of clinical psychology 62, 611-630 (2006).
  26. Federal Trade Commission. FTC to Ban BetterHelp from Revealing Consumers' Data, In- cluding Sensitive Mental Health Information, to Facebook and Others for Targeted Adver- tising. Press Release, Federal Trade Commission (2023).
  27. De Freitas, J., Uguralp, A. K., Oguz-Uguralp, Z. & Puntoni, S. Chatbots and Mental Health: Insights into the Safety of Generative AI. Journal of Consumer Psychology (2022).
  28. Pendse, S. R., Sharma, A., Vashistha, A., De Choudhury, M. & Kumar, N. "Can I not be suicidal on a Sunday?": understanding technology-mediated pathways to mental health support in Proceedings of the 2021 CHI Conference on Human Factors in Computing Sys- tems (2021), 1-16.
  29. Abd-Alrazaq, A. A., Alajlani, M., Alalwan, A. A., Bewick, B. M., Gardner, P. & Househ, M. An overview of the features of chatbots in mental health: A scoping review. International Journal of Medical Informatics 132, 103978 (2019).
  30. Norcross, J. C. & Wampold, B. E. What works for whom: Tailoring psychotherapy to the person. Journal of clinical psychology 67, 127-132 (2011).
  31. Matthews, S., Cantor, J. H., Holliday, S. B., Bialas, A., Eberhart, N. K., Breslau, J. & McBain, R. K. National preparedness for 988-the new mental health emergency hotline in the United States. Preventive medicine reports 33, 102208 (2023).
  32. Skorburg, J. A. & Friesen, P. Mind the Gaps: Ethical and Epistemic Issues in the Digital Mental Health Response to Covid-19. Hastings Center Report 51, 23 (2021).
  33. Hoffberg, A. S., Stearns-Yoder, K. A. & Brenner, L. A. The effectiveness of crisis line services: a systematic review. Frontiers in public health 7, 399 (2020).
  34. Pendse, S. R., Lalani, F. M., De Choudhury, M., Sharma, A. & Kumar, N. " Like Shock Ab- sorbers": understanding the human infrastructures of technology-mediated mental health support in Proceedings of the 2020 CHI Conference on Human Factors in Computing Sys- tems (2020), 1-14.
  35. Althoff, T., Clark, K. & Leskovec, J. Large-scale analysis of counseling conversations: An application of natural language processing to mental health. Transactions of the Association for Computational Linguistics 4, 463-476 (2016).
  36. Chakrabarty, T., Hidey, C. & Muresan, S. ENTRUST: Argument reframing with language models and entailment. arXiv preprint arXiv:2103.06758 (2021). · arXiv
  37. Sharma, E. & De Choudhury, M. Mental Health Support and its Relationship to Linguistic Accommodation in Online Communities in CHI (2018).
  38. Cheng, Y. & Jiang, H. AI-Powered mental health chatbots: Examining users' motivations, active communicative action and engagement after mass-shooting disasters. Journal of Con- tingencies and Crisis Management 28, 339-354 (2020).
  39. Ehsan, U., Wintersberger, P., Liao, Q. V., Watkins, E. A., Manger, C., Daumé III, H., Riener, A. & Riedl, M. O. Human-Centered Explainable AI (HCXAI): beyond opening the black- box of AI in CHI conference on human factors in computing systems extended abstracts (2022), 1-7.
  40. Turkington, R., Mulvenna, M. D., Bond, R. R., O'Neill, S., Potts, C., Armour, C., Ennis, E. & Millman, C. Why do people call crisis helplines? Identifying taxonomies of presenting reasons and discovering associations between these reasons. Health informatics journal 26, 2597-2613 (2020).
  41. McCambridge, J., Witton, J. & Elbourne, D. R. Systematic review of the Hawthorne ef- fect: new concepts are needed to study research participation effects. Journal of clinical epidemiology 67, 267-277 (2014).
  42. Nissenbaum, H. Privacy as contextual integrity. Wash. L. Rev. 79, 119 (2004).
  43. Li, H., Vincent, N., Chancellor, S. & Hecht, B. The Dimensions of Data Labor: A Road Map for Researchers, Activists, and Policymakers to Empower Data Producers in Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (2023), 1151- 1161.
  44. Yoo, D. W., Woo, H., Pendse, S. R., Lu, N., Birnbaum, M. L., Abowd, G. & De Choudhury, M. Missed Opportunities for Human-Centered AI Research: Understanding Stakeholder Collaboration in Mental Health AI Research. Proceedings of the ACM on Human-Computer Interaction (2024).
  45. Saha, K., Sugar, B., Torous, J., Abrahao, B., Kıcıman, E. & De Choudhury, M. A social media study on the effects of psychiatric medication use in Proceedings of the International AAAI Conference on Web and Social Media 13 (2019), 440-451.
  46. Saha, K., Torous, J., Kiciman, E., De Choudhury, M., et al. Understanding side effects of antidepressants: Large-scale longitudinal study on social media data. JMIR mental health 8, e26589 (2021).
  47. Ayvaz, S., Horn, J., Hassanzadeh, O., Zhu, Q., Stan, J., Tatonetti, N. P., Vilar, S., Brochhausen, M., Samwald, M., Rastegar-Mojarad, M., et al. Toward a complete dataset of drug-drug in- teraction information from publicly available sources. Journal of biomedical informatics 55, 206-217 (2015).
  48. Papoutsaki, A., So, S., Kenderova, G., Shapiro, B. & Epstein, D. A. Understanding De- livery of Collectively Built Protocols in an Online Health Community for Discontinuation of Psychiatric Drugs. Proceedings of the ACM on Human-Computer Interaction 5, 1-29 (2021). 100. Lyons, J. S., Stutesman, J., Neme, J., Vessey, J. T., O'Mahoney, M. T. & Camper, H. J. Predicting psychiatric emergency admissions and hospital outcome. Medical care, 792-800 (1997). 101. Alonso, S. G., de La Torre-Díez, I., Hamrioui, S., López-Coronado, M., Barreno, D. C., Nozaleda, L. M. & Franco, M. Data mining algorithms and techniques in mental health: a systematic review. Journal of medical systems 42, 1-15 (2018). 102. Birnbaum, M. L., Ernala, S. K., Rizvi, A., Arenare, E., R. Van Meter, A, De Choudhury, M & Kane, J. M. Detecting relapse in youth with psychotic disorders utilizing patient-generated and patient-contributed digital data from facebook. NPJ schizophrenia 5, 17 (2019). 103. Yang, X., Chen, A., PourNejatian, N., Shin, H. C., Smith, K. E., Parisien, C., Compas, C., Martin, C., Costa, A. B., Flores, M. G., et al. A large language model for electronic health records. NPJ Digital Medicine 5, 194 (2022). 104. Steinberg, E., Jung, K., Fries, J. A., Corbin, C. K., Pfohl, S. R. & Shah, N. H. Language models are an effective representation learning technique for electronic health record data. Journal of biomedical informatics 113, 103637 (2021). 105. Kottlors, J., Bratke, G., Rauen, P., Kabbasch, C., Persigehl, T., Schlamann, M. & Lennartz, S. Feasibility of differential diagnosis based on imaging patterns using a large language model. Radiology 308, e231167 (2023). 106. Gala, D. & Makaryus, A. N. The utility of language models in cardiology: a narrative re- view of the benefits and concerns of ChatGPT-4. International Journal of Environmental Research and Public Health 20, 6438 (2023). 107. Clusmann, J., Kolbinger, F. R., Muti, H. S., Carrero, Z. I., Eckardt, J.-N., Laleh, N. G., Löffler, C. M. L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G. P., et al. The future land- scape of large language models in medicine. Communications Medicine 3, 141 (2023). 108. Botelho, F., Tshimula, J. M. & Poenaru, D. Leveraging ChatGPT to Democratize and De- colonize Global Surgery: Large Language Models for Small Healthcare Budgets. World Journal of Surgery, 1-2 (2023). 109. Verma, G., Bhardwaj, A., Aledavood, T., De Choudhury, M. & Kumar, S. Examining the impact of sharing COVID-19 misinformation online on mental health. Scientific Reports 12, 8045 (2022). 110. Jin, Y., Chandra, M., Verma, G., Hu, Y., Choudhury, M. D. & Kumar, S. Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries 2023. arXiv: 2310.13132 [cs.CL]. 111. Bhatt, S., Goyal, P., Dandapat, S., Choudhury, M. & Sitaram, S. On the universality of deep contextual language models. arXiv preprint arXiv:2109.07140 (2021). 112. Petrik, M. L., Billera, M., Kaplan, Y., Matarazzo, B. & Wortzel, H. Balancing patient care and confidentiality: considerations in obtaining collateral information. Journal of Psychi- atric Practice® 21, 220-224 (2015). 113. Nichter, M. Idioms of distress revisited. Culture, Medicine, and Psychiatry 34, 401-416 (2010). 114. Kleinman, A. The illness narratives: Suffering, healing, and the human condition (Basic books, 1988). 115. Harrigian, K., Aguirre, C. & Dredze, M. Do models of mental health based on social media data generalize? in Findings of the association for computational linguistics: EMNLP 2020 (2020), 3774-3788. 116. Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Chen, Y., et al. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models. arXiv preprint arXiv:2309.01219 (2023). 117. · arXiv
  49. Chancellor, S., Nitzburg, G., Hu, A., Zampieri, F. & De Choudhury, M. Discovering Alter- native Treatments for Opioid Use Recovery Using Social Media in Proc. CHI (2019). 118. ElSherief, M., Sumner, S. A., Jones, C. M., Law, R. K., Kacha-Ochana, A., Shieber, L., Cordier, L., Holton, K. & De Choudhury, M. Characterizing and identifying the prevalence of web-based misinformation relating to medication for opioid use disorder: Machine learn- ing approach. Journal of medical Internet research 23, e30753 (2021). 119.
  50. Yoo, D. W., Ernala, S. K., Saket, B., Weir, D., Arenare, E., Ali, A. F., Van Meter, A. R., Birn- baum, M. L., Abowd, G. D. & De Choudhury, M. Clinician perspectives on using compu- tational mental health insights from patients' social media activities: design and qualitative evaluation of a prototype. JMIR Mental Health 8, e25455 (2021). 123. Duffourc, M. & Gerke, S. Generative AI in health care and liability risks for physicians and safety concerns for patients. Jama (2023). 124.
  51. Saenz, A. D., Harned, Z., Banerjee, O., Abràmoff, M. D. & Rajpurkar, P. Autonomous AI systems in the face of liability, regulations and costs. NPJ digital medicine 6, 185 (2023). 125. Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. Ethical and social risks of harm from language models. arXiv preprint arXiv:2112.04359 (2021). 126. Halleck, S. L. & Halleck, S. L. The Psychiatrist's Liability for Negligent Diagnosis. Law in the Practice of Psychiatry: A Handbook for Clinicians, 65-82 (1980). 127. Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M. & Zubizarreta, J. R. Suicide prediction models: a critical review of recent research with recommendations for the way forward. Molecular psychiatry 25, 168-179 (2020). 128. Large, M. M. The role of prediction in suicide prevention. Dialogues in clinical neuro- science (2018). 129. · arXiv
  52. Bhardwaj, R., Majumder, N. & Poria, S. Investigating gender bias in bert. Cognitive Com- putation 13, 1008-1018 (2021). 149. Kurita, K., Vyas, N., Pareek, A., Black, A. W. & Tsvetkov, Y. Measuring Bias in Con- textualized Word Representations in Proceedings of the First Workshop on Gender Bias in Natural Language Processing (eds Costa-jussà, M. R., Hardmeier, C., Radford, W. & Web- ster, K.) (Association for Computational Linguistics, Florence, Italy, Aug. 2019), 166-172. https://aclanthology.org/W19-3823. 150. Tan, Y. C. & Celis, L. E. Assessing social and intersectional biases in contextualized word representations. Advances in neural information processing systems 32 (2019). 151.
  53. Caliskan, A., Bryson, J. J. & Narayanan, A. Semantics derived automatically from language corpora contain human-like biases. Science 356, 183-186 (2017). 152. Kiritchenko, S. & Mohammad, S. Examining Gender and Race Bias in Two Hundred Senti- ment Analysis Systems in Proceedings of the Seventh Joint Conference on Lexical and Com- putational Semantics (eds Nissim, M., Berant, J. & Lenci, A.) (Association for Computa- tional Linguistics, New Orleans, Louisiana, June 2018), 43-53. https://aclanthology. org/S18-2005. 153. Tate, S. Generative Artificial Intelligence Tools in Medicine Will Amplify Stigmatizing Language. Journal of Addiction Medicine, 10-1097 (2023). 154. Weiner, S. G., Lo, Y.-C., Carroll, A. D., Zhou, L., Ngo, A., Hathaway, D. B., Rodriguez, C. P. & Wakeman, S. E. The incidence and disparities in use of stigmatizing language in clinical notes for patients with substance use disorder. Journal of addiction medicine, 10- 1097 (2023). 155. Mueser, K. T., DeTore, N. R., Kredlow, M. A., Bourgeois, M. L., Penn, D. L. & Hintz, K. Clinical and demographic correlates of stigma in first-episode psychosis: The impact of duration of untreated psychosis. Acta Psychiatrica Scandinavica 141, 157-166 (2020). 156. Barnes, A. Race and schizophrenia diagnoses in four types of hospitals. Journal of Black Studies 44, 665-681 (2013). 157. Bender, E. M. & Koller, A. Climbing towards NLU: On meaning, form, and understand- ing in the age of data in Proceedings of the 58th annual meeting of the association for computational linguistics (2020), 5185-5198. 158. Horvitz, E. Principles of mixed-initiative user interfaces in Proceedings of the SIGCHI con- ference on Human Factors in Computing Systems (1999), 159-166. 159.
  54. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Iii, H. D. & Craw- ford, K. Datasheets for datasets. Communications of the ACM 64, 86-92 (2021). 161. Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D. & Gebru, T. Model cards for model reporting in Proceedings of the conference on fairness, accountability, and transparency (2019), 220-229. 162.
  55. Ajmani, L. H., Chancellor, S., Mehta, B., Fiesler, C., Zimmer, M. & De Choudhury, M. A Systematic Review of Ethics Disclosures in Predictive Mental Health Research in Proceed- ings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (2023), 1311-1323. 163. Guaglione, S. The case for and against open-source large language models for use in newsrooms -digiday.com https : / / digiday . com / media / the -case -for - and-against-open-source-large-language-models-for-use-in- newsrooms/. [Accessed 05-11-2023]. 164. Harrer, S. Council Post: From Boring And Safe To Exciting And Dangerous: Why Large Language Models Need To Be Regulated -forbes.com https://www.forbes.com/ sites/forbestechcouncil/2023/03/22/from-boring-and-safe-to- exciting-and-dangerous-why-large-language-models-need-to-be- regulated/. [Accessed 05-11-2023]. 165. Joint Statement on AI Safety and Openness -open.mozilla.org https://open.mozilla. org/letter/. [Accessed 05-11-2023]. 166. Biden, J. Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence The White House. Accessed: 2023-11-03. 2023. https : / / www.whitehouse.gov/briefing-room/presidential-actions/2023/ 10/30/executive-order-on-the-safe-secure-and-trustworthy- development-and-use-of-artificial-intelligence/. 167. Press corner -ec.europa.eu https://ec.europa.eu/commission/presscorner/ detail/en/ip_23_5379. [Accessed 06-11-2023]. 168. Meskó, B. & Topol, E. J. The imperative for regulatory oversight of large language models (or generative AI) in healthcare. npj Digital Medicine 6, 120 (2023). 169. Empatica. Empatica's Platform Receives New FDA Clearance for Cardiac Digital Biomark- ers 2023. https : / / www . prnewswire . com / news -releases / empaticas - platform -receives -new -fda -clearance -for -cardiac -digital - biomarkers-301975974.html. 170. Empatica. Empatica Receives New FDA Clearance for Its Health Monitoring Platform and Announces Series B Financing 2022. https : / / www . prnewswire . com / news - releases/empatica-receives-new-fda-clearance-for-its-health- monitoring-platform-and-announces-series-b-financing-301685344. html. 171. Kleinman, A. The soul of care: the moral education of a husband and a doctor (Penguin, 2020).

Authors
De Choudhury, M., Pendse, S. R., & Kumar, N.
Affiliations
Georgia Institute of Technology (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
DOI
10.48550/arxiv.2311.14693
arXiv
2311.14693
OpenAlex
W4388733340
Cited by
78
References
156
Citations by year
2026: 35 · 2025: 28 · 2024: 15
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • American Foundation for Suicide Prevention
  • National Institute of Mental Health (R01MH117172, P50MH115838)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
large language models, digital mental health, generative AI, chatbots, care-seeking behavior, community-based care, institutional care, ecological model, affordances, electronic health records, AI companions, benefits and harms, AI regulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review