CoChat
Sign Up
PreprintCited by 64Digital Mental Health InterventionsSocial Robot Interaction and HRIEthics and Social Impacts of AI

The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support

Open access
Song, Inhwa, Pendse, Sachin R., Kumar, Neha, De Choudhury, Munmun·2024·arXiv
DOI 10.48550/arxiv.2401.14362arXiv 2401.14362
Open this paper in CoChat — free accountOpen PDF

Abstract

People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence suggests that general-purpose LLM chatbots also have notable risks that could endanger the welfare of users if not designed responsibly. In this study, we investigate the lived experiences of people who have used LLM chatbots for mental health support. We build on interviews with 21 individuals from globally diverse backgrounds to analyze how users create unique support roles for their chatbots, fill in gaps in everyday care, and navigate associated cultural limitations when seeking support from chatbots. We ground our analysis in psychotherapy literature around effective support, and introduce the concept of therapeutic alignment, or aligning AI with therapeutic values for mental health contexts. Our study offers recommendations for how designers can approach the ethical and effective use of LLM chatbots and other AI mental health support tools in mental health care.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2401.14362

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 59 · Cited by 64

Research works printed but not linked: 76

  1. Alaa A Abd-Alrazaq, Mohannad Alajlani, Ali Abdallah Alalwan, Bridge e M Bewick, Peter Gardner, and Mowafa Househ. 2019. An overview of the features of chatbots in mental health: A scoping review. International journal of medical informatics 132 (2019), 103978.
  2. Alaa Ali Abd-Alrazaq, Asma Rababeh, Mohannad Alajlani, Bridge e M Bewick, and Mowafa Househ. 2020. Effec- tiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis. Journal of medical Internet research 22, 7 (2020), e16021.
  3. Francois Barnard, Marlize Van Si ert, and Sirisha Rambhatla. 2023. Self-diagnosis and large language models: A new front for medical misinformation. arXiv preprint arXiv:2307.04910 (2023). · arXiv
  4. Aaron T Beck. 1991. Cognitive therapy: A 30-year retrospective. American psychologist 46, 4 (1991), 368.
  5. Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M Vardoulakis. 2020. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1-12.
  6. Patrick Biernacki and Dan Waldorf. 1981. Snowball sampling: Problems and techniques of chain referral sampling. Sociological methods & research 10, 2 (1981), 141-163.
  7. Edward S Bordin. 1979. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, research & practice 16, 3 (1979), 252.
  8. Eliane M Boucher, Nicole R Harake, Haley E Ward, Sarah Elizabeth Stoeckl, Junielly Vargas, Jared Minkel, Acacia C Parks, and Ran Zilca. 2021. Artificially intelligent chatbots in digital mental health interventions: a review. Expert Review of Medical Devices 18, sup1 (2021), 37-49.
  9. Alistair Campbell. 1999. Single session interventions: An example of clinical research in practice. Australian and New Zealand Journal of Family Therapy 20, 4 (1999), 183-194.
  10. Hyojin Chin, Hyeonho Song, Gumhee Baek, Mingi Shin, Chani Jung, Meeyoung Cha, Junghoi Choi, and Chiyoung Cha. 2023. The potential of chatbots for emotional support and promoting mental well-being in different cultures: mixed methods study. Journal of Medical Internet Research 25 (2023), e51712.
  11. Kenneth Mark Colby, James B Wa , and John P Gilbert. 1966. A computer method of psychotherapy: Preliminary communication. The Journal of Nervous and Mental Disease 142, 2 (1966), 148-152.
  12. Kimberly E Culley and Poornima Madhavan. 2013. A note of caution regarding anthropomorphism in HCI agents. Computers in Human Behavior 29, 3 (2013), 577-579.
  13. Simon D'Alfonso, Reeva Lederman, Sandra Bucci, Katherine Berry, et al. 2020. The digital therapeutic alliance and human-computer interaction. JMIR mental health 7, 12 (2020), e21895.
  14. Sindhu Kiranmai Ernala, Jordyn Seybolt, Dong Whi Yoo, Michael L Birnbaum, John M Kane, and Munmun De Choudhury. 2022. The Reintegration Journey Following a Psychiatric Hospitalization: Examining the Role of Social Technologies. Proceedings of the ACM on Human-computer Interaction 6, CSCW1 (2022), 1-31.
  15. Sarah Evans-Lacko, Sergio Aguilar-Gaxiola, Ali Al-Hamzawi, Jordi Alonso, Corina Benjet, Ronny Bruffaerts, WT Chiu, Silvia Florescu, Giovanni de Girolamo, Oye Gureje, et al. 2018. Socio-economic variations in the mental health treatment gap for people with anxiety, mood, and substance use disorders: results from the WHO World Mental Health (WMH) surveys. Psychological medicine 48, 9 (2018), 1560-1571.
  16. Riccardo Fogliato, Shreya Chappidi, Ma hew Lungren, Paul Fisher, Diane Wilson, Michael Fitzke, Mark Parkinson, Eric Horvitz, Kori Inkpen, and Besmira Nushi. 2022. Who goes first? Influences of human-AI workflow on decision making in clinical imaging. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 1362-1374.
  17. Jerome D Frank and Julia B Frank. 1993. Persuasion and healing: A comparative study of psychotherapy. JHU Press.
  18. Sigmund Freud and Joseph Breuer. 2004. Studies in hysteria. Penguin.
  19. Iason Gabriel. 2020. Artificial intelligence, values, and alignment. Minds and machines 30, 3 (2020), 411-437.
  20. Jill G Grant and Deena Mandell. 2016. Boundaries and relationships between service users and service providers in community mental health services. Social work in mental health 14, 6 (2016), 696-713.
  21. Kathleen T Heinlen, Elizabeth Reynolds Welfel, Elizabeth N Richmond, and Melissa S O'Donnell. 2003. The nature, scope, and ethics of psychologists'e-therapy Web sites: What consumers find when surfing the Web. Psychotherapy: theory, research, practice, training 40, 1-2 (2003), 112.
  22. Philip Henson, Pamela Peck, and John Torous. 2019. Considering the therapeutic alliance in digital mental health interventions. Harvard review of psychiatry 27, 4 (2019), 268-273.
  23. Azra Ismail, Divy Thakkar, Neha Madhiwalla, and Neha Kumar. 2023. Public Health Calls for/with AI: An Ethno- graphic Perspective. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1-26.
  24. Eunkyung Jo, Daniel A Epstein, Hyunhoon Jung, and Young-Ho Kim. 2023. Understanding the benefits and chal- lenges of deploying conversational AI leveraging large language models for public health intervention. In Proceed- ings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-16.
  25. Benjamin Kaveladze and Stephen M Schueller. 2023. A digital therapeutic alliance in digital mental health. In Digital therapeutics for mental health and addiction. Elsevier, 87-98.
  26. Elizabeth Kaziunas, Michael S Klinkman, and Mark S Ackerman. 2019. Precarious interventions: Designing for ecologies of care. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1-27.
  27. Siwon Kim, Sangdoo Yun, Hwaran Lee, Martin Gubri, Sungroh Yoon, and Seong Joon Oh. 2024. Propile: Probing privacy leakage in large language models. Advances in Neural Information Processing Systems 36 (2024).
  28. Taenyun Kim and Hayeon Song. 2023. Communicating the limitations of AI: the effect of message framing and ownership on trust in artificial intelligence. International Journal of Human-Computer Interaction 39, 4 (2023), 790- 800.
  29. Rafal Kocielnik, Elena Agapie, Alexander Argyle, Dennis T Hsieh, Kabir Yadav, Breena Taira, and Gary Hsieh. 2019. HarborBot: a chatbot for social needs screening. In AMIA Annual Symposium Proceedings, Vol. 2019. American Med- ical Informatics Association, 552.
  30. Min Hun Lee and Chong Jun Chew. 2023. Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1-22.
  31. Min Hun Lee, Daniel P Siewiorek, Asim Smailagic, Alexandre Bernardino, and Sergi Bermúdez Bermúdez i Badia. 2021. A human-ai collaborative approach for clinical decision making on rehabilitation assessment. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1-14.
  32. Yanchen Liu, Srishti Gautam, Jiaqi Ma, and Himabindu Lakkaraju. 2024. Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications. In Proceedings of the 2024 Confer- ence of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 3603-3620.
  33. Lester Luborsky, Barton Singer, and Lise Luborsky. 1975. Comparative studies of psychotherapies: Is it true that everyone has won and all must have prizes? Archives of general psychiatry 32, 8 (1975), 995-1008.
  34. Martin N Marshall. 1996. Sampling for qualitative research. Family practice 13, 6 (1996), 522-526.
  35. Chandler McClellan, Mir M Ali, and Ryan Mu er. 2021. Impact of mental health treatment on suicide a empts. The Journal of Behavioral Health Services & Research 48 (2021), 4-14.
  36. John J McGrath, Ali Al-Hamzawi, Jordi Alonso, Yasmin Altwaijri, Laura H Andrade, Evelyn J Bromet, Ronny Bruf- faerts, José Miguel Caldas de Almeida, Stephanie Chardoul, Wai Tat Chiu, et al. 2023. Age of onset and cumulative risk of mental disorders: a cross-national analysis of population surveys from 29 countries. The Lancet Psychiatry 10, 9 (2023), 668-681.
  37. Jingbo Meng, Minjin Rheu, Yue Zhang, Yue Dai, and Wei Peng. 2023. Mediated Social Support for Distress Reduc- tion: AI Chatbots vs. Human. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1-25.
  38. Sharan B Merriam and Robin S Grenier. 2019. alitative research in practice: Examples for discussion and analysis. John Wiley & Sons.
  39. Madison Milne-Ives, Caroline de Cock, Ernest Lim, Melissa Harper Shehadeh, Nick de Pennington, Guy Mole, Eduardo Normando, and Edward Meinert. 2020. The effectiveness of artificial intelligence conversational agents in health care: systematic review. Journal of medical Internet research 22, 10 (2020), e20346.
  40. Adam S Miner, Nigam Shah, Kim D Bullock, Bruce A Arnow, Jeremy Bailenson, and Jeff Hancock. 2019. Key con- siderations for incorporating conversational AI in psychotherapy. Frontiers in psychiatry 10 (2019), 746.
  41. Joshua R Moore and Robert Caudill. 2019. The bot will see you now: a history and review of interactive computerized mental health programs. Psychiatric Clinics 42, 4 (2019), 627-634.
  42. Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems. 72-78.
  43. John C Norcross and ERIN F Alexander. 2005. A primer on psychotherapy integration. Handbook of psychotherapy integration 2 (2005), 3-23.
  44. Chinasa T Okolo, Srujana Kamath, Nicola Dell, and Aditya Vashistha. 2021. "It cannot do all of my work": commu- nity health worker perceptions of AI-enabled mobile health applications in rural India. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1-20.
  45. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sand- hini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in neural information processing systems 35 (2022), 27730-27744.
  46. Sachin R Pendse, Neha Kumar, and Munmun De Choudhury. 2023. Marginalization and the Construction of Mental Illness Narratives Online: Foregrounding Institutions in Technology-Mediated Care. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1-30.
  47. Sachin R Pendse, Daniel Nkemelu, Nicola J Bidwell, Sushrut Jadhav, Soumitra Pathare, Munmun De Choudhury, and Neha Kumar. 2022. From treatment to healing: envisioning a decolonial digital mental health. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-23.
  48. Catherine Petrozzino. 2021. Who pays for ethical debt in AI? AI and Ethics 1, 3 (2021), 205-208.
  49. Roland Robertson et al. 1995. Glocalization: Time-space and homogeneity-heterogeneity. Global modernities 2, 1 (1995), 25-44.
  50. Carl R Rogers. 1957. The necessary and sufficient conditions of therapeutic personality change. Journal of consulting psychology 21, 2 (1957), 95.
  51. Joshua Rosenbaum. 2002. The Typing Cure. Wall Street Journal (2002), R10.
  52. Saul Rosenzweig. 1936. Some implicit common factors in diverse methods of psychotherapy. American journal of Orthopsychiatry 6, 3 (1936), 412.
  53. Victor Roudometof. 2016. Glocalization: A critical introduction. Routledge.
  54. Jessica L Schleider, Michael C Mullarkey, Kathryn R Fox, Mallory L Dobias, Akash Shroff, Erica A Hart, and Chantelle A Roulston. 2022. A randomized trial of online single-session interventions for adolescent depression during COVID-19. Nature Human Behaviour 6, 2 (2022), 258-268.
  55. Hugo Scurto, Thomas Similowski, Samuel Bianchini, and Baptiste Caramiaux. 2023. Probing Respiratory Care With Generative Deep Learning. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1-34.
  56. Ashish Sharma, Kevin Rushton, Inna Wanyin Lin, Theresa Nguyen, and Tim Althoff. 2024. Facilitating self-guided mental health interventions through human-language model interaction: A case study of cognitive restructuring. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-29.
  57. Hua Shen, Tiffany Knearem, Reshmi Ghosh, Kenan Alkiek, Kundan Krishna, Yachuan Liu, Ziqiao Ma, Savvas Petridis, Yi-Hao Peng, Li Qiwei, et al. 2024. Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions. arXiv preprint arXiv:2406.09264 (2024). · arXiv
  58. Heung-Yeung Shum, Xiao-dong He, and Di Li. 2018. From Eliza to XiaoIce: challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering 19 (2018), 10-26.
  59. Sunayana Sitaram, Monojit Choudhury, Barun Patra, Vishrav Chaudhary, Kabir Ahuja, and Kalika Bali. 2023. Ev- erything you need to know about multilingual LLMs: Towards fair, performant and reliable models for languages of the world. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts). 21-26.
  60. Petr Slovák, Nikki Theofanopoulou, Alessia Cecchet, Peter Co rell, Ferran Altarriba Bertran, Ella Dagan, Julian Childs, and Katherine Isbister. 2018. " I just let him cry... Designing Socio-Technical Interventions in Families to Prevent Mental Health Disorders. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1-34.
  61. Daniel J Solove. 2007. I've got nothing to hide and other misunderstandings of privacy. San Diego L. Rev. 44 (2007), 745.
  62. Inhwa Song, SoHyun Park, Sachin R Pendse, Jessica Lee Schleider, Munmun De Choudhury, and Young-Ho Kim. 2024. ExploreSelf: Fostering User-driven Exploration and Reflection on Personal Challenges with Adaptive Guidance by Large Language Models. arXiv preprint arXiv:2409.09662 (2024). · arXiv
  63. Stanley W Standal. 1954. The need for positive regard: A contribution to client-centered theory. Ph. D. Dissertation. University of Chicago, Department of Psychology.
  64. Stanley R Steindl, Marcela Matos, and Giancarlo Dimaggio. 2023. The interplay between therapeutic relationship and therapeutic technique: The whole is more than the sum of its parts. Journal of Clinical Psychology 79, 7 (2023), 1686-1692.
  65. Amir Taubenfeld, Yaniv Dover, Roi Reichart, and Ariel Goldstein. 2024. Systematic biases in LLM simulations of debates. arXiv preprint arXiv:2402.04049 (2024). · arXiv
  66. Yuan-Chi Tseng, Weerachaya Jarupreechachan, and Tuan-He Lee. 2023. Understanding the Benefits and Design of Chatbots to Meet the Healthcare Needs of Migrant Workers. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1-34.
  67. Alastair C van Heerden, Julia R Pozuelo, and Brandon A Kohrt. 2023. Global mental health services and the impact of artificial intelligence-Powered large language models. JAMA psychiatry 80, 7 (2023), 662-664.
  68. Milton L Wainberg, Pamela Scorza, James M Shultz, Liat Helpman, Jennifer J Mootz, Karen A Johnson, Yuval Neria, Jean-Marie E Bradford, Maria A Oquendo, and Melissa R Arbuckle. 2017. Challenges and opportunities in global mental health: a research-to-practice perspective. Current psychiatry reports 19 (2017), 1-10.
  69. Bruce E Wampold and Zac E Imel. 2015. The great psychotherapy debate: The evidence for what makes psychotherapy work. Routledge.
  70. Wenhuan Wang. 2017. Smartphones as social actors? Social dispositional factors in assessing anthropomorphism. Computers in Human Behavior 68 (2017), 334-344.
  71. Dennis P Watson. 2012. From structural chaos to a model of consumer support: understanding the roles of structure and agency in mental health recovery for the formerly homeless. Journal of Forensic Psychology Practice 12, 4 (2012), 325-348.
  72. Joseph Weizenbaum. 1977. Computers as" Therapists". Science 198, 4315 (1977), 354-354.
  73. Norbert Wiener. 1960. Some Moral and Technical Consequences of Automation: As machines learn they may develop unforeseen strategies at rates that baffle their programmers. Science 131, 3410 (1960), 1355-1358.
  74. Terry Winograd. 1986. A language/action perspective on the design of cooperative work. In Proceedings of the 1986 ACM conference on Computer-supported cooperative work. 203-220.
  75. Tian Xu, Junnan Yu, Dylan Thomas Doyle, and Stephen Voida. 2023. Technology-Mediated Strategies for Coping with Mental Health Challenges: Insights from People with Bipolar Disorder. Proceedings of the ACM on Human- Computer Interaction 7, CSCW2 (2023), 1-31.
  76. Travis Zack, Eric Lehman, Mirac Suzgun, Jorge A Rodriguez, Leo Anthony Celi, Judy Gichoya, Dan Jurafsky, Peter Szolovits, David W Bates, Raja-Elie E Abdulnour, et al. 2024. Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation study. The Lancet Digital Health 6, 1 (2024), e12-e22. This figure "acm-jdslogo.png" is available in "png" format from: http://arxiv.org/ps/2401.

Authors
Song, I., Pendse, S. R., Kumar, N., & De Choudhury, M.
Affiliations
  • Korea Advanced Institute of Science and Technology (KR)
  • University of California, San Francisco (US)
  • Georgia Institute of Technology (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
9
Issue
7
Pages
1-29
ISSN
2573-0142 (ISSN-L)
DOI
10.48550/arxiv.2401.14362
arXiv
2401.14362
OpenAlex
W4415250180
Cited by
64
References
59
Citations by year
2026: 45 · 2025: 15 · 2024: 3 · 2023: 1
FWCI
48.01
Type
journal article
Language
en
Open access
Licence
Locations
  • Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • American Foundation for Suicide Prevention
  • National Institute of Mental Health (R01MH117172,P50MH115838,T32MH115882, R01MH117172, P50MH115838, T32MH115882)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
large language model chatbots, mental health support, lived experience, AI ethics, psychotherapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review