Cited by 62Digital Mental Health InterventionsMental Health via WritingImpact of Technology on Adolescents

The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses

Open access
Young, Jordyn, Jawara, Laala M, Nguyen, Diep N, Daly, Brian, Huh-Yoo, Jina, Razi, Afsaneh·2024·Proceedings of the CHI Conference on Human Factors in Computing Systems

Abstract

Generative Artificial Intelligence (AI) is integrated into everyday technology, including news, education, and social media. AI has further pervaded private conversations as conversational partners, auto-completion, and response suggestions. As social media becomes young people’s main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges in a beneficial, safe, and socially appropriate way. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. However, when addressing a sensitive topic, like suicidal thoughts, young people preferred the human response. We also discuss the role of training in online peer support exchange and its implications for supporting young people’s well-being. Disclaimer: This paper includes sensitive topics, including suicide ideation. Reader discretion is advised.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3613904.3642574

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Generative AI models are increasingly achieving or surpassing human performance benchmarks in various domains, including medical diagnostic dialogue, persuasive communication, theory of mind, making people feel heard, responding to relationship issues and helping people reframe negative situations to reduce negative emotions.

    “These models are increasingly achieving or surpassing human performance benchmarks in various domains, including medical diagnostic dialogue28, persuasive communication29, theory of mind30, making people feel heard31, responding to relationship issues32 and helping people reframe negative situations to reduce negative emotions33.”
  • Recent research shows that generative AI can help halt suicidal ideation, and that young people show a preference for generative AI support responses over those from peers, adult mentors and therapists - but not on topics that invoke the AI's safety guardrails.

    “This resonates with recent research showing that generative AI can help halt suicidal ideation48, and that young people show a preference for generative AI support responses over those from peers, adult mentors and therapists – but not on topics that invoke the AI’s safety guardrails32.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 17

  1. [1][1] 2023. New AI Usage Data Shows Who's Using AI - and Uncovers a Population of 'Super-Users'. https://www.salesforce.com/news/press-releases/2023/09/07/aiusage-research/ -
  2. [9][9] Christopher J Bechler, Zakary L Tormala, and Derek D Rucker. 2021. The attitudebehavior relationship revisited. Psychological science 32, 8 (2021), 1285-1297. -
  3. [12][12] Michael L Birnbaum, Asra F Rizvi, Christoph U Correll, John M Kane, and Jamie Confino. 2017. Role of social media and the Internet in pathways to care for adolescents and young adults with psychotic disorders and non-psychotic mood disorders. Early intervention in psychiatry 11, 4 (2017), 290-295. -
  4. [14][14] T Bradford Bitterly, Alison Wood Brooks, and Maurice E Schweitzer. 2017. Risky business: When humor increases and decreases status. Journal of personality and social psychology 112, 3 (2017), 431. -
  5. [18][18] Virginia Braun and Victoria Clarke. 2019. Reflecting on reflexive thematic analysis. Qualitative research in sport, exercise and health 11, 4 (2019), 589-597. -
  6. [17][17] Petter Bae Brandtzaeg and Asbjørn Følstad. 2018. Chatbots: changing user needs and motivations. interactions 25, 5 (2018), 38-43. -
  7. [24][24] John A Cunningham, Amelia Gulliver, Lou Farrer, Kylie Bennett, and Bradley Carron-Arthur. 2014. Internet interventions for mental health and addictions: current findings and future directions. Current psychiatry reports 16 (2014), 1-5. -
  8. [26][26] Gayle A Dakof and Shelley E Taylor. 1990. Victims' perceptions of social support: What is helpful from whom? Journal of personality and social psychology 58, 1 (1990), 80. -
  9. [28][28] Louise A Ellis, Philippa Collin, Patrick J Hurley, Tracey A Davenport, Jane M Burns, and Ian B Hickie. 2013. Young men's attitudes and behaviour in relation to mental health and technology: implications for the development of online mental health services. BMC psychiatry 13, 1 (2013), 1-10. -
  10. [31][31] Asbjørn Følstad and Petter Bae Brandtzæg. 2017. Chatbots and the new world of HCI. interactions 24, 4 (2017), 38-42. -
  11. [39][39] MD Romael Haque and Sabirat Rubya. 2023. An Overview of Chatbot-Based Mobile Mental Health Apps: Insights From App Description and User Reviews. JMIR mHealth and uHealth 11, 1 (2023), e44838. -
  12. [61][61] Agusti Mardikaningsih, Ambiro Puji Asmaroini, Ahmad Lani, and Raup Padillah. 2023. The risk of ChatGPT as a first aid method: considering the potential danger for mental health support among young adults without professional assistance. Journal of Public Health (2023), fdad107. -
  13. [64][64] John A Naslund, Kelly A Aschbrenner, Lisa A Marsch, and Stephen J Bartels. 2016. The future of mental health care: peer-to-peer support and social media. Epidemiology and psychiatric sciences 25, 2 (2016), 113-122. -
  14. [66][66] Gabriel A. Orenstein and Lindsay Lewis. 2022. Eriksons Stages of Psychosocial Development. In StatPearls . StatPearls Publishing, Treasure Island (FL). http: //www.ncbi.nlm.nih.gov/books/NBK556096/ -
  15. [69][69] Afsaneh Razi, Ashwaq AlSoubai, Seunghyun Kim, Shiza Ali, Gianluca Stringhini, Munmun Choudhury, and Pamela J. Wisniewski. 2023. Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of Youth, Vol. 7. Association for Computing Machinery, New York, NY, USA, Article 89, 28 pages. https://doi. org/110.1145/3579522 - · DOI · Paper page
  16. [87][87] Kaisa Väänänen, Aleksi Hiltunen, Jari Varsaluoma, and Iikka Pietilä. 2020. CivicBots-Chatbots for supporting youth in societal participation. In Chatbot Research and Design: Third International Workshop, CONVERSATIONS 2019, Amsterdam, The Netherlands, November 19-20, 2019, Revised Selected Papers 3 . Springer, 143-157. -
  17. [91][91] Susan I Woodruff, Terry L Conway, Christine C Edwards, Sean P Elliott, and Jim Crittenden. 2007. Evaluation of an Internet virtual world chat room for adolescent smoking cessation. Addictive behaviors 32, 9 (2007), 1769-1786.

Cited by

Sorted by citations

Authors
Young, J., Jawara, L. M., Nguyen, D. N., Daly, B., Huh-Yoo, J., & Razi, A.
Affiliations
  • University of Michigan (US)
  • Drexel University (US)
  • College of Computing and Informatics, Drexel University, United States
Venue
Proceedings of the CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2024-05-11
Pages
1-18
OpenAlex
W4396786284
Cited by
59
References
60
Citations by year
2026: 27 · 2025: 26 · 2024: 6
FWCI
24.01
Type
conference paper
Language
en
Open access
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
National Science Foundation (2144880)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Mental Health via Writing
  • Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
Keywords
generative AI, peer support, youth, help-seeking, AI-generated responses, human-AI comparison, social media, suicidal ideation, sensitive topics, online training, youth well-being

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review