CoChat
Sign Up
Cited by 7

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youth

Lissak, Shir, Calderon, Nitay, Shenkman, Geva, Ophir, Yaakov, Fruchter, Eyal, Brunstein Klomek, Anat, Reichart, Roi·2024·Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
DOI 10.18653/v1/2024.naacl-long.113
Open this paper in CoChat — free account

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2024.naacl-long.113

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 62

  1. Gavin Abercrombie, Dirk Hovy, and Vinodkumar Prab- hakaran. 2023. Temporal and second language in- fluence on intra-annotator agreement and stability in hate speech labelling. In Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), pages 96-103, Toronto, Canada. Association for Computa- tional Linguistics. · DOI
  2. Nele Cox, Wim Vanden Berghe, Alexis Dewaele, and John Vincke. 2010. Acculturation strategies and men- tal health in gay, lesbian, and bisexual youth. Journal of Youth and Adolescence, 39:1199-1210.
  3. Samantha DeHaan, Laura E Kuper, Joshua C Magee, Lou Bigelow, and Brian S Mustanski. 2013. The interplay between online and offline explorations of identity, relationships, and sex: A mixed-methods study with lgbt youth. Journal of sex research, 50(5):421-434.
  4. Daniel Delmonaco and Oliver L Haimson. 2023. "noth- ing that i was specifically looking for": Lgbtq+ youth and intentional sexual health information seeking. Journal of LGBT Youth, 20(4):818-835.
  5. Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff M. Phillips, and Kai-Wei Chang. 2021. Harms of gender exclusivity and chal- lenges in non-binary representation in language tech- nologies. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Domini- can Republic, 7-11 November, 2021, pages 1968- 1994. Association for Computational Linguistics. · DOI
  6. Hannah Devinney, Jenny Björklund, and Henrik Björk- lund. 2022. Theories of "gender" in NLP bias re- search. In FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21 -24, 2022, pages 2083- 2102. ACM. · DOI · Paper page
  7. Graham T DiGuiseppi, Jordan P Davis, Ankur Srivas- tava, Eric K Layland, Duyen Pham, and Michele D Kipke. 2022. Multiple minority stress and behavioral health among young black and latino sexual minority men. LGBT health, 9(2):114-121.
  8. Nathan Daniel Doty, Brian LB Willoughby, Kristin M Lindahl, and Neena M Malik. 2010. Sexuality re- lated social support among lesbian, gay, and bisexual youth. Journal of youth and adolescence, 39:1134- 1147.
  9. Jack Drescher. 2015. Out of dsm: Depathologizing homosexuality. Behavioral sciences, 5(4):565-575.
  10. Anthony R D'Augelli, Arnold H Grossman, and Michael T Starks. 2006. Childhood gender atypical- ity, victimization, and ptsd among lesbian, gay, and bisexual youth. Journal of interpersonal violence, 21(11):1462-1482.
  11. Yoel Elizur and Michael Ziv. 2001. Family support and acceptance, gay male identity formation, and psychological adjustment: A path model. Family process, 40(2):125-144.
  12. Robert Elliott, Arthur C Bohart, Jeanne C Watson, and David Murphy. 2018. Therapist empathy and client outcome: An updated meta-analysis. Psychotherapy, 55(4):399.
  13. Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, and Jonathan May. 2022. Towards winoqueer: Developing a benchmark for anti-queer bias in large language models. CoRR, abs/2206.11484. · DOI
  14. Leah R Fowler, Lauren Schoen, Hadley Stevens Smith, and Stephanie R Morain. 2022. Sex education on tik- tok: a content analysis of themes. Health promotion practice, 23(5):739-742.
  15. Deborrah ES Frable, Linda Platt, and Steve Hoey. 1998. Concealable stigmas and positive self-perceptions: feeling better around similar others. Journal of per- sonality and social psychology, 74(4):909.
  16. Carly K Friedman and Elizabeth M Morgan. 2009. Comparing sexual-minority and heterosexual young women's friends and parents as sources of support for sexual issues. Journal of youth and adolescence, 38:920-936.
  17. Douglas C Haldeman. 2002. Therapeutic antidotes: Helping gay and bisexual men recover from conver- sion therapies. Journal of Gay & Lesbian Psychother- apy, 5(3-4):117-130.
  18. Adam O Horvath and Lester Luborsky. 1993. The role of the therapeutic alliance in psychotherapy. Journal of consulting and clinical psychology, 61(4):561.
  19. Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xiny- ing Song, and Denny Zhou. 2023. Large language models cannot self-correct reasoning yet. CoRR, abs/2310.01798. · DOI · Paper page
  20. Becky Inkster, Shubhankar Sarda, Vinod Subramanian, et al. 2018. An empathy-driven, conversational artifi- cial intelligence agent (wysa) for digital mental well- being: real-world data evaluation mixed-methods study. JMIR mHealth and uHealth, 6(11):e12106.
  21. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Men- sch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Re- nard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timo- thée Lacroix, and William El Sayed. 2023. Mistral 7b. CoRR, abs/2310.06825. · DOI · Paper page
  22. Laura Kann, Emily O'Malley Olsen, Tim McManus, William A Harris, Shari L Shanklin, Katherine H Flint, Barbara Queen, Richard Lowry, David Chyen, Lisa Whittle, et al. 2016. Sexual identity, sex of sexual contacts, and health-related behaviors among students in grades 9-12-united states and selected sites, 2015. Morbidity and Mortality Weekly Report: Surveillance Summaries, 65(9):1-202.
  23. Peter Kassel and Debra L Franko. 2000. Body image disturbance and psychodynamic psychotherapy with gay men. Harvard review of psychiatry, 8(6):307- 317.
  24. Frances A Kelley. 2015. The therapy relationship with lesbian and gay clients. Psychotherapy, 52(1):113.
  25. Angeliki Kerasidou. 2020. Artificial intelligence and the ongoing need for empathy, compassion and trust in healthcare. Bulletin of the World Health Organiza- tion, 98(4):245.
  26. Michael King, Joanna Semlyen, Sharon See Tai, Helen Killaspy, David Osborn, Dmitri Popelyuk, and Irwin Nazareth. 2008. A systematic review of mental disor- der, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC psychiatry, 8:1-17.
  27. Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, and Scott A. Hale. 2023. Personalisation within bounds: A risk taxonomy and policy framework for the align- ment of large language models with personalised feedback. CoRR, abs/2303.05453. · DOI · Paper page
  28. Katrina Kubicek, William J Beyer, George Weiss, Ellen Iverson, and Michele D Kipke. 2010. In the dark: Young men's stories of sexual initiation in the ab- sence of relevant sexual health information. Health Education & Behavior, 37(2):243-263.
  29. Leanna Lucero. 2017. Safe spaces in online places: So- cial media and lgbtq youth. Multicultural Education Review, 9(2):117-128.
  30. Naomi Mark. 2008. Identities in conflict: Forging an orthodox gay identity. Journal of Gay & Lesbian Mental Health, 12(3):179-194.
  31. Ilan H Meyer. 1995. Minority stress and mental health in gay men. Journal of health and social behavior, pages 38-56.
  32. Ilan H Meyer. 2003. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: con- ceptual issues and research evidence. Psychological bulletin, 129(5):674.
  33. Kimberly J Mitchell, Michele L Ybarra, Josephine D Korchmaros, and Joseph G Kosciw. 2014a. Ac- cessing sexual health information online: use, mo- tivations and consequences for youth with differ- ent sexual orientations. Health education research, 29(1):147-157.
  34. Kimberly J Mitchell, Michele L Ybarra, Josephine D Korchmaros, and Joseph G Kosciw. 2014b. Ac- cessing sexual health information online: use, mo- tivations and consequences for youth with differ- ent sexual orientations. Health education research, 29(1):147-157.
  35. Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andrés Codas, Clarisse Simões, Sahaj Agrawal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Ag- garwal, Hamid Palangi, Guoqing Zheng, Corby Ros- set, Hamed Khanpour, and Ahmed Awadallah. 2023. Orca 2: Teaching small language models how to rea- son. CoRR, abs/2311.11045. · DOI
  36. Robert R Morris, Kareem Kouddous, Rohan Kshir- sagar, and Stephen M Schueller. 2018. Towards an artificially empathic conversational agent for men- tal health applications: system design and user per- ceptions. Journal of medical Internet research, 20(6):e10148.
  37. Subhabrata Mukherjee, Arindam Mitra, Ganesh Jawa- har, Sahaj Agarwal, Hamid Palangi, and Ahmed Awadallah. 2023. Orca: Progressive learning from complex explanation traces of GPT-4. CoRR, abs/2306.02707. · DOI
  38. OpenAI. 2023. GPT-4 technical report. CoRR, abs/2303.08774. · DOI · Paper page
  39. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welin- der, Paul F. Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instruc- tions with human feedback. In NeurIPS.
  40. John E Pachankis, Kirsty A Clark, Skyler D Jackson, Kobe Pereira, and Deborah Levine. 2021. Current capacity and future implementation of mental health services in us lgbtq community centers. Psychiatric services, 72(6):669-676.
  41. Fabio Poletto, Marco Stranisci, Manuela Sanguinetti, Viviana Patti, and Cristina Bosco. 2017. Hate speech annotation: Analysis of an italian twitter corpus. In Proceedings of the Fourth Italian Conference on Computational Linguistics (CLiC-it 2017), Rome, Italy, December 11-13, 2017, volume 2006 of CEUR Workshop Proceedings. CEUR-WS.org.
  42. Chelsea N Proulx, Robert WS Coulter, James E Egan, Derrick D Matthews, and Christina Mair. 2019. As- sociations of lesbian, gay, bisexual, transgender, and questioning-inclusive sex education with mental health outcomes and school-based victimization in us high school students. Journal of Adolescent Health, 64(5):608-614.
  43. Hannah Rashkin, Antoine Bosselut, Maarten Sap, Kevin Knight, and Yejin Choi. 2018. Modeling naive psy- chology of characters in simple commonsense sto- ries. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15-20, 2018, Vol- ume 1: Long Papers, pages 2289-2299. Association for Computational Linguistics. · DOI
  44. Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empiri- cal Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, pages 3980-3990. Association for Computational Linguistics. · DOI · Paper page
  45. Russell Richie, Sachin Grover, and Fuchiang (Rich) Tsui. 2022. Inter-annotator agreement is not the ceil- ing of machine learning performance: Evidence from a comprehensive set of simulations. In Proceedings of the 21st Workshop on Biomedical Language Pro- cessing, BioNLP@ACL 2022, Dublin, Ireland, May 26, 2022, pages 275-284. Association for Computa- tional Linguistics. · DOI
  46. Björn Ross, Michael Rist, Guillermo Carbonell, Ben- jamin Cabrera, Nils Kurowsky, and Michael Wojatzki. 2017. Measuring the reliability of hate speech an- notations: The case of the european refugee crisis. CoRR, abs/1701.08118. · arXiv
  47. Emily F Rothman, Mairead Sullivan, Susan Keyes, and Ulrike Boehmer. 2012. Parents' supportive reactions to sexual orientation disclosure associated with better health: Results from a population-based survey of lgb adults in massachusetts. Journal of homosexuality, 59(2):186-200.
  48. Paul Röttger, Bertie Vidgen, Dirk Hovy, and Janet B. Pierrehumbert. 2022. Two contrasting data annota- tion paradigms for subjective NLP tasks. In Proceed- ings of the 2022 Conference of the North American Chapter of the Association for Computational Lin- guistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022, pages 175-190. Association for Computational Lin- guistics. · DOI
  49. Stephen T Russell and Jessica N Fish. 2016. Mental health in lesbian, gay, bisexual, and transgender (lgbt) youth. Annual review of clinical psychology, 12:465- 487.
  50. Ashish Sharma, Inna W Lin, Adam S Miner, David C Atkins, and Tim Althoff. 2023. Human-ai collabo- ration enables more empathic conversations in text- based peer-to-peer mental health support. Nature Machine Intelligence, 5(1):46-57.
  51. Ashish Sharma, Adam S. Miner, David C. Atkins, and Tim Althoff. 2020. A computational approach to un- derstanding empathy expressed in text-based mental health support. In Proceedings of the 2020 Confer- ence on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020, pages 5263-5276. Association for Computa- tional Linguistics. · DOI · Paper page
  52. Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vin- cent Zhao, Hongkun Yu, Kurt Keutzer, Trevor Dar- rell, and Denny Zhou. 2023. Flan-moe: Scaling instruction-finetuned language models with sparse mixture of experts. CoRR, abs/2305.14705. · DOI
  53. Geva Shenkman, Dorit Segal-Engelchin, and Orit Taubman-Ben-Ari. 2022. What we know and what re- mains to be explored about lgbtq parent families in is- rael: A sociocultural perspective. International Jour- nal of Environmental Research and Public Health, 19(7):4355.
  54. Donghoon Shin, Subeen Park, Esther Hehsun Kim, Soomin Kim, Jinwook Seo, and Hwajung Hong. 2022. Exploring the effects of ai-assisted emotional support processes in online mental health community. In CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022 -5 May 2022, Extended Abstracts, pages 300:1- 300:7. ACM. · DOI · Paper page
  55. K Ann Sondag, Andrew G Johnson, and Mary E Par- rish. 2022. School sex education: Teachers' and young adults' perceptions of relevance for lgbt stu- dents. Journal of LGBT Youth, 19(3):247-267.
  56. Hugo Touvron, Louis Martin, Kevin Stone, Peter Al- bert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton- Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, An- thony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Di- ana Liskovich, Yinghai Lu, Yuning Mao, Xavier Mar- tinet, Todor Mihaylov, Pushkar Mishra, Igor Moly- bog, Yixin Nie, Andrew Poulton, Jeremy Reizen- stein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subrama- nian, Xiaoqing Ellen Tan, Binh Tang, Ross Tay- lor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Ro- driguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023. Llama 2: Open foundation and fine- tuned chat models. CoRR, abs/2307.09288. · DOI · Paper page
  57. Quan Tu, Yanran Li, Jianwei Cui, Bin Wang, Ji-Rong Wen, and Rui Yan. 2022. MISC: A mixed strategy- aware model integrating COMET for emotional sup- port conversation. In Proceedings of the 60th Annual Meeting of the Association for Computational Lin- guistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, pages 308-319. Associa- tion for Computational Linguistics. · DOI
  58. Aditya Nrusimha Vaidyam, Hannah Wisniewski, John David Halamka, Matcheri S Kashavan, and John Blake Torous. 2019. Chatbots and conversa- tional agents in mental health: a review of the psychi- atric landscape. The Canadian Journal of Psychiatry, 64(7):456-464.
  59. Sarah E Valentine and Jillian C Shipherd. 2018. A systematic review of social stress and mental health among transgender and gender non-conforming peo- ple in the united states. Clinical psychology review, 66:24-38.
  60. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Pro- cessing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pages 5998-6008.
  61. Anuradha Welivita, Yubo Xie, and Pearl Pu. 2021. A large-scale dataset for empathetic response gener- ation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Domini- can Republic, 7-11 November, 2021, pages 1251- 1264. Association for Computational Linguistics. · DOI
  62. Amy Wenzel. 2017. Basic strategies of cognitive behav- ioral therapy. Psychiatric Clinics, 40(4):597-609.

Cited by

Sorted by citations

See all 7

Metadata

Authors
Lissak, S., Calderon, N., Shenkman, G., Ophir, Y., Fruchter, E., Brunstein Klomek, A., & Reichart, R.
Venue
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Publisher
Association for Computational Linguistics
Published
2024
Pages
2040-2079
DOI
10.18653/v1/2024.naacl-long.113
Cited by
7
References
1

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review