CoChat
Sign Up
PreprintCited by 92Speech and dialogue systemsEmotion and Mood RecognitionSentiment Analysis and Opinion Mining

Is ChatGPT Equipped with Emotional Dialogue Capabilities?

Open access
Zhao, Weixiang, Zhao, Yanyan, Lu, Xin, Wang, Shilong, Tong, Yanpeng, Qin, Bing·2023·arXiv
DOI 10.48550/arxiv.2304.09582arXiv 2304.09582
Open this paper in CoChat — free accountOpen PDF

Abstract

This report presents a study on the emotional dialogue capability of ChatGPT, an advanced language model developed by OpenAI. The study evaluates the performance of ChatGPT on emotional dialogue understanding and generation through a series of experiments on several downstream tasks. Our findings indicate that while ChatGPT's performance on emotional dialogue understanding may still lag behind that of supervised models, it exhibits promising results in generating emotional responses. Furthermore, the study suggests potential avenues for future research directions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2304.09582

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • ChatGPT demonstrates strong capabilities in emotional understanding.

    “Nevertheless, ChatGPT demonstrates strong capabilities in emotional understanding, including generating appropriate affective responses and scoring highly on measures of emotional awareness [18, 69].”

    From Emotional Coregulation in Close Relationships with AI Agents: A Survey of ChatGPT and Replika Users (2025) · cites this paper as [69]

    The Abstract reports promising results in generating emotional responses, and §5.1.4 describes context-specific, empathetic replies. But the Abstract says ChatGPT may lag behind supervised models in emotional dialogue understanding; §4.1.3 reports a 3–18 percentage-point gap in emotion recognition. The source therefore supports the response-generation aspect, not the unqualified claim of strong emotional understanding. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 46

  1. Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wen- liang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Zi- wei Ji, Tiezheng Yu, Willy Chung, et al. 2023. A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactiv- ity. arXiv preprint arXiv:2302.04023. · arXiv
  2. Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jean- nette N. Chang, Sungbok Lee, and Shrikanth S. Narayanan. 2008. IEMOCAP: interactive emotional dyadic motion capture database. Language Re- sources and Evaluation, 42(4):335-359.
  3. Cen Chen, Xiaolu Zhang, Sheng Ju, Chilin Fu, Caizhi Tang, Jun Zhou, and Xiaolong Li. 2019. Antprophet: an intention mining system behind alipay's intelli- gent customer service bot. In IJCAI, volume 8, pages 6497-6499.
  4. Maximillian Chen, Alexandros Papangelis, Chenyang Tao, Andy Rosenbaum, Seokhwan Kim, Yang Liu, Zhou Yu, and Dilek Hakkani-Tur. 2022. Weakly supervised data augmentation through prompt- ing for dialogue understanding. arXiv preprint arXiv:2210.14169. · arXiv
  5. Yi Cheng, Wenge Liu, Wenjie Li, Jiashuo Wang, Rui- hui Zhao, Bang Liu, Xiaodan Liang, and Yefeng Zheng. 2022. Improving multi-turn emotional sup- port dialogue generation with lookahead strategy planning. arXiv preprint arXiv:2210.04242. · arXiv
  6. Deepanway Ghosal, Navonil Majumder, Alexander Gelbukh, Rada Mihalcea, and Soujanya Poria. 2020. Cosmic: Commonsense knowledge for emotion identification in conversations. arXiv preprint arXiv:2010.02795. · arXiv
  7. Chao-Chun Hsu, Sheng-Yeh Chen, Chuan-Chun Kuo, Ting-Hao K. Huang, and Lun-Wei Ku. 2018. Emo- tionlines: An emotion corpus of multi-party con- versations. In Proceedings of the Eleventh Inter- national Conference on Language Resources and Evaluation, LREC 2018, Miyazaki, Japan, May 7- 12, 2018. European Language Resources Associa- tion (ELRA).
  8. Dou Hu, Lingwei Wei, and Xiaoyong Huai. 2021. Dia- loguecrn: Contextual reasoning networks for emo- tion recognition in conversations. arXiv preprint arXiv:2106.01978. · arXiv
  9. Veton Kepuska and Gamal Bohouta. 2018. Next- generation of virtual personal assistants (microsoft cortana, apple siri, amazon alexa and google home). In 2018 IEEE 8th annual computing and communi- cation workshop and conference (CCWC), pages 99- 103. IEEE.
  10. Jan Kocoń, Igor Cichecki, Oliwier Kaszyca, Mateusz Kochanek, Dominika Szydło, Joanna Baran, Julita Bielaniewicz, Marcin Gruza, Arkadiusz Janz, Kamil Kanclerz, et al. 2023. Chatgpt: Jack of all trades, master of none. arXiv preprint arXiv:2302.10724. · arXiv
  11. Joosung Lee and Wooin Lee. 2022. CoMPM: Context modeling with speaker's pre-trained memory track- ing for emotion recognition in conversation. In Pro- ceedings of the 2022 Conference of the North Amer- ican Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 5669-5679, Seattle, United States. Association for Computational Linguistics. · DOI
  12. Mike Lewis, Yinhan Liu, Naman Goyal, Mar- jan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461. · arXiv
  13. Jiangnan Li, Fandong Meng, Zheng Lin, Rui Liu, Peng Fu, Yanan Cao, Weiping Wang, and Jie Zhou. 2022. Neutral utterances are also causes: Enhanc- ing conversational causal emotion entailment with social commonsense knowledge. arXiv preprint arXiv:2205.00759. · arXiv
  14. Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2015. A diversity-promoting objec- tive function for neural conversation models. arXiv preprint arXiv:1510.03055. · arXiv
  15. Qintong Li, Hongshen Chen, Zhaochun Ren, Pengjie Ren, Zhaopeng Tu, and Zhumin Chen. 2019. Em- pdg: Multiresolution interactive empathetic dia- logue generation. arXiv preprint arXiv:1911.08698. · arXiv
  16. Yanran Li, Hui Su, Xiaoyu Shen, Wenjie Li, Ziqiang Cao, and Shuzi Niu. 2017. Dailydialog: A manually labelled multi-turn dialogue dataset. arXiv preprint arXiv:1710.03957. · arXiv
  17. Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out, pages 74-81.
  18. Zhaojiang Lin, Andrea Madotto, Jamin Shin, Peng Xu, and Pascale Fung. 2019. Moel: Mixture of empa- thetic listeners. arXiv preprint arXiv:1908.07687. · arXiv
  19. Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, and Minlie Huang. 2021. Towards emotional support dialog systems. arXiv preprint arXiv:2106.01144. · arXiv
  20. Xin Lu, Yanyan Zhao, Yang Wu, Yijian Tian, Huipeng Chen, and Bing Qin. 2020. An iterative emo- tion interaction network for emotion recognition in conversations. In Proceedings of the 28th Inter- national Conference on Computational Linguistics, pages 4078-4088.
  21. Navonil Majumder, Pengfei Hong, Shanshan Peng, Jiankun Lu, Deepanway Ghosal, Alexander Gelbukh, Rada Mihalcea, and Soujanya Poria. 2020. Mime: Mimicking emotions for em- pathetic response generation. arXiv preprint arXiv:2010.01454. · arXiv
  22. Navonil Majumder, Soujanya Poria, Devamanyu Haz- arika, Rada Mihalcea, Alexander Gelbukh, and Erik Cambria. 2019. Dialoguernn: An attentive rnn for emotion detection in conversations. In Proceedings of the AAAI conference on artificial intelligence, vol- ume 33, pages 6818-6825.
  23. Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic eval- uation of machine translation. In Proceedings of the 40th annual meeting of the Association for Compu- tational Linguistics, pages 311-318.
  24. Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Yajing Sun, and Yunpeng Li. 2022. Control globally, under- stand locally: A global-to-local hierarchical graph network for emotional support conversation. arXiv preprint arXiv:2204.12749. · arXiv
  25. Soujanya Poria, Devamanyu Hazarika, Navonil Ma- jumder, Gautam Naik, Erik Cambria, and Rada Mi- halcea. 2019a. MELD: A multimodal multi-party dataset for emotion recognition in conversations. In Proceedings of the 57th Annual Meeting of the As- sociation for Computational Linguistics, pages 527- 536, Florence, Italy. Association for Computational Linguistics. · DOI · Paper page
  26. Soujanya Poria, Navonil Majumder, Rada Mihalcea, and Eduard Hovy. 2019b. Emotion recognition in conversation: Research challenges, datasets, and re- cent advances. IEEE Access, 7:100943-100953.
  27. Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen, Michihiro Yasunaga, and Diyi Yang. 2023. Is chatgpt a general-purpose natural language process- ing task solver? arXiv preprint arXiv:2302.06476. · arXiv
  28. Libo Qin, Wanxiang Che, Yangming Li, Mingheng Ni, and Ting Liu. 2020. Dcr-net: A deep co-interactive relation network for joint dialog act recognition and sentiment classification. In Proceedings of the AAAI conference on artificial intelligence, vol- ume 34, pages 8665-8672.
  29. Libo Qin, Zhouyang Li, Wanxiang Che, Minheng Ni, and Ting Liu. 2021. Co-gat: A co-interactive graph attention network for joint dialog act recognition and sentiment classification. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 13709-13717.
  30. Vipul Raheja and Joel Tetreault. 2019. Dialogue act classification with context-aware self-attention. arXiv preprint arXiv:1904.02594. · arXiv
  31. Hannah Rashkin, Eric Michael Smith, Margaret Li, and Y-Lan Boureau. 2018. Towards empathetic open- domain conversation models: A new benchmark and dataset. arXiv preprint arXiv:1811.00207. · arXiv
  32. Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M Smith, et al. 2020. Recipes for building an open-domain chatbot. arXiv preprint arXiv:2004.13637. · arXiv
  33. Sahand Sabour, Chujie Zheng, and Minlie Huang. 2022. Cem: Commonsense-aware empathetic re- sponse generation. In Proceedings of the AAAI Con- ference on Artificial Intelligence, volume 36, pages 11229-11237.
  34. Weizhou Shen, Junqing Chen, Xiaojun Quan, and Zhix- ian Xie. 2021a. Dialogxl: All-in-one xlnet for multi- party conversation emotion recognition. In Proceed- ings of the AAAI Conference on Artificial Intelli- gence, volume 35, pages 13789-13797.
  35. Weizhou Shen, Siyue Wu, Yunyi Yang, and Xiaojun Quan. 2021b. Directed acyclic graph network for conversational emotion recognition. arXiv preprint arXiv:2105.12907. · arXiv
  36. Xiaohui Song, Longtao Huang, Hui Xue, and Songlin Hu. 2022. Supervised prototypical contrastive learn- ing for emotion recognition in conversation. In Pro- ceedings of the 2022 Conference on Empirical Meth- ods in Natural Language Processing, pages 5197- 5206, Abu Dhabi, United Arab Emirates. Associa- tion for Computational Linguistics.
  37. Quan Tu, Yanran Li, Jianwei Cui, Bin Wang, Ji- Rong Wen, and Rui Yan. 2022. Misc: A mixed strategy-aware model integrating comet for emotional support conversation. arXiv preprint arXiv:2203.13560. · arXiv
  38. Jindong Wang, Xixu Hu, Wenxin Hou, Hao Chen, Runkai Zheng, Yidong Wang, Linyi Yang, Hao- jun Huang, Wei Ye, Xiubo Geng, et al. 2023. On the robustness of chatgpt: An adversarial and out-of-distribution perspective. arXiv preprint arXiv:2302.12095. · arXiv
  39. Lanrui Wang, Jiangnan Li, Zheng Lin, Fandong Meng, Chenxu Yang, Weiping Wang, and Jie Zhou. 2022. Empathetic dialogue generation via sensitive emo- tion recognition and sensible knowledge selection. arXiv preprint arXiv:2210.11715. · arXiv
  40. Sayyed M Zahiri and Jinho D Choi. 2017. Emo- tion detection on tv show transcripts with sequence- based convolutional neural networks. arXiv preprint arXiv:1708.04299. · arXiv
  41. Duzhen Zhang, Zhen Yang, Fandong Meng, Xiuyi Chen, and Jie Zhou. 2022. Tsam: A two-stream at- tention model for causal emotion entailment. arXiv preprint arXiv:2203.00819. · arXiv
  42. Weixiang Zhao, Yanyan Zhao, Zhuojun Li, and Bing Qin. 2022a. Knowledge-bridged causal interac- tion network for causal emotion entailment. arXiv preprint arXiv:2212.02995. · arXiv
  43. Weixiang Zhao, Yanyan Zhao, and Xin Lu. 2022b. Cauain: Causal aware interaction network for emo- tion recognition in conversations. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI, pages 4524-4530.
  44. Weixiang Zhao, Yanyan Zhao, Xin Lu, and Bing Qin. 2022c. Don't lose yourself! empathetic response generation via explicit self-other awareness. arXiv preprint arXiv:2210.03884. · arXiv
  45. Weixiang Zhao, Yanyan Zhao, and Bing Qin. 2022d. Mucdn: Mutual conversational detachment network for emotion recognition in multi-party conversations. In Proceedings of the 29th International Conference on Computational Linguistics, pages 7020-7030.
  46. Li Zhou, Jianfeng Gao, Di Li, and Heung-Yeung Shum. 2020. The design and implementation of xiaoice, an empathetic social chatbot. Computational Linguis- tics, 46(1):53-93.

Cited by

Sorted by citations

Authors
Zhao, W., Zhao, Y., Lu, X., Wang, S., Tong, Y., & Qin, B.
Affiliations
Harbin Institute of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2304.09582
arXiv
2304.09582
OpenAlex
W4366559955
Cited by
92
References
0
Citations by year
2026: 17 · 2025: 30 · 2024: 33 · 2023: 12
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Keywords
ChatGPT, emotional dialogue, large language models, emotional responses, downstream tasks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review