CoChat
Sign Up
Cited by 135Emotion and Mood RecognitionEmotional Intelligence and PerformancePsychiatry, Mental Health, Neuroscience

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Emotional intelligence of Large Language Models

Open access
Wang, Xuena, Li, Xueting, Yin, Zi, Wu, Yue, Liu, Jia·2023·Journal of Pacific Rim Psychology
DOI 10.1177/18344909231213958
Open this paper in CoChat — free account

Abstract

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human emotions and values, which is critical for real-world applications, has not been systematically evaluated. Here, we assessed LLMs' Emotional Intelligence (EI), encompassing emotion recognition, interpretation, and understanding, which is necessary for effective communication and social interactions. Specifically, we first developed a novel psychometric assessment focusing on Emotion Understanding (EU), a core component of EI. This test is an objective, performance-driven, and text-based evaluation, which requires evaluating complex emotions in realistic scenarios, providing a consistent assessment for both human and LLM capabilities. With a reference frame constructed from over 500 adults, we tested a variety of mainstream LLMs. Most achieved above-average Emotional Quotient (EQ) scores, with GPT-4 exceeding 89% of human participants with an EQ of 117. Interestingly, a multivariate pattern analysis revealed that some LLMs apparently did not rely on the human-like mechanism to achieve human-level performance, as their representational patterns were qualitatively distinct from humans. In addition, we discussed the impact of factors such as model size, training method, and architecture on LLMs' EQ. In summary, our study presents one of the first psychometric evaluations of the human-like characteristics of LLMs, which may shed light on the future development of LLMs aiming for both high intellectual and emotional intelligence. Project website: https://emotional-intelligence.github.io/

Overview

Integrity signals

Registry

Crossref · 10.1177/18344909231213958

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 31 references

Research works printed but not linked: 13

  1. Bai Y., Kadavath S., Kundu S., Askell A., Kernion J., Jones A., Chen A., Goldie A., Mirhoseini A., McKinnon C., Chen C., Olsson C., Olah C., Hernandez D., Drain D., Ganguli D., Li D., Tran-Johnson E., Perez E. … Kaplan J. (2022). Constitutional AI: Harmlessness from AI feedback (arXiv:2212.08073). arXiv. http://arxiv.org/abs/2212.08073 · arXiv
  2. Baron-Cohen S., 2020, The pattern seekers: How autism drives human invention
  3. Hanafi Z., 2016, International Journal of Academic Research in Business and Social Sciences, 6, 268
  4. Hebenstreit K., Praas R., Kiesewetter L. P., Samwald M. (2023). An automatically discovered chain-of-thought prompt generalizes to novel models and datasets (arXiv:2305.02897). arXiv. http://arxiv.org/abs/2305.02897 · arXiv
  5. Hendrycks D., Burns C., Basart S., Zou A., Mazeika M., Song D., Steinhardt J. (2021). Measuring massive multitask language understanding (arXiv:2009.03300). arXiv. http://arxiv.org/abs/2009.03300 · arXiv
  6. Izard V., 2009, Human Evolution, 23, 213
  7. Kosinski M. (2023). Theory of mind may have spontaneously emerged in large language models (arXiv:2302.02083). arXiv. http://arxiv.org/abs/2302.02083 · arXiv
  8. OpenAI. (2023). GPT-4 technical report (arXiv:2303.08774). arXiv. http://arxiv.org/abs/2303.08774 · arXiv
  9. Taori R., Stanford Center for Research on Foundation Models, 3, 7
  10. Vaswani A., 2017, 31st Conference on Neural Information Processing Systems
  11. Zeng A., Liu X., Du Z., Wang Z., Lai H., Ding M., Yang Z., Xu Y., Zheng W., Xia X., Tam W. L., Ma Z., Xue Y., Zhai J., Chen W., Zhang P., Dong Y., Tang J. (2022). GLM-130B: An open bilingual pre-trained model (arXiv:2210.02414). arXiv. http://arxiv.org/abs/2210.02414 · arXiv
  12. Zhao W. X., Zhou K., Li J., Tang T., Wang X., Hou Y., Min Y., Zhang B., Zhang J., Dong Z., Du Y., Yang C., Chen Y., Chen Z., Jiang J., Ren R., Li Y., Tang X., Liu Z. … J.R. Wen (2023). A survey of large language models (arXiv:2303.18223). arXiv. http://arxiv.org/abs/2303.18223 · arXiv
  13. Zheng L., Chiang W.L., Sheng Y., Zhuang S., Wu Z., Zhuang Y., Lin Z., Li Z., Li D., Xing E. P., Zhang H., Gonzalez J. E., Stoica I. (2023). Judging LLM-as-a-judge with MT-Bench and Chatbot Arena . http://arxiv.org/abs/2306.05685 · arXiv

Cited by

Sorted by citations

Related

See all

Metadata

Authors
Wang, X., Li, X., Yin, Z., Wu, Y., & Liu, J.
Affiliations
  • Tsinghua University (CN)
  • Renmin University of China (CN)
  • Department of Psychology & Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China
ORCID
Venue
Journal of Pacific Rim Psychology
Publisher
SAGE Publications
Published
2023-01
Volume
17
ISSN
1834-4909 (ISSN-L)
DOI
10.1177/18344909231213958
OpenAlex
W4388708748
Cited by
128
References
31
Citations by year
2026: 41 · 2025: 59 · 2024: 27 · 2023: 1
FWCI
33.02
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Pacific Rim Psychology (publishedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Tsinghua University Guoqiang Institute (2020GQG1016)
  • Shuimu Tsinghua Scholar Program
  • Beijing Municipal Science & Technology Commission, Administrative Commission of Zhongguancun Science Park (Z221100002722012)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Social Sciences › Psychology › Social Psychology › Emotional Intelligence and Performance
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
Keywords
large language models, emotional intelligence, emotional understanding, emotional quotient, psychometric assessment, emotion recognition, GPT-4, model size, training methods, neural architecture, multivariate pattern analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review