Cited by 135Emotion and Mood RecognitionEmotional Intelligence and PerformancePsychiatry, Mental Health, Neuroscience

Emotional intelligence of Large Language Models

Open access
Wang, Xuena, Li, Xueting, Yin, Zi, Wu, Yue, Liu, Jia·2023·Journal of Pacific Rim Psychology

Abstract

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human emotions and values, which is critical for real-world applications, has not been systematically evaluated. Here, we assessed LLMs' Emotional Intelligence (EI), encompassing emotion recognition, interpretation, and understanding, which is necessary for effective communication and social interactions. Specifically, we first developed a novel psychometric assessment focusing on Emotion Understanding (EU), a core component of EI. This test is an objective, performance-driven, and text-based evaluation, which requires evaluating complex emotions in realistic scenarios, providing a consistent assessment for both human and LLM capabilities. With a reference frame constructed from over 500 adults, we tested a variety of mainstream LLMs. Most achieved above-average Emotional Quotient (EQ) scores, with GPT-4 exceeding 89% of human participants with an EQ of 117. Interestingly, a multivariate pattern analysis revealed that some LLMs apparently did not rely on the human-like mechanism to achieve human-level performance, as their representational patterns were qualitatively distinct from humans. In addition, we discussed the impact of factors such as model size, training method, and architecture on LLMs' EQ. In summary, our study presents one of the first psychometric evaluations of the human-like characteristics of LLMs, which may shed light on the future development of LLMs aiming for both high intellectual and emotional intelligence. Project website: https://emotional-intelligence.github.io/

Integrity signals

Registry

Crossref · 10.1177/18344909231213958

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Most LLMs achieve above-average scores in EQ, with GPT-4 scoring 117, surpassing 89% of human participants.

    “The results showed that most LLMs achieve above-average scores in emotional quotient (EQ), with GPT-4 scoring 117, surpassing 89% of human participants.”

    From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [212]

  • There are distinct differences in the quality of representational patterns of certain LLMs compared to humans.

    “This is evident from the distinct differences in the quality of their representational patterns, as compared to humans.”

    From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [212]

  • Certain LLMs achieve human-level performance without relying on mechanisms resembling those found in humans.

    “However, a multivariate pattern analysis indicated that certain LLMs achieve human-level performance without relying on mechanisms resembling those found in humans.”

    From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [212]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Wang, X., Li, X., Yin, Z., Wu, Y., & Liu, J.
Affiliations
  • Tsinghua University (CN)
  • Renmin University of China (CN)
  • Department of Psychology & Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China
Venue
Journal of Pacific Rim Psychology
Published
2023-01
Volume
17
ISSN
1834-4909 (ISSN-L)
OpenAlex
W4388708748
Cited by
128
References
31
Citations by year
2026: 41 · 2025: 59 · 2024: 27 · 2023: 1
FWCI
33.02
Type
journal article
Language
en
Open access
Locations
  • Journal of Pacific Rim Psychology (publishedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Tsinghua University Guoqiang Institute (2020GQG1016)
  • Shuimu Tsinghua Scholar Program
  • Beijing Municipal Science & Technology Commission, Administrative Commission of Zhongguancun Science Park (Z221100002722012)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Social Sciences › Psychology › Social Psychology › Emotional Intelligence and Performance
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
Keywords
large language models, emotional intelligence, emotional understanding, emotional quotient, psychometric assessment, emotion recognition, GPT-4, model size, training methods, neural architecture, multivariate pattern analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review