Cited by 96Sentiment Analysis and Opinion MiningEmotion and Mood RecognitionSpeech and dialogue systems

Long Dialogue Emotion Detection Based on Commonsense Knowledge Graph Guidance

Nie, Weizhi, Bao, Yuru, Zhao, Yue, Liu, Anan·2024·IEEE Transactions on Multimedia

Abstract

Dialogue emotion detection is always challenging due to human subjectivity and the randomness of dialogue content. In a conversation, the emotion of each person often develops via a cumulative process, which can be influenced by many elements of uncertainty. Much commonsense knowledge influences people's emotions imperceptibly, such as experiential or habitual knowledge. In the process of conversation, this commonsense knowledge information can be used to enrich the semantic information of each utterance and improve the accuracy of emotion recognition. In this paper, we propose a growing graph model for dialogues emotion detection based on retrieval of external knowledge atlas ATOMIC from local and global respectively, which can effectively represent the dialogues as a process variable in a sequence and the correlation among utterances also can be represented by the graph model. In particular, 1) we introduce a common sense knowledge graph for linking the commonsense knowledge retrieved from external knowledge atlas ATOMIC, which can effectively add auxiliary information to improve the performance of each utterance's representation. 2) We propose a novel self-supervised learning method for extracting the latent topic of each dialogue. Based on this design, we also propose an effective optimization mechanism to make the representation (embedding) of latent topic has a better distinction for the next operation. 3) Finally, the cross-attention module is utilized to combine the utterances' features and the latent conversation topic information. The attention mechanism can effectively use topic information to supplement the representation of utterances and improve recognition performance. The model is tested on three popular datasets in dialogue emotion detection and is empirically demonstrated to outperform the state-of-the-art approaches. Meanwhile, to demonstrate the performance of our approach, we also build a long dialogue dataset. The average length of each conversation is over 50 utterances. The final experimental results also demonstrate the superior performance of our approach.

Integrity signals

Registry

Crossref · 10.1109/tmm.2023.3267295

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Exploring new concepts increases the meta information of a person and helps to evaluate individual class predictions by local algorithms.

    “Exploring new concepts increases the meta information of a person and helps to evaluate individual class predictions by local algorithms [187].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Nie, W., Bao, Y., Zhao, Y., & Liu, A.
Affiliations
  • Tianjin University (CN)
  • School of Electrical and Information Engineering, Tianjin University, Tianjin, China
Venue
IEEE Transactions on Multimedia
Published
2024
Volume
26
Pages
514-528
ISSN
  • 1520-9210 (ISSN-L)
  • 1941-0077
OpenAlex
W4365801669
Cited by
96
References
3
Citations by year
2026: 21 · 2025: 13 · 2024: 28 · 2023: 33 · 2021: 1
FWCI
8.96
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Multimedia (publishedVersion)
Funders
  • National Natural Science Foundation of China (62272337)
  • National Archives Administration of China Science and Technology Project (2022-X-040)
  • Science and Technology Project of China Huaneng Group Company Ltd. (HNKJ22-H156)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
Keywords
commonsense knowledge graph, cross-attention, utterance representation, dialogue modeling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review