Emotions from text: machine learning for text-based emotion prediction
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
In addition to information, text contains attitudinal, and more specifically, emotional content. This paper explores the text-based emotion prediction problem empirically, using supervised machine learning with the SNoW learning architecture. The goal is to classify the emotional affinity of sentences in the narrative domain of children's fairy tales, for subsequent usage in appropriate expressive rendering of text-to-speech synthesis. Initial experiments on a preliminary data set of 22 fairy tales show encouraging results over a naïve baseline and BOW approach for classification of emotional versus non-emotional contents, with some dependency on parameter tuning. We also discuss results for a tripartite model which covers emotional valence, as well as feature set alternations. In addition, we present plans for a more cognitively sound sequential model, taking into consideration a larger set of basic emotions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Ekman, P. (1993) · American Psychologist · doi:10.1037/0003-066x.48.4.384 · Cited by 3,441
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Vocal communication of emotion: A review of research paradigms
Scherer, K. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00084-5 · Cited by 2,044
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Turney, P. D. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0212032 · Cited by 1,575
Predicting the semantic orientation of adjectives
Hatzivassiloglou, V., & McKeown, K. R. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979640 · Cited by 1,439
Li, X., & Roth, D. (2002) · Proceedings of the 19th international conference on Computational linguistics - · doi:10.3115/1072228.1072378 · Cited by 1,234
Self-citation
Cited by
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON
Mohammad, S. M., & Turney, P. D. (2013) · Computational Intelligence · doi:10.1111/j.1467-8640.2012.00460.x · Cited by 2,634
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
GoEmotions: A Dataset of Fine-Grained Emotions
Demszky, D., Movshovitz-Attias, D., Ko, J., Cowen, A., Nemade, G., & Ravi, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.372 · Cited by 873
GoEmotions: A Dataset of Fine-Grained Emotions
Demszky, D., Movshovitz-Attias, D., Ko, J., Cowen, A., Nemade, G., & Ravi, S. (2020) · arXiv · doi:10.48550/arxiv.2005.00547 · Cited by 873
“Other datasets annotate news headlines (Strapparava and Mihalcea, 2007), dialogs (Li et al., 2017), fairy-tales (Alm et al., 2005), movie subtitles ( ¨Ohman et al., 2018), sentences based on FrameNet (Ghazi et al., 2015), or self-reported experiences (Scherer and Wallbott, 1994) among other domains.”
BackgroundEmotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
“Many different materials have been used to elicit emotions in the laboratory such as facial expressions [22], slides [23], texts [24], music [25], and movies [26].”
BackgroundSentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_907-1 · Cited by 614
Fusing audio, visual and textual clues for sentiment analysis from multimodal content
Poria, S., Cambria, E., Howard, N., Huang, G.-B., & Hussain, A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.01.095 · Cited by 534
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2023) · Encyclopedia of Machine Learning and Data Science · doi:10.1007/978-1-4899-7502-7_907-2 · Cited by 518
AraVec: A set of Arabic Word Embedding Models for use in Arabic NLP
Soliman, A. B., Eissa, K., & El-Beltagy, S. R. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.10.117 · Cited by 509
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Towards multimodal sentiment analysis: harvesting opinions from the web
Morency, L.-P., Mihalcea, R., & Doshi, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070509 · Cited by 470
ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection
Hazarika, D., Poria, S., Mihalcea, R., Cambria, E., & Zimmermann, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1280 · Cited by 452
Identifying Expressions of Emotion in Text
Aman, S., & Szpakowicz, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74628-7_27 · Cited by 447
Survey on mining subjective data on the web
Tsytsarau, M., & Palpanas, T. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0238-6 · Cited by 443
Using Hashtags to Capture Fine Emotion Categories from Tweets
Mohammad, S. M., & Kiritchenko, S. (2015) · Computational Intelligence · doi:10.1111/coin.12024 · Cited by 408
Mohammad, S. M. (2016) · Emotion Measurement · doi:10.1016/b978-0-08-100508-8.00009-6 · Cited by 391
“Alm, Roth, and Sproat (2005) annotated 22 Grimm fairy tales (1580 sentences) for Ekman emotions.15 Strapparava and Mihalcea (2007) annotated newspaper headlines with intensity scores for each of the Ekman emotions, referred to as the Text Affect Dataset.16 Aman and Szpakowicz (2007) annotated blog…”
BackgroundUnderstanding Emotions in Text Using Deep Learning and Big Data
Chatterjee, A., Gupta, U., Chinnakotla, M. K., Srikanth, R., Galley, M., & Agrawal, P. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.029 · Cited by 384
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108639286 · Cited by 362
Cambria, E., Livingstone, A., & Hussain, A. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-34584-5_11 · Cited by 306
Harnessing Twitter "Big Data" for Automatic Emotion Identification
Wang, W., Chen, L., Thirunarayan, K., & Sheth, A. P. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.119 · Cited by 303
SemEval-2019 Task 3: EmoContext Contextual Emotion Detection in Text
Chatterjee, A., Narahari, K. N., Joshi, M., & Agrawal, P. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2005 · Cited by 283
A survey of state-of-the-art approaches for emotion recognition in text
Alswaidan, N., & Menai, M. E. B. (2020) · Knowledge and Information Systems · doi:10.1007/s10115-020-01449-0 · Cited by 273
WASSA-2017 Shared Task on Emotion Intensity
Mohammad, S., & Bravo-Marquez, F. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5205 · Cited by 270
Dynabench: Rethinking Benchmarking in NLP
Kiela, D., Bartolo, M., Nie, Y., Kaushik, D., Geiger, A., Wu, Z., Vidgen, B., Prasad, G., Singh, A., Ringshia, P., et al. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.324 · Cited by 254
Towards an intelligent framework for multimodal affective data analysis
Poria, S., Cambria, E., Hussain, A., & Huang, G.-B. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.005 · Cited by 236
(2013) · Cited by 236
A multi-label classification based approach for sentiment classification
Liu, S. M., & Chen, J.-H. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.036 · Cited by 236
Metaphor as a Medium for Emotion: An Empirical Study
Mohammad, S., Shutova, E., & Turney, P. (2016) · Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s16-2003 · Cited by 173
Speech Under Stress: Analysis, Modeling and Recognition
Hansen, J. H. L., & Patil, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74200-5_6 · Cited by 162
“Safety and Security – air traffic controllers and pilots in noisy high stress environments, deep sea divers, NASA-space explorations, power system operators, [1,3,4,5], military persons facing examination panel [6,7], law enforcement training [8].”
BackgroundInfluentialPREDICTING INDIVIDUAL WELL-BEING THROUGH THE LANGUAGE OF SOCIAL MEDIA
SCHWARTZ, H. A., SAP, M., KERN, M. L., EICHSTAEDT, J. C., KAPELNER, A., AGRAWAL, M., BLANCO, E., DZIURZYNSKI, L., PARK, G., STILLWELL, D., et al. (2016) · Biocomputing 2016 · doi:10.1142/9789814749411_0047 · Cited by 148
“8 While some language analyses have explored “happiness” based on emotion or mood, 9–14 modeling the broader construct of well-being is a relatively unexplored task.”
BackgroundPan, B., Hirota, K., Jia, Z., & Dai, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126866 · Cited by 142
Jiang, S., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274351 · Cited by 125
“This also allow us to keep emojis, which are important “words” for our analysis because they enable users’ to express emotional signals, sometimes even more significantly than with text [2, 27].”
BackgroundMai, S., Xing, S., & Hu, H. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2925966 · Cited by 89
Sentence-level Emotion Classification with Label and Context Dependence
Li, S., Huang, L., Wang, R., & Zhou, G. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1101 · Cited by 66
Antoine, J.-Y., Villaneau, J., & Lefeuvre, A. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1058 · Cited by 87
“We have decided to create a little corpus (230 sentences) of fairy tales, which are regularly used in works related to child affect analysis (Alm and al., 2005; Volkova and al., 2010).”
BackgroundA Systematic Analysis of User Experience Dimensions for Interactive Digital Narratives
Revi, A. T., Millard, D. E., & Middleton, S. E. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-62516-0_5 · Cited by 22
Metadata
- Authors
- Alm, C. O., Roth, D., & Sproat, R.
- Venue
- Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05
- Published
- 2005
- Pages
- 579-586
- OpenAlex
- W2168493061
- Cited by
- 781
- References
- 24
- FWCI
- 5.01
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.