The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Using Hashtags to Capture Fine Emotion Categories from Tweets
Abstract
Detecting emotions in microblogs and social media posts has applications for industry, health, and security. Statistical, supervised automatic methods for emotion detection rely on text that is labeled for emotions, but such data are rare and available for only a handful of basic emotions. In this article, we show that emotion‐word hashtags are good manual labels of emotions in tweets. We also propose a method to generate a large lexicon of word–emotion associations from this emotion‐labeled tweet corpus. This is the first lexicon with real‐valued word–emotion association scores. We begin with experiments for six basic emotions and show that the hashtag annotations are consistent and match with the annotations of trained judges. We also show how the extracted tweet corpus and word–emotion associations can be used to improve emotion classification accuracy in a different nontweet domain. Eminent psychologist Robert Plutchik had proposed that emotions have a relationship with personality traits. However, empirical experiments to establish this relationship have been stymied by the lack of comprehensive emotion resources. Because personality may be associated with any of the hundreds of emotions and because our hashtag approach scales easily to a large number of emotions, we extend our corpus by collecting tweets with hashtags pertaining to 585 fine emotions. Then, for the first time, we present experiments to show that fine emotion categories such as those of excitement, guilt, yearning, and admiration are useful in automatically detecting personality from text. Stream‐of‐consciousness essays and collections of Facebook posts marked with personality traits of the author are used as test sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
(1999) · Cited by 7,995
Using Information Content to Evaluate Semantic Similarity in a Taxonomy
Resnik, P. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9511007 · Cited by 3,193
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829
Mbti Manual: A Guide to the Development and Use of the Myers-briggs Type Indicator
Myers, I. B., McCaulley, M. H., & Most, R. B. (1985) · Medical Entomology and Zoology · Cited by 2,783
Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON
Mohammad, S. M., & Turney, P. D. (2013) · Computational Intelligence · doi:10.1111/j.1467-8640.2012.00460.x · Cited by 2,634
Self-citation(2007) · Cited by 2,018
Linguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961
Measuring praise and criticism: Inference of semantic orientation from association
Turney, P. D., & Littman, M. L. (2003) · ACM Transactions on Information Systems · doi:10.1145/944012.944013 · Cited by 1,502
PERSONALITY MEASURES AS PREDICTORS OF JOB PERFORMANCE: A META‐ANALYTIC REVIEW
TETT, R. P., JACKSON, D. N., & ROTHSTEIN, M. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00696.x · Cited by 1,481
WordNet Affect: an Affective Extension of WordNet
Strapparava, C., & Valitutti, A. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2yctm9q26ar4 · Cited by 1,384
Frustratingly Easy Domain Adaptation
Daumé, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0907.1815 · Cited by 1,383
A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION
PLUTCHIK, R. (1980) · Theories of Emotion · doi:10.1016/b978-0-12-558701-3.50007-7 · Cited by 1,370
The Myers-Briggs Type Indicator: Manual (1962).
Myers, I. B. (1962) · Consulting Psychologists Press eBooks · doi:10.1037/14404-000 · Cited by 1,102
Using linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046 · cited 6×
“Mairesse et al. (2007) improved on these features and distribute their system online.”
BackgroundMethodInfluentialModeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena
Bollen, J., Mao, H., & Pepe, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14171 · Cited by 936
Bougie, R., Pieters, R., & Zeelenberg, M. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/0092070303254412 · Cited by 894
Emotions from text: machine learning for text-based emotion prediction
Alm, C. O., Roth, D., & Sproat, R. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220648 · Cited by 781
The psychology and biology of emotion
Plutchik, R. (1994) · Cited by 725
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637
Identifying Sarcasm in Twitter: A Closer Look
González‐Ibáñez, R., Muresan, S., & Wacholder, N. (2011) · Cited by 627
SemEval-2007 task 14: affective text
Strapparava, C., & Mihalcea, R. (2007) · Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07 · doi:10.3115/1621474.1621487 · Cited by 602
A Latent Variable Model for Geographic Lexical Variation
Eisenstein, J., O'Connor, B., Smith, N. A., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6475412 · Cited by 584
Karypis, G. (2002) · doi:10.21236/ada439508 · Cited by 546
A model of textual affect sensing using real-world knowledge
Liu, H., Lieberman, H., & Selker, T. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604067 · Cited by 531
Big 5 correlates of three measures of subjective well-being
Hayes, N., & Joseph, S. (2003) · Personality and Individual Differences · doi:10.1016/s0191-8869(02)00057-0 · Cited by 458
Identifying Expressions of Emotion in Text
Aman, S., & Szpakowicz, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74628-7_27 · Cited by 447
Modeling emotions and other motivations in synthetic agents
Velásquez, J. D. (1997) · National Conference on Artificial Intelligence · Cited by 338
You are what you tweet: Personality expression and perception on Twitter
Qiu, L., Lin, H., Ramsay, J., & Yang, F. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.08.008 · Cited by 331
Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play?
Ravaja, N., Saari, T., Turpeinen, M., Laarni, J., Salminen, M., & Kivikangas, M. (2006) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.15.4.381 · Cited by 322
Big five personality variables and relationship constructs
White, J. K., Hendrick, S. S., & Hendrick, C. (2004) · Personality and Individual Differences · doi:10.1016/j.paid.2004.02.019 · Cited by 284
Using Analytic QP and Sparseness to Speed Training of Support Vector Machines
Platt, J. C. (1998) · Cited by 270
A Corpus-based Approach to Finding Happiness
Mihalcea, R. F., & Liu, H. (2006) · Cited by 199
Predicting student emotions in computer-human tutoring dialogues
Litman, D. J., & Forbes-Riley, K. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1219000 · Cited by 179
Tracking Sentiment in Mail: How Genders Differ on Emotional Axes
Mohammad, S. M., Tony, & Yang (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.6347 · Cited by 171
Self-citationMotivation and language behavior: A content analysis of suicide notes.
Osgood, C. E., & Walker, E. G. (1959) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0047078 · Cited by 166
From once upon a time to happily ever after: Tracking emotions in mail and books
Mohammad, S. M. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.05.030 · Cited by 159
Self-citationUsing a Heterogeneous Dataset for Emotion Analysis in Text
Chaffar, S., & Inkpen, D. Z. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21043-3_8 · Cited by 155
Compositionality Principle in Recognition of Fine-Grained Emotions from Text
Neviarouskaya, A., Prendinger, H., & Ishizuka, M. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13987 · Cited by 120
Taking Care of the Linguistic Features of Extraversion
Gill, A. J., & Oberlander, J. (2019) · Routledge eBooks · doi:10.4324/9781315782379-99 · Cited by 110
Emotion Estimation and Reasoning Based on Affective Textual Interaction
Ma, C., Prendinger, H., & Ishizuka, M. (2005) · Lecture notes in computer science · doi:10.1007/11573548_80 · Cited by 97
Emotional Sequencing and Development in Fairy Tales
Alm, C. O., & Sproat, R. (2005) · Lecture notes in computer science · doi:10.1007/11573548_86 · Cited by 95
Improving the Detection of Personality-Behavior Relationships in Consumer Research
Lastovicka, J. L., & Joachimsthaler, E. A. (1988) · Journal of Consumer Research · doi:10.1086/209138 · Cited by 85
Portable Features for Classifying Emotional Text
Mohammad, S. M. (2012) · NPARC · Cited by 76
Self-citationUsing natural language processing to classify suicide notes
Pestian, J. P., Matykiewicz, P., Grupp‐Phelan, J., Lavanier, S., Combs, J., & Kowatch, R. A. (2008) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572306.1572327 · Cited by 71
Multi-View Learning over Structured and Non-Identical OutputsPreprint
Ganchev, K., Graça, J., Blitzer, J. C., & Taskar, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.3256 · Cited by 58
Binary Classifiers and Latent Sequence Models for Emotion Detection in Suicide Notes
Cherry, C., Mohammad, S. M., & de Bruijn, B. (2012) · Biomedical Informatics Insights · doi:10.4137/bii.s8933 · Cited by 56
Self-citationIdentifying Emotions, Intentions, and Attitudes in Text Using a Game with a Purpose
Pearl, L., & Mark Steyvers, B. (2010) · North American Chapter of the Association for Computational Linguistics · Cited by 47
On emotion: The chicken-and-egg problem revisited
Plutchik, R. (1985) · Motivation and Emotion · doi:10.1007/bf00991576 · Cited by 40
Automated Mark Up of Affective Information in English Texts
Francisco, V., & Gervás, P. (2006) · Lecture notes in computer science · doi:10.1007/11846406_47 · Cited by 26
Representing emotional momentum within expressive internet communication
John, D., Boucouvalas, A. C., & Xu, Z. (2006) · Internet, Multimedia Systems and Applications · Cited by 20
Distinguishing affective states in weblogs
Généreux, M., & Evans, R. (2006) · University of Brighton Repository (University of Brighton) · Cited by 16
Cited by
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 880
Self-citationDeep Learning-Based Document Modeling for Personality Detection from Text
Majumder, N., Poria, S., Gelbukh, A., & Cambria, E. (2017) · IEEE Intelligent Systems · doi:10.1109/mis.2017.23 · Cited by 675
Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words
Mohammad, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1017 · Cited by 613
Self-citationDynamics of information diffusion and its applications on complex networks
Zhang, Z.-K., Liu, C., Zhan, X.-X., Lu, X., Zhang, C.-X., & Zhang, Y.-C. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.07.002 · Cited by 484
Metadata
- Authors
- Mohammad, S. M., & Kiritchenko, S.
- Venue
- Computational Intelligence
- Publisher
- Wiley
- Published
- 2014-01-10
- Volume
- 31
- Issue
- 2
- Pages
- 301-326
- ISSN
- 0824-7935 (ISSN-L)
- 1467-8640
- OpenAlex
- W1569507287
- Cited by
- 408
- References
- 56
- FWCI
- 27.73
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.