Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter
Open accessThe DOI matches its Crossref record; 65 of the 68 references it cites were found in a registry or an index.
Abstract
Individual happiness is a fundamental societal metric. Normally measured through self-report, happiness has often been indirectly characterized and overshadowed by more readily quantifiable economic indicators such as gross domestic product. Here, we examine expressions made on the online, global microblog and social networking service Twitter, uncovering and explaining temporal variations in happiness and information levels over timescales ranging from hours to years. Our data set comprises over 46 billion words contained in nearly 4.6 billion expressions posted over a 33 month span by over 63 million unique users. In measuring happiness, we construct a tunable, real-time, remote-sensing, and non-invasive, text-based hedonometer. In building our metric, made available with this paper, we conducted a survey to obtain happiness evaluations of over 10,000 individual words, representing a tenfold size improvement over similar existing word sets. Rather than being ad hoc, our word list is chosen solely by frequency of usage, and we show how a highly robust and tunable metric can be constructed and defended.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 Demonstration of robustness and tunability of our text-based hedonometer, and reasoning for choice of a specific metric. To measure the happiness of a given text, we first compute frequencies of all words; we then create an overall happiness score, Eq. (1) , as a weighted average of subsets of 10,222 individual word happiness assessments on a 1 to 9 scale, obtained through Mechanical Turk (see main text and Methods). In varying word sets by excluding stop words [58], we can systematically explore families of happiness metrics. In plot A, we show time series of average happiness for Twitter, binned by day, produced by different metrics. Each time series is generated by omitting words with as indicated in plot B, which shows the overall distribution of average happiness of individual words. For we use all words; as increases, we progressively remove words centered around the neutral evaluation of 5. Plot C provides a test for robustness through a pairwise comparison of all time series using Pearson's correlation coefficient. For , the time series show very strong mutual agreement. We choose (black curve in A and F, shown in B, white symbols in C, D, and E) for the present paper because of its excellent correlation in output with that of a wide range of , and for reasons concerning the following trade-offs. In A, we see that as the number of stop words increases, so does the variability of the time series, suggesting an improvement in instrument sensitivity. However, at the same time, we lose coverage of texts. Plot D first shows how the number of individual words for which we have evaluations decreases as increases. For , we have 3,686 individual words down from 10,222. Plot E next shows the percentage of the Twitter data set covered by each word list, accounting for word frequency; for , our metric uses 22.7% of all words. Lastly, in plot F (which uses plot A's legend), we show how coverage of words decreases with word rank. When , we incorporate all low rank words, with a decline beginning at rank 5,000. For , we see similar patterns with the maximum coverage declining; for , we see a maximum coverage of approximately 50%.](https://figures.cochat.ai/paper-figures/9ee1400e54384445affdaf17e661bc73/temporal-patterns-of-happiness-and-information-in-a-global-social-network-figure-2.jpg)















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“following Dodds et al.'s (2011) hedonometrics study, all host names were changed into names that score 5 (i.e., neutral in sentiments) on a valence scale of 1 - 9: Neil for male and Marjorie for female.”
From When guests trust hosts for their words: Host description and trust in sharing economy (2018) · cites this paper as Dodds et al.'s (2011)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
SIMPSON, E. H. (1949) · Nature · doi:10.1038/163688a0 · Cited by 14,164
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
What is Twitter, a social network or a news media?
Kwak, H., Lee, C., Park, H., & Moon, S. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772751 · Cited by 6,652 · cited 1×
“Twitter’s user population is therefore a blend of individuals, groups of individuals, organizations, media outlets, and automated services such as bots [50], representing a kind of disaggregated, crowd-sourced media [51].”
BackgroundTwitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206 · cited 1×
“gleaned from Twitter to predict stock market behavior [36].”
BackgroundJost, L. (2006) · Oikos · doi:10.1111/j.2006.0030-1299.14714.x · Cited by 4,669 · cited 1×
“We further focus our present work on our essential findings regarding temporal variations in happiness including: the overall time series; regular cycles at the scale of days and weeks; time series for subsets of tweets containing specific keywords; and detailed comparisons between texts at the level of individual wor…”
MethodInfluentialEnvironmental genome shotgun sequencing of the sargasso sea
Venter, J. C., Remington, K., Heidelberg, J. F., Halpern, A. L., Rusch, D., Eisen, J. A., Wu, D., Paulsen, I., Nelson, K. E., Nelson, W., et al. (2004) · Science · doi:10.1126/science.1093857 · Cited by 4,376 · cited 1×
“Accurate description through quantitative measurement is essential to the advancement of any scientific field, and the shift from being data scarce to data rich has revolutionized many areas [2–5] ranging from astronomy [6–8] to ecology and biology [9] to particle physics [10].”
BackgroundDetecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Quantitative Analysis of Culture Using Millions of Digitized Books
Michel, J.-B., Shen, Y. K., Aiden, A. P., Veres, A., Gray, M. K., The Google Books Team, Pickett, J. P., Hoiberg, D., Clancy, D., Norvig, P., et al. (2011) · Science · doi:10.1126/science.1199644 · Cited by 3,077 · cited 2×
“(English) [12,13], music lyrics (1960 to 2007) [23], and the New”
BackgroundA wandering mind is an unhappy mind
Killingsworth, M. A., & Gilbert, D. T. (2010) · Science · doi:10.1126/science.1192439 · Cited by 2,575 · cited 1×
“There is an important psychological distinction between an individual's current, experiential happiness”
Background
Research works printed but not linked: 4
- [19]Layard R 2005 Happiness London The Penguin Press
- [21]Lyubomirsky S 2007 The How of Happiness New York The Penguin Press
- [43]Mishne G 2005 Experiments with mood classification in blog posts. Style2005, 1st Workshop on Stylistic Analysis of Text for Information Access
- [60]Dodds PS Harris KD Kloumann IM Bliss CA Danforth CM 2011 Temporal patterns of happiness and information in a global social network: Hedonometrics and twitter. Draft version. Available at http://arxiv.org/abs/1101.5120v3. Accessed October 24, 2011 PMC3233600 22163266 · arXiv
Cited by
Newman, M. (2018) · doi:10.1093/oso/9780198805090.001.0001 · Cited by 2,297
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
SemEval-2016 Task 4: Sentiment Analysis in Twitter
Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1001 · Cited by 966
“, 2010), social science (Dodds et al., 2011), and market research (Burton and Soboleva, 2011; Qureshi et al.”
BackgroundBirds of the Same Feather Tweet Together. Bayesian Ideal Point Estimation Using Twitter Data
Barbera, P. (2012) · doi:10.2139/ssrn.2108098 · Cited by 983
Birds of the Same Feather Tweet Together: Bayesian Ideal Point Estimation Using Twitter Data
Barberá, P. (2015) · Political Analysis · doi:10.1093/pan/mpu011 · Cited by 1,298
SemEval-2017 Task 4: Sentiment Analysis in Twitter
Rosenthal, S., Farra, N., & Nakov, P. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2088 · Cited by 870
“, 2010), social science (Dodds et al., 2011), and market research (Burton and Soboleva, 2011; Qureshi et al.”
BackgroundSocial Sensing: A New Approach to Understanding Our Socioeconomic Environments
Liu, Y., Liu, X., Gao, S., Gong, L., Kang, C., Zhi, Y., Chi, G., & Shi, L. (2015) · Annals of the Association of American Geographers · doi:10.1080/00045608.2015.1018773 · Cited by 804
“Furthermore, analytics of geotagged tweets offer new insights on the geographical distribution of human sentimental expressions on places and the temporal changes compared with demographic and health characteristics (Dodds et al. 2011; Mitchell et al. 2013; Yang and Mu forthcoming).”
BackgroundUniting the Tribes: Using Text for Marketing Insight
Berger, J., Humphreys, A., Ludwig, S., Moe, W. W., Netzer, O., & Schweidel, D. A. (2020) · Journal of Marketing · doi:10.1177/0022242919873106 · Cited by 742
“Sentiment dictionaries such as Hedonometer (Dodds et al. 2011), VADER (Hutto and Gilbert 2014), and LIWC can be used to extract the sentiment of the text.”
MethodRapid assessment of disaster damage using social media activity
Kryvasheyeu, Y., Chen, H., Obradovich, N., Moro, E., Van Hentenryck, P., Fowler, J., & Cebrian, M. (2016) · Science Advances · doi:10.1126/sciadv.1500779 · Cited by 637
“Sentiment in Twitter has been studied and demonstrated to reflect temporal (19, 70) and geographical (71) mood variations.”
BackgroundMitchell, L., Frank, M. R., Harris, K. D., Dodds, P. S., & Danforth, C. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064417 · Cited by 515
“Following Dodds et al. (2011), for the remainder of this paper, we remove all words w i for which the happiness score falls in the range 4 < h avg ( w i ) < 6 when calculating h avg ( T ) .”
MethodSelf-citationInstagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Self-citationAir pollution lowers Chinese urbanites’ expressed happiness on social media
Zheng, S., Wang, J., Sun, C., Zhang, X., & Kahn, M. E. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0521-2 · Cited by 485
Chae, B. (. (2015) · International Journal of Production Economics · doi:10.1016/j.ijpe.2014.12.037 · Cited by 481
Pechenick, E. A., Danforth, C. M., & Dodds, P. S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137041 · Cited by 436
“We present “word shifts” [16] for a few examples of inter-decade divergences in Figs 7–12, specifically comparing the 1940s to the 1930s and the 1980s to the 1950s for the first unfiltered English data set (Figs 7–8) and both English Fiction data sets (Figs 9–12).”
BackgroundSelf-citationMeasuring objective and subjective well-being: dimensions and data sources
Voukelatou, V., Gabrielli, L., Miliou, I., Cresci, S., Sharma, R., Tesconi, M., & Pappalardo, L. (2021) · International Journal of Data Science and Analytics · doi:10.1007/s41060-020-00224-2 · Cited by 365
The emotional arcs of stories are dominated by six basic shapes
Reagan, A. J., Mitchell, L., Kiley, D., Danforth, C. M., & Dodds, P. S. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0093-1 · Cited by 269
“Hedonometer, which comprise the emotional arc [22].”
Self-citationThe Routledge Handbook of Research Methods for Social-Ecological Systems
Biggs, R., Preiser, R., de Vos, A., Schlüter, M., Maciejewski, K., & Clements, H. (2021) · Routledge eBooks · doi:10.4324/9781003021339 · Cited by 352
Natural language processing in mental health applications using non-clinical texts
CALVO, R. A., MILNE, D. N., HUSSAIN, M. S., & CHRISTENSEN, H. (2017) · Natural Language Engineering · doi:10.1017/s1351324916000383 · Cited by 362
“Golder and Macy (2011) and Dodds et al. (2011) are purely observational, but the others check that geographic and temporal variations correlate well against external statistics.”
BackgroundInfluentialForecasting the onset and course of mental illness with Twitter data
Reece, A. G., Reagan, A. J., Lix, K. L. M., Dodds, P. S., Danforth, C. M., & Langer, E. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-12961-9 · Cited by 401
“Word shift graphs We averaged labMT happiness scores across observations in each class, after the removal of common neutral words and retweeted promotional material (38) , .”
BackgroundMethodSelf-citationHuman language reveals a universal positivity bias
Dodds, P. S., Clark, E. M., Desu, S., Frank, M. R., Reagan, A. J., Williams, J. R., Mitchell, L., Harris, K. D., Kloumann, I. M., Bagrow, J. P., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1411678112 · Cited by 401
Self-citationUnderstanding the Political Representativeness of Twitter Users
Barberá, P., & Rivero, G. (2015) · Social Science Computer Review · doi:10.1177/0894439314558836 · Cited by 379
“Twitter, inequality, political discussion”
Dynamical classes of collective attention in twitter
Lehmann, J., Gonçalves, B., Ramasco, J. J., & Cattuto, C. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187871 · Cited by 380
“…including its network topology [18, 19, 20], the relations and types of messages between users [21, 22], the internal information propagation [23, 24, 25], the credibility of information [26, 27], and even its potential as an indicator of the state of mind of a population [28, 29, 30, 31, 32, 25].”
BackgroundTurner, K. G., Anderson, S., Gonzales-Chang, M., Costanza, R., Courville, S., Dalgaard, T., Dominati, E., Kubiszewski, I., Ogilvy, S., Porfirio, L., et al. (2016) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.07.017 · Cited by 354
More Tweets, More Votes: Social Media as a Quantitative Indicator of Political Behavior
DiGrazia, J., McKelvey, K., Bollen, J., & Rojas, F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079449 · Cited by 341
“For example, film title mentions correlate with box office revenue [12], and online expressions of public mood correlate with fluctuations in stock market prices, sleep, work, and happiness [13–15].”
BackgroundSentiment analysis of Twitter data during critical events through Bayesian networks classifiers
Ruz, G. A., Henríquez, P. A., & Mascareño, A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.005 · Cited by 332
The role of administrative data in the big data revolution in social science research
Connelly, R., Playford, C. J., Gayle, V., & Dibben, C. (2016) · Social Science Research · doi:10.1016/j.ssresearch.2016.04.015 · Cited by 330
“Picot and Piraino (2012) demonstrate the value of producing cohorts using administrative data in their analysis of immigrant earnings in Canada.”
BackgroundUsing wellbeing for public policy: Theory, measurement, and recommendations
Adler, A., & Seligman, M. E. P. (2016) · International Journal of Wellbeing · doi:10.5502/ijw.v6i1.429 · Cited by 277
Climate Change Sentiment on Twitter: An Unsolicited Public Opinion Poll
Cody, E. M., Reagan, A. J., Mitchell, L., Dodds, P. S., & Danforth, C. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136092 · Cited by 302
“Words uncovered by our analysis suggest that responses to climate change news are predominately from climate change activists rather than climate change deniers, indicating that Twitter is a valuable resource for the spread of climate change awareness.”
BackgroundSelf-citationData ex Machina: Introduction to Big Data
Lazer, D., & Radford, J. (2017) · Annual Review of Sociology · doi:10.1146/annurev-soc-060116-053457 · Cited by 303
“Dodds et al. (2011) show that big data can capture annual emotional cycles, particularly around holidays, as well as divergences during global events such as the financial crisis.”
BackgroundPearce, W., Holmberg, K., Hellsten, I., & Nerlich, B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094785 · Cited by 285
“Previous research on Twitter has mostly focused on either the content of tweets [12], emotions transmitted through tweets [13,14], or on structural aspects of tweeting, such as collective attention to issues [15,16].”
BackgroundWASSA-2017 Shared Task on Emotion Intensity
Mohammad, S., & Bravo-Marquez, F. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5205 · Cited by 270
“The gold training words are taken from existing affective norms and emotion lexicons: NRC Hashtag Emotion Lexicon (Mohammad, 2012b; Mohammad and Kir-itchenko, 2015), affective norms from Warriner et al. (2013), Brysbaert et al. (2014), and ratings for happiness from Dodds et al. (2011).”
BackgroundDiffusion of Lexical Change in Social Media
Eisenstein, J., O'Connor, B., Smith, N. A., & Xing, E. P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113114 · Cited by 242
“A wave of recent research has shown how social media datasets can enable large-scale analysis of patterns of communication [10,11], sentiment [12–14], and influence [15–19].”
BackgroundA survey of Twitter research: Data model, graph structure, sentiment analysis and attacks
Antonakaki, D., Fragopoulou, P., & Ioannidis, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114006 · Cited by 265
Towards felicitous decision making: An overview on challenges and trends of Big Data
Wang, H., Xu, Z., Fujita, H., & Liu, S. (2016) · Information Sciences · doi:10.1016/j.ins.2016.07.007 · Cited by 268
“[38] Twitter Hedonometrics Uncover temporal variations in happiness and information levels Guo and Vargo [49] Twitter during the 2012 US presidential election Semantic network analysis Empirically test “issue ownership network””
BackgroundAnger Is More Influential than Joy: Sentiment Correlation in Weibo
Fan, R., Zhao, J., Chen, Y., & Xu, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110184 · Cited by 244
When guests trust hosts for their words: Host description and trust in sharing economy
Tussyadiah, I. P., & Park, S. (2018) · Tourism Management · doi:10.1016/j.tourman.2018.02.002 · Cited by 264
“neutral sentiment (Dodds et al., 2011), were used to represent gender of the hosts.”
MethodMining Twitter Data for Improved Understanding of Disaster Resilience
Zou, L., Lam, N. S. N., Cai, H., & Qiang, Y. (2018) · Annals of the American Association of Geographers · doi:10.1080/24694452.2017.1421897 · Cited by 227
“The spatial–temporal pattern of average sentiment scores has been applied to investigate individual mood, geography of happiness, and public attitude toward climate change (Dodds et al. 2011; Golder and Macy 2011; Mitchell et al. 2013; Cody et al. 2015).”
BackgroundDeveloping Age and Gender Predictive Lexica over Social Media
Sap, M., Park, G., Eichstaedt, J., Kern, M., Stillwell, D., Kosinski, M., Ungar, L., & Schwartz, H. A. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1121 · Cited by 230
An evolutionary algorithm approach to link prediction in dynamic social networks
Bliss, C. A., Frank, M. R., Danforth, C. M., & Dodds, P. S. (2014) · Journal of Computational Science · doi:10.1016/j.jocs.2014.01.003 · Cited by 232
Self-citationSentiment Analysis in Health and Well-Being: Systematic Review
Zunic, A., Corcoran, P., & Spasic, I. (2020) · JMIR Medical Informatics · doi:10.2196/16023 · Cited by 213
Assessing the bias in samples of large online networks
González-Bailón, S., Wang, N., Rivero, A., Borge-Holthoefer, J., & Moreno, Y. (2014) · Social Networks · doi:10.1016/j.socnet.2014.01.004 · Cited by 238
“An increasing number of studies use Twitter data to investiate a wide range of phenomena, including information diffusion nd credibility, user mobility patterns, spikes of collective attenion, and trends in public sentiment (Bakshy et al., 2011; Bollen t al., 2011; Castillo et al., 2011; Cha et al., 2012; Dodds et al.…”
BackgroundJaidka, K., Giorgi, S., Schwartz, H. A., Kern, M. L., Ungar, L. H., & Eichstaedt, J. C. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906364117 · Cited by 228
Characterizing Geographic Variation in Well-Being Using Tweets
Schwartz, H., Eichstaedt, J., Kern, M., Dziurzynski, L., Lucas, R., Agrawal, M., Park, G., Lakshmikanth, S., Jha, S., Seligman, M., et al. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14442 · Cited by 218
“Others have looked at variation in positive and negative emotion word use in tweets, Facebook, or blogs across time (Dodds et al. 2011; Kramer 2010) or latitude (Dodds and Danforth 2010).”
What do people study when they study Twitter? Classifying Twitter related academic papers
Williams, S. A., Terras, M. M., & Warwick, C. (2013) · Journal of Documentation · doi:10.1108/jd-03-2012-0027 · Cited by 213
Twitter sentiment analysis: Capturing sentiment from integrated resort tweets
Philander, K., & Zhong, Y. (2016) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2016.02.001 · Cited by 201
A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214
“Researchers also used social media data to track the spread of disease [76] and to analyze other ailments on population-scale user bases from Twitter [70].”
BackgroundInfluentialBest-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation
Kiritchenko, S., & Mohammad, S. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2074 · Cited by 170
“(2013) and by Dodds et al. (2011) were 0.”
ResultInfluentialKnowledge-aware Assessment of Severity of Suicide Risk for Early Intervention
Gaur, M., Alambo, A., Sain, J. P., Kursuncu, U., Thirunarayan, K., Kavuluru, R., Sheth, A., Welton, R., & Pathak, J. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313698 · Cited by 190
“We used Language Assessment by Mechanical Turk (LabMT), a list of 10,222 words with happiness, rank, internet usage scores, employing strict match and soft match with Reddit posts [18].”
MethodImpact of convolutional neural network and FastText embedding on text classification
Umer, M., Imtiaz, Z., Ahmad, M., Nappi, M., Medaglia, C., Choi, G. S., & Mehmood, A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13459-x · Cited by 180
“It has many real-world applications in various fields such as finance [3], market research [34], social science [7] and politics [21].”
BackgroundKhoo, L. S., McNaney, R., Lim, M. K., & Chong, C. Y. (2024) · Sensors · doi:10.3390/s24020348 · Cited by 242
Data-Driven Content Analysis of Social Media: A Systematic Overview of Automated Methods
Schwartz, H. A., & Ungar, L. H. (2015) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716215569197 · Cited by 164
Characterizing Twitter Discussions About HPV Vaccines Using Topic Modeling and Community Detection
Surian, D., Nguyen, D. Q., Kennedy, G., Johnson, M., Coiera, E., & Dunn, A. G. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6045 · Cited by 184
“Applications of data mining using Twitter have included influenza surveillance [12-14] and measuring spatial differences in language or mood [15,16].”
Davies, L., LeClair, K. L., Bagley, P. J., Blunt, H. B., Hinton, L., Ryan, S., & Ziébland, S. (2020) · Qualitative Health Research · doi:10.1177/1049732320935835 · Cited by 202
“But research questions that require this technique can now be done through specifically designed applications or by using “big data” analytic techniques on existing data (Dodds et al., 2011; Dogan et al., 2017; Keedle et al., 2018; Larson & Csikszentmihalyi, 1983; Moskowitz & Young, 2006; Stone & Shiffman, 1994).”
MethodWeather impacts expressed sentiment
Baylis, P., Obradovich, N., Kryvasheyeu, Y., Chen, H., Coviello, L., Moro, E., Cebrian, M., & Fowler, J. H. (2018) · PLOS ONE · doi:10.1371/journal.pone.0195750 · Cited by 179
Big Data: Methodological Challenges and Approaches for Sociological Analysis
Tinati, R., Halford, S., Carr, L., & Pope, C. (2014) · Sociology · doi:10.1177/0038038513511561 · Cited by 158
Day of the week and the cross-section of returns
Birru, J. (2018) · Journal of Financial Economics · doi:10.1016/j.jfineco.2018.06.008 · Cited by 171
Distant Supervision for Emotion Classification with Discrete Binary Values
Suttles, J., & Ide, N. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37256-8_11 · Cited by 163
“Other studies have tackled the broader problem of detecting emotions in tweets, often for the purpose of modeling collective emotional trends [4, 5, 10,24].”
BackgroundTemperature and temperament: Evidence from Twitter
Baylis, P. (2020) · Journal of Public Economics · doi:10.1016/j.jpubeco.2020.104161 · Cited by 164
Garcia, D., & Sikström, S. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2013.10.001 · Cited by 161
Happiness and the Patterns of Life: A Study of Geolocated Tweets
Frank, M. R., Mitchell, L., Dodds, P. S., & Danforth, C. M. (2013) · Scientific Reports · doi:10.1038/srep02625 · Cited by 156
“Note that the relatively small differences in h avg scores reflect a small signal, yet one that we have shown previously can be resolved by our hedonometer 27 .”
Self-citationA Survey on Sentiment and Emotion Analysis for Computational Literary StudiesPreprint
Kim, E., & Klinger, R. (2018) · arXiv (Cornell University) · doi:10.17175/2019_008 · Cited by 179
“Although emotion recognition from text is a relatively new task, there are various approaches ranging from simple lexicon matching (Dodds et al., 2011), which is similar to unsupervised sentiment analysis (see Section 3.3.1), to deep learning methods (e.g., Abdul-Mageed and Ungar, 2017), both…”
MethodInfluentialWe Feel: Mapping Emotion on Twitter
Larsen, M. E., Boonstra, T. W., Batterham, P. J., ODea, B., Paris, C., & Christensen, H. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2403839 · Cited by 148
“This pattern is very similar to fluctuations observed in the average happiness level obtained from the “Hedonometer” [7].”
BackgroundMethodCitius: A Naive-Bayes Strategy for Sentiment Analysis on English Tweets
Gamallo, P., & García, M. (2014) · International Workshop on Semantic Evaluation (SemEval) · doi:10.3115/v1/s14-2026 · Cited by 142
“• Hedonometer 3 contains about 10 , 000 frequent words extracted from tweets which were classified as expressing some degree of hapiness (Dodds et al., 2011).”
BackgroundGore, R. J., Diallo, S. Y., & Padilla, J. J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133505 · Cited by 150
“This measure was introduced by Dodds and Danforth [10], tested for robustness and sensitivity [11], and employed by Mitchell et. al in a similar pursuit [12].”
MethodJarvis, T. L., Thornburg, D. A., Rebecca, A. M., & Teven, C. M. (2020) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000003200 · Cited by 155
“16 A similar study by Cognovi Labs and Duke University used supervised ML technology to examine commonly hashtagged words associated with plastic surgery.”
BackgroundMethodInfluentialGuan, Y., Zhang, H., Quang, D., Wang, Z., Parker, S. C. J., Pappas, D. A., Kremer, J. M., & Zhu, F. (2019) · Arthritis & Rheumatology · doi:10.1002/art.41056 · Cited by 137
“The premise of similarity modeling has been widely used in social network analysis and other areas (41,42).”
MethodAntoun, C., Zhang, C., Conrad, F. G., & Schober, M. F. (2016) · Field Methods · doi:10.1177/1525822x15603149 · Cited by 124
Twitter reciprocal reply networks exhibit assortativity with respect to happiness
Bliss, C. A., Kloumann, I. M., Harris, K. D., Danforth, C. M., & Dodds, P. S. (2012) · Journal of Computational Science · doi:10.1016/j.jocs.2012.05.001 · Cited by 149
Self-citationSurvey of Computational Approaches to Lexical Semantic ChangePreprint
Tahmasebi, N., Borin, L., & Jatowt, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.06278 · Cited by 156
“…for long-term sense tracking and analysis in this paper, recently researchers have also focused on diachronic change over shorter time spans such as several years (Dodds et al. 2011; DanescuNiculescu-Mizil et al. 2013; Eisenstein et al. 2014; Goel et al. 2016; Del Tredici and Fernández 2018).”
BackgroundMethodThe language of mental health problems in social media
Gkotsis, G., Oellrich, A., Hubbard, T., Dobson, R., Liakata, M., Velupillai, S., & Dutta, R. (2016) · Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology · doi:10.18653/v1/w16-0307 · Cited by 124
Online and Social Media Data As an Imperfect Continuous Panel Survey
Diaz, F., Gamon, M., Hofman, J. M., Kıcıman, E., & Rothschild, D. (2016) · PLOS ONE · doi:10.1371/journal.pone.0145406 · Cited by 131
“Much research has demonstrated the promise of online and social media for use in grass roots political mobilization [13], astroturfing [14], predicting outbreaks of influenza [15], reproducing economic indices [16], crisis response [17], and measuring people’s happiness and mood [18,19].”
BackgroundPositive words carry less information than negative words
Garcia, D., Garas, A., & Schweitzer, F. (2012) · EPJ Data Science · doi:10.1140/epjds3 · Cited by 118
“A critical examination of the conditions of that study shows that the quantification of emotions was done in an uncontrolled setup through the AmazonMechanical Turk.”
BackgroundDo all birds tweet the same?: characterizing twitter around the world
Poblete, B., Garcia, R., Mendoza, M., & Jaimes, A. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063724 · Cited by 120
“[5], which is also more commonly referred to as valence.”
BackgroundHow Guests Develop Trust in Hosts: An Investigation of Trust Formation in P2P Accommodation
Park, S., & Tussyadiah, I. P. (2019) · Journal of Travel Research · doi:10.1177/0047287519884654 · Cited by 131
“In order to minimize bias from positive or negative sentiments attached to certain names, Neil and Marjorie, which scored neutral in a previous study on sentiment classification (Dodds et al. 2011), were used to represent male and female hosts, respectively.”
BackgroundMeasuring Emotion in Parliamentary Debates with Automated Textual Analysis
Rheault, L., Beelen, K., Cochrane, C., & Hirst, G. (2016) · PLOS ONE · doi:10.1371/journal.pone.0168843 · Cited by 111
Positivity of the English Language
Kloumann, I. M., Danforth, C. M., Harris, K. D., Bliss, C. A., & Dodds, P. S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029484 · Cited by 118
“Promisingly, we have shown elsewhere for Twitter that the average happiness of individual words correlates well with that of surrounding words in status updates [20].”
BackgroundMethodResultSelf-citationSignals of Public Opinion in Online Communication: A Comparison of Methods and Data Sources
González‐Bailón, S., & Paltoglou, G. (2015) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716215569192 · Cited by 138
“…ranks resulted in the final list of 10,222 words, which spans multiple languages, verb conjugations, slang, and stop-words like “the” and “of” (Dodds et al. 2011). the crucial aspect of this dictionary is that all these stop-words obtained a valence score through fifty independent mechanical…”
BackgroundMethodInfluentialBirnbaum, M. L., Ernala, S. K., Rizvi, A. F., Arenare, E., R. Van Meter, A., De Choudhury, M., & Kane, J. M. (2019) · npj Schizophrenia · doi:10.1038/s41537-019-0085-9 · Cited by 109
A Social Media Based Index of Mental Well-Being in College Campuses
Bagroy, S., Kumaraguru, P., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025909 · Cited by 115
“[21] developed a “happiness index”, a hedonometer, based on textual content shared on Twitter.”
BackgroundThe Cinderella Complex: Word embeddings reveal gender stereotypes in movies and books
Xu, H., Zhang, Z., Wu, L., & Wang, C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225385 · Cited by 131
“html), each of which was assigned a happiness score ranging from one to nine by Amazon’s Mechanical Turk workers [42].”
BackgroundReagan, A. J., Danforth, C. M., Tivnan, B., Williams, J. R., & Dodds, P. S. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0121-9 · Cited by 69
Self-citationVisitors to urban greenspace have higher sentiment and lower negativity on Twitter
Schwartz, A. J., Dodds, P. S., O'Neil‐Dunne, J. P. M., Danforth, C. M., & Ricketts, T. H. (2019) · People and Nature · doi:10.1002/pan3.10045 · Cited by 92
“Word ratings were calculated by averaging scores from a pool of online crowdsource workers at Amazon’s Mechanical Turk (Dodds et al., 2011).”
MethodSelf-citationLife Satisfaction and the Pursuit of Happiness on Twitter
Yang, C., & Srinivasan, P. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150881 · Cited by 116
“, [9] where they show that the trend in happiness (affect) is influenced strongly by current events and illustrate this with many examples.”
BackgroundMethodInfluentialMining Twitter Feeds for Software User Requirements
Williams, G., & Mahmoud, A. (2017) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2017.14 · Cited by 108
“Searching through hashtags can be effective when Twitter is mined at a massive scale to infer the opinions of the masses towards a certain topic, such as learning peoples’ views of a certain public figure (search for #obama) or certain recent events (#election) [3], [17].”
BackgroundNewman, M. E. J. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780198805090.003.0006 · Cited by 112
Worker Well-Being: What it Is, and how it Should Be Measured
Wijngaards, I., King, O. C., Burger, M., & van Exel, J. N. A. (2021) · Applied Research in Quality of Life · doi:10.1007/s11482-021-09930-w · Cited by 132
STEINERT-THRELKELD, Z. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108529327 · Cited by 128
“Twitter users also exhibit less positive sentiment during working hours, consistent with social behaviors (Dodds et al., 2011; Golder and Macy, 2011b), and express greater positivity when they tweet further from their most common locations (Frank et al.”
BackgroundComplex Dynamical Systems in Social and Personality Psychology: Theory, Modeling, and Analysis
Richardson, M. J., Dale, R., & Marsh, K. L. (2014) · Handbook of Research Methods in Social and Personality Psychology · doi:10.1017/cbo9780511996481.015 · Cited by 104
Ethics of Smart Cities: Towards Value-Sensitive Design and Co-Evolving City Life
Helbing, D., Fanitabasi, F., Giannotti, F., Hänggli, R., Hausladen, C. I., van den Hoven, J., Mahajan, S., Pedreschi, D., & Pournaras, E. (2021) · Sustainability · doi:10.3390/su132011162 · Cited by 117
“…in order to inform strategies to maximise pollution reduction [97] or identify best locations for public services (e.g., recharge stations for electric vehicles) [98]; • Analysing anonymised social media conversations and news to infer the level of happiness, from country-to city-level [99,100].”
SemEval-2016 Task 7: Determining Sentiment Intensity of English and Arabic Phrases
Kiritchenko, S., Mohammad, S. M., & Salameh, M. (2016) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s16-1004 · Cited by 121
“One commonly used resource was the LabMT lexicon—a set of over 100,000 frequent single words from 10 languages, including English and Arabic (about 10,000 words in each language), manually annotated for happiness through Mechanical Turk (Dodds et al., 2011; Dodds et al., 2015).”
MethodSchuff, H., Barnes, J., Mohme, J., Padó, S., & Klinger, R. (2017) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/w17-5203 · Cited by 138
“, 2005), blogs (Aman and Szpakowicz, 2007) and microblogs (Dodds et al., 2011).”
MethodRicard, B. J., Marsch, L. A., Crosier, B., & Hassanpour, S. (2018) · Journal of Medical Internet Research · doi:10.2196/11817 · Cited by 95
“Similarly, LabMT is a measure of happiness, mapping words to a score for valence [23].”
Sarker, A., Belousov, M., Friedrichs, J., Hakala, K., Kiritchenko, S., Mehryary, F., Han, S., Tran, T., Rios, A., Kavuluru, R., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy114 · Cited by 109
“In addition, for subtask-2, the team’s systems utilized sentiment features—sentiment association scores obtained from existing manually and automatically created lexicons, including Hu and Liu Lexicon, 38 Norms of Valence, Arousal, and Dominance, 39 labMT, 40 and NRC Emoticon Lexicon.”
MethodGerlach, M., & Font-Clos, F. (2020) · Entropy · doi:10.3390/e22010126 · Cited by 171
“One of the main drawbacks of these datasets, however, is the lack of “purity” of the samples resulting from the fact that (i) the composition of the dataset is largely unknown (google-ngram data, see [31,32]); (ii) the texts are a mixture of different authors (Wikipedia); or (iii) the texts are extremely short (Twitte…”
BackgroundInfluentialUeda, M., Mori, K., Matsubayashi, T., & Sawada, Y. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.06.032 · Cited by 96
Emotion fusion for mental illness detection from social media: A survey
Zhang, T., Yang, K., Ji, S., & Ananiadou, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.11.031 · Cited by 113
“[87] 2012 Forum Mental disorders SVM, MLN Sentiment LIWC [88] 2013 Weibo Depression BayesNet, J48Tree,Decision Tree Sentiment HowNet [89] + some rules [81] 2013 Twitter Depression SVM Emotion LIWC, ANEW [82] 2013 Weibo Mental health status SVM Emotion word ontology features Chinese emotion word ontology dictionary [90…”
What Makes Content Engaging? How Emotional Dynamics Shape Success
Berger, J., Kim, Y. D., & Meyer, R. (2021) · Journal of Consumer Research · doi:10.1093/jcr/ucab010 · Cited by 79
“Indeed, our own preliminary investigation on a small set of movies found that Dodds et al. (2011) measure more accurately reflected actual respondents’ ratings of different chunks of movies.”
BackgroundMethodInfluentialKang, Y., Jia, Q., Gao, S., Zeng, X., Wang, Y., Angsüsser, S., Liu, Y., Ye, X., & Fei, T. (2019) · Transactions in GIS · doi:10.1111/tgis.12552 · Cited by 101
“In this study, scholars followed Dodd’s method (Dodds et al., 2011), where a daily happiness score was calculated from Twitter with the state-of-the-art NLP technologies, summarizing a range of human emotions in United States from a state level, and examining the connections to the socioeconomic…”
MethodMcCoy, T. H., Castro, V. M., Cagan, A., Roberson, A. M., Kohane, I. S., & Perlis, R. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0136341 · Cited by 90
“Recently, tools have been developed and validated to facilitate the algorithmic quantification of these feelings, referred to as sentiment, in text documents[2].”
MethodResult
Metadata
- Authors
- Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M.
- Affiliations
- University of Vermont (US)
- Corresponding author
- Dodds, Peter Sheridan
- Danforth, Christopher M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-07
- Volume
- 6
- Issue
- 12
- Pages
- e26752
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3233600
- OpenAlex
- W2099366530
- Semantic Scholar
- 09f692cf26f283a22484443cc07aa7cc1f8e70f0
- Cited by
- 809
- References
- 68
- Citations by year
- 2026: 17 · 2025: 32 · 2024: 43 · 2023: 49 · 2022: 58 · 2021: 72 · 2020: 66 · 2019: 53 · 2018: 90 · 2017: 77 · 2016: 64 · 2015: 67 · 2014: 62 · 2013: 35 · 2012: 18
- FWCI
- 52.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- ScholarWorks -A service of University of Vermont Libraries (University of Vermont) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CAREER, 0846668)
- National Aeronautics and Space Administration
- Office of Experimental Program to Stimulate Competitive Research
- Topics
- Social Sciences › Psychology › Social Psychology › Psychological Well-being and Life Satisfaction
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Keywords
- happiness, Twitter, social networks, temporal patterns, subjective well-being, information level, word frequency
- MeSH terms
- Emotions, Happiness, Humans, Language, Social Behavior, Social Support, Software, Work, Models, Statistical, Internet, Blogging, Social Networking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.