Global evidence of expressed sentiment alterations during the COVID-19 pandemic
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The COVID-19 pandemic has created unprecedented burdens on people's physical health and subjective well-being. While countries worldwide have developed platforms to track the evolution of COVID-19 infections and deaths, frequent global measurements of affective states to gauge the emotional impacts of pandemic and related policy interventions remain scarce. Using 654 million geotagged social media posts in over 100 countries, covering 74% of world population, coupled with state-of-the-art natural language processing techniques, we develop a global dataset of expressed sentiment indices to track national- and subnational-level affective states on a daily basis. We present two motivating applications using data from the first wave of COVID-19 (from 1 January to 31 May 2020). First, using regression discontinuity design, we provide consistent evidence that COVID-19 outbreaks caused steep declines in expressed sentiment globally, followed by asymmetric, slower recoveries. Second, applying synthetic control methods, we find moderate to no effects of lockdown policies on expressed sentiment, with large heterogeneity across countries. This study shows how social media data, when coupled with machine learning techniques, can provide real-time measurements of affective states.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
The Psychological Impact of Quarantine and How to Reduce It: Rapid Review of the Evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · doi:10.2139/ssrn.3532534 · Cited by 16,394
The psychological impact of quarantine and how to reduce it: Rapid review of the evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30460-8 · Cited by 16,378
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Holmes, E. A., O'Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., Ballard, C., Christensen, H., Cohen Silver, R., Everall, I., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30168-1 · Cited by 5,715
Using social and behavioural science to support COVID-19 pandemic response
Bavel, J. J. V., Baicker, K., Boggio, P. S., Capraro, V., Cichocka, A., Cikara, M., Crockett, M. J., Crum, A. J., Douglas, K. M., Druckman, J. N., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0884-z · Cited by 4,964 · cited 1×
“Previous studies have shown how nations with loose cultures (that is, having lenient norms and punishments for deviance) had more difficulty coordinating in the face of the pandemic 33,34 .”
BackgroundA global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker)
Hale, T., Angrist, N., Goldszmidt, R., Kira, B., Petherick, A., Phillips, T., Webster, S., Cameron-Blake, E., Hallas, L., Majumdar, S., et al. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01079-8 · Cited by 4,578
Mental health and the COVID-19 pandemic
Pfefferbaum, B., & North, C. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2008017 · Cited by 4,378 · cited 1×
“Following best practices proposed by previous studies32, we characterize the sentiment recovery process of each country in our sample as an exponential function starting from its minimum sentiment using equation (3) (Methods, ‘Sentiment recovery’, and Supplementary Fig.”
MethodInterrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049
Research works printed but not linked: 39
- Clark, A. et al. Global, regional, and national estimates of the population at increased risk of severe COVID-19 due to underlying health conditions in 2020: a modelling study. Lancet Glob. Health 8, e1003–e1017 (2020). · doi:10.1016/s2214-109x(20)30264-3
- Sibley, C. G. et al. Effects of the COVID-19 pandemic and nationwide lockdown on trust, attitudes toward government, and well-being. Am. Psychol. 75, 618–630 (2020). · DOI · Paper page
- Hao, B., Li, L., Gao, R., Li, A. & Zhu, T. in Active Media Technology (eds Ślȩzak, D. et al.) 324–335 (Springer International Publishing, 2014). · DOI
- Exton, C. & Shinwell, M. Policy Use of Well-Being Metrics (OECD, 2018); https://doi.org/10.1787/d98eb8ed-en · doi:10.1787/d98eb8ed-en
- Jaidka, K. et al. Estimating geographic subjective well-being from Twitter: a comparison of dictionary and data-driven language methods. Proc. Natl Acad. Sci. USA 117, 10165–10171 (2020). · DOI · Paper page
- Cheng, C., Barceló, J., Hartnett, A. S., Kubinec, R. & Messerschmidt, L. COVID-19 government response event dataset (CoronaNet v.1.0). Nat. Hum. Behav. 4, 756–768 (2020). · DOI · Paper page
- Luhmann, M. Using Big Data to study subjective well-being. Curr. Opin. Behav. Sci. 18, 28–33 (2017). · DOI
- Betsch, C. et al. Germany COVID-19 Snapshot MOnitoring (COSMO Germany): monitoring knowledge, risk perceptions, preventive behaviours, and public trust in the current coronavirus outbreak in Germany. Preprint at PsychArchives https://doi.org/10.23668/PSYCHARCHIVES.2776 (2020). · doi:10.23668/psycharchives.2776 · Paper page
- Ji, X., Chun, S. A., Wei, Z. & Geller, J. Twitter sentiment classification for measuring public health concerns. Soc. Netw. Anal. Min. 5, 13 (2015). · DOI
- Baylis, P. Temperature and temperament: evidence from Twitter. J. Public Econ. 184, 104161 (2020). · DOI · Paper page
- Wang, J., Obradovich, N. & Zheng, S. A 43-million-person investigation into weather and expressed sentiment in a changing climate. One Earth 2, 568–577 (2020). · DOI · Paper page
- Zheng, S., Wang, J., Sun, C., Zhang, X. & Kahn, M. E. Air pollution lowers Chinese urbanites’ expressed happiness on social media. Nat. Hum. Behav. 3, 237–243 (2019). · DOI · Paper page
- Kryvasheyeu, Y. et al. Rapid assessment of disaster damage using social media activity. Sci. Adv. 2, e1500779 (2016). · DOI · Paper page
- Miura, A., Komori, M., Matsumura, N. & Maeda, K. Expression of negative emotional responses to the 2011 Great East Japan Earthquake: analysis of big data from social media. Shinrigaku Kenkyu 86, 102–111 (2015). · DOI
- Roy, A. et al. A machine learning approach predicts future risk to suicidal ideation from social media data. NPJ Digit. Med. 3, 78 (2020). · DOI · Paper page
- Rattay, P. et al. Differences in risk perception, knowledge and protective behaviour regarding COVID-19 by education level among women and men in Germany: results from the COVID-19 Snapshot Monitoring (COSMO) study. PLoS ONE 16, e0251694 (2021). · DOI · Paper page
- Sun, A. & Zhao, Y. Divorce, abortion, and the child sex ratio: the impact of divorce reform in China. J. Dev. Econ. 120, 53–69 (2016). · DOI
- Anderson, M. L. Subways, strikes, and slowdowns: the impacts of public transit on traffic congestion. Am. Econ. Rev. 104, 2763–2796 (2014). · DOI · Paper page
- Hausman, C. & Rapson, D. S. Regression discontinuity in time: considerations for empirical applications. Annu. Rev. Resour. Econ. 10, 533–552 (2018). · DOI · Paper page
- Fan, R. et al. The minute-scale dynamics of online emotions reveal the effects of affect labeling. Nat. Hum. Behav. 3, 92–100 (2019). · DOI
- Mula, S., Di Santo, D., Gelfand, M. J., Cabras, C. & Pierro, A. The mediational role of desire for cultural tightness on concern with COVID-19 and perceived self-control. Front. Psychol. 12, 713952 (2021). · DOI
- Settanni, M. & Marengo, D. Sharing feelings online: studying emotional well-being via automated text analysis of Facebook posts. Front. Psychol. 6, 1045 (2015). · DOI · Paper page
- Kahn, J. H., Tobin, R. M., Massey, A. E. & Anderson, J. A. Measuring emotional expression with the Linguistic Inquiry and Word Count. Am. J. Psychol. 120, 263–286 (2007). · DOI · Paper page
- Liu, P., Tov, W., Kosinski, M., Stillwell, D. J. & Qiu, L. Do Facebook status updates reflect subjective well-being? Cyberpsychol. Behav. Soc. Netw. 18, 373–379 (2015). · DOI · Paper page
- Wang, N., Kosinski, M., Stillwell, D. J. & Rust, J. Can well-being be measured using Facebook status updates? Validation of Facebook’s gross national happiness index. Soc. Indic. Res. 115, 483–491 (2014). · DOI
- Wang, Z. et al. Demographic inference and representative population estimates from multilingual social media data. In WWW ’19: The World Wide Web Conference (eds Liu, L. & White, R.) 2056–2067 (ACM, 2019); https://doi.org/10.1145/3308558.3313684 · DOI · Paper page
- Hu, Y. & Wang, R.-Q. Understanding the removal of precise geotagging in tweets. Nat. Hum. Behav. 4, 1219–1221 (2020). · doi:10.1038/s41562-020-00949-x
- Chen, M., Zhang, H., Liu, W. & Zhang, W. The global pattern of urbanization and economic growth: evidence from the last three decades. PLoS ONE 9, e103799 (2014). · DOI · Paper page
- Kraemer, M. U. G. et al. Mapping global variation in human mobility. Nat. Hum. Behav. 4, 800–810 (2020). · DOI
- Hu, K. et al. Global patterns and trends in the breast cancer incidence and mortality according to sociodemographic indices: an observational study based on the global burden of diseases. BMJ Open 9, e028461 (2019). · DOI
- Razavi, A., Erondu, N. & Okereke, E. The Global Health Security Index: what value does it add? BMJ Glob. Health 5, e002477 (2020). · DOI · Paper page
- Sahni, T., Chandak, C., Chedeti, N. R. & Singh, M. Efficient Twitter sentiment classification using subjective distant supervision. Preprint at arXiv https://arxiv.org/abs/1701.03051 (2017). · DOI
- Rodríguez-Ruiz, J., Mata-Sánchez, J. I., Monroy, R., Loyola-González, O. & López-Cuevas, A. A one-class classification approach for bot detection on Twitter. Comput. Secur. 91, 101715 (2020). · DOI
- Rojo, J., Rivero, R., Romero-Morte, J., Fernández-González, F. & Pérez-Badia, R. Modeling pollen time series using seasonal-trend decomposition procedure based on LOESS smoothing. Int. J. Biometeorol. 61, 335–348 (2017). · DOI
- Grigg, O. A., Farewell, V. T. & Spiegelhalter, D. J. Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Stat. Methods Med. Res. 12, 147–170 (2003). · DOI · Paper page
- Barreca, A. I., Guldi, M., Lindo, J. M. & Waddell, G. R. Saving babies? Revisiting the effect of very low birth weight classification. Q. J. Econ. 126, 2117–1223 (2011). · DOI · Paper page
- Cattaneo, M. D., Idrobo, N. & Titiunik, R. A practical introduction to regression discontinuity designs: foundations. Preprint at arXiv https://arxiv.org/abs/1911.09511 (2019). · DOI · Paper page
- Cavallo, E., Galiani, S., Noy, I. & Pantano, J. Catastrophic natural disasters and economic growth. Rev. Econ. Stat. 95, 1549–1561 (2013). · DOI · Paper page
- Firpo, S. & Possebom, V. Synthetic control method: inference, sensitivity analysis and confidence sets. J. Causal Inference 6, 1–26 (2018). · DOI · Paper page
Cited by
More than a Feeling: Accuracy and Application of Sentiment Analysis
Hartmann, J., Heitmann, M., Siebert, C., & Schamp, C. (2023) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2022.05.005 · Cited by 356
Sentiment Analysis in the Age of Generative AI
Krugmann, J. O., & Hartmann, J. (2024) · Customer Needs and Solutions · doi:10.1007/s40547-024-00143-4 · Cited by 189
“Sentiment analysis based on natural language processing stands out as a prevalent use case in marketing, drawing significant attention across application contexts [2, 28, 65].”
S3: Social-network Simulation System with Large Language Model-Empowered Agents
Gao, C., Lan, X., Lu, Z., Mao, J., Piao, J., Wang, H., Jin, D., & Li, Y. (2023) · doi:10.2139/ssrn.4607026 · Cited by 113
Echo chamber effects on short video platforms
Gao, Y., Liu, F., & Gao, L. (2023) · Scientific Reports · doi:10.1038/s41598-023-33370-1 · Cited by 109
Metadata
- Authors
- Wang, J., Fan, Y., Palacios, J., Chai, Y., Guetta-Jeanrenaud, N., Obradovich, N., Zhou, C., & Zheng, S.
- Venue
- Nature Human Behaviour
- Published
- 2022-03-17
- Volume
- 6
- Issue
- 3
- Pages
- 349-358
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W4220790135
- Cited by
- 133
- References
- 22
- FWCI
- 9.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Funders
- Massachusetts Consortium on Pathogen Readiness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Global evidence of expressed sentiment alterations during the COVID-19 pandemic. https://app.cochat.ai/papers/10.1038/s41562-022-01312-y
- The paper
- Wang, J., Fan, Y., Palacios, J., Chai, Y., Guetta-Jeanrenaud, N., Obradovich, N., Zhou, C., & Zheng, S. (2022). Global evidence of expressed sentiment alterations during the COVID-19 pandemic. Nature Human Behaviour. https://doi.org/10.1038/s41562-022-01312-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.