CoChat

Global evidence of expressed sentiment alterations during the COVID-19 pandemic

Open access
Wang, Jianghao, Fan, Yichun, Palacios, Juan, Chai, Yuchen, Guetta-Jeanrenaud, Nicolas, Obradovich, Nick, Zhou, Chenghu, Zheng, Siqi · 2022 · Nature Human Behaviour
Cited by 133

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

The COVID-19 pandemic has created unprecedented burdens on people's physical health and subjective well-being. While countries worldwide have developed platforms to track the evolution of COVID-19 infections and deaths, frequent global measurements of affective states to gauge the emotional impacts of pandemic and related policy interventions remain scarce. Using 654 million geotagged social media posts in over 100 countries, covering 74% of world population, coupled with state-of-the-art natural language processing techniques, we develop a global dataset of expressed sentiment indices to track national- and subnational-level affective states on a daily basis. We present two motivating applications using data from the first wave of COVID-19 (from 1 January to 31 May 2020). First, using regression discontinuity design, we provide consistent evidence that COVID-19 outbreaks caused steep declines in expressed sentiment globally, followed by asymmetric, slower recoveries. Second, applying synthetic control methods, we find moderate to no effects of lockdown policies on expressed sentiment, with large heterogeneity across countries. This study shows how social media data, when coupled with machine learning techniques, can provide real-time measurements of affective states.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41562-022-01312-y

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 22 references

Research works printed but not linked: 39

  1. Clark, A. et al. Global, regional, and national estimates of the population at increased risk of severe COVID-19 due to underlying health conditions in 2020: a modelling study. Lancet Glob. Health 8, e1003–e1017 (2020). · doi:10.1016/s2214-109x(20)30264-3
  2. Sibley, C. G. et al. Effects of the COVID-19 pandemic and nationwide lockdown on trust, attitudes toward government, and well-being. Am. Psychol. 75, 618–630 (2020). · DOI · Paper page
  3. Hao, B., Li, L., Gao, R., Li, A. & Zhu, T. in Active Media Technology (eds Ślȩzak, D. et al.) 324–335 (Springer International Publishing, 2014). · DOI
  4. Exton, C. & Shinwell, M. Policy Use of Well-Being Metrics (OECD, 2018); https://doi.org/10.1787/d98eb8ed-en · doi:10.1787/d98eb8ed-en
  5. Jaidka, K. et al. Estimating geographic subjective well-being from Twitter: a comparison of dictionary and data-driven language methods. Proc. Natl Acad. Sci. USA 117, 10165–10171 (2020). · DOI · Paper page
  6. Cheng, C., Barceló, J., Hartnett, A. S., Kubinec, R. & Messerschmidt, L. COVID-19 government response event dataset (CoronaNet v.1.0). Nat. Hum. Behav. 4, 756–768 (2020). · DOI · Paper page
  7. Luhmann, M. Using Big Data to study subjective well-being. Curr. Opin. Behav. Sci. 18, 28–33 (2017). · DOI
  8. Betsch, C. et al. Germany COVID-19 Snapshot MOnitoring (COSMO Germany): monitoring knowledge, risk perceptions, preventive behaviours, and public trust in the current coronavirus outbreak in Germany. Preprint at PsychArchives https://doi.org/10.23668/PSYCHARCHIVES.2776 (2020). · doi:10.23668/psycharchives.2776 · Paper page
  9. Ji, X., Chun, S. A., Wei, Z. & Geller, J. Twitter sentiment classification for measuring public health concerns. Soc. Netw. Anal. Min. 5, 13 (2015). · DOI
  10. Baylis, P. Temperature and temperament: evidence from Twitter. J. Public Econ. 184, 104161 (2020). · DOI · Paper page
  11. Wang, J., Obradovich, N. & Zheng, S. A 43-million-person investigation into weather and expressed sentiment in a changing climate. One Earth 2, 568–577 (2020). · DOI · Paper page
  12. Zheng, S., Wang, J., Sun, C., Zhang, X. & Kahn, M. E. Air pollution lowers Chinese urbanites’ expressed happiness on social media. Nat. Hum. Behav. 3, 237–243 (2019). · DOI · Paper page
  13. Kryvasheyeu, Y. et al. Rapid assessment of disaster damage using social media activity. Sci. Adv. 2, e1500779 (2016). · DOI · Paper page
  14. Miura, A., Komori, M., Matsumura, N. & Maeda, K. Expression of negative emotional responses to the 2011 Great East Japan Earthquake: analysis of big data from social media. Shinrigaku Kenkyu 86, 102–111 (2015). · DOI
  15. Roy, A. et al. A machine learning approach predicts future risk to suicidal ideation from social media data. NPJ Digit. Med. 3, 78 (2020). · DOI · Paper page
  16. Rattay, P. et al. Differences in risk perception, knowledge and protective behaviour regarding COVID-19 by education level among women and men in Germany: results from the COVID-19 Snapshot Monitoring (COSMO) study. PLoS ONE 16, e0251694 (2021). · DOI · Paper page
  17. Sun, A. & Zhao, Y. Divorce, abortion, and the child sex ratio: the impact of divorce reform in China. J. Dev. Econ. 120, 53–69 (2016). · DOI
  18. Anderson, M. L. Subways, strikes, and slowdowns: the impacts of public transit on traffic congestion. Am. Econ. Rev. 104, 2763–2796 (2014). · DOI · Paper page
  19. Hausman, C. & Rapson, D. S. Regression discontinuity in time: considerations for empirical applications. Annu. Rev. Resour. Econ. 10, 533–552 (2018). · DOI · Paper page
  20. Fan, R. et al. The minute-scale dynamics of online emotions reveal the effects of affect labeling. Nat. Hum. Behav. 3, 92–100 (2019). · DOI
  21. Mula, S., Di Santo, D., Gelfand, M. J., Cabras, C. & Pierro, A. The mediational role of desire for cultural tightness on concern with COVID-19 and perceived self-control. Front. Psychol. 12, 713952 (2021). · DOI
  22. Settanni, M. & Marengo, D. Sharing feelings online: studying emotional well-being via automated text analysis of Facebook posts. Front. Psychol. 6, 1045 (2015). · DOI · Paper page
  23. Kahn, J. H., Tobin, R. M., Massey, A. E. & Anderson, J. A. Measuring emotional expression with the Linguistic Inquiry and Word Count. Am. J. Psychol. 120, 263–286 (2007). · DOI · Paper page
  24. Liu, P., Tov, W., Kosinski, M., Stillwell, D. J. & Qiu, L. Do Facebook status updates reflect subjective well-being? Cyberpsychol. Behav. Soc. Netw. 18, 373–379 (2015). · DOI · Paper page
  25. Wang, N., Kosinski, M., Stillwell, D. J. & Rust, J. Can well-being be measured using Facebook status updates? Validation of Facebook’s gross national happiness index. Soc. Indic. Res. 115, 483–491 (2014). · DOI
  26. Wang, Z. et al. Demographic inference and representative population estimates from multilingual social media data. In WWW ’19: The World Wide Web Conference (eds Liu, L. & White, R.) 2056–2067 (ACM, 2019); https://doi.org/10.1145/3308558.3313684 · DOI · Paper page
  27. Hu, Y. & Wang, R.-Q. Understanding the removal of precise geotagging in tweets. Nat. Hum. Behav. 4, 1219–1221 (2020). · doi:10.1038/s41562-020-00949-x
  28. Chen, M., Zhang, H., Liu, W. & Zhang, W. The global pattern of urbanization and economic growth: evidence from the last three decades. PLoS ONE 9, e103799 (2014). · DOI · Paper page
  29. Kraemer, M. U. G. et al. Mapping global variation in human mobility. Nat. Hum. Behav. 4, 800–810 (2020). · DOI
  30. Hu, K. et al. Global patterns and trends in the breast cancer incidence and mortality according to sociodemographic indices: an observational study based on the global burden of diseases. BMJ Open 9, e028461 (2019). · DOI
  31. Razavi, A., Erondu, N. & Okereke, E. The Global Health Security Index: what value does it add? BMJ Glob. Health 5, e002477 (2020). · DOI · Paper page
  32. Sahni, T., Chandak, C., Chedeti, N. R. & Singh, M. Efficient Twitter sentiment classification using subjective distant supervision. Preprint at arXiv https://arxiv.org/abs/1701.03051 (2017). · DOI
  33. Rodríguez-Ruiz, J., Mata-Sánchez, J. I., Monroy, R., Loyola-González, O. & López-Cuevas, A. A one-class classification approach for bot detection on Twitter. Comput. Secur. 91, 101715 (2020). · DOI
  34. Rojo, J., Rivero, R., Romero-Morte, J., Fernández-González, F. & Pérez-Badia, R. Modeling pollen time series using seasonal-trend decomposition procedure based on LOESS smoothing. Int. J. Biometeorol. 61, 335–348 (2017). · DOI
  35. Grigg, O. A., Farewell, V. T. & Spiegelhalter, D. J. Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Stat. Methods Med. Res. 12, 147–170 (2003). · DOI · Paper page
  36. Barreca, A. I., Guldi, M., Lindo, J. M. & Waddell, G. R. Saving babies? Revisiting the effect of very low birth weight classification. Q. J. Econ. 126, 2117–1223 (2011). · DOI · Paper page
  37. Cattaneo, M. D., Idrobo, N. & Titiunik, R. A practical introduction to regression discontinuity designs: foundations. Preprint at arXiv https://arxiv.org/abs/1911.09511 (2019). · DOI · Paper page
  38. Cavallo, E., Galiani, S., Noy, I. & Pantano, J. Catastrophic natural disasters and economic growth. Rev. Econ. Stat. 95, 1549–1561 (2013). · DOI · Paper page
  39. Firpo, S. & Possebom, V. Synthetic control method: inference, sensitivity analysis and confidence sets. J. Causal Inference 6, 1–26 (2018). · DOI · Paper page

Cited by

See all 133

Metadata

Authors
Wang, J., Fan, Y., Palacios, J., Chai, Y., Guetta-Jeanrenaud, N., Obradovich, N., Zhou, C., & Zheng, S.
Venue
Nature Human Behaviour
Published
2022-03-17
Volume
6
Issue
3
Pages
349-358
ISSN
2397-3374 (ISSN-L)
OpenAlex
W4220790135
Cited by
133
References
22
FWCI
9.29
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
Massachusetts Consortium on Pathogen Readiness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Global evidence of expressed sentiment alterations during the COVID-19 pandemic. https://app.cochat.ai/papers/10.1038/s41562-022-01312-y
The paper
Wang, J., Fan, Y., Palacios, J., Chai, Y., Guetta-Jeanrenaud, N., Obradovich, N., Zhou, C., & Zheng, S. (2022). Global evidence of expressed sentiment alterations during the COVID-19 pandemic. Nature Human Behaviour. https://doi.org/10.1038/s41562-022-01312-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.