Social Bots’ Sentiment Engagement in Health Emergencies: A Topic-Based Analysis of the COVID-19 Pandemic Discussions on Twitter
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
During the COVID-19 pandemic, when individuals were confronted with social distancing, social media served as a significant platform for expressing feelings and seeking emotional support. However, a group of automated actors known as social bots have been found to coexist with human users in discussions regarding the coronavirus crisis, which may pose threats to public health. To figure out how these actors distorted public opinion and sentiment expressions in the outbreak, this study selected three critical timepoints in the development of the pandemic and conducted a topic-based sentiment analysis for bot-generated and human-generated tweets. The findings show that suspected social bots contributed to as much as 9.27% of COVID-19 discussions on Twitter. Social bots and humans shared a similar trend on sentiment polarity—positive or negative—for almost all topics. For the most negative topics, social bots were even more negative than humans. Their sentiment expressions were weaker than those of humans for most topics, except for COVID-19 in the US and the healthcare system. In most cases, social bots were more likely to actively amplify humans’ emotions, rather than to trigger humans’ amplification. In discussions of COVID-19 in the US, social bots managed to trigger bot-to-human anger transmission. Although these automated accounts expressed more sadness towards health risks, they failed to pass sadness to humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“In the Twittersphere, social bots can drive high volumes of traffic, amplify polarizing and conspiracy content [52,53], and contribute to the circulation of misinformation [54].”
BackgroundBlei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516 · cited 1×
“The topic model is a statistical model of natural language processing developed for uncovering the hidden semantic structures within large corpora [90].”
BackgroundExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 1×
“It has been found that although people on social media cannot encounter non-verbal cues conveying emotions, which are common in face-to-face communication, emotion contagion could still occur via online emotional content [6,7,31,44].”
BackgroundText as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 1×
“The appropriate value of k (the fixed number of topics) for a given corpus is user-specified, without an absolute “right” answer [96], which means that the researchers needed to set the value based on the results’ interpretability.”
BackgroundMental health problems and social media exposure during COVID-19 outbreak
Gao, J., Zheng, P., Jia, Y., Chen, H., Mao, Y., Chen, S., Wang, Y., Fu, H., & Dai, J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231924 · Cited by 2,830
Mental Health Problems and Social Media Exposure During COVID-19 Outbreak
Gao, J., Zheng, P., Jia, Y., Chen, H., Mao, Y., Chen, S., Wang, Y., Fu, H., & Dai, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3541120 · Cited by 2,830
Li, S., Wang, Y., Xue, J., Zhao, N., & Zhu, T. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17062032 · Cited by 1,835
stm : An R Package for Structural Topic Models
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i02 · Cited by 1,714
Emotions and Information Diffusion in Social Media—Sentiment of Microblogs and Sharing Behavior
Stieglitz, S., & Dang-Xuan, L. (2013) · Journal of Management Information Systems · doi:10.2753/mis0742-1222290408 · Cited by 1,604 · cited 2×
“Meanwhile, following previous studies [56,88,89], our study subtracted the negative score from the positive score to measure sentiments polarity and added the two scores to measure sentiments strength.”
BackgroundResultWeaponized health communication: Twitter bots and Russian trolls amplify the vaccine debate
Broniatowski, D. A., Jamison, A. M., Qi, S., AlKulaib, L., Chen, T., Benton, A., Quinn, S. C., & Dredze, M. (2018) · American Journal of Public Health · doi:10.2105/ajph.2018.304567 · Cited by 1,149
Cited by
Chatbots: Security, privacy, data protection, and social aspects
Hasal, M., Nowaková, J., Ahmed Saghair, K., Abdulla, H., Snášel, V., & Ogiela, L. (2021) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.6426 · Cited by 249
Botometer 101: social bot practicum for computational social scientists
Yang, K.-C., Ferrara, E., & Menczer, F. (2022) · Journal of Computational Social Science · doi:10.1007/s42001-022-00177-5 · Cited by 159
Auditing Elon Musk's Impact on Hate Speech and Bots
Hickey, D., Schmitz, M., Fessler, D., Smaldino, P. E., Muric, G., & Burghardt, K. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22222 · Cited by 100
Jones, R., Mougouei, D., & Evans, S. L. (2021) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.304 · Cited by 62
Harnessing Artificial Intelligence for Health Message Generation: The Folic Acid Message Engine
Schmälzle, R., & Wilcox, S. (2022) · Journal of Medical Internet Research · doi:10.2196/28858 · Cited by 43
“The same problems arise concerning the marketing of products that might harm health or use bots to promote certain brands [95-97].”
Metadata
- Authors
- Shi, W., Liu, D., Yang, J., Zhang, J., Wen, S., & Su, J.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2020-11-23
- Volume
- 17
- Issue
- 22
- Pages
- 8701
- ISSN
- 1660-4601 (ISSN-L)
- OpenAlex
- W3108150888
- Cited by
- 91
- References
- 23
- FWCI
- 18.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Social Bots’ Sentiment Engagement in Health Emergencies: A Topic-Based Analysis of the COVID-19 Pandemic Discussions on Twitter. https://app.cochat.ai/papers/10.3390/ijerph17228701
- The paper
- Shi, W., Liu, D., Yang, J., Zhang, J., Wen, S., & Su, J. (2020). Social Bots’ Sentiment Engagement in Health Emergencies: A Topic-Based Analysis of the COVID-19 Pandemic Discussions on Twitter. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph17228701
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.