Top Concerns of Tweeters During the COVID-19 Pandemic: Infoveillance Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Background: The recent coronavirus disease (COVID-19) pandemic is taking a toll on the world’s health care infrastructure as well as the social, economic, and psychological well-being of humanity. Individuals, organizations, and governments are using social media to communicate with each other on a number of issues relating to the COVID-19 pandemic. Not much is known about the topics being shared on social media platforms relating to COVID-19. Analyzing such information can help policy makers and health care organizations assess the needs of their stakeholders and address them appropriately. Objective: This study aims to identify the main topics posted by Twitter users related to the COVID-19 pandemic. Methods: Leveraging a set of tools (Twitter’s search application programming interface (API), Tweepy Python library, and PostgreSQL database) and using a set of predefined search terms (“corona,” “2019-nCov,” and “COVID-19”), we extracted the text and metadata (number of likes and retweets, and user profile information including the number of followers) of public English language tweets from February 2, 2020, to March 15, 2020. We analyzed the collected tweets using word frequencies of single (unigrams) and double words (bigrams). We leveraged latent Dirichlet allocation for topic modeling to identify topics discussed in the tweets. We also performed sentiment analysis and extracted the mean number of retweets, likes, and followers for each topic and calculated the interaction rate per topic. Results: Out of approximately 2.8 million tweets included, 167,073 unique tweets from 160,829 unique users met the inclusion criteria. Our analysis identified 12 topics, which were grouped into four main themes: origin of the virus; its sources; its impact on people, countries, and the economy; and ways of mitigating the risk of infection. The mean sentiment was positive for 10 topics and negative for 2 topics (deaths caused by COVID-19 and increased racism). The mean for tweet topics of account followers ranged from 2722 (increased racism) to 13,413 (economic losses). The highest mean of likes for the tweets was 15.4 (economic loss), while the lowest was 3.94 (travel bans and warnings). Conclusions: Public health crisis response activities on the ground and online are becoming increasingly simultaneous and intertwined. Social media provides an opportunity to directly communicate health information to the public. Health systems should work on building national and international disease detection and surveillance systems through monitoring social media. There is also a need for a more proactive and agile public health presence on social media to combat the spread of fake news.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The unpredictability of the coronavirus due to the lack of complete knowledge on transmission and treatment motivates people to stay updated with the latest information (Abd-Alrazaq et al., 2020; Chandrasekaran et al., 2020).”
From Understanding user responses to the COVID-19 pandemic on Twitter from a terror management theory perspective: Cultural differences among the US, UK and India (2022) · cites this paper as Abd-Alrazaq et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Third, most research efforts have been devoted to analyzing English data, thus limiting their scope to English-speaking individuals in predominantly western countries (Abd-Alrazaq et al., 2020).”
From Understanding user responses to the COVID-19 pandemic on Twitter from a terror management theory perspective: Cultural differences among the US, UK and India (2022) · cites this paper as Abd-Alrazaq et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, most were based on tweets collected in the early stages of the pandemic, which were analyzed from an infoveillance perspective, thereby limiting their analyses to health-related responses (e.g., Abd-Alrazaq et al., 2020; Boon-Itt et al., 2020; Xue et al., 2020).”
From Understanding user responses to the COVID-19 pandemic on Twitter from a terror management theory perspective: Cultural differences among the US, UK and India (2022) · cites this paper as Abd-Alrazaq et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“most research has been conducted from an infoveillance perspective, thus limiting our understanding to health-related responses, such as the origin of the novel coronavirus, preventive measures, and other public knowledge about the virus (Abd-Alrazaq et al., 2020; Boon-Itt et al., 2020; Chandrasekaran et al., 2020; Xue et al., 2020).”
From Understanding user responses to the COVID-19 pandemic on Twitter from a terror management theory perspective: Cultural differences among the US, UK and India (2022) · cites this paper as Abd-Alrazaq et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Origin and evolution of pathogenic coronaviruses
Cui, J., Li, F., & Shi, Z.-L. (2019) · Nature Reviews Microbiology · doi:10.1038/s41579-018-0118-9 · Cited by 5,515 · cited 1×
“The family of coronaviruses was not considered to be highly pathogenic until 2003 and 2012 with the appearance of the severe acute respiratory syndrome in China followed by the Middle East respiratory syndrome in Saudi Arabia [2,3].”
BackgroundVelavan, T. P., & Meyer, C. G. (2020) · Tropical Medicine & International Health · doi:10.1111/tmi.13383 · Cited by 2,439 · cited 1×
“The disease is highly infectious, and, on average, each patient can spread the infection from 2 to 4 other individuals [5].”
BackgroundEconomic Effects of Coronavirus Outbreak (COVID-19) on the World Economy
Fernandes, N. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3557504 · Cited by 1,881
Coronaviruses — drug discovery and therapeutic options
Zumla, A., Chan, J. F. W., Azhar, E. I., Hui, D. S. C., & Yuen, K.-Y. (2016) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2015.37 · Cited by 1,707 · cited 1×
“The family of coronaviruses was not considered to be highly pathogenic until 2003 and 2012 with the appearance of the severe acute respiratory syndrome in China followed by the Middle East respiratory syndrome in Saudi Arabia [2,3].”
BackgroundAddressing Health-Related Misinformation on Social Media
Chou, W.-Y. S., Oh, A., & Klein, W. M. P. (2018) · JAMA · doi:10.1001/jama.2018.16865 · Cited by 933 · cited 1×
“This was not the focus of this study, but future studies should investigate the spread of “fake news” in combination with infectious disease outbreaks [23].”
BackgroundBotOrNot: A System to Evaluate Social Bots
Davis, C. A., Varol, O., Ferrara, E., Flammini, A., & Menczer, F. (2016) · Proceedings of the 25th International Conference Companion on World Wide Web - WWW 16 Companion · doi:10.1145/2872518.2889302 · Cited by 909
A work-in-process literature review: Incorporating social media in risk and crisis communication
Veil, S. R., Buehner, T., & Palenchar, M. J. (2011) · Journal of Contingencies and Crisis Management · doi:10.1111/j.1468-5973.2011.00639.x · Cited by 677 · cited 1×
“Research shows that crisis response activities in reality and online are becoming increasingly “simultaneous and intertwined” [21].”
BackgroundTwitter as a Tool for Health Research: A Systematic Review
Sinnenberg, L., Buttenheim, A. M., Padrez, K., Mancheno, C., Ungar, L., & Merchant, R. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2016.303512 · Cited by 634 · cited 2×
“A systematic review paper identified six main uses of Twitter for public health: analysis of shared content, surveillance of public health topics or diseases, public engagement, recruitment of research participants, Twitter-based public health interventions, and network analysis of Twitter users [9].”
BackgroundGlobal rise in human infectious disease outbreaks
Smith, K. F., Goldberg, M., Rosenthal, S., Carlson, L., Chen, J., Chen, C., & Ramachandran, S. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0950 · Cited by 612 · cited 1×
“Since the 1980s, human disease outbreaks have become increasingly frequent and diverse due to a plethora of ecological, environmental, and socioeconomic factors [1].”
BackgroundMultilingual Sentiment Analysis: State of the Art and Independent Comparison of Techniques
Dashtipour, K., Poria, S., Hussain, A., Cambria, E., Hawalah, A. Y. A., Gelbukh, A., & Zhou, Q. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9415-7 · Cited by 286 · cited 1×
“Additional work is necessary for multilingual sentiment analysis on social media platforms, as most research efforts have been devoted to English-language data [24], including this study.”
Background
Research works printed but not linked: 1
- Blei, DM, 2009, Text Mining, 101
Cited by
Items 101–200 of 773
Chen, Y., & Zhang, Z. (2022) · Food Quality and Preference · doi:10.1016/j.foodqual.2022.104530 · Cited by 55
Can technological advancements help to alleviate COVID-19 pandemic? a review
Thomas, M. J., Lal, V., Baby, A. K., Rabeeh, V. M., James, A., & Raj, A. K. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103787 · Cited by 61
“8 million tweets were identified with the keyword ‘corona,’ 2019-nCov’, and ‘COVID-19 using twitter’s Application Programming Interface (API) and Python Tweepy library [135].”
Chin, H., Lima, G., Shin, M., Zhunis, A., Cha, C., Choi, J., & Cha, M. (2023) · Journal of Medical Internet Research · doi:10.2196/40922 · Cited by 63
“In contrast, earlier research found that COVID-19 topics’ sentiments on Twitter were either positive or neutral [2].”
BackgroundResultInfluentialGeospatial analysis of misinformation in COVID-19 related tweets
Forati, A. M., & Ghose, R. (2021) · Applied Geography · doi:10.1016/j.apgeog.2021.102473 · Cited by 52
How COVID-19 Information Spread in U.S.? The Role of Twitter as Early Indicator of Epidemics
Comito, C. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3091281 · Cited by 49
Sukhwal, P. C., & Kankanhalli, A. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2117292119 · Cited by 50
Sentiment Analysis of Public Social Media as a Tool for Health-Related Topics
Arias, F. X., Zambrano, M., Guerra-Adames, A., Tejedor-Flores, N., & Vargas-Lombardo, M. (2022) · IEEE Access · doi:10.1109/access.2022.3187406 · Cited by 68
Bots Amplify and Redirect Hate Speech in Online Discourse About Racism During the COVID-19 Pandemic
Uyheng, J., Bellutta, D., & Carley, K. M. (2022) · Social Media + Society · doi:10.1177/20563051221104749 · Cited by 61
“racism, hate speech, bots, social media, COVID-19 pandemic rhetoric and xenophobic discourse (Abd-Alrazaq et al., 2020; Dubey, 2020; Stechemesser et al., 2020).”
BackgroundMonitoring People’s Emotions and Symptoms from Arabic Tweets during the COVID-19 Pandemic
Al-Laith, A., & Alenezi, M. (2021) · Information · doi:10.3390/info12020086 · Cited by 53
“In [26], the study analyzed 167,073 tweets collected from the beginning of February to mid-March 2020.”
BackgroundYan, C., Law, M., Nguyen, S., Cheung, J., & Kong, J. D. (2021) · Journal of Medical Internet Research · doi:10.2196/32685 · Cited by 54
“This finding XSL • FO RenderX builds upon previous literature describing how people bond over the topic of COVID-19 on Twitter [32].”
Ruíz-Frutos, C., Ortega‐Moreno, M., Días, A., Bernardes, J. M., García‐Iglesias, J. J., & Gómez-Salgado, J. C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17196982 · Cited by 50
“The topics of greatest interest have also been identified: origin and transmission routes; magnitude of the impact on countries (infected and deaths, stress and fear, economy, movement restrictions), means of spreading, and risk control [47].”
BackgroundUnderstanding the effects of message cues on COVID ‐19 information sharing on Twitter
Zheng, H., Goh, D. H., Lee, E. W. J., Lee, C. S., & Theng, Y. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24587 · Cited by 52
Selerio, E., Caladcad, J. A., Catamco, M. R., Capinpin, E. M. A., & Ocampo, L. A. (2021) · Socio-Economic Planning Sciences · doi:10.1016/j.seps.2021.101217 · Cited by 49
“SMR15 Real-time disease surveillance [3,43,66,72]”
Rahman, M. M., & Islam, M. N. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-16-5157-1_30 · Cited by 51
A Content and Sentiment Analysis of Greek Tweets during the Pandemic
Kydros, D. A., Argyropoulou, M., & Vrana, V. G. (2021) · Sustainability · doi:10.3390/su13116150 · Cited by 48
“Abd-Alrazaq et al. [22], examined topics shared on Twitter related to COVID-19 and found that mentions and sharing links were the most common actions indicating that users were interested in warning or informing their followers about COVID-19.”
Ashfield, S., & Donelle, L. (2020) · Journal of Medical Internet Research · doi:10.2196/20002 · Cited by 59
“Improper use of pharmacological drugs and panic buying have resulted from online COVID-19 myths [57], as well as concern over the disease being spread through meat consumption and Chinese biological military laboratories [58].”
BackgroundGrabowski, D., Overgaard, M., Meldgaard, J., Johansen, L. B., & Willaing, I. (2021) · Diabetology · doi:10.3390/diabetology2010001 · Cited by 46
“Concurrent with the rapid increase in COVID-19 cases, there was a large increase in information about COVID-19 in the news media and on social media platforms [49,50].”
BackgroundPobiruchin, M., Zowalla, R., & Wiesner, M. (2020) · Journal of Medical Internet Research · doi:10.2196/19629 · Cited by 45
“Abd-Alrazaq et al [16] analyzed the content and sentiment of about 2.8 million COVID-19–related tweets retrieved via the Twitter standard search API written in the English language.”
BackgroundInfluentialLyu, J. C., & Luli, G. K. (2021) · Journal of Medical Internet Research · doi:10.2196/25108 · Cited by 49
“Fear and stress were common emotions during the COVID-19 pandemic [29].”
BackgroundResultInfluentialNursing Perspectives on the Impacts of COVID-19: Social Media Content Analysis
Koren, A., Alam, M. A. U., Koneru, S., Devito, A., Abdallah, L., & Liu, B.-Y. (2021) · JMIR Formative Research · doi:10.2196/31358 · Cited by 39
“To analyze the nursing professionals’ perspectives of the COVID-19 outbreak (ie, nurses’ psychology [39,40], decision making [41,42], emotions [43], and concerns [44]), we applied current social media text analytic techniques [44,45].”
MethodCOVID-19 Discourse on Twitter in Four Asian Countries: Case Study of Risk Communication
Park, S., Han, S., Kim, J., Molaie, M. M., Vu, H. D., Singh, K., Han, J., Lee, W., & Cha, M. (2021) · Journal of Medical Internet Research · doi:10.2196/23272 · Cited by 59
“Given the remarkable performance of topic modeling in previous investigations, recent studies on the COVID-19 outbreak have also applied topic modeling to documents collected from different social media sites such as Facebook [42], Weibo [43], and Twitter [44].”
COVID-19 Misinformation Spread in Eight Countries: Exponential Growth Modeling Study
Nsoesie, E. O., Cesare, N., Müller, M., & Ozonoff, A. (2020) · Journal of Medical Internet Research · doi:10.2196/24425 · Cited by 51
“Although tracking the origins and spread of false beliefs surrounding COVID-19 remains difficult, infodemiology [9,10] may provide a framework for tracking and analyzing social determinants of COVID-19 misinformation spread [11-13].”
BackgroundCOVID-19 Vaccine Hesitancy in the Month Following the Start of the Vaccination Process
Cotfas, L., Delcea, C., & Gherai, R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910438 · Cited by 44
Esmaeilzadeh, P. (2022) · Progress in Disaster Science · doi:10.1016/j.pdisas.2022.100215 · Cited by 46
The pandemic semesters: Examining public opinion regarding online learning amidst COVID ‐19
Asare, A. O., Yap, R., Truong, N., & Sarpong, E. O. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12574 · Cited by 49
Herrera‐Peco, I., Jiménez-Gómez, B., Deudero, J. J. P., de Gracia, E. B., & Ruíz-Núñez, C. (2021) · Healthcare · doi:10.3390/healthcare9060662 · Cited by 46
“However, both the easy and quick access to these platforms and the lack of control over the veracity of the content posted, mean that they can be considered as rapid means of dispersing unverified health information [20,21], constituting a potential threat to public health [12,21] since disinformation, misinformation,…”
BackgroundLanyi, K., Green, R., Craig, D., & Marshall, C. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.804855 · Cited by 47
“Twitter data has been used successfully in previous surveillance studies as a source of real-time user-generated data to track trends in public dialog and perceptions over time and recognise what is happening on the ground during a viral pandemic (20, 24, 25).”
MethodNeed for ensuring care for neuro-emergencies—lessons learned from the COVID-19 pandemic
Hecht, N., Wessels, L., Werft, F.-O., Schneider, U. C., Czabanka, M., & Vajkoczy, P. (2020) · Acta Neurochirurgica · doi:10.1007/s00701-020-04437-z · Cited by 43
“These measures, together with the fear of infection [12], have changed peoples’ routines in drastic fashion in a very short period of time [1].”
BackgroundBehavioral practices of patients with multiple sclerosis during Covid-19 pandemic
Alnajashi, H. A., & Jabbad, R. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241103 · Cited by 42
Petrocchi, S., Iannello, P., Ongaro, G., Antonietti, A., & Pravettoni, G. (2021) · Current Psychology · doi:10.1007/s12144-021-01601-1 · Cited by 47
Andreadis, S. T., Antzoulatos, G. S., Mavropoulos, T., Giannakeris, P., Tzionis, G., Pantelidis, N., Ioannidis, K., Καρακώστας, Α., Gialampoukidis, I., Vrochidis, S., et al. (2021) · Online Social Networks and Media · doi:10.1016/j.osnem.2021.100134 · Cited by 46
“Similarly, the analysis in [13] grouped the popular topics in four categories: (a) origin of the virus, (b) its sources, (c) impact, and (d) prevention.”
Mapping the Bibliometrics Landscape of AI in Medicine: Methodological Study
Shi, J., Bendig, D., Vollmar, H. C., & Rasche, P. (2023) · Journal of Medical Internet Research · doi:10.2196/45815 · Cited by 53
“For instance, Abd-Alrazaq et al [38] used a topic modeling approach to identify top concerns regarding COVID-19 based on posts on Twitter, whereas Lee and Kang [32] applied the same method to find the top 50 topics in the technology and innovation management studies from 11,693 articles published…”
Smoking, Vaping, and Tobacco Industry During COVID-19 Pandemic: Twitter Data Analysis
Kamiński, M., Muth, A., & Bogdański, P. (2020) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2020.0384 · Cited by 36
“32 In this study, the un-dertone was generally negative—whereas the sentiment of the tweets on COVID-19 and smoking changes over time.”
Badell‐Grau, R. A., Cuff, J. P., Kelly, B. P., Waller‐Evans, H., & Lloyd‐Evans, E. (2020) · Journal of Medical Internet Research · doi:10.2196/19791 · Cited by 44
“The prevalence and online spread of misinformation has been reported previously for COVID-19 [1] with regard to social media platforms, and, as in this study, the findings ultimately identified an important role for public health organizations and governments in providing accessible online information and refutation o…”
BackgroundInfluentialBots as Active News Promoters: A Digital Analysis of COVID-19 Tweets
Al‐Rawi, A., & Shukla, V. (2020) · Information · doi:10.3390/info11100461 · Cited by 41
“For example, Abd-Alrazaq et al. [37] identified four main public concerns on Twitter in their examination of 167,073 unique tweets: (1) geological origin of the virus, (2) causes leading to the transfer of COVID-19 to humans, (3) impact on people, countries, and the economy, (4) ways of mitigating…”
BackgroundMeasuring COVID-19 Related Anxiety in Parents: Psychometric Comparison of Four Different Inventories
Kubb, C., & Foran, H. M. (2020) · JMIR Mental Health · doi:10.2196/24507 · Cited by 47
“Previous studies found different antecedents for COVID-19–related fears: fear about economic consequences, fear of new measures, fear of health care collapse, fear of illness, fear of death, or fear of spreading the virus to risk groups [99-102].”
COVID-19 Twitter Dataset with Latent Topics, Sentiments and Emotions AttributesPreprint
Gupta, R. K., Vishwanath, A., & Yang, Y. (2020) · arXiv (Cornell University) · doi:10.3886/e120321v12 · Cited by 62
“that Twitter has opened up real-time, full-fidelity data streams related to COVID-19 tweets since late April 2020 [5], and that a few recent studies have leveraged Twitter for COVID-19 studies (e.g., [6, 7]), to the best of our knowledge, no others have provided a tweet-by-tweet research resource with rich, semantical…”
BackgroundKwon, S., & Park, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107734 · Cited by 44
“, H1N1, Zika) to understand public concerns (Abd-Alrazaq et al., 2020; Lazard et al., 2015; Signorini, Segre, & Polgreen, 2011), differences in perception across geographical regions (Hou et al.”
Background#Covid-19: An exploratory investigation of hashtag usage on Twitter
Petersen, K., & Gerken, J. M. (2021) · Health Policy · doi:10.1016/j.healthpol.2021.01.001 · Cited by 38
Durmaz, N., & Hengirmen, E. (2022) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2021.2025008 · Cited by 40
“Due to the closures that were initiated due to the pandemic, as well as the social distance measures taken, the use of social media platforms to disseminate information increased.(3) According to 2021 data, the use of social media increased by 11% around the world compared to the previous year, reaching 4.”
BackgroundOptimism and pessimism analysis using deep learning on COVID-19 related twitter conversations
Blanco, G., & Lourenço, A. M. G. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102918 · Cited by 43
Larrouquère, L., Gabin, M., Poingt, E., Mouffak, A., Hlavaty, A., Lepelley, M., Khouri, C., Bellier, A., Alexandre, J., Bedouch, P., et al. (2020) · Fundamental and Clinical Pharmacology · doi:10.1111/fcp.12564 · Cited by 36
Investigating Public Discourses Around Gender and COVID-19: a Social Media Analysis of Twitter Data
Al‐Rawi, A., Grépin, K. A., Li, X., Morgan, R., Wenham, C., & Smith, J. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-021-00102-x · Cited by 45
Overview of Technologies Implemented During the First Wave of the COVID-19 Pandemic: Scoping Review
Abd-Alrazaq, A., Hassan, A., Abuelezz, I., Ahmed, A., Alzubaidi, M. S., Shah, U., Alhuwail, D., Giannicchi, A., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/29136 · Cited by 35
“Health care systems quickly became overwhelmed with the influx of patients, which led to overcrowded or inaccessible hospitals, delayed interventions for time-sensitive conditions and chronic illnesses, and overworked treatment teams that lacked proper personal protective equipment [2].”
Self-citationKoukaras, P., Tjortjis, C., & Rousidis, D. (2022) · Information Systems · doi:10.1016/j.is.2022.102054 · Cited by 37
“A study utilized 2.8 million tweets identifying 12 topics that were clustered into four themes: (i) the origin of the virus, (ii) the source of the tweet, (iii) its economic and society impact, and (iv) mitigation of the risk infection options [18].”
MethodInfluentialEvolution of Public Opinion on COVID-19 Vaccination in Japan: Large-Scale Twitter Data Analysis
Kobayashi, R., Takedomi, Y., Nakayama, Y., Suda, T., Uno, T., Hashimoto, T., Toyoda, M., Yoshinaga, N., Kitsuregawa, M., & Rocha, L. E. C. (2022) · Journal of Medical Internet Research · doi:10.2196/41928 · Cited by 37
“…has been particularly useful to monitor public opinion because users engage and react timely to environmental changes, for example, reacting to epidemic outbreaks [21,22], expressing concerns about the disease [23], accepting the pandemic situation [24], and reacting to vaccination issues [25-27].”
Zhou, X., Song, Y., Jiang, H., Wang, Q., Qu, Z., Zhou, X., Jit, M., Hou, Z., & Lin, L. K. (2021) · Journal of Medical Internet Research · doi:10.2196/26518 · Cited by 34
“Topic modeling is an unsupervised machine learning technique that can automatically identify underlying topics or clusters by identifying groups of words that often co-occur in a textual data set (ie, Weibo posts) [9,17,36].”
BackgroundKwon, S., & Park, A. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107087 · Cited by 33
“Since the COVID-19 outbreak, there have been a growing number of studies that explore public responses to the pandemic using social media data (Abd-Alrazaq et al., 2020; Ahmed et al., 2020; Boon-Itt et al., 2020; Chandrasekaran et al., 2020; Xue et al., 2020).”
InfluentialChang, C., Monselise, M., & Yang, C. C. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00083-3 · Cited by 32
Cultural Evolution and Digital Media: Diffusion of Fake News About COVID-19 on Twitter
de Oliveira, D. V. B., & Albuquerque, U. P. (2021) · SN Computer Science · doi:10.1007/s42979-021-00836-w · Cited by 36
Zhang, J., Wang, Y. J., Shi, M., & Wang, X. (2021) · JMIR Public Health and Surveillance · doi:10.2196/32814 · Cited by 33
“Text-mining techniques have been increasingly used in recent research to investigate tweets about the COVID-19 pandemic (eg, [17-21]) and about COVID-19 vaccines [15,16].”
MethodReveilhac, M., & Blanchard, A. (2022) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2022.100068 · Cited by 37
From science to politics: COVID-19 information fatigue on YouTube
Shi, C.-F., So, M., Stelmach, S., Earn, A., Earn, D. J. D., & Dushoff, J. G. (2022) · BMC Public Health · doi:10.1186/s12889-022-13151-7 · Cited by 35
“While there have been investigations of themes, sources, and/or engagement on YouTube [24, 28] or other social media [20], the studies to date have been limited regarding long-term changes of a COVID-19 focus in social media, especially with respect to integrated analysis of themes and sources along the first wave of…”
BackgroundTop concerns of user experiences in Metaverse games: A text-mining based approach
Çallı, B. A., & Ediz, Ç. (2023) · Entertainment Computing · doi:10.1016/j.entcom.2023.100576 · Cited by 51
Social Media as a Research Tool (SMaaRT) for Risky Behavior Analytics: Methodological Review
Singh, T., Roberts, K. E., Cohen, T., Cobb, N. K., Wang, J., Fujimoto, K., & Myneni, S. (2020) · JMIR Public Health and Surveillance · doi:10.2196/21660 · Cited by 35
“The recent COVID-19 pandemic has also shown how analyzing communication on such platforms can provide insights into the attitudes and behaviors of individuals as well as health care providers [19,20].”
BackgroundBibliometric analysis of fake news indexed in Web of Science and Scopus (2001-2020)
Patra, R. K., Pandey, N., & Sudarsan, D. (2022) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-11-2021-0177 · Cited by 37
Luo, H., Meng, X., Zhao, Y., & Cai, M. (2023) · Telematics and Informatics · doi:10.1016/j.tele.2023.102051 · Cited by 38
Large-Scale, Language-Agnostic Discourse Classification of Tweets During COVID-19
Gencoglu, O. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make2040032 · Cited by 33
Zhang, C., Xu, S., Li, Z., & Hu, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26482 · Cited by 31
“Unlike those in other research studies on Twitter [9-11], the data captured in this study are a random sampling of all Twitter data without using any filter, which can”
ResultSakti, A. M. T., Mohamad, E. M. W., & Azlan, A. A. (2021) · Journal of Medical Internet Research · doi:10.2196/28249 · Cited by 36
“Previous studies involving online media often only analyzed a single type of platform such as Twitter [49,50], Sina Weibo, the Chinese version of Twitter [51,52], Facebook [21], and online news portals [53,54].”
Purnomo, E. P., Loilatu, M. J., Nurmandi, A., Qodir, Z., Sihidi, I. T., & Lutfi, M. K. (2020) · Webology · doi:10.14704/web/v18i1/web18001 · Cited by 35
Service failures in times of crisis: An analysis of eWOM emotionality
Gerrath, M. H. E. E., Mafael, A., Ulqinaku, A., & Biraglia, A. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113349 · Cited by 40
Naveed, M. A., Malik, A., & Mahmood, K. (2021) · Library Hi Tech · doi:10.1108/lht-12-2020-0322 · Cited by 31
Nowak, B. M., Miedziarek, C., Pełczyński, S., & Rzymski, P. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182212266 · Cited by 34
Lohiniva, A., Pensola, A., Hyökki, S., Sivelä, J., & Tammi, T. (2022) · BMC Public Health · doi:10.1186/s12889-022-14563-1 · Cited by 33
Sentiment Analysis in the Age of COVID-19: A Bibliometric Perspective
Sandu, A., Cotfas, L., Delcea, C., Crăciun, L., & Molănescu, A. G. (2023) · Information · doi:10.3390/info14120659 · Cited by 31
Twitter discussions and emotions about COVID-19 pandemic: a machine learning approachPreprint
Xue, J., Chen, J., Hu, R., Chen, C., Zheng, C., Liu, X., & Zhu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.12830 · Cited by 28
“…been focusing on the following topics since January 2020, including (1) the confirmed cases and death rates [11, 18, 30]; (2) preventive measures [11, 18, 30]; (3) health authorities and government policies [10, 18]; (4) an outbreak in New York [18]; (5) COVID-19 stigma by referencing the…”
InfluentialSocial Media Insights During the COVID-19 Pandemic: Infodemiology Study Using Big Data
Tran, H. T. T., Lu, S., Tran, H., & Nguyen, B. V. (2021) · JMIR Medical Informatics · doi:10.2196/27116 · Cited by 27
“Abd-Alrazaq et al [14] discussed Twitter users’ top concerns during the COVID-19 pandemic by analyzing collected data in English.”
BackgroundBinkheder, S., Aldekhyyel, R. N., AlMogbel, A., Al-Twairesh, N., Alhumaid, N., Aldekhyyel, S. N., & Jamal, A. A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182413388 · Cited by 30
“Third, sentiment analysis can be combined with other Twitter metrics, such as tweets’ likes, retweets, and followers for each topic, to calculate the sentiment interaction rate [28] for each mHealth apps.”
BackgroundSocially Enhanced Situation Awareness from Microblogs Using Artificial Intelligence: A Survey
Lamsal, R., Harwood, A., & Rodriguez, M. A. (2022) · ACM Computing Surveys · doi:10.1145/3524498 · Cited by 35
“Similarly, Saura et al. [122] used SVM for sentiment analysis and LDA for topic modelling on tweets using hashtags related to startups to identify indicators for a successful startup business.”
MethodInfluentialSocial media and COVID ‐19: Characterizing anti‐quarantine comments on Twitter
Karami, A., & Anderson, M. (2020) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.349 · Cited by 26
“Some studies, such as (Abd-Alrazaq et al., 2020), have been developed on analyzing public opinion on social media data during the COVID-19 pandemic.”
BackgroundPercepção do medo de ser contaminado pelo novo coronavírus
Lindemann, I. L., Simonetti, A. B., do Amaral, C. P., Riffel, R. T., Simon, T. T., Stobbe, J. C., & Acrani, G. O. (2021) · Jornal Brasileiro de Psiquiatria · doi:10.1590/0047-2085000000306 · Cited by 47
Lee, E. W. J., Zheng, H., Goh, D. H., Lee, C. S., & Theng, Y. L. (2023) · Health Communication · doi:10.1080/10410236.2023.2170201 · Cited by 28
“At the alarmed discovery and realization of cost stages where panic dominates public attention but people are still optimistic, we argue that conversations on public health measures would take center stage (Abd-Alrazaq et al., 2020).”
BackgroundDong, L., & Liu, Y. (2023) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2023.1199041 · Cited by 44
Senapati, A., Khan, N. A., & Chebrolu, L. B. (2020) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcj-16-3-e1 · Cited by 27
Schück, S., Foulquié, P., Mebarki, A., Faviez, C., Khadhar, M., Texier, N., Katsahian, S., Burgun, A., & Chen, X. (2021) · JMIR Formative Research · doi:10.2196/23593 · Cited by 25
“Most of these prior studies considered messages in one social media platform or in one language, most often English Twitter followed by Chinese Weibo, except for the general misinformation-related study [33], which identified 2311 reports of rumors, stigma, and conspiracy theories in 25 languages from 87 countries.”
BackgroundMethodInfluentialSchweinberger, M., Haugh, M., & Hames, S. (2021) · Big Data & Society · doi:10.1177/20539517211021437 · Cited by 28
Unmasking People’s Opinions behind Mask-Wearing during COVID-19 Pandemic—A Twitter Stance Analysis
Cotfas, L., Delcea, C., Gherai, R., & Roxin, I. (2021) · Symmetry · doi:10.3390/sym13111995 · Cited by 30
Ramzy, M., & Ibrahim, B. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103644 · Cited by 38
Elyashar, A., Plochotnikov, I., Cohen, I.-C., Puzis, R., & Cohen, O. (2021) · Journal of Medical Internet Research · doi:10.2196/30217 · Cited by 28
“Multiple articles analyzed online discourses, sentiments, and general dynamics during the pandemic [4,31-35].”
Chen, A., Zhang, J., Liao, W., Luo, C., Shen, C., & Feng, B. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102990 · Cited by 32
“Despite the large amount of recent research that has documented COVID-19-related communication using social media data (Abd-Alrazaq et al., 2020; Park et al., 2020; Sarker et al., 2020; Shen et al., 2020; Zhao et al., 2020), the majority did not provide theoretical discussions illuminating higher-level dynamics in how…”
Trust in COVID ‐19 public health information
Verma, N., Fleischmann, K. R., Zhou, L., Xie, B., Lee, M. K., Rich, K., Shiroma, K., Jia, C., & Zimmerman, T. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24712 · Cited by 30
“…proportion of US older adults using social media (Pew Research Center, 2021) could create further challenges, as has been outlined in prior research (Abd-Alrazaq et al., 2020; Chakraborti & Roberts, 2020; Mattingly & Hogue, 2020; Stephens et al., 2018; Wong et al., 2021; Xie, He, et al., 2020).”
MethodWang, A., Dara, R. A., Yousefinaghani, S., Maier, E., & Sharif, S. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7020072 · Cited by 29
Babić, K., Petrović, M., Beliga, S., Martinčić-Ipšić, S., Matešić, M., & Meštrović, A. (2021) · Applied Sciences · doi:10.3390/app112110442 · Cited by 27
Zhuang, X., & Wang, Y. (2024) · International Journal of Tourism Research · doi:10.1002/jtr.2712 · Cited by 29
Tratamiento informativo y competencias mediáticas sobre la COVID-19 en Ecuador
Mullo-López, A. H., Moreno, P. D. C., & Mera, J. M. B. (2021) · Revista de Comunicación · doi:10.26441/rc20.1-2021-a8 · Cited by 37
Learning from Each Other—A Bibliometric Review of Research on Information Disorders
Bran, R. A., Țîru, L. G., Grosseck, G., Holotescu, C., & Maliţa, L. (2021) · Sustainability · doi:10.3390/su131810094 · Cited by 31
“…have China as a major player in this new global disinformation order from at least two perspectives: surveillance capitalism [64,65] (that is, the ways in which technology—especially the Internet—is used for social control) and infodemia— information pandemic triggered by the virus pandemic [66].”
BackgroundDing, J., Xu, M., Tse, Y. K., Lin, K., & Zhang, M. (2022) · Enterprise Information Systems · doi:10.1080/17517575.2022.2130012 · Cited by 29
“Due to the nature of the social media data that is unstructured, noisy, informal and large in volume, data pre-processing is a crucial step before starting the social media data analysis (Zhao, Zhan, and Jie 2018; Stieglitz et al. 2018; Abd-Alrazaq et al. 2020).”
MethodChen, L., Chang, K., & Chung, H.-Y. (2020) · Applied Sciences · doi:10.3390/app10165505 · Cited by 25
“Facing such huge amounts of textual information, the efficiency of big data analysis determines the speed of information integration and information application; moreover, it decides whether people can reach a dominant position in epidemic prevention and control, disease knowledge acquisition, and database establishme…”
BackgroundAnalyzing tourist data on Twitter: a case study in the province of Granada at Spain
Viñán-Ludeña, M. S., & de Campos, L. M. (2021) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-11-2020-0209 · Cited by 25
Li, M., Hua, Y., Liao, Y., Zhou, L., Li, X., Wang, L., & Yang, J. (2022) · Journal of Medical Internet Research · doi:10.2196/39676 · Cited by 24
Chen, Y., Niu, H., & Silva, E. A. (2022) · Cities · doi:10.1016/j.cities.2022.104054 · Cited by 25
Reuter, K., Deodhar, A. A., Makri, S., Zimmer, M. T., Berenbaum, F., & Nikiphorou, E. (2021) · Rheumatology · doi:10.1093/rheumatology/keab174 · Cited by 23
Jong, W., Liang, O. S., & Yang, C. C. (2021) · JMIRx Med · doi:10.2196/27485 · Cited by 22
“One study identified the top concerns among Twitter users to be the origin of the virus; its sources; its impact on people and society; and ways of mitigating the risk of infection [29].”
BackgroundA first public dataset from Brazilian twitter and news on COVID-19 in Portuguese
de Melo, T., & Figueiredo, C. M. S. (2020) · Data in Brief · doi:10.1016/j.dib.2020.106179 · Cited by 22
Sharma, S., & Sharma, S. (2020) · Journal of Statistics and Management Systems · doi:10.1080/09720510.2020.1833453 · Cited by 21
“Twitter, in our case, so rule-based analyzer becomes the best and appropriate choice in this scenario[20].”
BackgroundThe Impact of COVID-19 on Sport in Twitter: A Quantitative and Qualitative Content Analysis
González, L.-M., Devís‐Devís, J., Pellicer-Chenoll, M., Pans, M., Pardo, A., García‐Massó, X., Peset, F., Garzón-Farinós, F., & Samaniego, V. P. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094554 · Cited by 22
Teague, S. J., Shatte, A. B. R., Weller, E., Fuller‐Tyszkiewicz, M., & Hutchinson, D. M. (2022) · JMIR Mental Health · doi:10.2196/33058 · Cited by 29
“Latent Dirichlet allocation 167,073 (160,829) Twitter Affective response Global 2020 Epidemic or pandemic Abd-Alrazaq et al [51]”
BackgroundAlswedani, S., Katib, I. A., Abozinadah, E., & Mehmood, R. (2022) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2022.751681 · Cited by 21
Wankhade, M., & Rao, A. C. S. (2022) · Scientific Reports · doi:10.1038/s41598-022-21604-7 · Cited by 28
Metadata
- Authors
- Abd-Alrazaq, A., Alhuwail, D., Househ, M., Hamdi, M., & Shah, Z.
- Affiliations
- Hamad bin Khalifa University (QA)
- Kuwait University (KW)
- Corresponding author
- Shah, Zubair
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-04-21
- Volume
- 22
- Issue
- 4
- Pages
- e19016
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7175788
- OpenAlex
- W3015218641
- Cited by
- 774
- References
- 22
- Citations by year
- 2026: 16 · 2025: 33 · 2024: 72 · 2023: 101 · 2022: 176 · 2021: 247 · 2020: 129
- FWCI
- 195.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Qatar National Library
- Topics
- Social Sciences › Communication › Communication and COVID-19 Impact
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- COVID-19 pandemic, Twitter, social media discourse, public concern, topic modeling, sentiment analysis, retweets and likes, economic impact, viral origin, infection risk mitigation, racism, public health communication, health data sharing, public health crisis response, LDA topic modeling, bigrams, word frequency, travel ban
- MeSH terms
- Betacoronavirus, COVID-19, SARS-CoV-2, Data Collection, Humans, Pneumonia, Viral, Public Health, Global Health, Coronavirus, Coronavirus Infections, Data Mining, Health Communication, Pandemics, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

