The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
An exploratory study of COVID-19 misinformation on Twitter
Open accessAbstract
During the COVID-19 pandemic, social media has become a home ground for misinformation. To tackle this infodemic, scientific oversight, as well as a better understanding by practitioners in crisis management, is needed. We have conducted an exploratory study into the propagation, authors and content of misinformation on Twitter around the topic of COVID-19 in order to gain early insights. We have collected all tweets mentioned in the verdicts of fact-checked claims related to COVID-19 by over 92 professional fact-checking organisations between January and mid-July 2020 and share this corpus with the community. This resulted in 1500 tweets relating to 1274 false and 226 partially false claims, respectively. Exploratory analysis of author accounts revealed that the verified twitter handle(including Organisation/celebrity) are also involved in either creating(new tweets) or spreading(retweet) the misinformation. Additionally, we found that false claims propagate faster than partially false claims. Compare to a background corpus of COVID-19 tweets, tweets with misinformation are more often concerned with discrediting other information on social media. Authors use less tentative language and appear to be more driven by concerns of potential harm to others. Our results enable us to suggest gaps in the current scientific coverage of the topic as well as propose actions for authorities and social media users to counter misinformation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 5×
“Although such source-based approaches are popular and allow for a large-scale analysis of Twitter data [20 – 24], the reliability of news sources remains a subject of considerable disagreement [25,26].”
InfluentialSohrabi, C., Alsafi, Z., O'Neill, N., Khan, M., Kerwan, A., Al-Jabir, A., Iosifidis, C., & Agha, R. (2020) · International Journal of Surgery · doi:10.1016/j.ijsu.2020.02.034 · Cited by 6,069
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
NLTK: the Natural Language Toolkit
Loper, E., & Bird, S. (2002) · Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - · doi:10.3115/1118108.1118117 · Cited by 3,218
(1981) · Cited by 3,038
Misinformation and Its Correction: Continued Influence and Successful Debiasing
Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612451018 · Cited by 2,920 · cited 2×
“Complete retractions of the misinformation are also generally ineffective, despite people believing, understanding and remembering the retraction [44].”
The spreading of misinformation online
Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., Stanley, H. E., & Quattrociocchi, W. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517441113 · Cited by 2,407 · cited 1×
“According to seminal work by del Vicario et al. [33] it is “ the possibility of verification rather than the quality of information ” that is paramount.”
Zarocostas, J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30461-x · Cited by 2,344 · cited 2×
“Misinformation on COVID-19 appears to be spreading rapidly on social media [3].”
The COVID-19 social media infodemic
Cinelli, M., Quattrociocchi, W., Galeazzi, A., Valensise, C. M., Brugnoli, E., Schmidt, A. L., Zola, P., Zollo, F., & Scala, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-73510-5 · Cited by 2,313
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Emotions and Information Diffusion in Social Media—Sentiment of Microblogs and Sharing Behavior
Stieglitz, S., & Dang-Xuan, L. (2013) · Journal of Management Information Systems · doi:10.2753/mis0742-1222290408 · Cited by 1,604
Prior exposure increases perceived accuracy of fake news
Pennycook, G., Cannon, T. D., & Rand, D. G. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000465 · Cited by 1,268 · cited 1×
“This is a worrying development as even a single exposure to a piece of misinformation increases its perceived accuracy [10].”
The spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · Nature Communications · doi:10.1038/s41467-018-06930-7 · Cited by 1,125
Twitter under crisis: can we trust what we RT?
Mendoza, M., Poblete, B., & Castillo, C. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964869 · Cited by 955
BotOrNot: A System to Evaluate Social Bots
Davis, C. A., Varol, O., Ferrara, E., Flammini, A., & Menczer, F. (2016) · Proceedings of the 25th International Conference Companion on World Wide Web - WWW 16 Companion · doi:10.1145/2872518.2889302 · Cited by 909 · cited 1×
“To analyse the role of bots, we examined each account by using a bot detection API [67].”
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · CUNY Academic Works (City University of New York) · Cited by 882
Pennycook, G., & Rand, D. G. (2020) · Journal of Personality · doi:10.1111/jopy.12476 · Cited by 879
Detection and Resolution of Rumours in Social Media: A Survey
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 862 · cited 6×
“The term fake news is widely used to refer to inaccurate information [100] or more specifically to “fabricated information that mimics news media content in form but not in organisational process or intent” [40].”
InfluentialChen, E., Lerman, K., & Ferrara, E. (2020) · JMIR Public Health and Surveillance · doi:10.2196/19273 · Cited by 762
Zubiaga, A., Liakata, M., Procter, R., Wong Sak Hoi, G., & Tolmie, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150989 · Cited by 722
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701
A work-in-process literature review: Incorporating social media in risk and crisis communication
Veil, S. R., Buehner, T., & Palenchar, M. J. (2011) · Journal of Contingencies and Crisis Management · doi:10.1111/j.1468-5973.2011.00639.x · Cited by 677 · cited 1×
“First, and rather unsurprisingly, closely watching social media is recommended (cf. e.g. with [90 – 92]).”
Zhang, S., Diao, M., Yu, W., Pei, L., Lin, Z., & Chen, D. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.02.033 · Cited by 651
The Structural Virality of Online Diffusion
Goel, S., Anderson, A., Hofman, J., & Watts, D. J. (2016) · Management Science · doi:10.1287/mnsc.2015.2158 · Cited by 647
Social Media in Disaster Risk Reduction and Crisis Management
Alexander, D. E. (2014) · Science and Engineering Ethics · doi:10.1007/s11948-013-9502-z · Cited by 616
Assessing the risks of ‘infodemics’ in response to COVID-19 epidemics
Gallotti, R., Valle, F., Castaldo, N., Sacco, P., & De Domenico, M. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00994-6 · Cited by 591 · cited 2×
“Although there have already been some indications that bots might be involved [17,19,30], the majority of posts is generated by accounts that are likely to be human [19].”
The spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · RePEc: Research Papers in Economics · Cited by 574
Beware of the second wave of COVID-19
Xu, S., & Li, Y. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30845-x · Cited by 564
Evaluating the fake news problem at the scale of the information ecosystem
Allen, J., Howland, B., Mobius, M., Rothschild, D., & Watts, D. J. (2020) · Science Advances · doi:10.1126/sciadv.aay3539 · Cited by 528
The fake news game: actively inoculating against the risk of misinformation
Roozenbeek, J., & van der Linden, S. (2019) · Journal of Risk Research · doi:10.1080/13669877.2018.1443491 · Cited by 479
Fake news detection on social media using geometric deep learning
Monti, F., Frasca, F., Eynard, D., Mannion, D., & Bronstein, M. M. (2019) · arXiv · doi:10.48550/arxiv.1902.06673 · Cited by 392
Friggeri, A., Adamic, L., Eckles, D., & Cheng, J. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14559 · Cited by 382
Towards more systematic Twitter analysis: metrics for tweeting activities
Bruns, A., & Stieglitz, S. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2012.756095 · Cited by 359
Ebola, Twitter, and misinformation: a dangerous combination?
Oyeyemi, S. O., Gabarron, E., & Wynn, R. (2014) · BMJ · doi:10.1136/bmj.g6178 · Cited by 348
Debunking in a world of tribes
Zollo, F., Bessi, A., Del Vicario, M., Scala, A., Caldarelli, G., Shekhtman, L., Havlin, S., & Quattrociocchi, W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181821 · Cited by 345
Anatomy of an online misinformation network
Shao, C., Hui, P.-M., Wang, L., Jiang, X., Flammini, A., Menczer, F., & Ciampaglia, G. L. (2018) · PLOS ONE · doi:10.1371/journal.pone.0196087 · Cited by 278
COVID-19: the medium is the message
Garrett, L. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30600-0 · Cited by 277
Reading the riots on Twitter: methodological innovation for the analysis of big data
Procter, R., Vis, F., & Voss, A. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2013.774172 · Cited by 271
Why Students Share Misinformation on Social Media: Motivation, Gender, and Study-level Differences
Chen, X., Sin, S.-C. J., Theng, Y.-L., & Lee, C. S. (2015) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2015.07.003 · Cited by 260
A first look at COVID-19 information and misinformation sharing on Twitter
Singh, L., Bansal, S., Bode, L., Budak, C., Chi, G., Kawintiranon, K., Padden, C., Vanarsdall, R., Vraga, E. K., & Wang, Y. (2020) · PubMed · doi:10.48550/arxiv.2003.13907 · Cited by 249
Theocharis, Y., Barberá, P., Fazekas, Z., Popa, S. A., & Parnet, O. (2016) · Journal of Communication · doi:10.1111/jcom.12259 · Cited by 237
The role of bot squads in the political propaganda on Twitter
Caldarelli, G., Nicola, R. D., Vigna, F. D., Petrocchi, M., & Saracco, F. (2020) · Communications Physics · doi:10.1038/s42005-020-0340-4 · Cited by 163
Checking how fact-checkers check
Lim, C. (2018) · Research & Politics · doi:10.1177/2053168018786848 · Cited by 162
Disinformation and misinformation through the internet: Findings of an exploratory study
Hernon, P. (1995) · Government Information Quarterly · doi:10.1016/0740-624x(95)90052-7 · Cited by 153
Brand followers: Consumer motivation and attitude towards brand communications on Twitter
Kwon, E. S., Kim, E., Sung, Y., & Yoo, C. Y. (2014) · International Journal of Advertising · doi:10.2501/ija-33-4-657-680 · Cited by 143
Prevalence of Low-Credibility Information on Twitter During the COVID-19 OutbreakPreprint
Yang, K.-C., Torres-Lugo, C., & Menczer, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14484 · Cited by 128
Jiang, S., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274351 · Cited by 125
Towards a resilience management guideline — Cities as a starting point for societal resilience
Maraña, P., Eden, C., Eriksson, H., Grimes, C., Hernantes, J., Howick, S., Labaka, L., Latinos, V., Lindner, R., Majchrzak, T. A., et al. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101531 · Cited by 118
Self-citationBotOrNot: A System to Evaluate Social BotsPreprint
Davis, C. A., Varol, O., Ferrara, E., Flammini, A., & Menczer, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.00975 · Cited by 105
Topology comparison of Twitter diffusion networks effectively reveals misleading information
Pierri, F., Piccardi, C., & Ceri, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-58166-5 · Cited by 103
Miller, M., Banerjee, T., Muppalla, R., Romine, W. L., & Sheth, A. (2017) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7157 · Cited by 101
Hannak, A., Margolin, D., Keegan, B., & Weber, I. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14555 · Cited by 90
#COVID-19 on Twitter: Bots, Conspiracies, and Social Media Activism
Ferrara, E. (2020) · Europe PMC (PubMed Central) · Cited by 82
A Kernel of Truth: Determining Rumor Veracity on Twitter by Diffusion Pattern Alone
Rosenfeld, N., Szanto, A., & Parkes, D. (2020) · The Web Conference · doi:10.1145/3366423.3380180 · Cited by 67
Evaluation and analysis of term scoring methods for term extraction
Verberne, S., Sappelli, M., Hiemstra, D., & Kraaij, W. (2016) · Information Retrieval · doi:10.1007/s10791-016-9286-2 · Cited by 64
FakeCovid- A Multilingual Cross domain Fact Check Dataset for COVID-19
Shahi, G. K., & Nandini, D. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3965870 · Cited by 52
Self-citationYellow fever outbreaks and Twitter: Rumors and misinformation
Ortiz-Martínez, Y., & Jiménez-Arcia, L. F. (2017) · American Journal of Infection Control · doi:10.1016/j.ajic.2017.02.027 · Cited by 51
A Hybrid Model for Role-related User Classification on TwitterPreprint
Li, L., Song, Z., Zhang, X., & Fox, E. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.10202 · Cited by 8
Cited by
The COVID-19 social media infodemic
Cinelli, M., Quattrociocchi, W., Galeazzi, A., Valensise, C. M., Brugnoli, E., Schmidt, A. L., Zola, P., Zollo, F., & Scala, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-73510-5 · Cited by 2,313
The disaster of misinformation: a review of research in social media
Muhammed T, S., & Mathew, S. K. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00311-6 · Cited by 343
Pennycook, G., & Rand, D. G. (2022) · Nature Communications · doi:10.1038/s41467-022-30073-5 · Cited by 270
The Role of the Crowd in Countering Misinformation: A Case Study of the COVID-19 Infodemic
Micallef, N., He, B., Kumar, S., Ahamad, M., & Memon, N. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9377956 · Cited by 116
Knowledge Editing for Large Language Models: A Survey
Wang, S., Zhu, Y., Liu, H., Zheng, Z., Chen, C., & Li, J. (2025) · ACM Computing Surveys · doi:10.1145/3698590 · Cited by 79
Metadata
- Authors
- Shahi, G. K., Dirkson, A., & Majchrzak, T. A.
- Venue
- Online Social Networks and Media
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 22
- Pages
- 100104
- ISSN
- 2468-6964 (ISSN-L)
- OpenAlex
- W3024009241
- Cited by
- 352
- References
- 59
- FWCI
- 102.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.