Assessing the risks of ‘infodemics’ in response to COVID-19 epidemics
Open accessPublished version of a preprint
Abstract
During COVID-19, governments and the public are fighting not only a pandemic but also a co-evolving infodemic—the rapid and far-reaching spread of information of questionable quality. We analysed more than 100 million Twitter messages posted worldwide during the early stages of epidemic spread across countries (from 22 January to 10 March 2020) and classified the reliability of the news being circulated. We developed an Infodemic Risk Index to capture the magnitude of exposure to unreliable news across countries. We found that measurable waves of potentially unreliable information preceded the rise of COVID-19 infections, exposing entire countries to falsehoods that pose a serious threat to public health. As infections started to rise, reliable information quickly became more dominant, and Twitter content shifted towards more credible informational sources. Infodemic early-warning signals provide important cues for misinformation mitigation by means of adequate communication strategies. An analysis of news shared on Twitter estimates the level of infodemic risk associated with COVID-19 across countries. Epidemic spread and infodemic risk co-evolve, with reliable information becoming more dominant as infection rates rise locally.
AI snapshot
Written from the paper’s full text.
TL;DR
Analyzing more than 112 million Twitter messages in 64 languages from 21 January to 10 March 2020, the authors find that waves of unreliable and low-quality COVID-19 information often anticipate epidemic waves, while reliable information spreads after outbreaks hit. They introduce an Infodemic Risk Index and report that global infodemic risk tends to decline as epidemics expand, though country patterns vary substantially.
Key findings
- An estimated 40.4% of online messages during the period were due to automated agents (bots), doubling activity relative to estimates from only four years earlier.
- The authors extracted about 20.7 million links (3.3 million unique); about 50% of URLs were fact-checked by screening almost 4,000 expert-curated web domains, yielding a final database of 3,892 entries: 1,434 reliable, 2,264 unreliable, and 194 unknown.
- Infodemic waves of unreliable/low-quality information anticipate epidemic waves; when epidemics hit an area, reliable information is “inoculated” and focus shifts toward certified sources. The global Infodemic Risk Index tends to decrease as epidemics spread, with average risk on days with no confirmed cases at 0.276, a drop at first reported case, a rebound at 3 confirmed cases, then a decrease as cases grow.
- Country profiles differ: South Korea remains low-risk apart from an early spike; Canada is slightly higher; Venezuela is high-risk throughout; Russia shows erratic, pronounced spikes; Italy’s misinformation collapses after outbreak; and in the USA misinformation is mainly driven by verified sources and remains basically constant. The paper also finds G9 countries with remarkable infodemic risk and developing countries with far lower risk levels.
Methods
- Twitter messages were collected via the Filter API (24 Jan–10 Mar 2020) and Search API (21–24 Jan 2020) using hashtags/keywords including coronavirus, ncov, #Wuhan, covid19, covid-19, sarscov2, and covid. The authors estimate 161.2 million tweets were posted until 10 Mar 2020 and collected 112.6 million; more than 60 million geolocated messages containing more than 9 million news items were analyzed.
- Users were classified as human or non-human (bots) using a deep-learning algorithm with >90% accuracy and >95% precision for bots, while keeping verified/unverified distinctions. URLs were extracted and assigned reliability through fact-checking databases and a Harm Score scheme.
- The authors defined exposure, reliability/unreliability, and an Infodemic Risk Index (IRI) ranging from 0 to 1, aggregated daily and by country. Figure 3 considers 178 countries; Supplementary Fig. 5 uses 177 countries excluding China.
Limitations
- Paper-stated: only about 50% of URLs were fact-checked, and unassessable links were discarded; exposure is a lower bound because higher-order transmission pathways and users who read without resharing are not tracked; China was removed as a major outlier; the relationship with biological contagion patterns cannot be checked in some cases due to lack of reliable data; and whether the USA will show a similar readjustment remains to be checked.
- Paper-stated/evident: Twitter API restrictions after 25 Feb 2020 allowed no more than 4.5 million messages per day on average, so an increasing fraction of tweets was missed (161.2 million estimated posted vs. 112.6 million collected); geolocated analysis relies on about 56% of the total observed volume after geocoding profiles.
- Evident: source reliability inherits labels and Harm Scores from external databases and expert classification; the paper also notes that countries with high infodemic risk might be more unreliable in reporting epidemic data, which could alter perceptions and indirectly mislead people.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 18 cited sources checked · 0 supported · 0 flagged
- Findingown data
Waves of unreliable and low-quality information occur before epidemic waves.
“We found that waves of unreliable and low-quality information anticipate the epidemic ones, exposing entire countries to irrational social behavior and serious threats for public health.”
Quote in the paperSubstantial claim - Findingown data
Machine learning analysis of online user behavior revealed extraordinary activity by automated agents called social bots.
“By using state-of-the-art machine learning techniques to analyze the online behavior of users (see Methods for details), we have discovered an extraordinary activity of automated agents, referred to as social bots 14,15,35,39 .”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [14] De Domenico, M., Granell, C., Porter, M. A. & Arenas, A. The physics of spreading processes in multilayer networks. Nat. Phys. 12, 901–906 (2016). source
Not checked in the free run.
- cites [15] Brockmann, D. & Helbing, D. The hidden geometry of complex, network-driven contagion phenomena. Science 342, 1337–1342 (2013). source
Not checked in the free run.
- cites [35] Watts, D. J. A simple model of global cascades on random networks. Proc. Natl Acad. Sci. USA 99, 5766–5771 (2002). source
Not checked in the free run.
- cites [39] Hébert-Dufresne, L., Scarpino, S. V. & Young, J.-G. Macroscopic patterns of interacting contagions are indistinguishable from social reinforcement. Nat. Phys. https://doi.org/10.1038/s41567-020-0791-2 (2020). source
Not checked in the free run.
- Findingcitation
During the SARS-CoV-2 emergency, a significant part of human communication activity involved intentional production of informational noise and misleading or false information.
“Contrary to what it could be expected in principle, what this natural experiment reveals is that, on the verge of a threatening global pandemic emergency due to SARS-CoV-2 [23][24][25] , human communication activity is to a significant extent characterized by the intentional production of informational noise and even of misleading or false information 26 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26] Weekly Epidemiological Record Vol. 95, 16 (WHO, 2020); https://www.who.int/wer/2020/wer9516/en/
Not checked in the free run.
- Findingown data
The average infodemic risk index for days with no confirmed cases was 0.276.
“We first compute the average value for days with no confirmed cases, which is 0.276”
Quote in the paperNot a substantial claim - Findingreasoning
Globally, infodemic risk tended to decrease as the epidemics spread worldwide.
“Overall, the global level of infodemic risk tends to decrease as the epidemics spread globally”
Quote in the paperSubstantial claim
- Findingown data
The evolution of infodemic risk among countries with both high message volume and significant epidemic contagion was very asymmetric.
“the evolution of infodemic risk among countries with both high message volume and significant epidemic contagion tends to be very asymmetric”
Quote in the paperSubstantial claim - Findingown data
Countries with similar infodemic risk levels can have very different dynamic risk profiles.
“However, also the dynamic profiles of infodemic risk in countries with similar risk levels may be very different.”
Quote in the paperSubstantial claim - Findingown data
Unverified users, both humans and bots, shared a larger fraction of unreliable news than verified users.
“Unverified users, both humans and bots, share a larger fraction of unreliable news than verified users.”
Quote in the paperSubstantial claim - Findingown data
Reliable sources were more represented than unreliable ones among the news shared on Twitter about COVID-19.
“This analysis demonstrates that reliable sources are more represented than unreliable ones”
Quote in the paperNot a substantial claim - Findingown data
Profiles identified as bots had a larger number of followers than human profiles.
“At the same time, profiles identified as bots have a larger number of followers.”
Quote in the paperNot a substantial claim - Findingown data
As epidemics gained strength, the infodemic risk index decreased again.
“Then, as the epidemics gain strength, the infodemic risk index decreases again, confirming what observed in Fig. 3.”
Quote in the paperNot a substantial claim - Findingown data
In South Korea, infodemic risk stayed low throughout except for an isolated early spike.
“In a low-risk country such as South Korea, the level of infodemic risk remains small throughout apart from an isolated spike in the early phase.”
Quote in the paperNot a substantial claim - Findingown data
The overall decreasing pattern of infodemic risk is confirmed by daily and country-level aggregated measures.
“This overall pattern is confirmed in terms of measures of Infodemic Risk aggregated daily and at country level (Fig. 3 and Supplementary Fig. 5).”
Quote in the paperSubstantial claim - Findingown data
Geocoding user profile information expanded the geolocated message corpus to about 56% of total observed volume.
“However, by geocoding the information available in users' profiles, we were able to extend the corpus of geolocated messages to about 56% of the total observed volume”
Quote in the paperNot a substantial claim - Findingnone given
Infodemic risk varies substantially across US states.
“Notice also how infodemic risk varies substantially across US states.”
Quote in the paperNot a substantial claim - Findingown data
The Italian infodemic risk index dropped sharply coinciding with the first official report of non-imported epidemiological cases.
“Note the striking drop in the Italian infodemic risk index coinciding with the first official report of non-imported epidemiological cases.”
Quote in the paperNot a substantial claim - Findingown data
Countries with different infodemic risk levels show very different news source profiles.
“Figure 2 shows how countries characterized by different levels of infodemic risk present very different profiles of news sources.”
Quote in the paperSubstantial claim - Findingown data
Global infodemic risk decreased over time.
“The risk evolution for the whole world is also shown, demonstrating an overall decrease over time”
Quote in the paperSubstantial claim - Findingown data
More than 60 million geolocated messages containing more than 9 million news items were analyzed.
“A total of more than 60 millions geolocated messages, containing more than 9 millions news have been analyzed.”
Quote in the paperSubstantial claim - Findingown data
Unverified profiles had significantly fewer followers than verified profiles.
“The unverified profiles have a significantly smaller number of followers than the verified ones.”
Quote in the paperNot a substantial claim - Premisecitation
False information and conspiracy theories can cause confusion and discourage people from taking the crisis seriously, especially when socially validated and spread.
“Spreading false information or even conspiracy theories that support implausible explanations of the causal forces at work behind the crisis may create serious confusion and even discourage people from taking the crisis seriously or responsibly, all the more so, the more such signals receive social validation and spread across social groups and communities 27 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Tangcharoensathien, V. et al. A framework for managing the COVID-19 infodemic: methods and results of an online, crowdsourced WHO technical consultation. J. Med. Internet Res. https://doi.org/10.2196/19659 (2020). source
Not checked in the free run.
- Interpretationreasoning
Unreliable and low-quality information waves can seriously harm society's ability to respond adaptively by adopting norms and behaviors that contain epidemics.
“This generates waves of unreliable and low-quality information with potentially very dangerous impacts on the social capacity to respond adaptively at all scales by rapidly adopting those norms and behaviors that may effectively contain the propagation of the epidemics.”
Quote in the paperSubstantial claim - Premisecitation
The exact fundamental mechanisms behind the spread of false information and inflammatory content remain unknown.
“However, the exact fundamental mechanisms responsible for the spread of false information and inflammatory content, e.g. during political events 15, 35 36,37 , remains fundamentally unknown.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites 15, 35 36,37
Not checked in the free run.
- Study design and conductreasoning
After 25 Feb 2020, Twitter restrictions allowed collection of no more than 4.5 million messages per day on average.
“The global attention towards COVID19 increased the volume of messages after 25 Feb 2020: however, Twitter restrictions allowed us to get no more than 4.5 millions messages per day, on average.”
Quote in the paperSubstantial claim - Study design and conductown data
From 26 Feb 2020, the study reached the limit of the fraction of data shared by Twitter, missing an increasing fraction of Tweets.
“From 26 Feb, we reached the limit of the fraction of data shared by Twitter (see Methods), missing an increasing fraction of Tweets”
Quote in the paperSubstantial claim - Interpretationreasoning
The URL fact-checking method overcame limitations of text mining across languages for narrative analysis.
“This method allowed us to overcome the limitations due to text mining of different languages for the analysis of narratives.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The exposure measure provides a lower bound on the number of exposed users because higher-order transmission pathways are not tracked.
“Note that our measure provides a lower bound to the number of exposed users, because we do not track higher-order transmission pathways”
Quote in the paperNot a substantial claim - Interpretationown data
After COVID-19 hits countries, there is a positive behavioral response to infodemics.
“Positive behavioral response to infodemics after COVID-19 hits countries”
Quote in the paperSubstantial claim - Interpretationreasoning
In high-infodemic-risk countries, the speed and effectiveness of COVID-19 containment could depend on a prompt switch in communication strategies and countering active sources of dangerous fake news.
“This means that, especially in countries where infodemic risk is high, the eventual speed and effectiveness of the containment of the COVID-19 could depend on a prompt regime switch in communication strategies and in the effective countervailing of the most active sources of the most dangerous categories of fake news.”
Quote in the paperSubstantial claim - Interpretationown data
Countries respond in different ways to infodemics.
“Countries respond in different ways to infodemics.”
Quote in the paperSubstantial claim - Interpretationown data
In a highly digitalized society, the epidemic and infodemic dimensions of a pandemic must be treated as two sides of the same coin.
“Our findings demonstrate that, in a highly digitalized society, the epidemic and the infodemic dimensions of a pandemic must be seen as two sides of the same coin.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The deep neural network model is more stable in classifying users who act as broadcasters.
“Our deep neural network model has the advantage to be more stable in the classification of certain users playing the role of broadcasters.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Because verified profiles participate more strongly in the risk index, including all users would only increase the estimated risk.
“As verified profiles participate in the risk index more strongly, we can expect the estimate of risk to be only greater if we could include all users.”
Quote in the paperNot a substantial claim - Interpretationown data
Infodemics is typically driven by combined action of human and non-human actors (bots) pursuing largely undisclosed goals.
“The infodemics is typically driven by the combined action of both human and non-human actors (bots), which pursue largely undisclosed goals .”
Quote in the paperSubstantial claim - Study design and conductreasoning
China was removed from the analysis as a major outlier because its epidemic timing and size made comparison difficult.
“China has to be considered as a major outlier due to its role in the global epidemic in terms of timing and size of the contagion, which makes it difficult to compare to other countries, and has therefore been removed from this analysis.”
Quote in the paperSubstantial claim - Study design and conductcitation
The human versus non-human classification is based on a well-established deep learning algorithm with state-of-the-art accuracy.
“It is based on a well established algorithm based on deep learning 37 with state-of-the-art accuracy 15,41 .”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [37] Aral, S. & Eckles, D. Protecting elections from social media manipulation. Science 365, 858–861 (2019). source
Not checked in the free run.
- cites [15] Brockmann, D. & Helbing, D. The hidden geometry of complex, network-driven contagion phenomena. Science 342, 1337–1342 (2013). source
Not checked in the free run.
- cites [41] Marchetti, R. & Ceccobelli, D. Twitter and television in a hybrid media system. Journalism Pract. 10, 626–644 (2016). source
Not checked in the free run.
- May combine two claims. 36
- Classified as probably not a substantial claim. 13
- The quote only partly states this claim. 1
May combine two claims.
Findingown dataWhen an epidemic reaches an area, reliable information spreads rapidly and attention shifts to certified sources.
“When the epidemics hit the same area, reliable information is quickly inoculated, like antibodies, and the system shifts focus towards certified informational sources.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationAn estimated 40.4% of online messages in the period came from automated agents, twice the estimate from four years earlier.
“Specifically, we estimate that 40.4% of online messages during this period were due to such automated agents, doubling the activity with respect to estimates of only four years ago 35 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Watts, D. J. A simple model of global cascades on random networks. Proc. Natl Acad. Sci. USA 99, 5766–5771 (2002). source
Not checked in the free run.
May combine two claims.
Findingown dataAverage follower counts were 660 for unverified humans, 1,400 for unverified bots, 51,000 for verified humans, and 240,000 for verified bots.
“The average values are: 660 for Unverified Humans (circles), 1400 for Unverified Bots (squares, 51k for Verified Humans (stars) and 240k for Verified Bots (diamonds).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe study found 4,988 domains, reduced to 4,417 after removing hard duplicates across databases.
“We have found a total of 4,988 domains, reduced to 4,417 after removing hard duplicates across databases.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn South Korea, infodemic risk decreased as contagion spread, indicating growing public focus on reliable news.
“As the contagion spreads to significant levels, the infodemic risk further decreases, signalling an increasing focus of the public opinion toward reliable news sources.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe probability distributions of follower counts for the four user classes all display a fat tail, but different categories have different outreach.
“All distributions display a fat-tail, but different categories of users have a different outreach.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAbout 0.84% of collected posts were geo-tagged by users, giving highly accurate location information.
“About 0.84% of collected posts were geo-tagged by the user, providing highly accurate information about their geographic location.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCanada had slightly higher infodemic risk than South Korea; risk rose as epidemics spread but remained low.
“Canada presents a slightly higher level of infodemic risk, and unlike South Korea, we see that the risk level increases as the epidemics spread, but stays at low levels.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningThe geolocated data used in the paper slightly overestimated the fraction of unreliable news for unverified accounts and underestimated the fraction of fake news for verified profiles compared with the whole sample of Tweets.
“The difference, possibly caused by the correlation of this kind of behaviour with the choice of how customising the field”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn Venezuela, infodemics was fully active throughout observation, and verified sources contributed substantially to it.
“At the opposite, in a high-risk country such as Venezuela, the infodemics is in full swing throughout the period of observation, and in addition to the expected activity from unverified sources one notices that even verified ones contribute to a large extent to the infodemics.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe relationship between declining infodemic risk and expanding epidemics appears general, with a nonlinearly negative association between confirmed cases and infodemic risk.
“Fig. 4 shows, however, that the relationship between reduction of infodemic risk and expansion of the epidemics seems to be a rather general trend, as the relationship between number of confirmed cases and infodemic risk is (nonlinearly) negative, confirming the result shown in Fig. 3.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIran, the United States, Germany, the Netherlands, Austria, and Norway maintained their relative infodemic risk levels, while Italy, South Korea, and Japan significantly reduced it as the epidemics progressed.
“with major roles played not only by countries such as Iran, but also United States, Germany, the Netherlands, Austria and Norway maintaining their relative levels, and other countries like Italy, South Korea and Japan significantly reducing it with the progression of the epidemics.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataProcessing reduced the overall database to 3,920 unique domains.
“This phase of processing reduced the overall database to unique 3,920 domains.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOf the 3,892 entries, 1,434 were reliable, 2,264 were unreliable, and 194 were unknown.
“Type Count RELIABLE 1434 UNRELIABLE 2264 UNKNOWN 194 Total 3892”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the USA, misinformation was mainly driven by verified sources and remained basically constant after the epidemic outbreak.
“For the USA, misinformation is mainly driven by verified sources, and it remains basically constant even after the epidemics outbreak.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataReporting the first confirmed COVID-19 case in a country was associated with a drop in the infodemic risk index, followed by a return to the natural level at three confirmed cases.
“We observe that reporting of the first case is associated with a drop in the risk index, followed by an increase back to the”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCollective attention about COVID-19 first increased after the outbreak in Wuhan between 24 Jan and 02 Feb 2020, and rose strongly again after the epidemics spread in northern Italy from 20 Feb 2020 onward.
“We can observe a first increase in collective attention after the outbreak in Wuhan, China (between 24 Jan and 02 Feb 2020) and a second strong rise after the epidemics began to spread in northern Italy (20 Feb 2020 onwards).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn Italy, infodemic risk was mostly from unverified sources, but misinformation collapsed and shifted suddenly to reliable sources after the epidemic outbreak.
“In the case of Italy the risk is mostly due to the activity of unverified sources, but we notice that with the outbreak of the epidemics, the production of misinformation literally collapses and there is a sudden shift to reliable sources.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThere are G9 countries with remarkable infodemic risk and developing countries with far lower risk levels.
“In fact, we find that there are G9 countries with remarkable infodemic risk and developing countries with far lower risk levels.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the COVID-19 crisis, complex infodemic effects are at work with significant cross-country variation, and socio-economic development is not the key discriminant between high and low infodemic risk.
“Here, we have shown that in the context of the COVID-19 crisis, complex infodemic effects are indeed at work, with significant variations across countries, where level of socio-economic development is not the key discriminant to separate countries with high vs. low infodemic risk.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe fraction of geolocated messages was constantly about 56% of the total volume recorded.
“The fraction of Geoolocated (messages with shared locations, or geonamed, indicated in green) is constantly about 56% of the total volume recorded”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn Russia, infodemic risk was erratic with sudden pronounced spikes, verified sources played a major role, and epidemic information was fragmented and mostly unreliable.
“Finally, in a relatively high-risk country such as Russia we notice that infodemic risk is erratic with sudden, very pronounced spikes, and again also verified sources play a major role.Here too, information about the epidemics is fragmented and mostly unreliable.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAfter filtering poorly defined domains, the final database contained 3,892 entries.
“This action reduced the database to the final number of 3,892 entries”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAbout half of extracted URLs were fact-checked using nearly 4,000 expert-curated web domains; the rest pointed to vanished pages or content not automatically classifiable.
“About 50% of URLs have been fact-checked by screening almost 4,000 expert-curated web domains, whereas the remaining corpus was pointing to disappeared web pages or to content not classifiable automatically (eg, videos on YouTube) and unpopular sources.”
Quote in the paperNot a substantial claim- Rests on an assumption: The reliability of a URL can be inherited from the reliability of its source domain.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenRepeated exposure to a message from different sources acts as indirect validation of its reliability and relevance, leading users to spread it and become informationally infectious.
“As users are repeatedly hit by a given message from different sources, this works as an indirect validation of its reliability and relevance, leading the user to spread it in turn, and to become an informationally infectious agent.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataHuman response to falsehood shows early-warning signals that adequate communication strategies might mitigate.
“Contrary to mainstream beliefs, we show that human response to falsehood exhibits early-warning signals that might be mitigated with adequate communication strategies.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).
PremisecitationIt has been proposed that at population level, dynamics of multiple interacting contagions are indistinguishable from social reinforcement.
“Recently, it has been suggested that this challenging phenomenon might be due to the fact that, at population level, the dynamics of multiple interacting contagions are indistinguishable from social reinforcement 38 .”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [38] Stella, M., Cristoforetti, M. & De Domenico, M. Influence of augmented humans in online interactions during voting events. PLoS ONE 14, e0214210 (2019). source
Not checked in the free run.
May combine two claims.
Premiseown dataInformation dynamics intended to change perceptions can direct collective attention to false or inflammatory content, a phenomenon called infodemics that resembles epidemics.
“In this study, we show that information dynamics tailored to alter individuals' perceptions and, consequently, their behavioral response, is able to drive collective attention 12 towards false 13,14 or inflammatory 15 content, a phenomenon named infodemics [16][17][18][19] , sharing similarities with more traditional epidemics and spreading phenomena [20][21][22] .”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [12] Zarocostas, J. How to fight an infodemic. Lancet 395, 676 (2020). source
Not checked in the free run.
- cites [13] Pastor-Satorras, R., Castellano, C., Van Mieghem, P. & Vespignani, A. Epidemic processes in complex networks. Rev. Mod. Phys. 87, 925–979 (2015). source
Not checked in the free run.
- cites [14] De Domenico, M., Granell, C., Porter, M. A. & Arenas, A. The physics of spreading processes in multilayer networks. Nat. Phys. 12, 901–906 (2016). source
Not checked in the free run.
- cites [15] Brockmann, D. & Helbing, D. The hidden geometry of complex, network-driven contagion phenomena. Science 342, 1337–1342 (2013). source
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenInfodemics arise from simultaneous activity of multiple human and non-human sources of fake or unreliable news.
“As shown in Fig. 1, an infodemics is the result of the simultaneous action of multiple human and non-human sources of fake or unreliable news.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe danger posed by infodemics can be comparable to and additive with that of the epidemic itself.
“In fact, the dangerousness of infodemics can compare and sum up to a large extent to that of the epidemics itself 29 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [29] Ferrara, E., Varol, O., Davis, C., Menczer, F. & Flammini, A. The rise of social bots. Commun. ACM 59, 96–104 (2016). source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenPerceived and actual biological and social risks feed upon one another and may co-evolve in complex ways.
“Perceived and actual biological and social risks feed upon one another, and may co-evolve in complex ways.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenHuman and non-human accounts create unreliable COVID-19 content, and their followers are exposed to it and reshare it, becoming infectious agents.
“Human and non-human accounts forge unreliable content -such as fake or untrustworthy news -about the COVID19, a topic attracting the collective attention of the whole world.Their followers are exposed to such content, and reshare it, becoming infectious agents:”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenThe method has the highest accuracy (>90%) and precision (>95%) in identifying bots compared with state-of-the-art methods.
“More in detail, our method has the highest accuracy (>90%) and precision in identifying bots (>95%) when compared with state-of-the-art methods.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe global decrease in infodemic risk suggests that contagion expansion led people to seek more reliable sources and that verified influencers began spreading more reliable news.
“suggesting that evidence of the expansion of the contagion leads people to look for relatively more reliable sources, and that verified influencers with many followers started inoculating the system with more reliable news (see Supplementary Figures 3 and 4), playing a role that presents interesting analogies to that of antibodies in the treatment of an infectious disease.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningWhen effective therapies are unavailable, coordination of behaviors and diffusion of pro-social orientations driven by reliable information are key resources for mitigating adverse effects.
“Especially in situations where effective therapies to contrast the diffusion of the pandemic are not readily available, coordination of behaviors and diffusion of pro-social orientations driven by reliable information at all scales are the key resources for the mitigation of adverse effects.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataUntil 24 Feb 2020, about 60,000 tweets were lost out of millions, capturing more than 99.5% of all posted messages.
“We estimate that until 24 Feb 2020 we lost about 60,000 tweets out of millions, capturing more than 99.5% of all messages posted (see Supplementary Fig. 1).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenCountries with high infodemic risk might also report epidemic data less reliably, altering perceptions and misleading people seeking reliable information.
“It is also interesting to observe though that countries with high infodemic risk might also be more unreliable in terms of reporting of epidemic data, thus altering the perceptions of people and indirectly misleading them in their search for reliable information.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataEscalating epidemics lead people to pay more attention to reliable sources, potentially limiting infodemics, but the speed of adjustment may strongly affect social outcomes.
“The escalation of the epidemics leads people to progressively pay attention to more reliable sources thus potentially limiting the impact of the infodemics, but the actual speed of adjustment may make a major difference in determining the social outcome, and in particular between a controlled epidemics and a global pandemics.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductnone givenThe Infodemic Risk Index is robust to user classification and is not sensitive to the performance of bot detection algorithms.
“IRI is robust to user classification, making it an indicator not sensitive to performances of bot detection algorithms.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe reliability classification used manually checked web domains collected from multiple publicly available databases.
“We have collected manually-checked web domains from multiple publicly available databases, including scientific and journalistic ones.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductcitationThe choice of Twitter API was the safest to date because biases affecting the Sample API are not found in REST and Filter APIs.
“Note that this choice is the safest as to date: in fact, it has been recently shown that biases affecting Sample API (which samples data based on rate limits), for instance, are not found in REST and Filter APIs 40 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] Eysenbach, G. How to fight an infodemic: the four pillars of infodemic management. J. Med. Internet Res. 22, e21820 (2020). source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe findings cast new light on the social mechanics of infodemics-epidemics interaction and may help policy makers design a more integrated strategic approach.
“This casts new light on the social mechanics of the infodemics-epidemics interaction, and may be of help to policy makers to design a more integrated strategic approach, by suitably embedding communication and information management into a comprehensive, extended public health perspective.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataAn estimated 161.2 million tweets were posted until 10 Mar 2020, and 112.6 million were collected.
“We have estimated a total of 161.2 millions tweets posted until 10 Mar 2020: we have successfully collected 112.6 millions of them, providing an unprecedented opportunity for infodemics analysis.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataReliable and unreliable sources circulate in different ways and reach different targets.
“however, they circulate in different ways and reach different targets, a feature that is perfectly captured by the infodemic risk index introduced in this study.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe decrease in infodemic risk was especially pronounced as epidemics escalated, suggesting mediation by perceived social alarm.
“The effect is particularly pronounced with the escalation of the epidemics, suggesting that this effect could be mediated by levels of perceived social alarm.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenWhen two or more domains are soft duplicates, the classification with the highest Harm Score is kept as a conservative choice.
“When two or more domains are soft duplicates, we keep the classification with the highest Harm Score, as a conservative choice.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Verified users are more authentic than unverified users because Twitter applies strict verification criteria.
“In fact, verified users should be considered as more authentic than unverified ones, because Twitter makes use of strict criteria for verification.”
The paper relies on this without support.
Twitter messages are a valid proxy for global human communication activity during the pandemic.
“We focus our attention on the analysis of messages posted on a popular microblogging platform 30 , an online social network characterized by heterogeneous connectivity 31 and topological shortcuts typical of small-world systems 32 .”
The paper relies on this without support.
The reliability of a URL can be inherited from the reliability of its source domain.
“Each URL is therefore used for fact-checking, inheriting the reliability of its source (see Methods).”
The paper relies on this without support.
The machine learning classifier used to distinguish human from bot accounts is accurate.
“we have used an accurate machine learning approach to classify the author as human or non-human (i.e., bot)”
The authors state this as an assumption.
Exposure can be approximated by the number of followers of the posting user at first order.
“The number of followers K u of a single user u defines the exposure, in terms of potential visualizations at first-order approximation, of a single message m posted by user u at time t .”
The paper relies on this without support.
The geolocated subset of tweets is representative enough of the full Twitter sample for estimating infodemic risk.
“The fraction of Geoolocated (messages with shared locations, or geonamed, indicated in green) is constantly about 56% of the total volume recorded”
The authors state this as an assumption.
Message reliability can be adequately represented as a binary value after discarding links that cannot be easily assessed.
“The reliability r m of a single message m is either 0 or 1, because we discard all web links that can not be easily assessed”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Bots are present in online cryptocurrency discussions and in the infodemics about the COVID-19 pandemic.
“Similar results were obtained about the presence of bots in online cryptocurrency discussions [24] and as part of the 'infodemics' about the COVID-19 pandemic [14].”
From A decade of social bot detection (2020) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Unknown source categories are also described as unreliable
MinorThe supplementary figure description classifies every category other than MSM and SCIENCE as unreliable, but the classification table labels OTHER and SHADOW as UNKNOWN.
“Reliable news includes MSM and SCIENCE, whereas unreliable news includes the remaining categories.”
“OTHER 5 UNKNOWN Domains pointing to general content that can not be easily classified, such as videos on YouTube.SHADOW 6 UNKNOWN Domains related to URL shortening, that can be classified a priori .”
Cites
Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China
Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y., Zhang, L., Fan, G., Xu, J., Gu, X., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30183-5 · Cited by 48,884 · see citing works
Collective dynamics of ‘small-world’ networks
Watts, D. J., & Strogatz, S. H. (1998) · Nature · doi:10.1038/30918 · Cited by 43,060 · cited 1× · see citing works
“We focus our attention on the analysis of messages posted on a popular microblogging platform ( 25 ) , an online social network characterized by heterogeneous connectivity ( 26 ) and topological shortcuts typical of small-world systems ( 27 ) .”
BackgroundEmergence of Scaling in Random Networks
Barabási, A.-L., & Albert, R. (1999) · Science · doi:10.1126/science.286.5439.509 · Cited by 36,135 · see citing works
A novel coronavirus from patients with pneumonia in China, 2019
Zhu, N., Zhang, D., Wang, W., Li, X., Yang, B., Song, J., Zhao, X., Huang, B., Shi, W., Lu, R., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001017 · Cited by 28,244 · see citing works
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1× · see citing works
“In this study, we show that information dynamics tailored to alter individuals' perceptions and, consequently, their behavioral response, is able to drive collective attention 12 towards false 13, 14 or inflammatory 15 content, a phenomenon named infodemics [16] [17] [18] [19] , sharing similarities with more traditio…”
BackgroundWhat is Twitter, a social network or a news media?
Kwak, H., Lee, C., Park, H., & Moon, S. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772751 · Cited by 6,652 · see citing works
Catastrophic cascade of failures in interdependent networks
Buldyrev, S. V., Parshani, R., Paul, G., Stanley, H. E., & Havlin, S. (2010) · Nature · doi:10.1038/nature08932 · Cited by 4,513 · cited 1× · see citing works
“(1) Note that different users of the same class might have overlapping social neighborhoods: those neighbors might be reached multiple times by the messages coming from distinct users of the same class, therefore our measure of exposure accounts for this effect.”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160 · cited 1× · see citing works
“However, contrary to what it could be expected in principle, what this natural experiment reveals is that, on the verge of a threatening global pandemic, human communication activity is to a significant extent characterized by the intentional production of informational noise and even of misleading or false informatio…”
ResultBenkler, Y. R. (2017) · Yale University Press eBooks · doi:10.12987/9780300127232 · Cited by 3,718 · see citing works
Epidemic processes in complex networks
Pastor-Satorras, R., Castellano, C., Van Mieghem, P., & Vespignani, A. (2015) · Reviews of Modern Physics · doi:10.1103/revmodphys.87.925 · Cited by 3,697 · cited 1× · see citing works
“In this study, we show that information dynamics tailored to alter individuals' perceptions and, consequently, their behavioral response, is able to drive collective attention 12 towards false 13, 14 or inflammatory 15 content, a phenomenon named infodemics [16] [17] [18] [19] , sharing similarities with more traditio…”
BackgroundThe effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak
Chinazzi, M., Davis, J. T., Ajelli, M., Gioannini, C., Litvinova, M., Merler, S., Pastore y Piontti, A., Mu, K., Rossi, L., Sun, K., et al. (2020) · Science · doi:10.1126/science.aba9757 · Cited by 3,694 · cited 1× · see citing works
“Therefore, if on the one hand we face the risks of a global epidemics threat, requiring outstanding efforts for modeling and anticipating the time course of the spreading ( 22 ) , on the other hand we can speak of an infodemics threat ( 23 ) , where low-quality content provides an alternative for news consumption to u…”
BackgroundA simple model of global cascades on random networks
Watts, D. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.082090499 · Cited by 2,673 · cited 1× · see citing works
“Information spreading on this type of networks is well understood in terms of global cascades in a population of individuals who have to choose between complementary alternatives, while accounting for the behavior and the relative size of their social neighborhood ( 28 ) , and accounting for factors which characterize…”
BackgroundZarocostas, J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30461-x · Cited by 2,344 · see citing works
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016) · Communications of the ACM · doi:10.1145/2818717 · Cited by 1,973 · see citing works
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803 · see citing works
Eysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351 · see citing works
Social Media: A Critical Introduction
Fuchs, C. (2014) · doi:10.4135/9781446270066 · Cited by 1,311 · cited 1× · see citing works
“The recent explosion of publicly shared, decentralized information production that characterizes digital societies ( 16 ) and in particular social media activity ( 17 ) provides an exceptional laboratory for the observation and the study of these complex social dynamics ( 18 ) , and potentially functions as a very pow…”
BackgroundThe Hidden Geometry of Complex, Network-Driven Contagion Phenomena
Brockmann, D., & Helbing, D. (2013) · Science · doi:10.1126/science.1245200 · Cited by 1,253 · see citing works
Networks formed from interdependent networks
Gao, J., Buldyrev, S. V., Stanley, E., & Havlin, S. (2011) · Nature Physics · doi:10.1038/nphys2180 · Cited by 1,196 · cited 1× · see citing works
“The news reliability of messages produced by a specific class of users is therefore defined as (2) Unreliability can be defined similarly, replacing r m with 1-r m .”
BackgroundThe spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · Nature Communications · doi:10.1038/s41467-018-06930-7 · Cited by 1,125 · see citing works
Social bots distort the 2016 U.S. Presidential election online discussion
Bessi, A., & Ferrara, E. (2016) · First Monday · doi:10.5210/fm.v21i11.7090 · Cited by 993 · see citing works
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · see citing works
The physics of spreading processes in multilayer networks
De Domenico, M., Granell, C., Porter, M. A., & Arenas, A. (2016) · Nature Physics · doi:10.1038/nphys3865 · Cited by 649 · see citing works
SuperCooperators: altruism, evolution, and why we need each other to succeed
(2011) · Choice Reviews Online · doi:10.5860/choice.49-2054 · Cited by 619 · see citing works
Communication and Cooperation in Social Dilemmas: A Meta-Analytic Review
Balliet, D. (2010) · Journal of Conflict Resolution · doi:10.1177/0022002709352443 · Cited by 598 · cited 1× · see citing works
“In large, complex societies, an important mediator of large-scale cooperation is communication ( 14 ) , which may be crucial to coordinate individual perceptions and behaviors in the pursuit of the common interest ( 15 ) .”
BackgroundThe spread of low-credibility content by social bots
Shao, C., Ciampaglia, G. L., Varol, O., Yang, K.-C., Flammini, A., & Menczer, F. (2018) · RePEc: Research Papers in Economics · Cited by 574 · see citing works
Tangcharoensathien, V., Calleja, N., Nguyen, T., Purnat, T., D’Agostino, M., Garcia-Saiso, S., Landry, M., Rashidian, A., Hamilton, C., AbdAllah, A., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/19659 · Cited by 561 · see citing works
Self-citationHow to Fight an Infodemic: The Four Pillars of Infodemic Management
Eysenbach, G. (2020) · Journal of Medical Internet Research · doi:10.2196/21820 · Cited by 551 · see citing works
Infodemiology: the epidemiology of (mis)information
Eysenbach, G. (2002) · The American Journal of Medicine · doi:10.1016/s0002-9343(02)01473-0 · Cited by 527 · cited 1× · see citing works
“In this study, we show that information dynamics tailored to alter individuals' perceptions and, consequently, their behavioral response, is able to drive collective attention 12 towards false 13, 14 or inflammatory 15 content, a phenomenon named infodemics [16] [17] [18] [19] , sharing similarities with more traditio…”
BackgroundDisinformation and social bot operations in the run up to the 2017 French presidential election
Ferrara, E. (2017) · First Monday · doi:10.5210/fm.v22i8.8005 · Cited by 524 · see citing works
Bots increase exposure to negative and inflammatory content in online social systems
Stella, M., Ferrara, E., & De Domenico, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1803470115 · Cited by 492 · see citing works
Self-citationInfodemiology and Infoveillance
Eysenbach, G. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.006 · Cited by 420 · see citing works
The spread of medical fake news in social media – The pilot quantitative study
Waszak, P. M., Kasprzycka-Waszak, W., & Kubanek, A. (2018) · Health Policy and Technology · doi:10.1016/j.hlpt.2018.03.002 · Cited by 406 · see citing works
Adaptive specializations, social exchange, and the evolution of human intelligence
Cosmides, L., Barrett, H. C., & Tooby, J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0914623107 · Cited by 292 · see citing works
Using Behavioral Science to help fight the Coronavirus
Lunn, P. D., Belton, C. A., Lavin, C., McGowan, F., Timmons, S., & Robertson, D. A. (2020) · Journal of Behavioral Public Administration · doi:10.30636/jbpa.31.147 · Cited by 285 · see citing works
Polarization and Fake News: Early Warning of Potential Misinformation Targets
Vicario, M. D., Quattrociocchi, W., Scala, A., & Zollo, F. (2019) · ACM Transactions on the Web · doi:10.1145/3316809 · Cited by 280 · see citing works
Can’t We Just Disregard Fake News? The Consequences of Exposure to Inaccurate Information
Rapp, D. N., & Salovich, N. A. (2018) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218785193 · Cited by 214 · see citing works
Protecting elections from social media manipulation
Aral, S., & Eckles, D. (2019) · Science · doi:10.1126/science.aaw8243 · Cited by 209 · see citing works
Giglietto, F., Rossi, L., & Bennato, D. (2012) · Journal of Technology in Human Services · doi:10.1080/15228835.2012.743797 · Cited by 140 · see citing works
Tampering with Twitter’s Sample API
Pfeffer, J., Mayer, K., & Morstatter, F. (2018) · EPJ Data Science · doi:10.1140/epjds/s13688-018-0178-0 · Cited by 135 · see citing works
Effects of network structure, competition and memory time on social spreading phenomena
Gleeson, J. P., O’Sullivan, K. P., Banos, R., & Moreno, Y. (2016) · Arrow@dit (Dublin Institute of Technology) · Cited by 130 · see citing works
A Reasoned Approach to Dealing With Fake News
Britt, M. A., Rouet, J., Blaum, D., & Millis, K. (2019) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218814855 · Cited by 101 · see citing works
Miller, J. H., Butts, C. T., & Rode, D. C. (2002) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(01)00159-7 · Cited by 100 · see citing works
Altay, S., de Araujo, E., & Mercier, H. (2021) · Digital Journalism · doi:10.1080/21670811.2021.1941163 · Cited by 97 · see citing works
Effects of Network Structure, Competition and Memory Time on Social Spreading Phenomena
Gleeson, J. P., O’Sullivan, K. P., Baños, R. A., & Moreno, Y. (2016) · Physical Review X · doi:10.1103/physrevx.6.021019 · Cited by 91 · see citing works
Ecosystem or Echo-System? Exploring Content Sharing across Alternative Media Domains
Starbird, K., Arif, A., Wilson, T., Koevering, K. V., Yefimova, K., & Scarnecchia, D. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15009 · Cited by 85 · see citing works
Deploying governance networks for societal challenges
Ojo, A., & Mellouli, S. (2016) · Government Information Quarterly · doi:10.1016/j.giq.2016.04.001 · Cited by 71 · cited 2× · see citing works
“For this reason, we developed an Infodemic Risk Index (IRI), which quantifies the rate at which a generic user is exposed to unreliable news produced by a specific class of users (partial IRI, equation (3)) or by any class of users (IRI, equation (4)):”
BackgroundMethodMacroscopic patterns of interacting contagions are indistinguishable from social reinforcement
Hébert-Dufresne, L., Scarpino, S. V., & Young, J.-G. (2020) · Nature Physics · doi:10.1038/s41567-020-0791-2 · Cited by 71 · see citing works
Unraveling the Origin of Social Bursts in Collective Attention
Domenico, M. D., & Altmann, E. G. (2020) · Scientific Reports · doi:10.1038/s41598-020-61523-z · Cited by 52 · see citing works
Self-citationInfluence of augmented humans in online interactions during voting events
Stella, M., Cristoforetti, M., & De Domenico, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214210 · Cited by 51 · see citing works
Self-citationCrowdsourcing data to mitigate epidemics
Leung, G. M., & Leung, K. S. M. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30055-8 · Cited by 50 · see citing works
Twitter and Television in a Hybrid Media System: The 2013 Italian election campaign
Marchetti, R., & Ceccobelli, D. (2016) · Journalism Practice · doi:10.1080/17512786.2015.1040051 · Cited by 32 · see citing works
An agent-based model about the effects of fake news on a norovirus outbreak
Brainard, J. S., Hunter, P. R., & Hall, I. (2020) · Revue d Épidémiologie et de Santé Publique · doi:10.1016/j.respe.2019.12.001 · Cited by 20 · cited 1× · see citing works
“In fact, the dangerousness of infodemics can compare and sum up to a large extent to that of the epidemics itself ( 24 ) .”
BackgroundCortina, M. (2017) · Psychoanalytic Inquiry · doi:10.1080/07351690.2017.1362920 · Cited by 15 · cited 1× · see citing works
“(4) Both indices are well defined and range from 0 (no infodemic risk) to 1 (maximum infodemic risk).”
Background
Flagged first, then by citations
7 of the 61 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
What social media told us in the time of COVID-19: A scoping review
Tsao, S.-F., Chen, H., Tisseverasinghe, T., Yang, Y., Li, L., & Butt, Z. A. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30315-0 · Cited by 816 · see citing works
Robustness and resilience of complex networks
Artime, O., Grassia, M., Domenico, M. D., Gleeson, J. P., Makse, H. A., Mangioni, G., Perc, M., & Radicchi, F. (2024) · Nature Reviews Physics · doi:10.1038/s42254-023-00676-y · Cited by 692 · see citing works
“…resilience at a societal level: it is well known that information spreading can represent a serious threat to public health systems, polarize debates and undermine public trust in democratic institutions 167,168 , but spreading can also have positive impacts such as diffusing innovations 166,169 .”
BackgroundSelf-citationGolinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 604 · see citing works
“[121] 1 N/A 0 [53] 1 0 [1] 1 [18,42,127] 3 [1,18,21,31,42, 56,74,127] 8 [1] 1 Internet search engines, social media”
BackgroundNon-pharmaceutical interventions during the COVID-19 pandemic: A review
Perra, N. (2021) · Physics Reports · doi:10.1016/j.physrep.2021.02.001 · Cited by 518 · see citing works
“[374] studies he communication strategies of official accounts (i.e., public health, emergency services, officials) on Twitter during he evolution of the emergency.”
BackgroundInfluentialGrowing polarization around climate change on social media
Falkenberg, M., Galeazzi, A., Torricelli, M., Marco, N. D., Larosa, F., Sas, M. I., Mekacher, A., Pearce, W., Zollo, F., Quattrociocchi, W., et al. (2022) · Nature Climate Change · doi:10.1038/s41558-022-01527-x · Cited by 401 · see citing works
An exploratory study of COVID-19 misinformation on Twitter
Shahi, G. K., Dirkson, A. R., & Majchrzak, T. A. (2021) · Online Social Networks and Media · doi:10.1016/j.osnem.2020.100104 · Cited by 352 · see citing works
“Although there have already been some indications that bots might be involved [17,19,30], the majority of posts is generated by accounts that are likely to be human [19].”
Socioeconomic impacts of COVID-19 in low-income countries
Josephson, A., Kilic, T., & Michler, J. D. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01096-7 · Cited by 344 · see citing works
Vuong, Q., Le, T.-T., La, V., Huyền, N. T. T., Ho, M., Khuc, Q. V., & Nguyen, M. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01034-6 · Cited by 339 · see citing works
Coninck, D. D., Frissen, T., Matthijs, K., d’Haenens, L., Lits, G., Champagne-Poirier, O., Carignan, M.-È., David, M. D., Pignard-Cheynel, N., Salerno, S., et al. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.646394 · Cited by 315 · see citing works
Hussain, A., Tahir, A., Hussain, Z., Sheikh, Z., Gogate, M., Dashtipour, K. K., Ali, A., & Sheikh, A. (2021) · Journal of Medical Internet Research · doi:10.2196/26627 · Cited by 288 · see citing works
“Social network analysis [35,36] can be performed in conjunction with DL methods to effectively identify sources of fake news or misinformation and their social networks to help deal with infodemic challenges [37,38].”
A decade of social bot detection
Cresci, S. (2020) · Communications of the ACM · doi:10.1145/3409116 · Cited by 323 · see citing works
“Similar results were obtained about the presence of bots in online cryptocurrency discussions [24] and as part of the “infodemics” about the COVID-19 pandemic [14].”
ResultOnline misinformation is linked to early COVID-19 vaccination hesitancy and refusal
Pierri, F., Perry, B. L., DeVerna, M. R., Yang, K.-C., Flammini, A., Menczer, F., & Bryden, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-10070-w · Cited by 264 · see citing works
A review and agenda for integrated disease models including social and behavioural factors
Bedson, J., Skrip, L., Pedi, D., Abramowitz, S. A., Carter, S., Jalloh, M. F., Funk, S., Gobat, N., Giles‐Vernick, T., Chowell, G., et al. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01136-2 · Cited by 224 · see citing works
A review on social spam detection: Challenges, open issues, and future directions
Rao, S., Verma, A. K., & Bhatia, T. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115742 · Cited by 225 · see citing works
The COVID-19 Infodemic: Twitter versus Facebook
Yang, K.-C., Pierri, F., Hui, P.-M., Axelrod, D., Torres-Lugo, C., Bryden, J., & Menczer, F. (2021) · Big Data & Society · doi:10.1177/20539517211013861 · Cited by 206 · see citing works
“A similar delay was recently reported between peaks of exposure to Infodemic tweets and of COVID-19 cases in different countries (Gallotti et al., 2020).”
BackgroundInfluentialHuman mobility trends during the early stage of the COVID-19 pandemic in the United States
Lee, M., Zhao, J. F., Sun, Q., Pan, Y., Zhou, W., Xiong, C., & Zhang, L. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241468 · Cited by 190 · see citing works
Thinking clearly about social aspects of infectious disease transmission
Buckee, C. O., Noor, A. M., & Sattenspiel, L. (2021) · Nature · doi:10.1038/s41586-021-03694-x · Cited by 179 · see citing works
Pian, W., Chi, J., & Ma, F. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102713 · Cited by 180 · see citing works
“Risk communication refers to building verbal/ non-verbal structured messages in the minds of the target audience (Sezgin et al., 2020; Gallotti et al., 2020), which is aimed at alleviating the potential risks during the pandemic via risk assessment, intervention, and management (JCIH Editorial Team…”
BackgroundPolitical polarization drives online conversations about COVID ‐19 in the United States
Jiang, J., Chen, E., Shen, Y., Lerman, K., & Ferrara, E. (2020) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.202 · Cited by 172 · see citing works
“As of May 2020, there are also many pre-print papers providing preliminary analyses of online discussions surrounding COVID-19 (Alshaabi et al., 2020; Barrios & Hochberg, 2020; Cinelli et al., 2020; Ferrara, 2020; Gallotti et al., 2020; Gao et al., 2020; Kleinberg et al., 2020; Pennycook et al., 2020; Schild et al., 2…”
BackgroundMardani, A., Saraji, M. K., Mishra, A. R., et al. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106613 · Cited by 166 · see citing works
Gozzi, N., Tizzani, M., Starnini, M., Ciulla, F., Paolotti, D., Panisson, A., & Perra, N. (2020) · Journal of Medical Internet Research · doi:10.2196/21597 · Cited by 166 · see citing works
What types of COVID-19 conspiracies are populated by Twitter bots?
Ferrara, E. (2020) · First Monday · doi:10.5210/fm.v25i6.10633 · Cited by 223 · see citing works
Infodemics: a new challenge for public health
Briand, S. C., Cinelli, M., Nguyen, T., Lewis, R., Prybylski, D., Valensise, C. M., Colizza, V., Tozzi, A. E., Perra, N., Baronchelli, A., et al. (2021) · Cell · doi:10.1016/j.cell.2021.10.031 · Cited by 125 · see citing works
“At the same time, the ongoing revisions of evidence and an overabundant and changing information landscape may induce confusion for policy-makers and civil society (Gallotti et al., 2020; Tangcharoensathien et al., 2020).”
Artificial intelligence cooperation to support the global response to COVID-19
Luengo-Oroz, M. A., Pham, K. H., Aylett-Bullock, J., Kirkpatrick, R., Luccioni, A. S., Rubel, S., Wachholz, C., Chakchouk, M., Biggs, P., Nguyen, T., et al. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0184-3 · Cited by 133 · see citing works
Kisa, S., & Kisa, A. (2024) · Journal of Medical Internet Research · doi:10.2196/56931 · Cited by 132 · see citing works
“The study by Gallotti et al [33] also highlighted the differentiated roles of verified and unverified users on social media in propagating COVID-19–related information.”
InfluentialSocial media trust: Fighting misinformation in the time of crisis
Shahbazi, M., & Bunker, D. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102780 · Cited by 126 · see citing works
Sentiment analysis and topic modeling for COVID-19 vaccine discussions
Yin, H., Song, X., Yang, S., & Li, J. (2022) · World Wide Web · doi:10.1007/s11280-022-01029-y · Cited by 125 · see citing works
“[20] noticed that infodemic spread rapidly and widely through social media platforms during the pandemic.”
BackgroundLink, E. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102714 · Cited by 110 · see citing works
Statistical inference links data and theory in network science
Peel, L., Peixoto, T. P., & Domenico, M. D. (2022) · Nature Communications · doi:10.1038/s41467-022-34267-9 · Cited by 108 · see citing works
“…infrastructures 12,13 to communication systems 14,15 ) and social (from socio-technical relationships 16 – 19 to animal interactions 20,21 ) systems, enhancing our understanding of emergent phenomena in society 22,23 , life 24 – 26 and disease 27 – 29 , as well as their combination 30 – 35 .”
BackgroundSelf-citationRussian propaganda on social media during the 2022 invasion of Ukraine
Geissler, D., Bär, D., Pröllochs, N., & Feuerriegel, S. (2023) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00414-5 · Cited by 136 · see citing works
“Here, it may be likely that counter-measures from fake news mitigation can be adapted [50, 51]; yet this requires further research to establish the effectiveness of such interventions.”
BackgroundUyheng, J., & Carley, K. M. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-020-00087-4 · Cited by 96 · see citing works
“To enforce reasonable comparability between the datasets, hashtags which were not geographically specific to either the US or the Philippines were not included, such as #Wuhanvirus, #Chinavirus, and #coronavirus, which related studies have otherwise used [36, 89].”
MethodPrevalence of Low-Credibility Information on Twitter During the COVID-19 OutbreakPreprint
Yang, K.-C., Torres-Lugo, C., & Menczer, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14484 · Cited by 94 · see citing works
“All rights reserved. behaviors of inauthentic actors (Gallotti et al. 2020; Ferrara 2020).”
BackgroundSu, Z., Cheshmehzangi, A., McDonnell, D., et al. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.839433 · Cited by 94 · see citing works
Ruffo, G., Semeraro, A., Giachanou, A., & Rosso, P. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100531 · Cited by 110 · see citing works
Salvi, C., Iannello, P., Cancer, A., McClay, M., Rago, S., Dunsmoor, J. E., & Antonietti, A. (2021) · Frontiers in Communication · doi:10.3389/fcomm.2020.562588 · Cited by 93 · see citing works
“Recent studies on the impact of misinformation during the COVID19 pandemic highlight how unreliable and inflammatory information (Gallotti et al., 2020) may have threatened public health in several countries by altering individuals’ perception of risk behaviors (Oh et al.”
BackgroundWang, X., Fan, C., Yu, G., & Zhang, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107174 · Cited by 94 · see citing works
Shi, W., Liu, D., Yang, J., Zhang, J., Wen, S., & Su, J. Y. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228701 · Cited by 92 · see citing works
“It has been well acknowledged that in the outbreak, non-human accounts contributed to social media infodemics [23,66,67], yet bots’ involvement in public sentiments during the pandemic remains unclear.”
BackgroundCompeting spreading dynamics in simplicial complex
Wen-yao, L., Xue, X., Pan, L., Lin, T., & Wang, W. (2021) · Applied Mathematics and Computation · doi:10.1016/j.amc.2021.126595 · Cited by 93 · see citing works
“[8] Riccardo Gallotti, Francesco Valle, Nicola Castaldo, Pierluigi Sacco, and Manlio De Domenico.”
BackgroundCountering misinformation: A multidisciplinary approach
Gradoń, K., Hołyst, J. A., Moy, W. R., Sienkiewicz, J., & Suchecki, K. (2021) · Big Data & Society · doi:10.1177/20539517211013848 · Cited by 87 · see citing works
“As Gallotti et al. (2020) noted on the verge of the global pandemic emergency, human communication is largely characterized by the production of informational noise and misleading or false information.”
BackgroundGarcía-Marín, D. (2020) · El Profesional de la Informacion · doi:10.3145/epi.2020.jul.11 · Cited by 86 · see citing works
Social Media for Public Health: Framework for Social Media–Based Public Health Campaigns
Hunt, I. D. V., & Linos, E. (2022) · Journal of Medical Internet Research · doi:10.2196/42179 · Cited by 87 · see citing works
“The extent to which social media facilitates dissemination of misinformation was exemplified by infodemics—defined by the World Health Organization as an overabundance of both inaccurate and accurate information—during the COVID-19 pandemic [20,21].”
Racism is a Virus: Anti-Asian Hate and Counterhate in Social Media during the COVID-19 CrisisPreprint
Ziems, C., He, B., Soni, S., & Kumar, S. (2020) · arXiv (Cornell University) · Cited by 81 · see citing works
Vijaykumar, S., Jin, Y., Rogerson, D., Lu, X., Sharma, S., Maughan, A. D., Fadel, B., de Oliveira-Costa, M. S., Pagliari, C., & Morris, D. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00752-7 · Cited by 79 · see citing works
Papadopoulou, L., & Maniou, T. A. (2021) · Digital Journalism · doi:10.1080/21670811.2021.1945472 · Cited by 74 · see citing works
Cheng, M., Wang, S., Yan, X., Yang, T., Wang, W., Zehao, H., Xiao, X., Nazarian, S., & Bogdan, P. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.644801 · Cited by 75 · see citing works
One Year of COVID-19 Vaccine Misinformation on Twitter: Longitudinal Study
Pierri, F., Deverna, M. R., Yang, K.-C., Axelrod, D., Bryden, J., & Menczer, F. (2022) · Journal of Medical Internet Research · doi:10.2196/42227 · Cited by 82 · see citing works
“However, our aggregate analysis could not disentangle the infodemic trends and peaks associated with different countries as observed in prior work [29].”
Hybrid ensemble framework with self-attention mechanism for social spam detection on imbalanced data
Rao, S., Verma, A. K., & Bhatia, T. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119594 · Cited by 71 · see citing works
García-Saisó, S., Martí, M., Brooks, I. S., et al. (2021) · Revista Panamericana de Salud Pública · doi:10.26633/rpsp.2021.56 · Cited by 67 · see citing works
#COVID-19 on Twitter: Bots, Conspiracies, and Social Media Activism
Ferrara, E. (2020) · Europe PMC (PubMed Central) · Cited by 63 · see citing works
#lockdown: Network-Enhanced Emotional Profiling in the Time of COVID-19
Stella, M., Restocchi, V., & Deyne, S. D. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4020014 · Cited by 60 · see citing works
Martínez, A. A., Torres, M. J. F., & Fernández, L. R. (2022) · Revista Latina de Comunicación Social · doi:10.4185/rlcs-2022-1538 · Cited by 64 · see citing works
Coordination patterns reveal online political astroturfing across the world
Schoch, D., Keller, F. B., Stier, S., & Yang, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-08404-9 · Cited by 64 · see citing works
Sustained online amplification of COVID-19 elites in the United States
Gallagher, R. J., Doroshenko, L., Shugars, S., Lazer, D., & Foucault Welles, B. (2021) · Social Media + Society · doi:10.1177/20563051211024957 · Cited by 80 · see citing works
“However, media outlets vary widely in their commitment and ability to sharing high-quality, accurate information, and the World Health Organization and other experts have warned of an “infodemic which has plagued the COVID-19 pandemic (W.H.O. 2020; Donovan 2020; Gallotti et al. 2020).”
BackgroundBotha, N. N., Segbedzi, C. E., Dumahasi, V. K., Maneen, S., Kodom, R. V., Tsedze, I. S., Akoto, L. A., Atsu, F. S., Lasim, O. U., & Ansah, E. W. (2024) · Archives of Public Health · doi:10.1186/s13690-024-01414-1 · Cited by 75 · see citing works
Vertical social distancing policy is ineffective to contain the COVID-19 pandemic
Duczmal, L. H., Almeida, A. C. L., Duczmal, D. B., et al. (2020) · Cadernos de Saúde Pública · doi:10.1590/0102-311x00084420 · Cited by 58 · see citing works
Adebesin, F., Smuts, H., Mawela, T., Maramba, G., & Hattingh, M. (2023) · JMIR Infodemiology · doi:10.2196/48620 · Cited by 57 · see citing works
“24 Nature Human Behaviour 205 Assessing the Risks of “Infodemics” in Response to COVID19 Epidemics Gallotti et al [50], 2020”
Causal Modeling of Twitter Activity during COVID-19
Gencoglu, O., & Gruber, M. (2020) · Computation · doi:10.3390/computation8040085 · Cited by 54 · see citing works
Moral Emotions Shape the Virality of COVID-19 Misinformation on Social Media
Solovev, K., & Pröllochs, N. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512266 · Cited by 63 · see citing works
“On the other hand, however, this crisis has bred a multitude of rumors [24, 26, 33, 36, 45], and verdicts of reputable fact-checking organizations (e.”
BackgroundFlow of online misinformation during the peak of the COVID-19 pandemic in Italy
Caldarelli, G., Nicola, R. D., Petrocchi, M., Pratelli, M., & Saracco, F. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00289-4 · Cited by 54 · see citing works
Vijaykumar, S., McNeill, A., & Simpson, J. (2021) · Public Health Nutrition · doi:10.1017/s1368980021000124 · Cited by 55 · see citing works
“The public concern about CNI, as evidenced by these examples, is problematic when the current context is considered: the UK faces an obesity crisis and therefore requires the majority of the population to make critical dietary choices; and social media, the most preferred source of nutrition information, is now rife w…”
BackgroundCollective emotions during the COVID-19 outbreak.
Metzler, H., Rimé, B., Pellert, M., Niederkrotenthaler, T., Natale, A. D., & García, D. (2022) · Emotion · doi:10.1037/emo0001111 · Cited by 52 · see citing works
A multilayer network model of the coevolution of the spread of a disease and competing opinions
Peng, K., Zheng, L., Lin, V., Lindstrom, M. R., Parkinson, C., Wang, C., Bertozzi, A. L., & Porter, M. A. (2021) · Mathematical Models and Methods in Applied Sciences · doi:10.1142/s0218202521500536 · Cited by 58 · see citing works
“On the other hand, social media also allows the pervasive spread of misinformation and disinformation, leading to so-called infodemics, which refer to epidemics of information.(27,73) Distortion and inaccurate information can impair people’s mental and physical health,(63) trigger anxiety and distrust, and ultimately…”
BackgroundBayesian Graph Local Extrema Convolution with Long-tail Strategy for Misinformation Detection
Zhang, G., Zhang, S., & Yuan, G. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3639408 · Cited by 57 · see citing works
“[15].”
Community notes increase trust in fact-checking on social media
Drolsbach, C., Solovev, K., & Pröllochs, N. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae217 · Cited by 59 · see citing works
Two Stage Transformer Model for COVID-19 Fake News Detection and Fact CheckingPreprint
Vijjali, R., Potluri, P., Kumar, S., & Teki, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13253 · Cited by 84 · see citing works
“In (Gallotti et al., 2020), the authors develop an Infodemic Risk Index (IRI) after analyzing Twitter posts”
BackgroundShams, A. B., Apu, E. H., Rahman, A., Raihan, M. M. S., Siddika, N., Preo, R. B., Hussein, M. R., Mostari, S., & Kabir, R. (2021) · Healthcare · doi:10.3390/healthcare9020156 · Cited by 54 · see citing works
“7 million tweets on COVID-19 streaming past every day [13].”
BackgroundInformation disorders during the COVID-19 infodemic: The case of Italian Facebook
Guarino, S., Pierri, F., Giovanni, M. D., & Celestini, A. (2021) · Online Social Networks and Media · doi:10.1016/j.osnem.2021.100124 · Cited by 54 · see citing works
Cruickshank, I. J., & Carley, K. M. (2020) · Applied Network Science · doi:10.1007/s41109-020-00317-8 · Cited by 51 · see citing works
“This is because good information is a key enabler to combat the effects of the pandemic whereas misinformation can exacerbate its effects (Hussain 2020; Gallotti et al. 2020).”
BackgroundCharacterizing network dynamics of online hate communities around the COVID-19 pandemic
Uyheng, J., & Carley, K. M. (2021) · Applied Network Science · doi:10.1007/s41109-021-00362-x · Cited by 52 · see citing works
Living with COVID-19-triggered pseudoscience and conspiracies
Desta, T. T., & Mulugeta, T. (2020) · International Journal of Public Health · doi:10.1007/s00038-020-01412-4 · Cited by 51 · see citing works
Luo, H., Meng, X., Zhao, Y., & Cai, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107733 · Cited by 52 · see citing works
“In addition, considering that the data used in this study were related to the COVID-19 epidemic, the number of daily confirmed cases was also included in the analysis as a control variable to reduce the possible influence of environmental factors (Gallotti et al., 2020).”
BackgroundMethodHow older adults manage misinformation and information overload - A qualitative study
Vivion, M., Reid, V., Dubé, È., Coutant, A., Benoit, A., & Tourigny, A. (2024) · BMC Public Health · doi:10.1186/s12889-024-18335-x · Cited by 55 · see citing works
“Information overload has essentially been studied in relation to the issues of misinformation and disinformation, rather than as a separate phenomenon [4, 5].”
BackgroundKumar, V., Singh, D., Kaur, M., & Damaševičius, R. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.564 · Cited by 50 · see citing works
“Gallotti et al. (2020) explored the social media tweets posted on Twitter.”
BackgroundAzithromycin consumption during the COVID-19 pandemic in Croatia, 2020
Bogdanić, N., Močibob, L., Vidović, T., Soldo, A., & Begovać, J. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263437 · Cited by 50 · see citing works
“analyzed Twitter messages posted from January to March 2020, and found an increase in potentially unreliable information in those early stages of the COVID-19 pandemic [8].”
BackgroundBots Amplify and Redirect Hate Speech in Online Discourse About Racism During the COVID-19 Pandemic
Uyheng, J., Bellutta, D., & Carley, K. M. (2022) · Social Media + Society · doi:10.1177/20563051221104749 · Cited by 47 · see citing works
“These issues play out in important ways in cyberspace, where “infodemics” have spread alongside COVID-19 outbreaks in the offline world (Gallotti et al., 2020).”
BackgroundThe role of social media in public health crises caused by infectious disease: a scoping review
Terry, K., Yang, F. H., Yao, Q., & Liu, C. (2023) · BMJ Global Health · doi:10.1136/bmjgh-2023-013515 · Cited by 48 · see citing works
“Therefore, maintaining a balance between the collection and use of public health information and the protection of citizens’ privacy has always been an important ethical and legal challenge for public health agencies and those studying these topics.”
BackgroundKestilä‐Kekkonen, E., Koivula, A., & Tiihonen, A. (2022) · European Political Science Review · doi:10.1017/s1755773922000224 · Cited by 44 · see citing works
“Having said that, citizens’ perspective of the ‘knowledge’ about the virus itself, the disease it causes, and prevention of and recovery from the disease are multidimensional and contradictory (Gallotti et al., 2020; Naeem and Bhatti, 2020).”
BackgroundDark Web Marketplaces and COVID-19: before the vaccine
Bracci, A., Nadini, M., Aliapoulios, M., McCoy, D., Gray, I., Teytelboym, A., Gallo, A., & Baronchelli, A. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00259-w · Cited by 52 · see citing works
Castioni, P., Andrighetto, G., Gallotti, R., di Sorrentino, E. P., & Domenico, M. D. (2022) · Royal Society Open Science · doi:10.1098/rsos.220716 · Cited by 43 · see citing works
“, refusing vaccines or not adopting non-pharmaceutical interventions, such as wearing masks and physical distancing) [13] that substantially increase epidemic spread [8, 14, 15].”
BackgroundMethodSelf-citationTsoy, D., Godinić, D., Tong, Q., Obrenovic, B., Khudaykulov, A., & Kurpayanidi, K. I. (2022) · Sustainability · doi:10.3390/su14127192 · Cited by 45 · see citing works
A multi-information epidemic spreading model on a two-layer network
Li, D., Xie, W., Han, D., et al. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119723 · Cited by 43 · see citing works
Misinformation and Hate Speech: The Case of Anti-Asian Hate Speech During the COVID-19 Pandemic
Kim, J. Y., & Kesari, A. (2021) · Journal of Online Trust and Safety · doi:10.54501/jots.v1i1.13 · Cited by 45 · see citing works
“Although the work on misinformation (e.g., Swire-Thompson and Lazer 2019; Jerit and Zhao 2020; Gallotti et al. 2020; Kouzy et al. 2020) and hate speech has been conducted in isolation (e.g., Howard 2019; Coates 2020), we argue that in practice, these two forms of online speech are interwoven.”
BackgroundLoubere, L., Kasparian, S., & Ashkar, F. (2018) · Les cahiers du journalisme · doi:10.31188/cajsm · Cited by 42 · see citing works
Health Misinformation on Social Media: A Systematic Literature Review and Future Research Directions
Li, Y., Marga, J. J., Cheung, C. M. K., Shen, X., & Lee, M. (2022) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00164 · Cited by 43 · see citing works
Vaccination passports: Challenges for a future of air transportation
Sun, X., Wandelt, S., & Zhang, A. (2021) · Transport Policy · doi:10.1016/j.tranpol.2021.06.018 · Cited by 41 · see citing works
“…argument for such counter-intuitive behaviour is that COVID-19 has put a magnifying glass on the fact that we are living in the age of infodemics (Gallotti et al., 2020), where few people or organizations intentionally spread fake news and false scientific claims, mostly under exploitation of…”
BackgroundMEGA: Machine Learning-Enhanced Graph Analytics for Infodemic Risk Management
Hang, C. N., Yu, P.-D., Chen, S., Tan, C. W., & Chen, G. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3314632 · Cited by 42 · see citing works
“For instance, the authors in [6] introduced the Infodemic Risk Index (IRI) to evaluate the likelihood of an infodemic occurrence in various nations.”
BackgroundMethodInfluentialRetractedSystematic Literature Review of Social Media Bots Detection Systems
Ellaky, Z., Benabbou, F., & Ouahabi, S. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.04.004 · Cited by 38 · see citing works
Shapiro, J. T., Víquez‐R, L., Leopardi, S., Vicente‐Santos, A., Mendenhall, I. H., Frick, W. F., Kading, R. C., Medellín, R. A., Racey, P. A., & Kingston, T. (2021) · Viruses · doi:10.3390/v13071356 · Cited by 38 · see citing works
“The public and policy-makers are generally not reading academic journals, but getting information from sound bites, videos, and interviews disseminated via traditional news outlets and social media [207–209], both of which can spread misinformation [210,211].”
BackgroundCognitive underpinnings of COVID-19 vaccine hesitancy
Acar-Burkay, S., & Cristian, D. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114911 · Cited by 38 · see citing works
Xu, C. L., & Yan, W. (2022) · Current Psychology · doi:10.1007/s12144-022-03289-3 · Cited by 42 · see citing works
“This is not only because of the epidemic itself, but also because of the overwhelming information given during the epidemic (Catedrilla et al., 2020; Gallotti et al., 2020; Patel et al., 2020; Patwa et al., 2021).”
BackgroundDesinformación anticientífica sobre la COVID-19 difundida en Twitter en Hispanoamérica
García-Marín, D., & Merino-Ortego, M. (2022) · Cuadernos info · doi:10.7764/cdi.52.42795 · Cited by 37 · see citing works
Public health challenges and opportunities after COVID-19
Sacco, P. L., & Domenico, M. D. (2021) · Bulletin of the World Health Organization · doi:10.2471/blt.20.267757 · Cited by 35 · see citing works
“At the same time, fringe but very vocal social circles such as groups opposed to vaccination and more generally believers in conspiracy theories have lost momentum in the broader public opinion.(21) However, not all changes have been for the good.”
BackgroundSelf-citationLu, X., Vijaykumar, S., Jin, Y., & Rogerson, D. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101750 · Cited by 38 · see citing works
When Do Parties Lie? Misinformation and Radical-Right Populism Across 26 Countries
Törnberg, P., & Chueri, J. (2025) · The International Journal of Press/Politics · doi:10.1177/19401612241311886 · Cited by 44 · see citing works
“MBFC offers the largest dataset covering biased and low factual news sources, and has been widely used to identify misinformation shared on social media (e.g., Baly et al., 2018; Gallotti et al., 2020; Sharma et al., 2020).”
Ding, X., Shang, B., Xie, C., Xin, J., & Yu, F. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04564-x · Cited by 40 · see citing works
“On February 2, 2020, the World Health Organization (WHO) highlighted the “ infodemic ” as a parallel crisis to the pandemic and a signi fi cant barrier to effective public health responses (Gallotti et al. 2020; Naeem and Bhatti 2020; World Health Organization 2020).”
Bashaddadh, O. M. A., Omar, N., Mohd, M., & Khalid, M. N. A. (2025) · IEEE Access · doi:10.1109/access.2025.3572051 · Cited by 36 · see citing works
“Studies have also demonstrated a substantial increase in research efforts related to fake news detection and the development of detection systems during this period [63], [64].”
Characterizing the roles of bots on Twitter during the COVID-19 infodemic
Xu, W., & Sasahara, K. (2021) · Journal of Computational Social Science · doi:10.1007/s42001-021-00139-3 · Cited by 36 · see citing works
“Research about the COVID-19 infodemic has discovered the information flow pathways between humans and bots [14].”
BackgroundChen, E., Jiang, J., Chang, H.-C. H., Murić, G., & Ferrara, E. (2021) · JMIR Infodemiology · doi:10.2196/32378 · Cited by 35 · see citing works
“While the intensity of its effects varies based on country and culture, infodemics was and continues to be a salient issue in COVID-19 discourse [4,5].”
Studying the COVID-19 infodemic at scale
Gruzd, A. A., Domenico, M. D., Sacco, P. L., & Briand, S. C. (2021) · Big Data & Society · doi:10.1177/20539517211021115 · Cited by 36 · see citing works
Self-citationPierri, F., Luceri, L., Chen, E., & Ferrara, E. (2022) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00420-7 · Cited by 33 · see citing works
“An “infodemic” of misleading and inaccurate information became particularly worrisome during the COVID-19 pandemic (Cinelli et al. 2020b; Gallotti et al. 2020; Yang et al. 2021; Chen et al. 2022).”
Background
- Authors
- Gallotti, R., Valle, F., Castaldo, N., Sacco, P., & De Domenico, M.
- Affiliations
- Fondazione Bruno Kessler (IT)
- Venue
- Nature Human Behaviour
- Published
- 2020-10-29
- Volume
- 4
- Issue
- 12
- Pages
- 1285-1293
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W3015622078
- Cited by
- 591
- References
- 61
- Citations by year
- 2026: 39 · 2025: 69 · 2024: 80 · 2023: 90 · 2022: 129 · 2021: 137 · 2020: 46 · 2018: 1
- FWCI
- 134.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion, public-domain)
- medRxiv (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Padua Research Archive (University of Padova) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Communication › Communication and COVID-19 Impact
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Keywords
- infodemic, COVID-19 pandemic, misinformation, Twitter, news reliability, early warning indicators, epidemic spread, misinformation mitigation, public health communication, social media
- MeSH terms
- COVID-19, Humans, Mass Media, Models, Theoretical, Risk Assessment, Consumer Health Information, Social Networking, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review