Combining interventions to reduce the spread of viral misinformation
Open accessPublished version of a preprint
Abstract
Misinformation online poses a range of threats, from subverting democratic processes to undermining public health measures. Proposed solutions range from encouraging more selective sharing by individuals to removing false content and accounts that create or promote it. Here we provide a framework to evaluate interventions aimed at reducing viral misinformation online both in isolation and when used in combination. We begin by deriving a generative model of viral misinformation spread, inspired by research on infectious disease. By applying this model to a large corpus (10.5 million tweets) of misinformation events that occurred during the 2020 US election, we reveal that commonly proposed interventions are unlikely to be effective in isolation. However, our framework demonstrates that a combined approach can achieve a substantial reduction in the prevalence of misinformation. Our results highlight a practical path forward as misinformation online continues to threaten vaccination efforts, equity and democratic processes around the globe.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
<i>Stan</i> : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754 · see citing works
Complex Contagions and the Weakness of Long Ties
Centola, D., & Macy, M. (2007) · American Journal of Sociology · doi:10.1086/521848 · Cited by 1,878 · see citing works
Emotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,396 · see citing works
Shifting attention to accuracy can reduce misinformation online
Pennycook, G., Epstein, Z., Mosleh, M., Arechar, A. A., Eckles, D., & Rand, D. G. (2021) · Nature · doi:10.1038/s41586-021-03344-2 · Cited by 1,155 · see citing works
Fighting misinformation on social media using crowdsourced judgments of news source quality
Pennycook, G., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806781116 · Cited by 947 · cited 1× · see citing works
“1), (3) the fit did not contain divergent transitions and (4) the event lasted longer than an hour (that is, >12 data points to fit).”
BackgroundMay, R. M., Levin, S. A., & Sugihara, G. (2008) · Nature · doi:10.1038/451893a · Cited by 797 · see citing works
Prediction and explanation in social systems
Hofman, J. M., Sharma, A., & Watts, D. J. (2017) · Science · doi:10.1126/science.aal3856 · Cited by 429 · see citing works
Poison If You Don’t Know How to Use It: Facebook, Democracy, and Human Rights in Myanmar
Whitten-Woodring, J., Kleinberg, M. S., Thawnghmung, A., & Thitsar, M. T. (2020) · The International Journal of Press/Politics · doi:10.1177/1940161220919666 · Cited by 77 · see citing works
Flagged first, then by citations
Research works printed but not linked: 18
- [5]Lazer DMJ The science of fake news Science 2018 359 1094 1096 10.1126/science.aao2998 29590025 · DOI · Paper page
- [6]Velásquez, N. et al. Online hate network spreads malicious COVID-19 content outside the control of individual social media platforms. Sci. Rep.10.1038/s41598-021-89467-y (2021). PMC8206165 34131158 · DOI
- [7]Pennycook, G. & Rand, D. G. Research note: examining false beliefs about voter fraud in the wake of the 2020 presidential election. Harv. Kennedy Sch. Misinformation Rev.10.37016/mr-2020-51 (2021). · DOI
- [8]Huszár, F. et al. Algorithmic amplification of politics on Twitter. Proc. Natl Acad. Sci. USA10.1073/pnas.2025334119 (2022). PMC8740571 34934011
- [9]Sanderson, Z., Brown, M. A., Bonneau, R., Nagler, J. & Tucker, J. A. Twitter flagged Donald Trump’s tweets with election misinformation: they continued to spread both on and off the platform. Harv. Kennedy Sch. Misinformation Rev.10.37016/MR-2020-77 (2021). · DOI
- [10]Bak-Coleman JB Stewardship of global collective behavior Proc. Natl Acad. Sci. USA 2021 118 2025764118 10.1073/pnas.2025764118 PMC8271675 34155097 · DOI · Paper page
- [12]Bakshy, E., Mason, W. A., Hofman, J. M. & Watts, D. J. Everyone’s an influencer: quantifying influence on Twitter. In Proc. 4th ACM International Conference on Web Search and Data Mining, WSDM 2011 65–74 (ACM Press, 2011); 10.1145/1935826.1935845 · DOI · Paper page
- [14]Lloyd-Smith JO Schreiber SJ Kopp PE Getz WM Superspreading and the effect of individual variation on disease emergence Nature 2005 438 355 359 10.1038/nature04153 16292310 PMC7094981 · DOI · Paper page
- [15]Levin S Social–ecological systems as complex adaptive systems: modeling and policy implications Environ. Dev. Econ. 2013 18 111 132 10.1017/S1355770X12000460 · DOI
- [18]Bakshy, E., Rosenn, I., Marlow, C. & Adamic, L. The role of social networks in information diffusion. In WWW ’12—Proc. 21st Annual Conference on World Wide Web 519–528 (ACM Press, 2012); 10.1145/2187836.2187907 · DOI · Paper page
- [19]Kimura, M. & Saito, K. Tractable models for information diffusion in social networks. In Proc. 10th European Conference on Principles and Practice of Knowledge Discovery in Databases (eds Fürnkranz, J. et al.) 259–271 (Springer, 2006); 10.1007/11871637 · DOI
- [21]Lerman K Information is not a virus, and other consequences of human cognitive limits Future Internet 2016 8 21 10.3390/fi8020021 · DOI
- [22]Juul, J. L. & Ugander, J. Comparing information diffusion mechanisms by matching on cascade size. Proc. Natl Acad. Sci. USA10.1073/pnas.2100786118 (2021). PMC8609637 34750252
- [23]Wang L Wood BC An epidemiological approach to model the viral propagation of memes Appl. Math. Model. 2011 35 5442 5447 10.1016/j.apm.2011.04.035 · DOI
- [24]Martin, T., Hofman, J. M., Sharma, A., Anderson, A. & Watts, D. J. Exploring limits to prediction in complex social systems. In Proc. 25th International World Wide Web Conference, WWW 2016 683–694 (International World Wide Web Conferences Steering Committee, 2016); 10.1145/2872427.2883001 · DOI
- [25]Arif, A. et al. How information snowballs: exploring the role of exposure in online rumor propagation. In Proc. ACM Conference on Computer Supported Cooperative Work, CSCW Vol. 27, 466–477 (Association for Computing Machinery, 2016); 10.1145/2818048.2819964 · DOI
- [26]Butts CT Revisiting the foundations of network analysis Science 2009 325 414 416 10.1126/science.1171022 19628855 · DOI
- [30]Saunois, M., Jackson, R. B., Bousquet, P., Poulter, B. & Canadell, J. G. The growing role of methane in anthropogenic climate change. Environ. Res. Lett.10.1088/1748-9326/11/12/120207 (2016). · DOI
Cited by
Sorted by citations
Pennycook, G., & Rand, D. G. (2022) · Nature Communications · doi:10.1038/s41467-022-30073-5 · Cited by 270 · see citing works
Social Drivers and Algorithmic Mechanisms on Digital Media.
Metzler, H., & Garcia, D. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231185057 · Cited by 204 · see citing works
“They could highlight overlap between opposed groups (Bail, 2021), prioritize news a user actually wants to see (Rathje et al., 2022), or simply limit how far fake news spreads (Bak-Coleman et al., 2022).”
BackgroundWang, X., Zhang, M., Fan, W., & Zhao, K. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24576 · Cited by 67 · see citing works
RETRACTED: Debiasing misinformation: how do people diagnose health recommendations from AI?
Shin, D., Jitkajornwanich, K., Lim, J. S., & Spyridou, A. (2024) · Online Information Review · doi:10.1108/oir-04-2023-0167 · Cited by 32 · see citing works
Retracted
- Authors
- Bak-Coleman, J. B., Kennedy, I., Wack, M., Beers, A., Schafer, J. S., Spiro, E. S., Starbird, K., & West, J. D.
- Affiliations
- University of Washington (US)
- Corresponding author
- Bak-Coleman, Joseph B.
- ORCID
- Venue
- Nature Human Behaviour
- Published
- 2022-06-23
- Volume
- 6
- Issue
- 10
- Pages
- 1372-1380
- ISSN
- 2397-3374 (ISSN-L)
- PMC
- PMC9584817
- OpenAlex
- W4283325287
- Cited by
- 145
- References
- 8
- Citations by year
- 2026: 22 · 2025: 35 · 2024: 43 · 2023: 33 · 2022: 11 · 2021: 1
- FWCI
- 44.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Nature Human Behaviour (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- John S. and James L. Knight Foundation
- National Science Foundation (2027792)
- Craig Newmark Philanthropies
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Social Sciences › Communication › Social Media and Politics
- Keywords
- viral misinformation, misinformation spread, intervention evaluation, combined intervention, epidemic modeling, Twitter, 2020 US presidential election, selective sharing
- MeSH terms
- Communication, Humans, Politics, Public Health, Vaccination, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review