Online Hate: Is Hate an Infectious Disease? Is Social Media a Promoter?
Open accessAbstract
Our time is marked by a resurgence of hate that threatens to increase oppression. Social media has contributed to this by acting as a medium through which hate speech is spread. How should we model the spread of hate? This article considers two models. First, I consider a simple contagion model. In this model, hate spreads like a virus through a social network. This model, however, fails to capture the fact that people do not acquire hatred from a single infectious contact. Instead, it builds up in a person's beliefs and attitudes through time until the infection reaches a level where the subject themselves becomes a generator of hate speech. Second, to accommodate this, I consider an alternative model known as complex contagion. I argue that not only is a complex contagion model more explanatory and predictive, but it can be used to explain why certain features of social media cause it to be a promoter of hate. I conclude by sketching some mitigation strategies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Policing creates a self-reinforcing feedback loop: higher status is achieved within the group by strong adherence to the norms, and positive reinforcement for hateful expression and negative reward for adherence to nonhateful norms creates an arms race in which community members are incentivised to become more extreme.
“[P]olicing creates a self-reinforcing feedback loop. Higher status is achieved within the group by strong adherence to the norms, and in turn, positive reinforcement for hateful expression - and negative reward for adherence to nonhateful or less hateful norms - creates an arms race in which community members are incentivised to become more extreme. [15, 11]”
From Exploring incel group dynamics: a computational study of hierarchy and group-boundary policing (2025) · cites this paper as [15]
Community norms foster extreme content and harshly punish any opposition to the blackpill ideology.
“The community norms foster extreme content and harshly punish any opposition to the blackpill ideology.”
From Exploring incel group dynamics: a computational study of hierarchy and group-boundary policing (2025) · cites this paper as [15]
Cites
Social psychology of intergroup relations
Tajfel, H. (1982) · Annual Review of Psychology · doi:10.1146/annurev.ps.33.020182.000245 · Cited by 7,949 · see citing works
Threshold models of collective behavior
Granovetter, M. (1978) · American Journal of Sociology · doi:10.1086/226707 · Cited by 6,072 · see citing works
The online disinhibition effect
Suler, J. (2004) · CyberPsychology & Behavior · doi:10.1089/1094931041291295 · Cited by 4,375 · see citing works
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · see citing works
Spread of epidemic disease on networks.
Newman, M. (2002) · Physical review. E, Statistical, nonlinear, and soft matter physics · doi:10.1103/physreve.66.016128 · Cited by 3,179 · see citing works
What Makes Online Content Viral?
Berger, J., & Milkman, K. L. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0353 · Cited by 3,178 · see citing works
The Tipping Point: How Little Things Can Make a Big Difference
Meadows-Klue, D. (2004) · Interactive Marketing · doi:10.1057/palgrave.im.4340262 · Cited by 3,064 · see citing works
Making it explicit : reasoning, representing, and discursive commitment
Brandom, R. B. (1994) · Proceedings and Addresses of the American Philosophical Association · Cited by 2,632 · see citing works
Complex Contagions and the Weakness of Long Ties
Centola, D., & Macy, M. (2007) · American Journal of Sociology · doi:10.1086/521848 · Cited by 1,878 · see citing works
Emotion shapes the diffusion of moralized content in social networks
Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618923114 · Cited by 1,396 · see citing works
ECHO CHAMBERS AND EPISTEMIC BUBBLES
Nguyen, C. T. (2020) · Episteme · doi:10.1017/epi.2018.32 · Cited by 1,115 · see citing works
Waldron, J. (2012) · Harvard University Press eBooks · doi:10.4159/harvard.9780674065086 · Cited by 949 · see citing works
Information contagion: an empirical study of the spread of news on digg and twitter social networks
Lerman, K., & Ghosh, R. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14021 · Cited by 813 · see citing works
Social Network Effects on the Extent of Innovation Diffusion: A Computer Simulation
Abrahamson, E., & Rosenkopf, L. (1997) · Organization Science · doi:10.1287/orsc.8.3.289 · Cited by 803 · see citing works
Down Girl: The Logic of Misogyny
Manne, K. (2017) · doi:10.1093/oso/9780190604981.001.0001 · Cited by 791 · see citing works
The online competition between pro- and anti-vaccination views
Johnson, N. F., Velásquez, N., Restrepo, N. J., Leahy, R., Gabriel, N., Oud, S. E., Zheng, M., Manrique, P. D., Wuchty, S., & Lupu, Y. (2020) · Nature · doi:10.1038/s41586-020-2281-1 · Cited by 704 · see citing works
Norms in the Wild: How to Diagnose, Measure, and Change Social Norms
Bicchieri, C. (2016) · Cited by 698 · see citing works
Fanning the Flames of Hate: Social Media and Hate CrimePreprint
Müller, K., & Schwarz, C. (2020) · Journal of the European Economic Association · doi:10.2139/ssrn.3082972 · Cited by 625 · see citing works
Moral outrage in the digital age
Crockett, M. J. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0213-3 · Cited by 618 · see citing works
Arousal Increases Social Transmission of Information
Berger, J. (2011) · Psychological Science · doi:10.1177/0956797611413294 · Cited by 600 · see citing works
Out-group animosity drives engagement on social media
Rathje, S., Van Bavel, J. J., & van der Linden, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024292118 · Cited by 560 · see citing works
Performative Force, Convention, and Discursive Injustice
Kukla, R. (2012) · Hypatia · doi:10.1111/j.1527-2001.2012.01316.x · Cited by 527 · see citing works
Citizens Versus the Internet: Confronting Digital Challenges With Cognitive Tools
Kozyreva, A., Lewandowsky, S., & Hertwig, R. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620946707 · Cited by 479 · see citing works
Echo chambers and viral misinformation: Modeling fake news as complex contagion
Törnberg, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203958 · Cited by 430 · see citing works
Stanley, J. (2015) · Princeton University Press eBooks · doi:10.1515/9781400865802 · Cited by 426 · see citing works
Misconceptions, Misinformation, and the Logic of Identity-Protective Cognition
Kahan, D. M. (2017) · doi:10.2139/ssrn.2973067 · Cited by 423 · see citing works
You Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech
Chandrasekharan, E., Pavalanathan, U., Srinivasan, A., Glynn, A., Eisenstein, J., & Gilbert, E. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134666 · Cited by 390 · see citing works
Quattrociocchi, W., Scala, A., & Sunstein, C. R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2795110 · Cited by 389 · see citing works
Some Reflections on Language Games
Sellars, W. (1954) · Philosophy of Science · doi:10.1086/287344 · Cited by 382 · see citing works
Cascade dynamics of complex propagation
Centola, D. M., Eguı́luz, V. M., & Macy, M. W. (2006) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2006.06.018 · Cited by 361 · see citing works
The Simple Rules of Social Contagion
Hodas, N. O., & Lerman, K. (2014) · Scientific Reports · doi:10.1038/srep04343 · Cited by 317 · see citing works
Cascading Behavior in Networks: Algorithmic and Economic Issues
Kleinberg, J. M. (2007) · Algorithmic Game Theory · doi:10.1017/cbo9780511800481.026 · Cited by 288 · see citing works
What is hate speech? Part 1: The Myth of Hate
Brown, A. (2017) · Law and Philosophy · doi:10.1007/s10982-017-9297-1 · Cited by 246 · see citing works
Anger Is More Influential than Joy: Sentiment Correlation in Weibo
Fan, R., Zhao, J., Chen, Y., & Xu, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110184 · Cited by 244 · see citing works
What is so special about online (as compared to offline) hate speech?
Brown, A. (2018) · Ethnicities · doi:10.1177/1468796817709846 · Cited by 232 · see citing works
O’Connor, C., & Weatherall, J. O. (2018) · Yale University Press eBooks · doi:10.2307/j.ctv8jp0hk · Cited by 230 · see citing works
Howard, J. W. (2019) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051517-012343 · Cited by 224 · see citing works
Greijdanus, H., Fernandes, C. A. D. M., Turner-Zwinkels, F. M., Honari, A., Roos, C. A., Rosenbusch, H., & Postmes, T. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.03.003 · Cited by 206 · see citing works
Speech and harm: controversies over free speech
Oberdiek, H. (2013) · Choice Reviews Online · doi:10.5860/choice.50-3207 · Cited by 205 · see citing works
Censorship and Silencing: Practices of Cultural Regulation
Post, R. C. (1999) · Bulletin of the American Academy of Arts and Sciences · doi:10.2307/3824123 · Cited by 194 · see citing works
McGowan, M. K. (2019) · doi:10.1093/oso/9780198829706.001.0001 · Cited by 190 · see citing works
Maitra, I. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199236282.003.0005 · Cited by 182 · see citing works
Complex Contagions: A Decade in Review
Guilbeault, D., Becker, J., & Centola, D. (2017) · arXiv.org · doi:10.1007/978-3-319-77332-2_1 · Cited by 179 · see citing works
Blocking information on COVID-19 can fuel the spread of misinformation
Larson, H. J. (2020) · Nature · doi:10.1038/d41586-020-00920-w · Cited by 172 · see citing works
Stuck: How Vaccine Rumors Start—and Why They Don't Go Away
Reich, J. A. (2024) · Journal of Health Politics Policy and Law · doi:10.1215/03616878-11672667 · Cited by 169 · see citing works
Brown, A. (2015) · Routledge eBooks · doi:10.4324/9781315714899 · Cited by 142 · see citing works
On ‘Whites Only’ Signs and Racist Hate Speech: Verbal Acts of Racial Discrimination1
McGowan, M. K. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199236282.003.0006 · Cited by 126 · see citing works
Opinion polarization by learning from social feedback
Banisch, S., & Olbrich, E. (2018) · Journal of Mathematical Sociology · doi:10.1080/0022250x.2018.1517761 · Cited by 125 · see citing works
Sunstein, C. R. (2019) · The MIT Press eBooks · doi:10.7551/mitpress/11974.001.0001 · Cited by 122 · see citing works
How Twitter Gamifies Communication
Nguyen, C. T. (2021) · doi:10.1093/oso/9780198833659.003.0017 · Cited by 121 · see citing works
Group Identity, Social Influence, and Collective Action Online
Spears, R., & Postmes, T. (2015) · Wiley eBooks · doi:10.1002/9781118426456.ch2 · Cited by 119 · see citing works
Dangerous Speech and Dangerous Ideology: An Integrated Model for Monitoring and Prevention
Maynard, J. L., & Benesch, S. (2016) · Genocide Studies and Prevention · doi:10.5038/1911-9933.9.3.1317 · Cited by 116 · see citing works
Schöne, J. P., Parkinson, B., & Goldenberg, A. (2021) · Affective Science · doi:10.1007/s42761-021-00057-7 · Cited by 114 · see citing works
Popa‐Wyatt, M., & Wyatt, J. (2017) · Philosophical Studies · doi:10.1007/s11098-017-0986-2 · Cited by 113 · see citing works
Self-citationWhat is Hate Speech? Part 2: Family Resemblances
Brown, A. (2017) · Law and Philosophy · doi:10.1007/s10982-017-9300-x · Cited by 110 · see citing works
Opinion polarization by learning from social feedback
Banisch, S., & Olbrich, E. (2019) · MPG.PuRe (Max Planck Society) · Cited by 107 · see citing works
McGowan, M. K. (2008) · Australasian Journal of Philosophy · doi:10.1080/00048400802370334 · Cited by 97 · see citing works
Recursive patterns in online echo chambers
Brugnoli, E., Cinelli, M., Quattrociocchi, W., & Scala, A. (2019) · Scientific Reports · doi:10.1038/s41598-019-56191-7 · Cited by 95 · see citing works
Hate Speech on Social Media: Content Moderation in Context
Wilson, R. A., & Land, M. K. (2021) · OpenCommons at University of Connecticut (University of Connecticut) · Cited by 83 · see citing works
Matsuda, M., Lawrence, C. R., Delgado, R., et al. (2018) · Routledge eBooks · doi:10.4324/9780429502941 · Cited by 81 · see citing works
Retweeting: its linguistic and epistemic value
Marsili, N. (2020) · Synthese · doi:10.1007/s11229-020-02731-y · Cited by 80 · see citing works
Terror, Hate and the Demands of Counter-Speech
Howard, J. W. (2019) · British Journal of Political Science · doi:10.1017/s000712341900053x · Cited by 77 · see citing works
Parekh, B. (2006) · Public Policy Research · doi:10.1111/j.1070-3535.2005.00405.x · Cited by 75 · see citing works
Toxic Speech: Toward an Epidemiology of Discursive Harm
Tirrell, L. (2017) · Philosophical Topics · doi:10.5840/philtopics201745217 · Cited by 73 · see citing works
Differentiating hate speech: a systemic discrimination approach
Gelber, K. (2019) · Critical Review of International Social and Political Philosophy · doi:10.1080/13698230.2019.1576006 · Cited by 71 · see citing works
Information Is Not a Virus, and Other Consequences of Human Cognitive Limits
Lerman, K. (2016) · Future Internet · doi:10.3390/fi8020021 · Cited by 70 · see citing works
Countering Dangerous Speech: New Ideas for Genocide PreventionPreprint
Benesch, S. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.3686876 · Cited by 66 · see citing works
Conzo, P., Fuochi, G., Anfossi, L., Spaccatini, F., & Mosso, C. O. (2021) · Scientific Reports · doi:10.1038/s41598-021-95800-2 · Cited by 58 · see citing works
Howard, J. W. (2019) · Philosophy & Public Affairs · doi:10.1111/papa.12145 · Cited by 55 · see citing works
Maynard, J. L. (2022) · doi:10.1093/oso/9780198776796.001.0001 · Cited by 54 · see citing works
Toxic Speech: Inoculations and Antidotes
Tirrell, L. (2018) · The Southern Journal of Philosophy · doi:10.1111/sjp.12297 · Cited by 47 · see citing works
Can "More Speech" Counter Ignorant Speech?
Lepoutre, M. (2019) · Journal of Ethics and Social Philosophy · doi:10.26556/jesp.v16i3.682 · Cited by 47 · see citing works
Parlamis, J. D. (2012) · International Journal of Conflict Management · doi:10.1108/10444061211199322 · Cited by 46 · see citing works
McGowan, M. K. (2018) · Routledge eBooks · doi:10.4324/9781315181189-12 · Cited by 41 · see citing works
Caponetto, L., & Cepollaro, B. (2022) · Ethical Theory and Moral Practice · doi:10.1007/s10677-022-10334-4 · Cited by 41 · see citing works
Free Speech in the Digital Age
(2019) · doi:10.1093/oso/9780190883591.001.0001 · Cited by 35 · see citing works
Inciting Genocide, Pleading Free Speech
Benesch, S. (2004) · World Policy Journal · doi:10.1215/07402775-2004-3001 · Cited by 33 · see citing works
What’s Wrong with the Online Echo Chamber: A Motivated Reasoning Account
Avnur, Y. (2020) · Journal of Applied Philosophy · doi:10.1111/japp.12426 · Cited by 32 · see citing works
Is the Attention Economy Noxious
Castro, C., & Pham, A. (2020) · CaltechAUTHORS (California Institute of Technology) · Cited by 30 · see citing works
Hate Contagion: Measuring the spread and trajectory of hate on social mediaPreprint
Gallacher, J., & Bright, J. (2021) · doi:10.31234/osf.io/b9qhd · Cited by 23 · see citing works
Slur Creation, Bigotry Formation: the Power of Expressivism
Jeshion, R. (2017) · Phenomenology and Mind · doi:10.13128/phe_mi-20113 · Cited by 21 · see citing works
Discursive Epidemiology: Two Models
Tirrell, L. (2021) · Aristotelian Society Supplementary Volume · doi:10.1093/arisup/akab008 · Cited by 19 · see citing works
Hate Speech against Women Online
Richardson-Self, L. V. (2021) · Rowman & Littlefield Publishers eBooks · doi:10.5771/9781538147801 · Cited by 16 · see citing works
On Simulating the Propagation and Countermeasures of Hate Speech in Social Networks
López-Sánchez, M., & Müller, A. (2021) · Applied Sciences · doi:10.3390/app112412003 · Cited by 13 · see citing works
The rules of contagion: why things spread––and why they stop
Kevany, S. (2021) · International Affairs · doi:10.1093/ia/iiab054 · Cited by 8 · see citing works
Slurring Speech and Social Norms
Popa‐Wyatt, M. (2021) · Routledge eBooks · doi:10.4324/9781003047483-15 · Cited by 2 · see citing works
Self-citationA Distortion or ‘Our’ Default?
Mikkola, M. (2021) · Aristotelian Society Supplementary Volume · doi:10.1093/arisup/akab004 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Exploring incel group dynamics: a computational study of hierarchy and group-boundary policing
Solopova, V., Popa-Wyatt, M., & Berškytė, J. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-024-00357-5 · Cited by 6 · see citing works
“[15, 11] Community moderation on this platform often involves drawing the moderator’s attention to posts that violate community norms.”
Self-citation
- Authors
- Popa‐Wyatt, M.
- Affiliations
- University of Manchester (GB)
- Corresponding author
- Popa‐Wyatt, Mihaela
- ORCID
- Popa‐Wyatt, Mihaela
- Venue
- Journal of Applied Philosophy
- Publisher
- Wiley
- Published
- 2023-07-25
- Volume
- 40
- Issue
- 5
- Pages
- 788-812
- ISSN
- 0264-3758 (ISSN-L)
- 1468-5930
- OpenAlex
- W4385248532
- Cited by
- 17
- References
- 87
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 4
- FWCI
- 7.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Applied Philosophy (publishedVersion, cc-by)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Social Sciences › Communication › Social Media and Politics
- Keywords
- online hate, hate speech, social media, complex contagion, simple contagion, social networks, belief formation, oppression, mitigation measures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review