"How over is it?" Understanding the Incel Community on YouTube
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
YouTube is by far the largest host of user-generated video content worldwide. Alas, the platform has also come under fire for hosting inappropriate, toxic, and hateful content. One community that has often been linked to sharing and publishing hateful and misogynistic content are the Involuntary Celibates (Incels), a loosely defined movement ostensibly focusing on men's issues. In this paper, we set out to analyze the Incel community on YouTube by focusing on this community's evolution over the last decade and understanding whether YouTube's recommendation algorithm steers users towards Incel-related videos. We collect videos shared on Incel communities within Reddit and perform a data-driven characterization of the content posted on YouTube. Among other things, we find that the Incel community on YouTube is getting traction and that, during the last decade, the number of Incel-related videos and comments rose substantially. We also find that users have a 6.3% chance of being suggested an Incel-related video by YouTube's recommendation algorithm within five hops when starting from a non Incel-related video. Overall, our findings paint an alarming picture of online radicalization: not only Incel activity is increasing over time, but platforms may also play an active role in steering users towards such extreme content.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · cited 1×
“We also compute the Fleiss’ Kappa Score [26] to assess the agreement between the annotators, finding it to be 0 .”
MethodThe Kolmogorov-Smirnov Test for Goodness of Fit
Massey, F. J. (1951) · Journal of the American Statistical Association · doi:10.1080/01621459.1951.10500769 · Cited by 7,210
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
Deep Neural Networks for YouTube Recommendations
Covington, P., Adams, J., & Sargin, E. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959190 · Cited by 3,539
The echo chamber effect on social media
Cinelli, M., De Francisci Morales, G., Galeazzi, A., Quattrociocchi, W., & Starnini, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2023301118 · Cited by 2,092 · cited 2×
“This effect entails a viewer who begins to engage with this type of content and likely falls into an algorithmic rabbit hole, with recommendations becoming increasingly dominated by such harmful content and beliefs, which also becomes increasingly extreme [16, 53, 56, 65, 68].”
BackgroundResultFILTER BUBBLE: Wie wir im Internet entmündigt werden
Pariser, E. (2012) · doi:10.3139/9783446431164 · Cited by 1,849
The filter bubble: how the new personalized web is changing what we read and how we think
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0926 · Cited by 1,319
Massanari, A. (2017) · New Media & Society · doi:10.1177/1461444815608807 · Cited by 1,264 · cited 1×
“Massanari [48] performs a qualitative study of how Reddit’s algorithms, policies, and general community structure enables, and even supports, toxic culture.”
BackgroundBaumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881
Self-citationAuditing radicalization pathways on YouTube
Ribeiro, M. H., Ottoni, R., West, R., Almeida, V. A. F., & Meira, W. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372879 · Cited by 580
Assessing the Threat of Incel Violence
Hoffman, B., Ware, J., & Shapiro, E. (2020) · Studies in Conflict & Terrorism · doi:10.1080/1057610x.2020.1751459 · Cited by 408
You Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech
Chandrasekharan, E., Pavalanathan, U., Srinivasan, A., Glynn, A., Eisenstein, J., & Gilbert, E. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134666 · Cited by 390
Exploring Misogyny across the Manosphere in Reddit
Farrell, T., Fernandez, M., Novotny, J., & Alani, H. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326045 · Cited by 265 · cited 3×
“Guided by other studies using Reddit as a source for collecting and analyzing YouTube videos [60], and based on evidence suggesting that Incels are particularly active on Red-dit [23, 63], we build our dataset by collecting videos shared on Incel-related communities on Reddit.”
BackgroundMethodFrom “Incel” to “Saint”: Analyzing the violent worldview behind the 2018 Toronto attack
Baele, S. J., Brace, L., & Coan, T. G. (2021) · Terrorism and Political Violence · doi:10.1080/09546553.2019.1638256 · Cited by 244 · cited 2×
“[4] study content shared by members of the Incel community, focusing on how support and motivation for violence result from their worldview.”
BackgroundOnline hatred of women in the Incels.me forum: Linguistic analysis and automatic detection
Jaki, S., De Smedt, T., Gwóźdź, M., Panchal, R., Rossa, A., & De Pauw, G. (2019) · Journal of Language Aggression and Conflict · doi:10.1075/jlac.00026.jak · Cited by 226 · cited 2×
“Jaki et al. [38] study misogyny on the Incels.me forum, analyzing users’ language and detecting misogyny instances, homopho-bia, and racism using a deep learning classifier that achieves up to 95% accuracy.”
BackgroundMethodMESSNER, M. A. (1998) · Gender & Society · doi:10.1177/0891243298012003002 · Cited by 217 · cited 1×
“Although the Manosphere had roots in anti-feminism [24, 52], it is ultimately a reactionary community, with its ideology evolving and spreading mainly on the Web [28].”
BackgroundSexual Violence in the ‘Manosphere’: Antifeminist Men’s Rights Discourses on Rape
Gotell, L., & Dutton, E. (2016) · International Journal for Crime, Justice and Social Democracy · doi:10.5204/ijcjsd.v5i2.310 · Cited by 197 · cited 1×
“” Overall, research studying the Manosphere has been mostly theoretical and qualitative in nature [28, 30, 33, 43].”
Background
Cited by
Hadi Mogavi, R., Deng, C., Juho Kim, J., Zhou, P., D. Kwon, Y., Hosny Saleh Metwally, A., Tlili, A., Bassanelli, S., Bucchiarone, A., Gujar, S., et al. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100027 · Cited by 369
“I Think Most of Society Hates Us”: A Qualitative Thematic Analysis of Interviews with Incels
Daly, S. E., & Reed, S. M. (2022) · Sex Roles · doi:10.1007/s11199-021-01250-5 · Cited by 136
“This is a political movement, friend”: Why “incels” support violence
O'Donnell, C., & Shor, E. (2022) · The British Journal of Sociology · doi:10.1111/1468-4446.12923 · Cited by 105
Pedreschi, D., Pappalardo, L., Ferragina, E., Baeza-Yates, R., Barabási, A.-L., Dignum, F., Dignum, V., Eliassi-Rad, T., Giannotti, F., Kertész, J., et al. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2024.104244 · Cited by 102
“Examples include the analysis of Facebook users’ behaviour [81], Google Maps’ suggestions to drivers [82], data gathered from browser loggers [83, 84], platforms’ APIs [81, 85], bots that simulate human behaviour [86–88], and experiments that ask volunteers to behave in specific ways [89–92].”
Mainstreaming the Blackpill: Understanding the Incel Community on TikTok
Solea, A. I., & Sugiura, L. (2023) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-023-09559-5 · Cited by 105
Metadata
- Authors
- Papadamou, K., Zannettou, S., Blackburn, J., De Cristofaro, E., Stringhini, G., & Sirivianos, M.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-10-13
- Volume
- 5
- Issue
- CSCW2
- Pages
- 1-25
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3163205709
- Cited by
- 80
- References
- 17
- FWCI
- 4.41
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.