Technologically scaffolded atypical cognition: the case of YouTube’s recommender system
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
YouTube has been implicated in the transformation of users into extremists and conspiracy theorists. The alleged mechanism for this radicalizing process is YouTube’s recommender system, which is optimized to amplify and promote clips that users are likely to watch through to the end. YouTube optimizes for watch-through for economic reasons: people who watch a video through to the end are likely to then watch the next recommended video as well, which means that more advertisements can be served to them. This is a seemingly innocuous design choice, but it has a troubling side-effect. Critics of YouTube have alleged that the recommender system tends to recommend extremist content and conspiracy theories, as such videos are especially likely to capture and keep users’ attention. To date, the problem of radicalization via the YouTube recommender system has been a matter of speculation. The current study represents the first systematic, pre-registered attempt to establish whether and to what extent the recommender system tends to promote such content. We begin by contextualizing our study in the framework of technological seduction. Next, we explain our methodology. After that, we present our results, which are consistent with the radicalization hypothesis. Finally, we discuss our findings, as well as directions for future research and recommendations for users, industry, and policy-makers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Attitudinal Effects of Mere Exposure
Zajonc, R. B. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0025848 · Cited by 6,745 · cited 1×
“As far back as Zajonc (1968), psychologists have investigated the mere familiarity effect .”
BackgroundReasoning the fast and frugal way: Models of bounded rationality.
Gigerenzer, G., & Goldstein, D. G. (1996) · Psychological Review · doi:10.1037/0033-295x.103.4.650 · Cited by 3,504
SPERBER, D., CLÉMENT, F., HEINTZ, C., MASCARO, O., MERCIER, H., ORIGGI, G., & WILSON, D. (2010) · Mind & Language · doi:10.1111/j.1468-0017.2010.01394.x · Cited by 1,795
The Effects of Anti-Vaccine Conspiracy Theories on Vaccination Intentions
Jolley, D., & Douglas, K. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089177 · Cited by 1,232
Lacking control increases illusory pattern perception
Whitson, J. A., & Galinsky, A. D. (2008) · Science · doi:10.1126/science.1159845 · Cited by 1,119
ECHO CHAMBERS AND EPISTEMIC BUBBLES
Nguyen, C. T. (2020) · Episteme · doi:10.1017/epi.2018.32 · Cited by 1,115
Goertzel, T. (1994) · Political Psychology · doi:10.2307/3791630 · Cited by 1,094 · cited 1×
“…accounts have emphasized the link between conspiracy theories and perceived powerlessness (Abalakina-Paap et al. 1999; Whitson and Galinsky 2008), lack of trust in authority (Swami et al. 2010), and the active desire to display defiance towards established norms and institutions (Goertzel 1994).”
BackgroundConspiracy theories: Causes and cures
Sunstein, C. R., & Vermeule, A. (2009) · Journal of Political Philosophy · doi:10.1111/j.1467-9760.2008.00325.x · Cited by 1,050
The Role of Conspiracist Ideation and Worldviews in Predicting Rejection of Science
Lewandowsky, S., Gignac, G. E., & Oberauer, K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075637 · Cited by 693
Cited by
Psychological inoculation improves resilience against misinformation on social media
Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022) · Science Advances · doi:10.1126/sciadv.abo6254 · Cited by 472
“( 43 ) find that YouTube’s recommender system tends to recommend extremist content by so-called “gurus,” who regularly make use of manipulation techniques such as those addressed in the videos from studies 1 to 6.”
Examining the consumption of radical content on YouTube
Hosseinmardi, H., Ghasemian, A., Clauset, A., Mobius, M., Rothschild, D. M., & Watts, D. J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101967118 · Cited by 171
Misunderstanding the harms of online misinformation
Budak, C., Nyhan, B., Rothschild, D. M., Thorson, E., & Watts, D. J. (2024) · Nature · doi:10.1038/s41586-024-07417-w · Cited by 156
Are Anti-Feminist Communities Gateways to the Far Right? Evidence from Reddit and YouTube
Mamié, R., Horta Ribeiro, M., & West, R. (2021) · 13th ACM Web Science Conference 2021 · doi:10.1145/3447535.3462504 · Cited by 75
Inoculating against the spread of Islamophobic and radical-Islamist disinformation
Lewandowsky, S., & Yesilada, M. (2021) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-021-00323-z · Cited by 62
Metadata
- Authors
- Alfano, M., Fard, A. E., Carter, J. A., Clutton, P., & Klein, C.
- Venue
- Synthese
- Published
- 2020-06-09
- Volume
- 199
- Issue
- 1-2
- Pages
- 835-858
- ISSN
- 0039-7857 (ISSN-L)
- 1573-0964
- OpenAlex
- W3034691823
- Cited by
- 107
- References
- 18
- FWCI
- 16.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Technologically scaffolded atypical cognition: the case of YouTube’s recommender system. https://app.cochat.ai/papers/10.1007/s11229-020-02724-x
- The paper
- Alfano, M., Fard, A. E., Carter, J. A., Clutton, P., & Klein, C. (2021). Technologically scaffolded atypical cognition: the case of YouTube’s recommender system. Synthese. https://doi.org/10.1007/s11229-020-02724-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.