Disturbed YouTube for Kids: Characterizing and Detecting Inappropriate Videos Targeting Young Children
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
A large number of the most-subscribed YouTube channels target children of very young age. Hundreds of toddler-oriented channels on YouTube feature inoffensive, well produced, and educational videos. Unfortunately, inappropriate content that targets this demographic is also common. YouTube's algorithmic recommendation system regrettably suggests inappropriate content because some of it mimics or is derived from otherwise appropriate content. Considering the risk for early childhood development, and an increasing trend in toddler's consumption of YouTube media, this is a worrisome problem. In this work, we build a classifier able to discern inappropriate content that targets toddlers on YouTube with 84.3% accuracy, and leverage it to perform a large-scale, quantitative characterization that reveals some of the risks of YouTube media consumption by young children. Our analysis reveals that YouTube is still plagued by such disturbing videos and its currently deployed counter-measures are ineffective in terms of detecting them in a timely manner. Alarmingly, using our classifier we show that young children are not only able, but likely to encounter disturbing videos when they randomly browse the platform starting from benign videos.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · cited 1×
“After obtaining all the annotations, we compute the Fleiss agreement score ( κ ) [17] across all annotators: we find κ = 0 .”
Deep Neural Networks for YouTube Recommendations
Covington, P., Adams, J., & Sargin, E. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959190 · Cited by 3,539
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“For thumbnails, due to the limited number of training examples in our dataset, we use transfer learning [24] and the pre-trained Inception-v3 Convolutional Neural Network (CNN) [33], which is built from the large-scale ImageNet dataset.”
Method
Cited by
From Moral Panic to Systemic Change: Making Child-Centered Design the Default
Radesky, J., & Hiniker, A. (2022) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2021.100351 · Cited by 44
“And recommender systems respond to users’ interests by promoting increasingly extreme and radicalized versions of these interests [27, 28], including recommending disturbing content to young children [29].”
BackgroundNagata, J. M., Chu, J., Ganson, K. T., Murray, S. B., Iyer, P., Gabriel, K. P., Garber, A. K., Bibbins‐Domingo, K., & Baker, F. C. (2023) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13673 · Cited by 39
Designing Child-Safe Conversational AI: Three Dilemmas for Responsible Design
Kurian, N. (2025) · Proceedings of the 7th ACM Conference on Conversational User Interfaces · doi:10.1145/3719160.3737638 · Cited by 9
A Privacy-Preserving Architecture for the Protection of Adolescents in Online Social Networks
Charalambous, M., Papagiannis, P., Papasavva, A., Leonidou, P., Constaninou, R., Terzidou, L., Christophides, T., Nicolaou, P., Theofanis, O., Kalatzantonakis, G., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.12038 · Cited by 4
Self-citation
Metadata
- Authors
- Papadamou, K., Papasavva, A., Zannettou, S., Blackburn, J., Kourtellis, N., Leontiadis, I., Stringhini, G., & Sirivianos, M.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2020-05-26
- Volume
- 14
- Pages
- 522-533
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W3037745950
- Cited by
- 128
- References
- 5
- FWCI
- 6.25
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Disturbed YouTube for Kids: Characterizing and Detecting Inappropriate Videos Targeting Young Children. https://app.cochat.ai/papers/10.1609/icwsm.v14i1.7320
- The paper
- Papadamou, K., Papasavva, A., Zannettou, S., Blackburn, J., Kourtellis, N., Leontiadis, I., Stringhini, G., & Sirivianos, M. (2020). Disturbed YouTube for Kids: Characterizing and Detecting Inappropriate Videos Targeting Young Children. Proceedings of the International AAAI Conference on Web and Social Media. https://doi.org/10.1609/icwsm.v14i1.7320
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.