What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
Open accessAbstract
Whereas much of the success of the current generation of neural language models has been driven by increasingly large training corpora, relatively little research has been dedicated to analyzing these massive sources of textual data. In this exploratory analysis, we delve deeper into the Common Crawl, a colossal web corpus that is extensively used for training language models. We find that it contains a significant amount of undesirable content, including hate speech and sexually explicit content, even after filtering procedures. We discuss the potential impacts of this content on language models and conclude with future research directions and a more mindful approach to corpus collection and analysis.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Very recent research has begun to analyze dataset values, question assumptions around dataset use, unpack what is represented in ML datasets, and establish basics of how an organized dataset lifecycle might proceed.
“Very recent research - most published within the last year - has begun to analyze dataset values [18, 40], question assumptions around dataset use [100], unpack what is represented in ML datasets [43, 88, 124] and establish basics of how an organized dataset lifecycle might proceed [74].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 3× · see citing works
“It will also be important to evaluate whether curation is sufficient: it remains possible that a model could create an undesirable generation from multiple distinct innocuous examples (Bender et al., 2021; Gehman et al., 2020).”
BackgroundSemantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · see citing works
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610 · see citing works
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484 · see citing works
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · see citing works
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264 · see citing works
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240 · see citing works
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Talat, Z., & Hovy, D. (2016) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n16-2013 · Cited by 1,919 · see citing works
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · Cited by 1,749 · see citing works
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · see citing works
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A. G., & Wiegand, M. (2017) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/w17-1101 · Cited by 1,447 · see citing works
Massanari, A. (2017) · New Media & Society · doi:10.1177/1461444815608807 · Cited by 1,264 · see citing works
Deep Learning for Hate Speech Detection in Tweets
Badjatiya, P., Gupta, S., Gupta, M., & Varma, V. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054223 · Cited by 1,243 · see citing works
A Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241 · see citing works
SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter
Basile, V., Bosco, C., Fersini, E., Nozza, D., Patti, V., Pardo, F. M. R., Rosso, P., & Sanguinetti, M. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2007 · Cited by 889 · see citing works
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · cited 1× · see citing works
“…high quality and safe neural language models will likely require the community to adopt more mindful data collection practices (Gehman et al., 2020; Bender and Friedman, 2018; Gebru et al., 2018; Jo and Gebru, 2020; Paullada et al., 2020; Bender et al., 2021), establish standardized filtering…”
BackgroundA large annotated corpus for learning natural language inferencePreprint
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.05326 · Cited by 732 · see citing works
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727 · see citing works
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
Gehman, S., Gururangan, S., Sap, M., Choi, Y., & Smith, N. A. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.301 · Cited by 693 · see citing works
StereoSet: Measuring stereotypical bias in pretrained language models
Nadeem, M., Bethke, A., & Reddy, S. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.416 · Cited by 643 · see citing works
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548 · cited 1× · see citing works
“…community to adopt more mindful data collection practices (Gehman et al., 2020; Bender and Friedman, 2018; Gebru et al., 2018; Jo and Gebru, 2020; Paullada et al., 2020; Bender et al., 2021), establish standardized filtering pipelines for corpora (Roziewski and Stokowiec, 2016; Ortiz Suarez et…”
BackgroundPersistent Anti-Muslim Bias in Large Language Models
Abid, A., Farooqi, M., & Zou, J. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462624 · Cited by 476 · see citing works
Detection of Depression-Related Posts in Reddit Social Media Forum
Tadesse, M. M., Lin, H., Xu, B., & Yang, L. (2019) · IEEE Access · doi:10.1109/access.2019.2909180 · Cited by 466 · see citing works
On Measuring Social Biases in Sentence Encoders
May, C., Wang, A., Bordia, S., Bowman, S. R., & Rudinger, R. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1063 · Cited by 461 · see citing works
Learning Gender-Neutral Word Embeddings
Zhao, J., Zhou, Y., Li, Z., Wang, W., & Chang, K.-W. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1521 · Cited by 376 · see citing works
CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataPreprint
Wenzek, G., Lachaux, M.-A., Conneau, A., Chaudhary, V., Guzmán, F., Joulin, A., & Grave, É. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00359 · Cited by 362 · see citing works
Directions in abusive language training data, a systematic review: Garbage in, garbage out
Vidgen, B., & Derczynski, L. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243300 · Cited by 335 · see citing works
Release Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · see citing works
Manzini, T., Chong, L. Y., Black, A. W., & Tsvetkov, Y. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1062 · Cited by 284 · see citing works
Social Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.487 · Cited by 274 · see citing works
Exploring Misogyny across the Manosphere in Reddit
Farrell, T., Fernandez, M., Novotny, J., & Alani, H. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326045 · Cited by 265 · see citing works
Gonen, H., & Goldberg, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03862 · Cited by 242 · see citing works
Asynchronous pipelines for processing huge corpora on medium to low resource infrastructures
Suárez, P. O., Sagot, B., & Romary, L. (2019) · Publication Server of the Institute for German Language (Institute for German Language) · doi:10.14618/ids-pub-9021 · Cited by 235 · see citing works
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP
Schick, T., Udupa, S., & Schütze, H. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00434 · Cited by 227 · see citing works
Identifying and Reducing Gender Bias in Word-Level Language Models
Bordia, S., & Bowman, S. R. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop · doi:10.18653/v1/n19-3002 · Cited by 219 · see citing works
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00447 · Cited by 179 · see citing works
Why we should have seen that coming
Wolf, M. J., Miller, K., & Grodzinsky, F. S. (2017) · ACM SIGCAS Computers and Society · doi:10.1145/3144592.3144598 · Cited by 174 · see citing works
Deep Learning Models for Multilingual Hate Speech DetectionPreprint
Aluru, S. S., Mathew, B., Saha, P., & Mukherjee, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.06465 · Cited by 158 · see citing works
Wachs, S., Wright, M. F., & Vazsonyi, A. T. (2019) · Criminal Behaviour and Mental Health · doi:10.1002/cbm.2116 · Cited by 133 · see citing works
Adult content detection in videos with convolutional and recurrent neural networks
Wehrmann, J., Simões, G. S., Barros, R. C., & Cavalcante, V. F. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.07.012 · Cited by 114 · see citing works
Investigating Gender Bias in BERT
Bhardwaj, R., Majumder, N., & Poria, S. (2021) · Cognitive Computation · doi:10.1007/s12559-021-09881-2 · Cited by 112 · see citing works
Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine LearningPreprint
Jo, E. S., & Gebru, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10389 · Cited by 102 · see citing works
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training
Zhang, Y., Wang, G., Li, C., Gan, Z., Brockett, C., & Dolan, B. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.698 · Cited by 94 · see citing works
LARGE SCALE IMAGE-BASED ADULT-CONTENT FILTERING
Rowley, H. A., Jing, Y., & Baluja, S. (2006) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0001377002900296 · Cited by 91 · see citing works
Tackling Online Abuse: A Survey of Automated Abuse Detection MethodsPreprint
Mishra, P., Yannakoudakis, H., & Shutova, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06024 · Cited by 74 · see citing works
Web page classification: a survey of perspectives, gaps, and future directions
Hashemi, M. (2020) · Multimedia tools and applications · doi:10.1007/s11042-019-08373-8 · Cited by 72 · see citing works
Statistical and structural approaches to filtering Internet pornography
Ho, W. H., & Watters, P. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1401289 · Cited by 60 · see citing works
A Transparent Framework for Evaluating Unintended Demographic Bias in Word Embeddings
Sweeney, C., & Najafian, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1162 · Cited by 58 · see citing works
Putting Humans in the Natural Language Processing Loop: A SurveyPreprint
Wang, Z. J., Choi, D., Xu, S., & Yang, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04044 · Cited by 54 · see citing works
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A.-M., Djouvas, C., Chatzakou, D., Ilias Leontiadis, A., Blackburn, J., Stringhini, G., Vakali, A. I., Sirivianos, M., & Kourtellis, N. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1443347 · Cited by 54 · see citing works
WebGuard: Web based adult content detection and filtering system
Hammami, M., Chahir, Y., & Chen, L. (2004) · doi:10.1109/wi.2003.1241271 · Cited by 51 · see citing works
Fritz, N., Malic, V., Paul, B., & Zhou, Y. (2020) · Gender Issues · doi:10.1007/s12147-020-09255-2 · Cited by 47 · see citing works
Hube, C. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3053375 · Cited by 39 · see citing works
Examining Gender and Race Bias in Two Hundred Sentiment Analysis SystemsPreprint
Kiritchenko, S., & Mohammad, S. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04508 · Cited by 37 · see citing works
Gender Bias in Contextualized Word EmbeddingsPreprint
Zhao, J., Wang, T., Yatskar, M., Cotterell, R., Ordóñez, V., & Chang, K.-W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.03310 · Cited by 33 · see citing works
Hate begets Hate: A Temporal Study of Hate SpeechPreprint
Mathew, B., Illendula, A., Saha, P., Sarkar, S., Goyal, P., & Mukherjee, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10966 · Cited by 29 · see citing works
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative ModelsPreprint
Engel, J., Hoffman, M. D., & Roberts, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05772 · Cited by 22 · see citing works
Pornography and Sexual Violence
Foubert, J. D., Blanchard, W., Houston, M., & Williams, R. R. (2019) · Springer eBooks · doi:10.1007/978-3-030-23645-8_7 · Cited by 22 · see citing works
POINTER: Constrained Text Generation via Insertion-based Generative Pre-trainingPreprint
Zhang, Y., Wang, G., Li, C., Gan, Z., Brockett, C., & Dolan, B. (2020) · arXiv (Cornell University) · Cited by 21 · see citing works
Identifying Sensitive URLs at Web-Scale
Matic, S., Iordanou, C., Smaragdakis, G., & Nikolaos Laoutaris, B. (2020) · ACM Internet Measurement Conference (IMC) · doi:10.1145/3419394.3423653 · Cited by 19 · see citing works
Content-Based Text Classifiers for Pornographic Web Filtering
Polpinij, J., Chotthanom, A., Sibunruang, C., Chamchong, R., & Puangpronpitag, S. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2006.384926 · Cited by 16 · see citing works
LanguageCrawl: A Generic Tool for Building Language Models Upon Common-Crawl
Roziewski, S., & Kozłowski, M. (2016) · Language Resources and Evaluation · doi:10.1007/s10579-021-09551-7 · Cited by 14 · see citing works
Analysis of Representation of Sexuality on Women's and Men's Pornographic Websites
Shim, J. W., Kwon, M., & Cheng, H.-I. (2015) · Social Behavior and Personality An International Journal · doi:10.2224/sbp.2015.43.1.53 · Cited by 13 · see citing works
The Woman Worked as a Babysitter: On Biases in Language GenerationPreprint
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.01326 · Cited by 9 · see citing works
Characterizing (Un)moderated Textual Data in Social Systems
Lima, L., Reis, J. C. S., Melo, P., Murai, F., & Benevenuto, F. (2020) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam49781.2020.9381327 · Cited by 9 · see citing works
Exploratory Analysis of a Terabyte Scale Web CorpusPreprint
Kolias, V., Anagnostopoulos, I. E., & Kayafas, E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5443 · Cited by 7 · see citing works
Temporal effects of Unmoderated Hate speech in Gab.Preprint
Mathew, B., Illendula, A., Saha, P., Sarkar, S., Goyal, P., & Mukherjee, A. (2019) · arXiv (Cornell University) · Cited by 6 · see citing works
On the Unintended Social Bias of Training Language Generation Models with Data from Local MediaPreprint
Florez, O. U. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00461 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Grave, E., Bojanowski, P., Gupta, P., Joulin, A., and Mikolov, T. (2018). Learning word vectors for 157 languages. arXiv preprint arXiv:1802.06893 . · arXiv
- Polpinij, J., Chotthanom, A., Sibunruang, C., Chamchong, R., and Puangpronpitag, S. (2006). Contentbased text classifiers for pornographic web filtering. In 2006 IEEE International Conference on Systems, Man and Cybernetics , volume 2, pages 1481-1485. IEEE.
- Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog , 1(8):9.
- Vidgen, B. and Derczynski, L. (2020). Directions in abusive language training data: Garbage in, garbage out. arXiv preprint arXiv:2004.01670 . · arXiv
Cited by
Sorted by citations
Casheekar, A. M., Lahiri, A., Rath, K., Prabhakar, K. S., & Srinivasan, K. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100632 · Cited by 236 · see citing works
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00447 · Cited by 179 · see citing works
Multimodal datasets: misogyny, pornography, and malignant stereotypes
Birhane, A., Prabhu, V. U., & Kahembwe, E. (2021) · arXiv · doi:10.48550/arxiv.2110.01963 · Cited by 160 · see citing works
Beyond Discrimination: Generative AI Applications and Ethical Challenges in Forensic Psychiatry
Tortora, L. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1346059 · Cited by 72 · see citing works
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Laurençon, H., Saulnier, L., Wang, T., Akiki, C., del Moral, A. V., Scao, T. L., Von Werra, L., Mou, C., Ponferrada, E. G., Nguyen, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.03915 · Cited by 61 · see citing works
Self-citationThe Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems
Ziems, C., Yu, J., Wang, Y., Halevy, A. Y., & Yang, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.261 · Cited by 73 · see citing works
A Critical Analysis of the Largest Source for Generative AI Training Data: Common Crawl
Baack, S. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659033 · Cited by 52 · see citing works
Data Governance in the Age of Large-Scale Data-Driven Language Technology
Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534637 · Cited by 45 · see citing works
Self-citationPLACES: Prompting Language Models for Social Conversation Synthesis
Chen, M., Papangelis, A., Tao, C., Kim, S., Rosenbaum, A., Liu, Y., Zhou, Y., & Hakkani-Tür, D. Z. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.63 · Cited by 31 · see citing works
Handling and Presenting Harmful Text in NLP Research
Kirk, H. R., Birhane, A., Vidgen, B., & Derczynski, L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.35 · Cited by 36 · see citing works
The value of books in the age of generative AI training data
Rowberry, S. P. (2025) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565251358020 · Cited by 5 · see citing works
Drivers of Trust in Generative AI-powered Voice Assistants: The Role of References
Widjaya, M. A., Bermúdez, J. P., Moradbakhti, L., & Calvo, R. A. (2023) · Electronic workshops in computing · doi:10.14236/ewic/bcshci2023.13 · Cited by 4 · see citing works
Dobinson, T., Chen, J., & Steele, C. (2024) · Australian Review of Applied Linguistics · doi:10.1075/aral.24146.dob · Cited by 4 · see citing works
The Problem of Zombie Datasets: A Framework For Deprecating Datasets.
Corry, F., Sridharan, H., Luccioni, A. S., Ananny, M., Schultz, J., & Crawford, K. (2021) · Cited by 2 · see citing works
Self-citationFalbo, A., & LaCroix, T. (2022) · Feminist Philosophy Quarterly · doi:10.5206/fpq/2022.3/4.14264 · Cited by 10 · see citing works
Rechtmässigkeit von Open Source-Ermittlungen durch Strafverfolgungsbehörden
Simmler, M., & Canova, G. (2024) · Risiko & Recht · doi:10.36862/eiz-rr202401-03
Liu, J., Li, Y., Wang, N., Sun, Y. N., Wang, T., Hu, Y., Chen, H., & Gong, X. (2025) · Energy · doi:10.1016/j.energy.2025.138190
- Authors
- Luccioni, A. S., & Viviano, J. D.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2105.02732
- OpenAlex
- W3169705981
- Cited by
- 17
- References
- 71
- Citations by year
- 2025: 2 · 2024: 6 · 2023: 3 · 2022: 4 · 2021: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- Common Crawl, web corpus, hate speech, sexually explicit material, training data quality, corpus filtering, neural language models, training data bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
