The DOI matches its Crossref record; 167 of the 167 references it cites were found in a registry or an index.
Directions in abusive language training data, a systematic review: Garbage in, garbage out
Open accessAbstract
Data-driven and machine learning based approaches for detecting, categorising and measuring abusive content such as hate speech and harassment have gained traction due to their scalability, robustness and increasingly high performance. Making effective detection systems for abusive content relies on having the right training datasets, reflecting a widely accepted mantra in computer science: Garbage In, Garbage Out. However, creating training datasets which are large, varied, theoretically-informed and that minimize biases is difficult, laborious and requires deep expertise. This paper systematically reviews 63 publicly available training datasets which have been created to train abusive language classifiers. It also reports on creation of a dedicated website for cataloguing abusive language data hatespeechdata.com. We discuss the challenges and opportunities of open science in this field, and argue that although more dataset sharing would bring many benefits it also poses social and ethical risks which need careful consideration. Finally, we provide evidence-based recommendations for practitioners creating new abusive content training datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 1×
“Traditional qualitative methods cannot scale to handle the hundreds of millions of posts which appear on each major social media platform every day, and introduce various inconsistencies and biases [8].”
BackgroundAutomated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Google Scholar, Scopus and the Web of Science: A Longitudinal and Cross-Disciplinary Comparison
Harzing, A.-W., & Alakangas, S. (2016) · Scientometrics · doi:10.1007/s11192-015-1798-9 · Cited by 1,784
The digital divide shifts to differences in usage
van Deursen, A. J., & van Dijk, J. A. (2014) · New Media & Society · doi:10.1177/1461444813487959 · Cited by 1,733 · cited 1×
“Social science research indicates that ‘digital divides’ exist, whereby online users are not representative of wider populations and may vary between different online spaces [84, 87, 88].”
BackgroundQuantifying publication bias in meta-analysis
Lin, L., & Chu, H. (2018) · Biometrics · doi:10.1111/biom.12817 · Cited by 1,674
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
Çömlekçi, M. F. (2019) · Kırklareli University Institutional Repository (Kırklareli University) · Cited by 1,607
Online social networks: Why do students use facebook?
Cheung, C. M. K., Chiu, P.-Y., & Lee, M. K. O. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2010.07.028 · Cited by 1,501
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w17-1101 · Cited by 1,395
A Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241
Mariani, J. (2018) · HAL · Cited by 1,151
Abusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122
Gorwa, R., Binns, R., & Katzenbach, C. (2020) · Big Data & Society · doi:10.1177/2053951719897945 · Cited by 1,097
Buckels, E. E., Trapnell, P. D., & Paulhus, D. L. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.01.016 · Cited by 919
Hostile and Benevolent Sexism: Measuring Ambivalent Sexist Attitudes Toward Women
Glick, P., & Fiske, S. T. (1997) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.1997.tb00104.x · Cited by 905
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · cited 7×
“To provide structure to how we analyse the datasets, we partly adopt the ‘data statements’ framework put forward by Bender and Friedman [48], as well as other work that provides frameworks, schema and processes for analysing NLP artefacts [49–51].”
BackgroundMethodInfluentialThe Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817
Gillespie, T. (2019) · doi:10.12987/9780300235029 · Cited by 806
Amazon Mechanical Turk: Gold Mine or Coal Mine?
Fort, K., Adda, G., & Cohen, K. B. (2011) · Computational Linguistics · doi:10.1162/coli_a_00057 · Cited by 761
Language-agnostic BERT Sentence Embedding
Feng, F., Yang, Y., Cer, D., Arivazhagan, N., & Wang, W. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.62 · Cited by 758
Predicting the Type and Target of Offensive Posts in Social Media
Zampieri, M., Malmasi, S., Nakov, P., Rosenthal, S., Farra, N., & Kumar, R. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1144 · Cited by 720
SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)
Zampieri, M., Malmasi, S., Nakov, P., Rosenthal, S., Farra, N., & Kumar, R. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2010 · Cited by 701
Metamorphic Testing: A Review of Challenges and Opportunities
Chen, T. Y., Kuo, F.-C., Liu, H., Poon, P.-L., Towey, D., Tse, T. H., & Zhou, Z. Q. (2019) · ACM Computing Surveys · doi:10.1145/3143561 · Cited by 665
Ex Machina: Personal Attacks Seen at Scale
Wulczyn, E., Thain, N., & Dixon, L. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052591 · Cited by 636
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., Stringhini, G., Vakali, A., Sirivianos, M., & Kourtellis, N. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.14991 · Cited by 596
Detecting Hate Speech on the World Wide Web
Warner, W. B., & Hirschberg, J. (2012) · Cited by 586
Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter
Waseem, Z. (2016) · Proceedings of the First Workshop on NLP and Computational Social Science · doi:10.18653/v1/w16-5618 · Cited by 569
“Participant” Perceptions of Twitter Research Ethics
Fiesler, C., & Proferes, N. (2018) · Social Media + Society · doi:10.1177/2056305118763366 · Cited by 528
Gillespie, T. (2018) · Cited by 511
Myers West, S. (2018) · New Media & Society · doi:10.1177/1461444818773059 · Cited by 477
Understanding Abuse: A Typology of Abusive Language Detection Subtasks
Waseem, Z., Davidson, T., Warmsley, D., & Weber, I. (2017) · Proceedings of the First Workshop on Abusive Language Online · doi:10.18653/v1/w17-3012 · Cited by 474
Benchmarking Aggression Identification in Social Media.
Kumar, R., Ojha, A. K., Malmasi, S., & Zampieri, M. (2018) · International Conference on Computational Linguistics · Cited by 474
Content moderation, AI, and the question of scale
Gillespie, T. (2020) · Big Data & Society · doi:10.1177/2053951720943234 · Cited by 437
Hate Speech Dataset from a White Supremacy Forum
de Gibert, O., Perez, N., García-Pablos, A., & Cuadros, M. (2018) · Proceedings of the 2nd Workshop on Abusive Language Online (ALW2) · doi:10.18653/v1/w18-5102 · Cited by 425
Williams, M. L., Burnap, P., & Sloan, L. (2017) · Sociology · doi:10.1177/0038038517708140 · Cited by 423
Racial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414
Us and them: identifying cyber hate on Twitter across multiple protected characteristics
Burnap, P., & Williams, M. L. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0072-6 · Cited by 396
Mellon, J., & Prosser, C. (2017) · Research & Politics · doi:10.1177/2053168017720008 · Cited by 396
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Proceedings of the Fourteenth Workshop on Semantic Evaluation · doi:10.18653/v1/2020.semeval-1.188 · Cited by 378
Self-citationMean Birds: Detecting Aggression and Bullying on Twitter
Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., & Vakali, A. (2017) · Proceedings of the 2017 ACM on Web Science Conference · doi:10.1145/3091478.3091487 · Cited by 369
Business Process Variability Modeling: A Survey
Rosa, M. L., Aalst, W. M. P. V. D., Dumas, M., & Milani, F. P. (2018) · ACM Computing Surveys · doi:10.1145/3041957 · Cited by 358
Hate speech review in the context of online social networks
Chetty, N., & Alathur, S. (2018) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.05.003 · Cited by 357
The hateful memes challenge: Detecting hate speech in multimodal memes
Kiela, D., Firooz, H., Mohan, A., Goswami, V., Singh, A., Ringshia, P., & Testuggine, D. (2020) · arXiv · doi:10.48550/arxiv.2005.04790 · Cited by 352
Who cares about Sarcastic Tweets? Investigating the Impact of Sarcasm on Sentiment Analysis.
Maynard, D., & Greenwood, M. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ios4bdd5xas · Cited by 349
Spread of Hate Speech in Online Social Media
Mathew, B., Dutt, R., Goyal, P., & Mukherjee, A. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326034 · Cited by 348
Analysis of named entity recognition and linking for tweets
Derczynski, L., Maynard, D., Rizzo, G., van Erp, M., Gorrell, G., Troncy, R., Petrak, J., & Bontcheva, K. (2015) · Information Processing & Management · doi:10.1016/j.ipm.2014.10.006 · Cited by 340
Self-citationHardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
SHAPIRO, I. (2002) · Political Theory · doi:10.1177/0090591702030004008 · Cited by 323
Accessible Reproducible Research
Mesirov, J. P. (2010) · Science · doi:10.1126/science.1179653 · Cited by 307
Crowd-sourced Text Analysis: Reproducible and Agile Production of Political Data
BENOIT, K., CONWAY, D., LAUDERDALE, B. E., LAVER, M., & MIKHAYLOV, S. (2016) · American Political Science Review · doi:10.1017/s0003055416000058 · Cited by 295
Abusive Language Detection on Arabic Social Media
Mubarak, H., Darwish, K., & Magdy, W. (2017) · Proceedings of the First Workshop on Abusive Language Online · doi:10.18653/v1/w17-3008 · Cited by 295
Developing an online hate classifier for multiple social media platforms
Salminen, J., Hopf, M., Chowdhury, S. A., Jung, S.-G., Almerekhi, H., & Jansen, B. J. (2020) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-019-0205-6 · Cited by 286
On the Origins of Memes by Means of Fringe Web Communities
Zannettou, S., Caulfield, T., Blackburn, J., De Cristofaro, E., Sirivianos, M., Stringhini, G., & Suarez-Tangil, G. (2018) · Proceedings of the Internet Measurement Conference 2018 · doi:10.1145/3278532.3278550 · Cited by 283
BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning
Kirsch, A., van Amersfoort, J., & Gal, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08158 · Cited by 283
Multilingual and Multi-Aspect Hate Speech Analysis
Ousidhoum, N., Lin, Z., Zhang, H., Song, Y., & Yeung, D.-Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1474 · Cited by 276
A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection
Bohra, A., Vijay, D., Singh, V., Akhtar, S. S., & Shrivastava, M. (2018) · Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media · doi:10.18653/v1/w18-1105 · Cited by 265
Challenges in discriminating profanity from hate speech
Malmasi, S., & Zampieri, M. (2018) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2017.1409284 · Cited by 264
Perceptual confidence neglects decision-incongruent evidence in the brain
Peters, M. A. K., Thesen, T., Ko, Y. D., Maniscalco, B., Carlson, C., Davidson, M., Doyle, W., Kuzniecky, R., Devinsky, O., Halgren, E., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0139 · Cited by 252
Exploring Hate Speech Detection in Multimodal Publications
Gomez, R., Gibert, J., Gomez, L., & Karatzas, D. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093414 · Cited by 250
Lessons from archives: strategies for collecting sociocultural data in machine learning
Jo, E. S., & Gebru, T. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372829 · Cited by 240
Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased.
Irwig, L., Macaskill, P., Berry, G., & Glasziou, P. (1998) · PubMed Central · Cited by 240
Multi-label Hate Speech and Abusive Language Detection in Indonesian Twitter
Ibrohim, M. O., & Budi, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3506 · Cited by 239
Political Turbulence: How Social Media Shape Collective Action
MARGETTS, H., JOHN, P., HALE, S., & YASSERI, T. (2015) · doi:10.2307/j.ctvc773c7 · Cited by 238
Bird, S., Dale, R., Dorr, B. J., Gibson, B., Joseph, M. T., Kan, M., Lee, D., Powley, B., Radev, D., & Tan, Y. F. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4pzr64y6ri9j · Cited by 238
Detecting Online Hate Speech Using Context Aware Models
Texas A&M University, U., Gao, L., & Huang, R. (2017) · RANLP 2017 - Recent Advances in Natural Language Processing Meet Deep Learning · doi:10.26615/978-954-452-049-6_036 · Cited by 235
Overview of the GermEval 2018 Shared Task on the Identification of Offensive Language
Wiegand, M., Siegel, M., & Ruppenhofer, J. (2019) · Publication Server of the Institute for German Language (Institute for German Language) · Cited by 232
Are they Our Brothers? Analysis and Detection of Religious Hate Speech in the Arabic Twittersphere
Albadi, N., Kurdi, M., & Mishra, S. (2018) · 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2018.8508247 · Cited by 228
The Digital Divide Among Twitter Users and Its Implications for Social Research
Blank, G. (2017) · Social Science Computer Review · doi:10.1177/0894439316671698 · Cited by 225
Characterizing and Detecting Hateful Users on Twitter
Ribeiro, M., Calais, P., Santos, Y., Almeida, V., & Meira Jr., W. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15057 · Cited by 221
Hate speech detection in the Indonesian language: A dataset and preliminary study
Alfina, I., Mulia, R., Fanany, M. I., & Ekanata, Y. (2017) · 2017 International Conference on Advanced Computer Science and Information Systems (ICACSIS) · doi:10.1109/icacsis.2017.8355039 · Cited by 221
Corpus Annotation through Crowdsourcing: Towards Best Practice Guidelines
Sabou, M., Bontcheva, K., Derczynski, L., & Scharl, A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/569wpuc5pjnt · Cited by 217
Self-citationWilliams, M. L., & Burnap, P. (2016) · British Journal of Criminology · doi:10.1093/bjc/azv059 · Cited by 213
Overview of the Evalita 2018 Task on Automatic Misogyny Identification (AMI)
Fersini, E., Nozza, D., & Rosso, P. (2018) · EVALITA Evaluation of NLP and Speech Tools for Italian · doi:10.4000/books.aaccademia.4497 · Cited by 213
What is Gab: A Bastion of Free Speech or an Alt-Right Echo Chamber
Zannettou, S., Bradlyn, B., De Cristofaro, E., Kwak, H., Sirivianos, M., Stringini, G., & Blackburn, J. (2018) · Companion of the The Web Conference 2018 on The Web Conference 2018 - WWW '18 · doi:10.1145/3184558.3191531 · Cited by 209
HATE: Why We Should Resist it With Free Speech, Not Censorship
Strossen, N. (2018) · New York Law School’s Digital Commons (New York Law School) · Cited by 209
What is Gab? A Bastion of Free Speech or an Alt-Right Echo Chamber?
Zannettou, S., Bradlyn, B., Cristofaro, E. D., Kwak, H., Sirivianos, M., Stringhini, G., & Blackburn, J. (2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.1802.05287 · Cited by 202
A Large Labeled Corpus for Online Harassment Research
Golbeck, J., Ashktorab, Z., Banjo, R. O., Berlinger, A., Bhagwan, S., Buntain, C., Cheakalos, P., Geller, A. A., Gergory, Q., Gnanasekaran, R. K., et al. (2017) · Proceedings of the 2017 ACM on Web Science Conference · doi:10.1145/3091478.3091509 · Cited by 201
Challenges and frontiers in abusive content detection
Vidgen, B., Harris, A., Nguyen, D., Tromble, R., Hale, S., & Margetts, H. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3509 · Cited by 199
Self-citationCounterfactual Fairness in Text Classification through Robustness
Garg, S., Perot, V., Limtiaco, N., Taly, A., Chi, E. H., & Beutel, A. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3317950 · Cited by 198
Ex Machina: Personal Attacks Seen at Scale
Wulczyn, E., Thain, N., & Dixon, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08914 · Cited by 196
Aggravating language a study of abusive and insulting language
Lachenicht, L. G. (1980) · Paper in Linguistics · doi:10.1080/08351818009370513 · Cited by 194
The New ABCs of Research: Achieving Breakthrough Collaborations
Shneiderman, B. (2016) · doi:10.1093/acprof:oso/9780198758839.001.0001 · Cited by 193
L-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language
Mulki, H., Haddad, H., Bechikh Ali, C., & Alshabani, H. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3512 · Cited by 187
Suiter, J. (2016) · Political Insight · doi:10.1177/2041905816680417 · Cited by 182
Hine, G., Onaolapo, J., De Cristofaro, E., Kourtellis, N., Leontiadis, I., Samaras, R., Stringhini, G., & Blackburn, J. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14893 · Cited by 181
Growing the artificial intelligence industry in the UK
Hall, W., & Pesenti, J. (2017) · ePrints Soton (University of Southampton) · Cited by 180
Bottom-up data Trusts: disturbing the ‘one size fits all’ approach to data governance
Delacroix, S., & Lawrence, N. D. (2019) · International Data Privacy Law · doi:10.1093/idpl/ipz014 · Cited by 179
A Benchmark Dataset for Learning to Intervene in Online Hate Speech
Qian, J., Bethke, A., Liu, Y., Belding, E., & Wang, W. Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1482 · Cited by 179
A Just and Comprehensive Strategy for Using NLP to Address Online Abuse
Jurgens, D., Hemphill, L., & Chandrasekharan, E. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1357 · Cited by 178
Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?
Davis, P. M., & Fromerth, M. J. (2007) · Scientometrics · doi:10.1007/s11192-007-1661-8 · Cited by 174
Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisis
Roß, B., Rist, M., Carbonell, G., Cabrera, B., Kurowsky, N., & Wojatzki, M. (2016) · DuEPublico (University of Duisburg-Essen) · doi:10.17185/duepublico/42132 · Cited by 172
Lorenzo-Trueba, J., Barra-Chicote, R., Gallardo-Antolín, A., Yamagishi, J., & Montero, J. M. (2016) · The Association for Computational Linguistics · Cited by 169
Jha, A., & Mamidi, R. (2017) · Proceedings of the Second Workshop on NLP and Computational Social Science · doi:10.18653/v1/w17-2902 · Cited by 169
Peer to Peer Hate: Hate Speech Instigators and Their Targets
ElSherief, M., Nilizadeh, S., Nguyen, D., Vigna, G., & Belding, E. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15038 · Cited by 169
An Italian Twitter Corpus of Hate Speech against Immigrants
Sanguinetti, M., Poletto, F., Bosco, C., Patti, V., & Stranisci, M. A. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/26vnss59hfcq · Cited by 168
Overview of the EVALITA 2018 Hate Speech Detection Task
Bosco, C., Dell’Orletta, F., Poletto, F., Sanguinetti, M., & Tesconi, M. (2018) · EVALITA Evaluation of NLP and Speech Tools for Italian · doi:10.4000/books.aaccademia.4503 · Cited by 164
A Hierarchically-Labeled Portuguese Hate Speech Dataset
Fortuna, P., Rocha da Silva, J., Soler-Company, J., Wanner, L., & Nunes, S. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3510 · Cited by 161
Detection of Abusive Language: the Problem of Biased Datasets
Wiegand, M., Ruppenhofer, J., & Kleinbauer, T. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1060 · Cited by 159
Like Trainer, Like Bot? Inheritance of Bias in Algorithmic Content Moderation
Binns, R., Veale, M., Kleek, M. G. V., & Shadbolt, N. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67256-4_32 · Cited by 156
Predicting links in ego-networks using temporal information
Tabourier, L., Libert, A.-S., & Lambiotte, R. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-015-0062-0 · Cited by 152
Overview of the task on automatic misogyny identification at IberEval 2018
Fersini, E., Rosso, P., & Anzovino, M. (2018) · BOA (University of Milano-Bicocca) · Cited by 152
Deeper Attention to Abusive User Content Moderation
Pavlopoulos, J., Malakasiotis, P., & Androutsopoulos, I. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1117 · Cited by 151
Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systems
Eger, S., Şahin, G. G., Rücklé, A., Lee, J.-U., Schulz, C., Mesgar, M., Swarnkar, K., Simpson, E., & Gurevych, I. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1165 · Cited by 150
Bohannon, J. (2011) · Science · doi:10.1126/science.334.6054.307 · Cited by 140
A Dataset and Preliminaries Study for Abusive Language Detection in Indonesian Social Media
Ibrohim, M. O., & Budi, I. D. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.08.169 · Cited by 136
Chung, Y.-L., Kuzmenko, E., Tekiroglu, S. S., & Guerini, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1271 · Cited by 135
Privacy, anonymity, and big data in the social sciences
Daries, J. P., Reich, J., Waldo, J., Young, E. M., Whittinghill, J., Ho, A. D., Seaton, D. T., & Chuang, I. L. (2014) · Communications of the ACM · doi:10.1145/2643132 · Cited by 131
Did you offend me? Classification of Offensive Tweets in Hinglish Language
Mathur, P., Sawhney, R., Ayyar, M. P., & Shah, R. R. (2018) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w18-5118 · Cited by 129
Quantifying population-level health benefits and harms of e-cigarette use in the United States
Soneji, S. S., Sung, H., Primack, B. A., Pierce, J. P., & Sargent, J. D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0193328 · Cited by 124
Like Trainer, Like Bot? Inheritance of Bias in Algorithmic Content Moderation
Binns, R., Veale, M., Kleek, M. G. V., & Shadbolt, N. (2017) · UCL Discovery (University College London) · Cited by 113
Exploring Deep Multimodal Fusion of Text and Photo for Hate Speech Classification
Yang, F., Peng, X., Ghosh, G., Shilon, R., Ma, H., Moore, E., & Predović, G. (2019) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w19-3502 · Cited by 111
Evaluating and improving the usability of Mechanical Turk for low-income workers in India
Khanna, S., Ratan, A. L., Davis, J., & Thies, W. (2010) · ACM Symposium on Computing for Development (ACM DEV) · doi:10.1145/1926180.1926195 · Cited by 107
Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee CrisisPreprint
Roß, B., Rist, M., Carbonell, G., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08118 · Cited by 106
Transfer learning for hate speech detection in social media
Yuan, L., Wang, T., Ferraro, G., Suominen, H., & Rizoiu, M.-A. (2023) · Journal of Computational Social Science · doi:10.1007/s42001-023-00224-9 · Cited by 103
Psychology of personal data donation
Skatova, A., & Goulding, J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0224240 · Cited by 102
Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine LearningPreprint
Jo, E. S., & Gebru, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10389 · Cited by 102
Quality of flow diagram in systematic review and/or meta-analysis
Vu-Ngoc, H., Elawady, S. S., Mehyar, G. M., Abdelhamid, A. H., Mattar, O. M., Halhouli, O., Vuong, N. L., Ali, C. D. M., Hassan, U. H., Kien, N. D., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195955 · Cited by 99
Dataset Construction for the Detection of Anti-Social Behaviour in Online Communication in Arabic
Alakrot, A., Murray, L., & Nikolov, N. S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.473 · Cited by 99
海洋におけるネオジム 全球データベース,海洋間比較,古海洋学研究への意味
Tina, V. D. F., Alexander, M. G., Lambelet, M., Susan, H. L., Stichel, T., & David, J. W. (2016) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · Cited by 98
Dude, srsly?: The Surprisingly Formal Nature of Twitter's Language
Hu, Y., Talamadupula, K., & Subbarao Kambhampati, B. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14443 · Cited by 97
Offensive Comments in the Brazilian Web: a dataset and baseline results
de Pelle, R. P., & Moreira, V. P. (2017) · Anais do Brazilian Workshop on Social Network Analysis and Mining (BraSNAM) · doi:10.5753/brasnam.2017.3260 · Cited by 91
Waqas, A., Salminen, J. O., Jung, S., Almerekhi, H., & Jansen, B. J. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222194 · Cited by 88
Topic-driven toxicity: Exploring the relationship between online toxicity and news topics
Salminen, J. O., Şengün, S., Corporan, J., Jung, S., & Jansen, B. J. J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0228723 · Cited by 88
Broad Twitter Corpus: A Diverse Named Entity Recognition Resource
Derczynski, L., Bontcheva, K., & Roberts, I. G. (2016) · International Conference on Computational Linguistics · Cited by 81
Self-citationChatzakou, D., Kourtellis, N., Blackburn, J., Cristofaro, E. D., Stringhini, G., & Vakali, A. I. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3053890 · Cited by 80
The New ABC’s of Research: Achieving Breakthrough Collaborations
Jull, M. (2017) · Technology|Architecture + Design · doi:10.1080/24751448.2017.1292800 · Cited by 75
Hine, G. E., Onaolapo, J. O., Cristofaro, E. D., Kourtellis, N., Ilias Leontiadis, A., Samaras, R., Stringhini, G., & Blackburn, J. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.841768 · Cited by 74
Detecting Offensive Statements towards Foreigners in Social Media
Bretschneider, U., & Peters, R. (2017) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2017.268 · Cited by 68
Álvarez‐Carmona, M. Á., Guzmán-Falcón, E., Montes-y-Gómez, M., Escalante, H. J., Villaseñor-Pineda, L., Reyes‐Meza, V., & Sulayes, A. R. (2018) · Cited by 68
Understanding Human-Machine Networks: A Cross-Disciplinary Survey
Tsvetkova, M., Yasseri, T., Meyer, E. T., Pickering, J. B., Engen, V., Walland, P., Lüders, M., Følstad, A., & Bravos, G. (2018) · ACM Computing Surveys · doi:10.1145/3039868 · Cited by 67
Estimation across Data Sets: Two-Stage Auxiliary Instrumental Variables Estimation (2SAIV)
Franklin, C. H. (1989) · Political Analysis · doi:10.1093/pan/1.1.1-a · Cited by 66
Sharifirad, S., Jafarpour, B., & Matwin, S. (2018) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w18-5114 · Cited by 65
Evaluating NLP Models via Contrast SetsPreprint
Gardner, M., Artzi, Y., Basmova, V., Berant, J., Bogin, B., Chen, S., Dasigi, P., Dua, D., Elazar, Y., Gottumukkala, A., et al. (2020) · arXiv (Cornell University) · Cited by 65
Sport, M. (2019) · Cited by 64
Chatzakou, D., Kourtellis, N., Blackburn, J., Cristofaro, E. D., Stringhini, G., & Vakali, A. I. (2017) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3078714.3078721 · Cited by 58
The New ABCs of Research: Achieving Breakthrough Collaborations
Shneiderman, B. (2016) · Cited by 56
Creating a WhatsApp Dataset to Study Pre-teen Cyberbullying
Sprugnoli, R., Menini, S., Tonelli, S., Oncini, F., & Piras, E. M. (2018) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w18-5107 · Cited by 55
Degree based Classification of Harmful Speech using Twitter DataPreprint
Sharma, S., Agrawal, S., & Shrivastava, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04197 · Cited by 54
Salminen, J. O., Veronesi, F., Almerekhi, H., Jung, S.-G., & Jansen, B. J. J. (2018) · International Conference on Social Networks Analysis, Management and Security (SNAMS) · doi:10.1109/snams.2018.8554954 · Cited by 50
Text Processing Like Humans Do: Visually Attacking and Shielding NLP SystemsPreprint
Eger, S., Şahin, G. G., Rücklé, A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11508 · Cited by 49
Multi-use of the sea: A wide array of opportunities from site-specific cases across Europe
Bocci, M., Sangiuliano, S. J., Sarretta, A., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215010 · Cited by 49
A Quality Type-aware Annotated Corpus and Lexicon for Harassment Research
Rezvan, M., Shekarpour, S., Balasuriya, L., Thirunarayan, K., Shalin, V. L., & Sheth, A. (2018) · ACM Web Science Conference (WebSci) · doi:10.1145/3201064.3201103 · Cited by 46
A Biased Review of Biases in Twitter Studies on Political Collective Action
Cihon, P., & Yasseri, T. (2016) · Frontiers in Physics · doi:10.3389/fphy.2016.00034 · Cited by 46
Lutzky, U., & Kehoe, A. (2016) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.21.2.02lut · Cited by 44
Reasoning about Political Bias in Content Moderation
Jiang, S., Robertson, R. E., & Wilson, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7117 · Cited by 36
Data philanthropy and the design of the infraethics for information societies
Taddeo, M. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0113 · Cited by 35
Шапиро, Я. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511492174.002 · Cited by 33
Do Scopus and WoS Correct “Old” Omitted Citations?
Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016) · Scientometrics · doi:10.1007/s11192-016-1867-8 · Cited by 31
Like trainer, like bot? Inheritance of bias in algorithmic content moderationPreprint
Binns, R., Veale, M., Kleek, M. G. V., & Shadbolt, N. (2017) · doi:10.31219/osf.io/97u3q · Cited by 31
The GATE Crowdsourcing Plugin: Crowdsourcing Annotated Corpora Made Easy
Bontcheva, K., Roberts, I. G., Derczynski, L., & Rout, D. (2014) · doi:10.3115/v1/e14-2025 · Cited by 30
Self-citationDatasets of Slovene and Croatian Moderated News Comments
Ljubešić, N., Erjavec, T., & Fišer, D. (2018) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w18-5116 · Cited by 30
A Quality Type-Aware Annotated Corpus and Lexicon for Harassment Research
Rezvan, M., Shekarpour, S., Balasuriya, L., Thirunarayan, K., Shalin, V. L., & Sheth, A. (2019) · Journal of Bioresource Management · Cited by 30
I Wish I Didn't Say That! Analyzing and Predicting Deleted Messages in TwitterPreprint
Petrović, S., Osborne, M., & Lavrenko, V. P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.3107 · Cited by 27
Nyman, T. J., Antfolk, J., Lampinen, J. M., Korkman, J., & Santtila, P. O. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238292 · Cited by 22
Ritson, S. (2016) · Social Studies of Science · doi:10.1177/0306312716647508 · Cited by 21
Crowdsourcing the Measurement of Interstate Conflict
D'Orazio, V. J., Kenwick, M., Lane, M., Palmer, G., & Reitter, D. (2016) · PLoS ONE · doi:10.1371/journal.pone.0156527 · Cited by 15
Bottom-up data Trusts: disturbing the ‘one size fits all’ approach to data governance
Delacroix, S., & Lawrence, N. (2018) · doi:10.2139/ssrn.3265315 · Cited by 11
Design choices for productive, secure, data-intensive research at scale in the cloudPreprint
Arenas, D., Atkins, J., Austin, C., Beavan, D., Cabrejas-Egea, A., Carlysle-Davies, S., Carter, I. M., Clarke, R., Cunningham, J. A., Doel, T., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.08737 · Cited by 7
Cited by
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Proceedings of the Fourteenth Workshop on Semantic Evaluation · doi:10.18653/v1/2020.semeval-1.188 · Cited by 378
Self-citationA systematic review of hate speech automatic detection using natural language processing
Jahan, M. S., & Oussalah, M. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126232 · Cited by 279
Dynabench: Rethinking Benchmarking in NLP
Kiela, D., Bartolo, M., Nie, Y., Kaushik, D., Geiger, A., Wu, Z., Vidgen, B., Prasad, G., Singh, A., Ringshia, P., et al. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.324 · Cited by 254
Self-citationLearning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection
Vidgen, B., Thrush, T., Waseem, Z., & Kiela, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.132 · Cited by 174
Self-citationOffensive, aggressive, and hate speech analysis: From data-centric to human-centered approach
Kocoń, J., Figas, A., Gruza, M., Puchalska, D., Kajdanowicz, T., & Kazienko, P. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102643 · Cited by 103
Metadata
- Authors
- Vidgen, B., & Derczynski, L.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-12-28
- Volume
- 15
- Issue
- 12
- Pages
- e0243300
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W3014487746
- Cited by
- 318
- References
- 167
- FWCI
- 5.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.