The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Risk of Racial Bias in Hate Speech Detection
Open accessAbstract
We investigate how annotators' insensitivity to differences in dialect can lead to racial bias in automatic hate speech detection models, potentially amplifying harm against minority populations.We first uncover unexpected correlations between surface markers of African American English (AAE) and ratings of toxicity in several widely-used hate speech datasets.Then, we show that models trained on these corpora acquire and propagate these biases, such that AAE tweets and tweets by self-identified African Americans are up to two times more likely to be labelled as offensive compared to others.Finally, we propose dialect and race priming as ways to reduce the racial bias in annotation, showing that when annotators are made explicitly aware of an AAE tweet's dialect they are significantly less likely to label the tweet as offensive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Toxicity detection models misclassify African-American English tweets as negative more often than those written in Standard American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
The cited source says what the claim attributes to it.
In the citing paper
“For example, toxicity classifiers may disproportionately flag African-American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019)”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
In the citing paper
“models are trained with historical data and can present issues such as gender bias and racial bias in AI models [68,73], potentially exacerbating structural inequalities [10]”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 5,022
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
The Impact of Social Media on Children, Adolescents, and Families
O'Keeffe, G. S., Clarke-Pearson, K., & Council on Communications and Media (2011) · Pediatrics · doi:10.1542/peds.2011-0054 · Cited by 1,987 · cited 1×
“Toxic language (e.g., hate speech, abusive speech, or other offensive speech) primarily targets members of minority groups and can catalyze real-life violence towards them (O’Keeffe et al., 2011; Cleland, 2014; Mozur, 2018).”
BackgroundHateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Talat, Z., & Hovy, D. (2016) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n16-2013 · Cited by 1,919
Internal and external motivation to respond without prejudice.
Plant, E. A., & Devine, P. G. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.3.811 · Cited by 1,689
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · SocialNLP@EACL · doi:10.18653/v1/w17-1101 · Cited by 1,478
Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network
Zhang, Z., Robinson, D., & Tepper, J. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93417-4_48 · Cited by 676
Research works printed but not linked: 2
- E. Ashby Plant and Patricia G. Devine. 1998. Inter- nal and external motivation to respond without prej- udice. J. Pers. Soc. Psychol., 75(3):811-832.
- Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hi- erarchical attention networks for document classifi- cation. In NAACL.
Cited by
Sorted by citations
Items 101–200 of 808
Designing Word Filter Tools for Creator-led Comment Moderation
Jhaver, S., Chen, Q. Z., Knauss, D., & Zhang, A. X. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517505 · Cited by 82
Empirical Analysis of Multi-Task Learning for Reducing Identity Bias in Toxic Comment Detection
Vaidya, A., Mai, F., & Ning, Y. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7334 · Cited by 87
Quantifying and alleviating political bias in language models
Liu, R., Jia, C., Wei, J., Xu, G., & Vosoughi, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2021.103654 · Cited by 68
Mansur, Z., Omar, N., & Tiun, S. B. (2023) · IEEE Access · doi:10.1109/access.2023.3239375 · Cited by 77
Hate speech detection in social media: Techniques, recent trends, and future challenges
Rawat, A., Kumar, S., & Samant, S. S. (2024) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1648 · Cited by 70
Toxic language in online incel communities
Pelzer, B., Kaati, L., Cohen, K., & Fernquist, J. (2021) · SN Social Sciences · doi:10.1007/s43545-021-00220-8 · Cited by 89
“They only care to show us the wheelchair”: disability representation in text-to-image AI models
Mack, K. A., Qadri, R., Denton, R., Kane, S. K., & Bennett, C. L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642166 · Cited by 67
Beyond Black & White: Leveraging Annotator Disagreement via Soft-Label Multi-Task Learning
Fornaciari, T., Uma, A., Paun, S., Plank, B., Hovy, D., & Poesio, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.204 · Cited by 83
Bias in Automatic Speech Recognition: The Case of African American Language
Martin, J., & Wright, K. E. (2022) · Applied Linguistics · doi:10.1093/applin/amac066 · Cited by 71
Bot-Adversarial Dialogue for Safe Conversational Agents
Xu, J., Ju, D., Li, M., Boureau, Y.-L., Weston, J., & Dinan, E. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.235 · Cited by 64
Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech RecognitionPreprint
Huang, X., Xing, L., Dernoncourt, F., & Paul, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10361 · Cited by 75
Text Analysis for Psychology: Methods, Principles, and PracticesPreprint
Kennedy, B., Ashokkumar, A., Boyd, R. L., & Dehghani, M. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h2b8t · Cited by 62
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548
A Genealogy of Critical Race and Digital Studies: Past, Present, and Future
Hamilton, A. M. (2020) · Sociology of Race and Ethnicity · doi:10.1177/2332649220922577 · Cited by 69
Detoxifying Language Models Risks Marginalizing Minority Voices
Xu, A., Pathak, E., Wallace, E., Gururangan, S., Sap, M., & Klein, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.190 · Cited by 131
Self-citationNardone, V., Marmorino, F., Germani, M. M., Cichowska-Cwalińska, N., Menditti, V. S., Gallo, P., Studiale, V., Taravella, A., Landi, M., Reginelli, A., et al. (2024) · Current Oncology · doi:10.3390/curroncol31090369 · Cited by 71
Automated Evaluation of Writing – 50 Years and Counting
Klebanov, B. B., & Madnani, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.697 · Cited by 60
Fairness in Large Language Models: A Taxonomic Survey
Chu, Z., Wang, Z., & Zhang, W. (2024) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3682112.3682117 · Cited by 106
Udupa, S., Maronikolakis, A., & Wisiorek, A. (2023) · Big Data & Society · doi:10.1177/20539517231172424 · Cited by 80
Feature-Based Explanations Don't Help People Detect Misclassifications of Online Toxicity
Carton, S., Mei, Q., & Resnick, P. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7282 · Cited by 58
Kaplan, D. M., Palitsky, R., Arconada Alvarez, S. J., Pozzo, N. S., Greenleaf, M. N., Atkinson, C. A., & Lam, W. A. (2024) · Journal of Medical Internet Research · doi:10.2196/51837 · Cited by 55
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
Singhal, M., Ling, C., Paudel, P., Thota, P., Kumarswamy, N., Stringhini, G., & Nilizadeh, S. (2023) · 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp57164.2023.00056 · Cited by 57
DynaSent: A Dynamic Benchmark for Sentiment Analysis
Potts, C., Wu, Z., Geiger, A., & Kiela, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.186 · Cited by 56
Teach Me to Explain: A Review of Datasets for Explainable NLP.Preprint
Wiegreffe, S., & Marasović, A. (2021) · arXiv (Cornell University) · Cited by 57
Impact of politically biased data on hate speech classification
Wich, M., Bauer, J., & Groh, G. (2020) · Workshop on Abusive Language Online · doi:10.18653/v1/2020.alw-1.7 · Cited by 54
Natural Language Processing for Dialects of a Language: A Survey
Joshi, A., Dabre, R., Kanojia, D., Li, Z., Zhan, H., Haffari, G., & Dippold, D. (2025) · ACM Computing Surveys · doi:10.1145/3712060 · Cited by 103
Tomalin, M., Byrne, B., Concannon, S. J., Saunders, D., & Ullmann, S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09583-1 · Cited by 58
Lu, C., & Jurgens, D. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.8 · Cited by 53
Teach Me to Explain: A Review of Datasets for Explainable Natural Language ProcessingPreprint
Wiegreffe, S., & Marasović, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12060 · Cited by 128
Ethical implications of AI in the Metaverse
Zhuk, A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00450-5 · Cited by 64
Wang, S. (2020) · Digital Journalism · doi:10.1080/21670811.2020.1851279 · Cited by 56
Affective computing in the modern workplace
Richardson, S. (2020) · Business Information Review · doi:10.1177/0266382120930866 · Cited by 51
Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators’ Disagreement
Leonardelli, E., Menini, S., Aprosio, A. P., Guerini, M., & Tonelli, S. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.822 · Cited by 51
Artificial intelligence, digital colonialism, and the implications for Africa’s future development
Salami, A. O. (2024) · Data & Policy · doi:10.1017/dap.2024.75 · Cited by 51
Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts
Baheti, A., Sap, M., Ritter, A., & Riedl, M. O. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.397 · Cited by 60
Self-citationLarge Language Models for Text Classification: From Zero-Shot Learning to Instruction-Tuning
Chae, Y., & Davidson, T. (2025) · Sociological Methods & Research · doi:10.1177/00491241251325243 · Cited by 72
Contextual Analysis of Social Media
Patton, D. U., Frey, W. R., McGregor, K. A., Lee, F.-T., McKeown, K. R., & Moss, E. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375841 · Cited by 50
In Data We Trust: A Critical Analysis of Hate Speech Detection Datasets
Madukwe, K. J., Gao, X., & Xue, B. (2020) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2020.alw-1.18 · Cited by 49
Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science
Cambo, S. A., & Gergle, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501998 · Cited by 49
AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation
Zheng, C., Sabour, S., Wen, J., Zhang, Z., & Huang, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.99 · Cited by 84
KOLD: Korean Offensive Language Dataset
Jeong, Y., Oh, J., Lee, J., Ahn, J., Moon, J., Park, S., & Oh, A. H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.744 · Cited by 53
Improving hate speech detection using Cross-Lingual Learning
Firmino, A. A., Baptista, C. D. S., & de Paiva, A. C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121115 · Cited by 53
X under Musk’s leadership: Substantial hate and no reduction in inauthentic activity
Hickey, D., Fessler, D. M. T., Lerman, K., & Burghardt, K. (2025) · PLoS ONE · doi:10.1371/journal.pone.0313293 · Cited by 88
Trouble on the Horizon: Forecasting the Derailment of Online Conversations as they Develop
Chang, J. P., & Danescu-Niculescu-Mizil, C. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1481 · Cited by 53
Papasavva, A., Aliapoulios, M., Ballard, C., Cristofaro, E. D., Stringhini, G., Zannettou, S., & Blackburn, J. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19330 · Cited by 52
Bias in Machine Learning -- What is it Good for?Preprint
Hellström, T., Dignum, V., & Bensch, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00686 · Cited by 107
Whose side are ethics codes on?: power, responsibility and the social good
Washington, A., & Kuo, R. (2020) · FAT* · doi:10.1145/3351095.3372844 · Cited by 34
Hate Speech Classifiers Learn Normative Social Stereotypes
Davani, A. M., Atari, M., Kennedy, B., & Dehghani, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00550 · Cited by 73
Investigating the affordances of OpenAI's large language model in developing listening assessments
Aryadoust, V., Zakaria, A., & Jia, Y. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100204 · Cited by 67
Investigating African-American Vernacular English in Transformer-Based Text Generation
Groenwold, S., Ou, L., Parekh, A., Honnavalli, S., Levy, S., Mirza, D., & Wang, W. Y. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.473 · Cited by 59
More than a Modern Day Green Book: Exploring the Online Community of Black Twitter
Klassen, S., Kingsley, S., McCall, K., Weinberg, J., & Fiesler, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479602 · Cited by 46
Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-TuningPreprint
Chae, Y., & Davidson, T. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/sthwk · Cited by 54
Ganesan, A. V., Matero, M., Ravula, A. R., Vu, H., & Schwartz, H. A. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.357 · Cited by 50
Combating hate speech using an adaptive ensemble learning model with a case study on COVID-19
Agarwal, S., & Chowdary, C. R. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115632 · Cited by 51
Towards Unbiased and Accurate Deferral to Multiple Experts
Keswani, V., Lease, M., & Kenthapadi, K. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462516 · Cited by 45
“[68] Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A Smith.”
Background“Is it a Qoincidence?”: An Exploratory Study of QAnon on Voat
Papasavva, A., Blackburn, J., Stringhini, G., Zannettou, S., & Cristofaro, E. D. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450036 · Cited by 43
Automated Identification of Toxic Code Reviews Using ToxiCR
Sarker, J., Turzo, A. K., Dong, M., & Bosu, A. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3583562 · Cited by 57
Zeinert, P., Inie, N., & Derczynski, L. (2021) · doi:10.18653/v1/2021.acl-long.247 · Cited by 49
Nascimento, F. R. S., Cavalcanti, G. D. C., & Costa‐Abreu, M. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117032 · Cited by 49
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning
Jin, X., Barbieri, F., Kennedy, B., Davani, A. M., Neves, L., & Ren, X. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.296 · Cited by 63
Steed, R., Panda, S., Kobren, A., & Wick, M. J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.247 · Cited by 55
Towards more robust hate speech detection: using social context and user data
Nagar, S., Barbhuiya, F. A., & Dey, K. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01051-6 · Cited by 42
Do, K., Pang, R. Y., Jiang, J., & Reinecke, K. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581347 · Cited by 51
Inequalities and content moderation
Gregorio, G. D., & Stremlau, N. (2023) · Global Policy · doi:10.1111/1758-5899.13243 · Cited by 49
Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations
Bao, J., Wu, J., Zhang, Y., Chandrasekharan, E., & Jurgens, D. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450122 · Cited by 44
Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models
Balkır, E., Kiritchenko, S., Nejadgholi, I., & Fraser, K. (2022) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2022.trustnlp-1.8 · Cited by 49
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.241 · Cited by 38
ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Detection in Conversational AI
Curry, A. C., Abercrombie, G., & Rieser, V. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.587 · Cited by 64
Automated Content Moderation Increases Adherence to Community Guidelines
Ribeiro, M. H., Cheng, J., & West, R. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583275 · Cited by 57
Safeguarding human values: rethinking US law for generative AI’s societal impacts
Cheong, I., Caliskan, A., & Kohno, T. (2024) · AI and Ethics · doi:10.1007/s43681-024-00451-4 · Cited by 61
Skinner, Z., Brown, S. L., & Walsh, G. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382901 · Cited by 42
Synthesized Social Signals: Computationally-Derived Social Signals from Account Histories
Im, J., Tandon, S., Chandrasekharan, E., Denby, T., & Gilbert, É. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376383 · Cited by 39
Exploring Antecedents and Consequences of Toxicity in Online Discussions
Xia, Y., Zhu, H., Lu, T., Zhang, P., & Gu, N. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415179 · Cited by 45
Towards a Comprehensive Taxonomy and Large-Scale Annotated Corpus for Online Slur Usage
Kurrek, J., Saleem, H. M., & Ruths, D. A. (2020) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2020.alw-1.17 · Cited by 38
Diversity in sociotechnical machine learning systems
Fazelpour, S., & De‐Arteaga, M. (2022) · Big Data & Society · doi:10.1177/20539517221082027 · Cited by 55
Choi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.699 · Cited by 38
Racist and Sexist Hate Speech Detection: Literature Review
Istaiteh, O., Al-Omoush, R., & Tedmori, S. (2020) · International Conference on Intelligent Data Science Technologies and Applications (IDSTA) · doi:10.1109/idsta50958.2020.9264052 · Cited by 38
Petrescu, A., Truică, C., Apostol, E., & Karras, P. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482481 · Cited by 38
Fairness in Language Models Beyond English: Gaps and Challenges
Ramesh, K., Sitaram, S., & Choudhury, M. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.157 · Cited by 60
Bunde, E. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.154 · Cited by 35
Harris, C., Halevy, M., Howard, A., Bruckman, A. S., & Yang, D. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533144 · Cited by 41
Sánchez-Junquera, J., Chulvi, B., Rosso, P., & Ponzetto, S. P. (2021) · Applied Sciences · doi:10.3390/app11083610 · Cited by 39
Personal Bias in Prediction of Emotions Elicited by Textual Opinions
Miłkowski, P., Gruza, M., Kanclerz, K., Kazienko, P., Grimling, D., & Kocoń, J. (2021) · doi:10.18653/v1/2021.acl-srw.26 · Cited by 34
Balayn, A., Yang, J., Szlávik, Z., & Bozzon, A. (2021) · ACM Transactions on Social Computing · doi:10.1145/3479158 · Cited by 38
Detecting abusive comments at a fine-grained level in a low-resource language
Chakravarthi, B. R., Priyadharshini, R., Banerjee, S., Jagadeeshan, M. B., Kumaresan, P. K., Ponnusamy, R., Benhur, S., & McCrae, J. P. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100006 · Cited by 36
Accountability Issues, Online Covert Hate Speech, and the Efficacy of Counter‐Speech
Baider, F. (2023) · Politics and Governance · doi:10.17645/pag.v11i2.6465 · Cited by 33
Udupa, S., & Dattatreyan, E. G. (2023) · New York University Press eBooks · doi:10.18574/nyu/9781479819164.001.0001 · Cited by 38
Large Language Models Are Biased Because They Are Large Language Models
Resnik, P. (2025) · Computational Linguistics · doi:10.1162/coli_a_00558 · Cited by 61
Ball-Burack, A., Lee, M. S. A., Cobbe, J., & Singh, J. P. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445875 · Cited by 38
Lalor, J. P., Abbasi, A., Oketch, K., Yang, Y., & Forsgren, N. (2024) · ACM Transactions on Information Systems · doi:10.1145/3641276 · Cited by 40
Intrinsic bias metrics do not correlate with application bias
Goldfarb-Tarrant, S., Marchant, R., Muñoz Sánchez, R., Pandya, M., & Lopez, A. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.150 · Cited by 33
SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems
Dinan, E., Abercrombie, G., Bergman, A., Spruit, S., Hovy, D., Boureau, Y.-L., & Rieser, V. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.284 · Cited by 32
Russo, G., Verginer, L., Horta Ribeiro, M., & Casiraghi, G. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22184 · Cited by 32
Stereotypes in ChatGPT: an empirical study
Busker, T., Choenni, S., & Bargh, M. S. (2023) · International Conference on Theory and Practice of Electronic Governance · doi:10.1145/3614321.3614325 · Cited by 40
Shortcut Learning Explanations for Deep Natural Language Processing: A Survey on Dataset Biases
Dogra, V., Verma, S., Kavita, K., Woźniak, M., Shafi, J., & Ijaz, M. F. (2024) · IEEE Access · doi:10.1109/access.2024.3360306 · Cited by 36
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties
Sorensen, T., Jiang, L., Hwang, J. D., Levine, S., Pyatkin, V., West, P., Dziri, N., Lu, X., Rao, K., Bhagavatula, C., et al. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i18.29970 · Cited by 101
Self-citationComparing the Language of QAnon-Related Content on Parler, Gab, and Twitter
Sipka, A., Hannák, A., & Urman, A. (2021) · Web Science Conference · doi:10.1145/3501247.3531550 · Cited by 36
Evaluating GPT-3 Generated Explanations for Hateful Content Moderation
Wang, H., Hee, M. S., Awal, M. R., Choo, K. T. W., & Lee, R. K.-W. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/694 · Cited by 59
NLPositionality: Characterizing Design Biases of Datasets and Models
Santy, S., Liang, J. T., Bras, R. J. L., Reinecke, K., & Sap, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.505 · Cited by 74
Self-citationInvestigating Annotator Bias with a Graph-Based Approach
Wich, M., Kuwatly, H. A., & Groh, G. (2020) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2020.alw-1.22 · Cited by 32
Metadata
- Authors
- Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A.
- Affiliations
- University of Washington (US)
- Carnegie Mellon University (US)
- Allen Institute for Artificial Intelligence (US)
- Corresponding author
- Sap, Maarten
- Venue
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Published
- 2019
- Pages
- 1668-1678
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2949678053
- Cited by
- 817
- References
- 40
- Citations by year
- 2026: 59 · 2025: 96 · 2024: 86 · 2023: 139 · 2022: 142 · 2021: 178 · 2020: 105 · 2019: 12
- FWCI
- 40.99
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Science Foundation (1714566)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- hate speech detection, racial bias, African American English, dialects, annotation bias, hate speech datasets, priming, minority groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
