The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Risk of Racial Bias in Hate Speech Detection
Open accessAbstract
We investigate how annotators' insensitivity to differences in dialect can lead to racial bias in automatic hate speech detection models, potentially amplifying harm against minority populations.We first uncover unexpected correlations between surface markers of African American English (AAE) and ratings of toxicity in several widely-used hate speech datasets.Then, we show that models trained on these corpora acquire and propagate these biases, such that AAE tweets and tweets by self-identified African Americans are up to two times more likely to be labelled as offensive compared to others.Finally, we propose dialect and race priming as ways to reduce the racial bias in annotation, showing that when annotators are made explicitly aware of an AAE tweet's dialect they are significantly less likely to label the tweet as offensive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Toxicity detection models misclassify African-American English tweets as negative more often than those written in Standard American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
The cited source says what the claim attributes to it.
In the citing paper
“For example, toxicity classifiers may disproportionately flag African-American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019)”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
In the citing paper
“models are trained with historical data and can present issues such as gender bias and racial bias in AI models [68,73], potentially exacerbating structural inequalities [10]”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 5,022
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
The Impact of Social Media on Children, Adolescents, and Families
O'Keeffe, G. S., Clarke-Pearson, K., & Council on Communications and Media (2011) · Pediatrics · doi:10.1542/peds.2011-0054 · Cited by 1,987 · cited 1×
“Toxic language (e.g., hate speech, abusive speech, or other offensive speech) primarily targets members of minority groups and can catalyze real-life violence towards them (O’Keeffe et al., 2011; Cleland, 2014; Mozur, 2018).”
BackgroundHateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Talat, Z., & Hovy, D. (2016) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n16-2013 · Cited by 1,919
Internal and external motivation to respond without prejudice.
Plant, E. A., & Devine, P. G. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.3.811 · Cited by 1,689
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · SocialNLP@EACL · doi:10.18653/v1/w17-1101 · Cited by 1,478
Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network
Zhang, Z., Robinson, D., & Tepper, J. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93417-4_48 · Cited by 676
Research works printed but not linked: 2
- E. Ashby Plant and Patricia G. Devine. 1998. Inter- nal and external motivation to respond without prej- udice. J. Pers. Soc. Psychol., 75(3):811-832.
- Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hi- erarchical attention networks for document classifi- cation. In NAACL.
Cited by
Sorted by citations
Items 201–300 of 808
Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark
Zhou, J., Deng, J., Mi, F., Li, Y., Wang, Y., Huang, M., Jiang, X., Liu, Q., & Meng, H. M. L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.262 · Cited by 34
Srinivasan, K. B., Danescu-Niculescu-Mizil, C., Lee, L., & Tan, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.09563 · Cited by 31
Why Don’t You Do It Right? Analysing Annotators’ Disagreement in Subjective Tasks
Sandri, M., Leonardelli, E., Tonelli, S., & Jezek, E. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.178 · Cited by 31
Misogynoir: challenges in detecting intersectional hate
Kwarteng, J., Perfumi, S. C., Farrell, T., Third, A., & Fernandez, M. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00993-7 · Cited by 30
“Perspective API has also been used in other studies to review and compare datasets and to identify toxic content (Kumar et al., n.d.; Sap et al., 2019; Zannettou et al., 2020).”
MethodCase Study: Deontological Ethics in NLP
Prabhumoye, S., Boldt, B., Salakhutdinov, R., & Black, A. W. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.297 · Cited by 35
Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Framework
Halevy, M., Harris, C., Bruckman, A., Yang, D., & Howard, A. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483299 · Cited by 36
Foltz, P. W., Chandler, C., Diaz-Asper, C. M., Cohen, A. S., Rodriguez, Z. B., Holmlund, T. B., & Elvevåg, B. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.07.011 · Cited by 33
Accelerating automatic hate speech detection using parallelized ensemble learning models
Agarwal, S., Sonawane, A., & Chowdary, C. R. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120564 · Cited by 30
Intersectional Bias in Hate Speech and Abusive Language DatasetsPreprint
Kim, J., Ortiz, C., Nam, S., Santiago, S., & Datta, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05921 · Cited by 49
Ruddit: Norms of Offensiveness for English Reddit Comments
Hada, R., Sudhir, S., Mishra, P., Yannakoudakis, H., Mohammad, S. M., & Shutova, E. (2021) · doi:10.18653/v1/2021.acl-long.210 · Cited by 30
Understanding and identifying the use of emotes in toxic chat on Twitch
Kim, J., Wohn, D. Y., & Cha, M. (2021) · Online Social Networks and Media · doi:10.1016/j.osnem.2021.100180 · Cited by 38
The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning
Hessel, J., Hwang, J. D., Park, J. S., Zellers, R., Bhagavatula, C., Rohrbach, A., Saenko, K., & Choi, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_32 · Cited by 37
Self-citationFrost‐Arnold, K. (2022) · doi:10.1093/oso/9780190089184.001.0001 · Cited by 31
Martin, D., Prabhakaran, V., Kuhlberg, J., Smart, A., & Isaac, W. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07572 · Cited by 80
Menini, S., Aprosio, A. P., & Tonelli, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14916 · Cited by 47
Combining Feature and Instance Attribution to Detect Artifacts
Pezeshkpour, P., Jain, S., Singh, S., & Wallace, B. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.153 · Cited by 41
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media
Ghosh, S., Baker, D., Jurgens, D., & Prabhakaran, V. (2021) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/2021.wnut-1.35 · Cited by 35
Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels
Ribeiro, M. H., Jhaver, S., Zannettou, S., Blackburn, J., Stringhini, G., Cristofaro, E. D., & West, R. (2021) · UCL Discovery (University College London) · Cited by 28
Hidden behind the obvious: Misleading keywords and implicitly abusive language on social media
Yin, W., & Zubiaga, A. (2022) · Online Social Networks and Media · doi:10.1016/j.osnem.2022.100210 · Cited by 30
Sequential Integrated Gradients: a simple but effective method for explaining language models
Enguehard, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.477 · Cited by 58
Akhtar, S., Basile, V., & Patti, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15896 · Cited by 71
Wingate, D., Shoeybi, M., & Sorensen, T. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.412 · Cited by 26
Measure Utility, Gain Trust: Practical Advice for XAI Researchers
Davis, B., Glenski, M., Sealy, W. I. N., & Arendt, D. (2020) · IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX) · doi:10.1109/trex51495.2020.00005 · Cited by 31
Exploring Stylometric and Emotion-Based Features for Multilingual Cross-Domain Hate Speech Detection
Markov, I., Ljubešić, N., Fišer, D., & Daelemans, W. M. P. (2021) · VU Research Portal · Cited by 26
On learning and representing social meaning in NLP: a sociolinguistic perspective
Nguyen, D., Rosseel, L., & Grieve, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.50 · Cited by 28
A Sociotechnical Audit: Assessing Police Use of Facial Recognition
Radiya-Dixit, E., & Neff, G. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594084 · Cited by 36
Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets
Ousidhoum, N. D., Song, Y., & Yeung, D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.199 · Cited by 26
Reconsidering Annotator Disagreement about Racist Language: Noise or Signal?
Larimore, S., Kennedy, I., Haskett, B., & Arseniev-Koehler, A. (2021) · International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/2021.socialnlp-1.7 · Cited by 68
Sachdeva, P., Barreto, R., von Vacano, C., & Kennedy, C. J. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533216 · Cited by 25
D’Arcy, A., & Bender, E. M. (2022) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-031120-015324 · Cited by 32
Wenzel, K., Devireddy, N., Davison, C., & Kaufman, G. F. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581357 · Cited by 26
Interpreting Predictions of NLP Models
Wallace, E., Gardner, M., & Singh, S. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2020.emnlp-tutorials.3 · Cited by 28
NLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfer
Ahn, H., Sun, J., Park, C. Y., & Seo, J. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.206 · Cited by 24
Reliability Testing for Natural Language Processing Systems
Tan, S., Joty, S., Baxter, K., Taeihagh, A., Bennett, G. A., & Kan, M. (2021) · doi:10.18653/v1/2021.acl-long.321 · Cited by 31
Domain-Specific Keyword Extraction Using Joint Modeling of Local and Global Contextual Semantics
Abulaish, M., Fazil, M., & Zaki, M. J. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3494560 · Cited by 24
On the challenges of using black-box APIs for toxicity evaluation in research
Pozzobon, L., Ermis, B., Lewis, P., & Hooker, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.472 · Cited by 29
FuzzE: Fuzzy Fairness Evaluation of Offensive Language Classifiers on African-American English
Rios, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5434 · Cited by 23
Characterizing Variation in Toxic Language by Social Context
Radfar, B., Shivaram, K., & Culotta, A. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7366 · Cited by 25
Memes in the Wild: Assessing the Generalizability of the Hateful Memes Challenge Dataset
Kirk, H. R., Jun, Y., Rauba, P., Wachtel, G., Li, R., Bai, X., Broestl, N., Doff-Sotta, M., Shtedritski, A., & Asano, Y. M. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.4 · Cited by 26
Measuring and mitigating language model biases in abusive language detection
Song, R., Giunchiglia, F., Li, Y., Shi, L., & Xu, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103277 · Cited by 23
HARE: Explainable Hate Speech Detection with Step-by-Step Reasoning
Yang, Y., Kim, J., Kim, Y., Ho, N., Thorne, J. P., & Yun, S.-Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.365 · Cited by 47
Mapping the Design Space of Teachable Social Media Feed Experiences
Feng, K. J. K., Koo, X., Tan, L., Bruckman, A. S., McDonald, D. W., & Zhang, A. X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642120 · Cited by 34
How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impact
Jin, Z., Chauhan, G., Tse, B., Sachan, M., & Mihalcea, R. F. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.273 · Cited by 25
Why the Data Revolution Needs Qualitative Thinking
Tanweer, A., Gade, E. K., Krafft, P. M., & Dreier, S. K. (2021) · Harvard Data Science Review · doi:10.1162/99608f92.eee0b0da · Cited by 22
Features or Spurious Artifacts? Data-centric Baselines for Fair and Robust Hate Speech Detection
Ramponi, A., & Tonelli, S. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.221 · Cited by 22
Bingley, W., Haslam, S. A., Steffens, N. K., Gillespie, N. A., Worthy, P., Curtis, C., Lockey, S., Bialkowski, A., Ko, R. K. L., & Wiles, J. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101025 · Cited by 31
From Pick-Up Artists to Incels: A Data-Driven Sketch of the Manosphere.
Ribeiro, M. H., Blackburn, J., Bradlyn, B., Cristofaro, E. D., Stringhini, G., Long, S., Greenberg, S., & Zannettou, S. (2020) · Cited by 22
Detecting ‘Dirt’ and ‘Toxicity’: Rethinking Content Moderation as Pollution BehaviourPreprint
Thylstrup, N. B., & Talat, Z. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3709719 · Cited by 22
How Robust are Fact Checking Systems on Colloquial Claims?
Kim, B., Kim, H., Hong, S., & Kim, G. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.121 · Cited by 23
Utilizing subjectivity level to mitigate identity term bias in toxic comments classification
Zhao, Z., Zhang, Z., & Hopfgartner, F. (2022) · Online Social Networks and Media · doi:10.1016/j.osnem.2022.100205 · Cited by 26
Adaptive Sampling Strategies to Construct Equitable Training Datasets
Cai, W., Encarnación, R., Chern, B., Corbett‐Davies, S., Bogen, M., Bergman, S., & Goel, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533203 · Cited by 21
Neumann, T., De‐Arteaga, M., & Fazelpour, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533205 · Cited by 29
Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts
Hallinan, S., Liu, A., Choi, Y., & Sap, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.21 · Cited by 36
Self-citationFrom Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models
Mendelsohn, J., Bras, R. J. L., Choi, Y., & Sap, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.845 · Cited by 33
Self-citationDirections for NLP Practices Applied to Online Hate Speech Detection
Fortuna, P., Domínguez, M., Wanner, L., & Talat, Z. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.809 · Cited by 20
Investigating the Impact of Gender Representation in ASR Training Data: a Case Study on Librispeech
Garnerin, M., Rossato, S., & Besacier, L. (2021) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2021.gebnlp-1.10 · Cited by 21
Dataset of Fake News Detection and Fact Verification: A Survey
Murayama, T. (2021) · arXiv · doi:10.48550/arxiv.2111.03299 · Cited by 40
An archival perspective on pretraining data
Desai, M. A., Pasquetto, I. V., Jacobs, A. Z., & Card, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100966 · Cited by 26
Self-citationA Multimodal Deep Framework for Derogatory Social Media Post Identification of a Recognized Person
Bhowmick, R. S., Ganguli, I., Paul, J., & Sil, J. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3447651 · Cited by 21
Patterns of Bias: How Mainstream Media Operationalize Links between Mass Shootings and Terrorism
Dreier, S. K., Gade, E. K., Card, D., & Smith, N. A. (2022) · Political Communication · doi:10.1080/10584609.2022.2111484 · Cited by 20
Self-citationDebunking multi-lingual social media posts using deep learning
Kotiyal, B., Pathak, H., & Singh, N. (2023) · International Journal of Information Technology · doi:10.1007/s41870-023-01288-6 · Cited by 20
Efstratiou, A., Blackburn, J., Caulfield, T., Stringhini, G., Zannettou, S., & Cristofaro, E. D. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22138 · Cited by 20
Pashto offensive language detection: a benchmark dataset and monolingual Pashto BERT
Haq, I., Qiu, W., Guo, J., & Tang, P. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1617 · Cited by 20
Incivility is Rising among American Politicians on TwitterPreprint
Frimer, J. A., Aujla, H., Feinberg, M., Skitka, L. J., Aquino, K. F., Eichstaedt, J. C., & Willer, R. (2022) · doi:10.31234/osf.io/2hku3 · Cited by 20
Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia
Kuo, T.-S., Halfaker, A., Cheng, Z., Kim, J., Wu, M.-H., Wu, T., Holstein, K., & Zhu, H. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642278 · Cited by 32
Investigating Sampling Bias in Abusive Language Detection
Razo, D., & Kübler, S. (2020) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2020.alw-1.9 · Cited by 19
Ethical and technical challenges of AI in tackling hate speech
Cortiz, D., & Zubiaga, A. (2021) · The International Review of Information Ethics · doi:10.29173/irie416 · Cited by 20
Mitigating Biases in Toxic Language Detection through Invariant Rationalization
Chuang, Y.-S., Gao, M., Luo, H., Glass, J. R., Lee, H.-Y., Chen, Y.-N., & Li, S.-W. D. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.12 · Cited by 24
Ahmed, Z., Vidgen, B., & Hale, S. A. (2022) · EPJ Data Science · doi:10.1140/epjds/s13688-022-00319-9 · Cited by 22
Jarzemsky, J., Paup, J., & Fiesler, C. L. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569846 · Cited by 19
Perfect Storm for Epistemic Injustice
Stewart, H., Cichocki, E., & McLeod, C. (2022) · Feminist Philosophy Quarterly · doi:10.5206/fpq/2022.3/4.14291 · Cited by 26
Pei, J., & Jurgens, D. (2023) · Linguistic Annotation Workshop · doi:10.18653/v1/2023.law-1.25 · Cited by 37
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection
AlKhamissi, B., Ladhak, F., Iyer, S. V., Stoyanov, V., Kozareva, Z., Li, X., Fung, P., Mathias, L., Çelikyılmaz, A., & Diab, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.136 · Cited by 24
Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Countering
Bonaldi, H., Dellantonio, S., Tekiroğlu, S. S., & Guerini, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.549 · Cited by 19
ChatGPT en Educación Superior: explorando sus potencialidades y sus limitaciones
Galli, M. G., & Kanobel, M. C. (2023) · Revista Educación Superior y Sociedad (ESS) · doi:10.54674/ess.v35i2.815 · Cited by 37
Improving Cross-Domain Hate Speech Detection by Reducing the False Positive Rate
Markov, I., & Daelemans, W. M. P. (2021) · Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda (NLP4IF) · doi:10.18653/v1/2021.nlp4if-1.3 · Cited by 19
Say ‘YES’ to Positivity: Detecting Toxic Language in Workplace Communications
Bhat, M. M., Hosseini, S., Awadallah, A. H., Bennett, P. N., & Li, W. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.173 · Cited by 18
Identity and Status: When Counterspeech Increases Hate Speech Reporting and Why
Kim, J. Y., Sim, J., & Cho, D. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10229-2 · Cited by 19
Chakraborty, T., & Masud, S. (2022) · ACM SIGWEB Newsletter · doi:10.1145/3522598.3522601 · Cited by 22
Examining risks of racial biases in NLP tools for child protective services
Field, A., Coston, A., Gandhi, N., Chouldechova, A., Putnam-Hornstein, E., Steier, D., & Tsvetkov, Y. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594094 · Cited by 18
In the Name of Fairness: Assessing the Bias in Clinical Record De-identification
Xiao, Y., Lim, S., Pollard, T., & Ghassemi, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593982 · Cited by 23
Repairing the harm: Toward an algorithmic reparations approach to hate speech content moderation
Peterson‐Salahuddin, C. (2024) · Big Data & Society · doi:10.1177/20539517241245333 · Cited by 18
Auditing GPT's Content Moderation Guardrails: Can ChatGPT Write Your Favorite TV Show?
Mahomed, Y., Crawford, C. M., Gautam, S., Friedler, S. A., & Metaxa, D. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658932 · Cited by 25
Detecting Arabic textual threats in social media using artificial intelligence: An overview
Elzayady, H., Mohamed, M. S., Badran, K. M., & Salama, G. I. (2022) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v25.i3.pp1712-1722 · Cited by 18
Towards Socially Responsible AI: Cognitive Bias-Aware Multi-Objective Learning
Sen, P., & Ganguly, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5654 · Cited by 18
Beyond "Fairness:" Structural (In)justice Lenses on AI for EducationPreprint
Madaio, M., Blodgett, S. L., Mayfield, E., & Dixon‐Román, E. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08847 · Cited by 39
Fan, X., Xiao, Q., Zhou, X., Pei, J., Sap, M., Lu, Z., & Shen, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713477 · Cited by 52
Self-citationInvestigating and Mitigating Biases in Crowdsourced Data
Hettiachchi, D., Sanderson, M., Gonçalves, J., Hosio, S. J., Kazai, G., Lease, M., Schaekermann, M., & Yılmaz, E. (2021) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3462204.3481729 · Cited by 17
Resources for Multilingual Hate Speech Detection
Arango, A., Pérez, J. E. P., Poblete, B., Saldaña, M., & Proust, V. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.12 · Cited by 17
Multi-VALUE: A Framework for Cross-Dialectal English NLP
Ziems, C., Held, W., Yang, J., Dhamala, J., Gupta, R., & Yang, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.44 · Cited by 29
A survey of hate speech detection in Indian languages
Nandi, A., Sarkar, K., Mallick, A., & De, A. (2024) · Social Network Analysis and Mining · doi:10.1007/s13278-024-01223-y · Cited by 17
Lee, C., Gligorić, K., Kalluri, P., Harrington, M., Durmus, E., Sanchez, K. L., San, N., Tse, D., Zhao, X., Hamedani, M. G., et al. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322764121 · Cited by 26
Effects of Algorithmic Flagging on Fairness
TeBlunthuis, N., Hill, B. M., & Halfaker, A. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449130 · Cited by 22
DALC: the Dutch Abusive Language Corpus
Caselli, T., Schelhaas, A., Weultjes, M., Leistra, F., van der Veen, H., Timmerman, G., & Nissim, M. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.6 · Cited by 17
Fairness and Robustness in Invariant Learning: A Case Study in Toxicity ClassificationPreprint
Adragna, R., Creager, E., Madras, D., & Zemel, R. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06485 · Cited by 42
Un-Straightening Generative AI: How Queer Artists Surface and Challenge Model Normativity
Taylor, J., Mire, J., Spektor, F., DeVrio, A., Sap, M., Zhu, H., & Fox, S. E. (2025) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3715275.3732061 · Cited by 26
Self-citationAre You Sure You Want to View This Community? Exploring the Ethics of Reddit’s Quarantine Practice
Carlson, C. R., & Cousineau, L. S. (2020) · Journal of Media Ethics · doi:10.1080/23736992.2020.1819285 · Cited by 19
de Vries, I., & Radford, J. P. (2021) · The British Journal of Criminology · doi:10.1093/bjc/azab077 · Cited by 20
Metadata
- Authors
- Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A.
- Affiliations
- University of Washington (US)
- Carnegie Mellon University (US)
- Allen Institute for Artificial Intelligence (US)
- Corresponding author
- Sap, Maarten
- Venue
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Published
- 2019
- Pages
- 1668-1678
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2949678053
- Cited by
- 817
- References
- 40
- Citations by year
- 2026: 59 · 2025: 96 · 2024: 86 · 2023: 139 · 2022: 142 · 2021: 178 · 2020: 105 · 2019: 12
- FWCI
- 40.99
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Science Foundation (1714566)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- hate speech detection, racial bias, African American English, dialects, annotation bias, hate speech datasets, priming, minority groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
