The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
The Risk of Racial Bias in Hate Speech Detection
Open accessAbstract
We investigate how annotators' insensitivity to differences in dialect can lead to racial bias in automatic hate speech detection models, potentially amplifying harm against minority populations.We first uncover unexpected correlations between surface markers of African American English (AAE) and ratings of toxicity in several widely-used hate speech datasets.Then, we show that models trained on these corpora acquire and propagate these biases, such that AAE tweets and tweets by self-identified African Americans are up to two times more likely to be labelled as offensive compared to others.Finally, we propose dialect and race priming as ways to reduce the racial bias in annotation, showing that when annotators are made explicitly aware of an AAE tweet's dialect they are significantly less likely to label the tweet as offensive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Toxicity detection models misclassify African-American English tweets as negative more often than those written in Standard American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
The cited source says what the claim attributes to it.
In the citing paper
“For example, toxicity classifiers may disproportionately flag African-American English (Mozafari, Farahbakhsh, and Crespi 2020; Sap et al. 2019)”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Sap et al. 2019
In the citing paper
“models are trained with historical data and can present issues such as gender bias and racial bias in AI models [68,73], potentially exacerbating structural inequalities [10]”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 5,022
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
The Impact of Social Media on Children, Adolescents, and Families
O'Keeffe, G. S., Clarke-Pearson, K., & Council on Communications and Media (2011) · Pediatrics · doi:10.1542/peds.2011-0054 · Cited by 1,987 · cited 1×
“Toxic language (e.g., hate speech, abusive speech, or other offensive speech) primarily targets members of minority groups and can catalyze real-life violence towards them (O’Keeffe et al., 2011; Cleland, 2014; Mozur, 2018).”
BackgroundHateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Talat, Z., & Hovy, D. (2016) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n16-2013 · Cited by 1,919
Internal and external motivation to respond without prejudice.
Plant, E. A., & Devine, P. G. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.3.811 · Cited by 1,689
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · SocialNLP@EACL · doi:10.18653/v1/w17-1101 · Cited by 1,478
Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network
Zhang, Z., Robinson, D., & Tepper, J. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93417-4_48 · Cited by 676
Research works printed but not linked: 2
- E. Ashby Plant and Patricia G. Devine. 1998. Inter- nal and external motivation to respond without prej- udice. J. Pers. Soc. Psychol., 75(3):811-832.
- Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hi- erarchical attention networks for document classifi- cation. In NAACL.
Cited by
Sorted by citations
Items 501–600 of 808
The Paradox of Multilingual Emotion Detection
Bruyne, L. D. (2023) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.18653/v1/2023.wassa-1.40 · Cited by 4
An Empirical Study of Metrics to Measure Representational Harms in Pre-Trained Language Models
Hosseini, S., Palangi, H., & Awadallah, A. H. (2023) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2023.trustnlp-1.11 · Cited by 25
A study towards contextual understanding of toxicity in online conversations
Madhyastha, P., Founta, A.-M., & Specia, L. (2023) · Natural Language Engineering · doi:10.1017/s1351324923000414 · Cited by 4
Hamel, E., & Kani, N. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3331139 · Cited by 5
BiasX: “Thinking Slow” in Toxic Content Moderation with Explanations of Implied Social Biases
Zhang, Y., Nanduri, S., Jiang, L., Wu, T., & Sap, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.300 · Cited by 16
Self-citationTechnological Solutions to Online Toxicity: Potential and Pitfalls
Bodaghi, A., Fung, B. C. M., & Schmitt, K. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3340235 · Cited by 6
Kadakol, S., Sanjanasri, J. P., & Lal, G. J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-99-9043-6_6 · Cited by 4
Hate Speech Detection by Using Rationales for Judging Sarcasm
Mamun, M. B., Tsunakawa, T., Nishida, M., & Nishimura, M. (2024) · Applied Sciences · doi:10.3390/app14114898 · Cited by 7
Understanding hate speech: the HateInsights dataset and model interpretability
Arshad, M. U., & Shahzad, W. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2372 · Cited by 5
Reward Model Interpretability via Optimal and Pessimal Tokens
Christian, B., Kirk, H. R., Thompson, J. A. F., Summerfield, C., & Dumbalska, T. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732068 · Cited by 10
Gun Violence News Information Retrieval using BERT as Sequence Tagging Task
Lin, H.-Y., Moh, T.-S., & Westlake, B. G. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671919 · Cited by 3
Machine Learning for Identifying Abusive Content in Text Data
Nayak, R., & Baek, H. S. (2022) · Learning and analytics in intelligent systems · doi:10.1007/978-3-030-93052-3_9 · Cited by 4
Hate Words Detection Among Sri Lankan Social Media Text Messages
Shalinda, J. A. D. U., & Munasinghe, L. (2022) · International Research Conference on Smart Computing and Systems Engineering (SCSE) · doi:10.1109/scse56529.2022.9905129 · Cited by 4
Yee, K., Sebag, A. S., Redfield, O., Eck, M., Sheng, E., & Belli, L. S. (2023) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2023.trustnlp-1.10 · Cited by 5
Fair Without Leveling Down: A New Intersectional Fairness Definition
Maheshwari, G., Bellet, A., Denis, P., & Mikaela Keller, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.558 · Cited by 9
Matos, B., Lima, R. C., Almeida, J. M., Gonçalves, M., & Santos, R. L. T. (2024) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01187-5 · Cited by 3
Recognition of Toxicity of Reviews in Online Discussions
Machová, K., Mach, M., & Vasilko, M. (2022) · Acta Polytechnica Hungarica · doi:10.12700/aph.19.4.2022.4.1 · Cited by 4
Reading Between the Demographic Lines: Resolving Sources of Bias in Toxicity ClassifiersPreprint
Reichert, E., Qiu, H., & Bayrooti, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16402 · Cited by 8
Efficiently Mitigating Classification Bias via Transfer Learning.Preprint
Jin, X., Barbieri, F., Davani, A. M., Kennedy, B., Neves, L., & Ren, X. (2020) · arXiv (Cornell University) · Cited by 4
A Study on Bias Detection and Classification in Natural Language ProcessingPreprint
Evans, A. S., Moniz, H., & Luisa, C. (2023) · Research Square · doi:10.21203/rs.3.rs-3351695/v1 · Cited by 4
Critical, but constructive: defining, detecting, and addressing bias in Computational Social Science
Hase, V., Bachl, M., & TeBlunthuis, N. (2025) · Communication Methods and Measures · doi:10.1080/19312458.2025.2575468 · Cited by 4
Nguyen, T. T., Xu, J., Roy, A., Daumé, H., & Carpuat, M. J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.602 · Cited by 4
McLeroy, A. M., Chen, Y., & Boxell, O. (2024) · International Journal of Social Science Studies · doi:10.11114/ijsss.v12i2.6751 · Cited by 3
Saqia, B., Khan, K., Rahman, A. U., Khan, S. U., Alkhowaiter, M., Khan, W., & Ullah, A. (2024) · IEEE Access · doi:10.1109/access.2024.3504258 · Cited by 3
Kojah, S. A., Toyama, K., & Haimson, O. L. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757504 · Cited by 3
Identity-related Speech Suppression in Generative AI Content Moderation
Proebsting, G., Anigboro, O. I., Crawford, C. M., Metaxa, D., & Friedler, S. A. (2025) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3757887.3763010 · Cited by 8
Explainable AI for Hate Speech Moderation: A Stakeholder‐Centered and Sociotechnical Review
Qureshi, M. D. M., Qureshi, M. A., & Rashwan, W. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70076 · Cited by 6
Johnson, R. L., Duran, L. D. D., Panai, E., González, N. M., Pistilli, G., Kalpokienė, J., & Bertulfo, D. J. (2026) · AI and Ethics · doi:10.1007/s43681-026-01038-x · Cited by 4
Thesis Distillation: Investigating The Impact of Bias in NLP Models on Hate Speech Detection
Elsafoury, F. (2023) · doi:10.18653/v1/2023.bigpicture-1.5 · Cited by 3
What Is Wrong with My Model? Identifying Systematic Problems with Semantic Data Slicing
Yang, C., Hong, Y., Lewis, G. A., Wu, T., & Kästner, C. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695033 · Cited by 5
Rehman, U., Shah, M. U., Iqbal, F., & Fatima, R. (2024) · AI and Ethics · doi:10.1007/s43681-024-00605-4 · Cited by 2
Psychological Impact of AI Moderation
Subrahmanyam, S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0335-2.ch008 · Cited by 3
Long, H. L., O’Neil, A., & Kübler, S. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_099 · Cited by 3
Who Gets Flagged? An Experiment on Censorship and Bias in Social Media Reporting
Feezell, J. T., Conroy, M., Gómez-Aguiñaga, B., & Wagner, J. K. (2023) · PS Political Science & Politics · doi:10.1017/s1049096522001238 · Cited by 4
Exposing Racial Dialect Bias in Abusive Language Detection: Can Explainability Play a Role?
Manerba, M. M., & Morini, V. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-23618-1_32 · Cited by 3
Jaki, S., & Steiger, S. (2023) · Springer eBooks · doi:10.1007/978-3-662-65964-9 · Cited by 7
Computer Vision, Human Likeness, and Problematic Behaviors
Otterbacher, J. (2023) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3563359.3597381 · Cited by 3
Nascimento, F., & Chown, E. (2023) · Lever Press eBooks · doi:10.1353/book.110606 · Cited by 3
Stubborn Lexical Bias in Data and Models
Serrano, S., Dodge, J., & Smith, N. A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.516 · Cited by 3
Self-citationHATE SPEECH ON SOCIAL MEDIA: A CASE STUDY OF BLASPHEMY IN INDONESIAN CONTEXT
Elfrida, R., & Pasaribu, A. N. (2023) · English Review Journal of English Education · doi:10.25134/erjee.v11i2.7909 · Cited by 7
Context-Aware Offensive Language Detection in Human-Chatbot Conversations
Shin, M., Chin, H., Song, H., Choi, Y., Choi, J., & Cha, M. (2024) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp60711.2024.00049 · Cited by 5
Self-citationZhou, J., Verma, G., Zhang, L., Chang, N., & Choudhury, M. D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710990 · Cited by 4
Duluth at SemEval-2020 Task 12: Offensive Tweet Identification in English with Logistic Regression
Ted Pedersen, A. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.255 · Cited by 3
August, T., Sap, M., Clark, E., Reinecke, K., & Smith, N. A. (2020) · doi:10.18653/v1/2020.nuse-1.6 · Cited by 3
Self-citationEnriching Abusive Language Detection with Community Context
Saleem, H. M., Kurrek, J., & Ruths, D. A. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.13 · Cited by 3
A Multi-task Learning Model for Fine-Grain Dialogue Social Bias Measurement
Mai, H., Zhou, X., & Wang, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17189-5_27 · Cited by 3
An Attribute-Aligned Strategy for Learning Speech Representation
Huang, Y.-L., Su, B.-H., Hong, Y.-W. P., & Lee, C.-C. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1341 · Cited by 3
Dependency-Based Embedding for Distinguishing Between Hate Speech and Offensive Language
Madukwe, K. J., Gao, X., & Xue, B. (2020) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wiiat50758.2020.00132 · Cited by 3
QaDialMoE: Question-answering Dialogue based Fact Verification with Mixture of Experts
Wang, L., Zhang, P., Lu, X., Zhang, L., Yan, C., & Zhang, C. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.229 · Cited by 4
Mosquera, A. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.250 · Cited by 3
Dialect Diversity in Text Summarization on TwitterPreprint
Celis, L. E., & Keswani, V. (2020) · arXiv (Cornell University) · Cited by 2
Reading In-Between the Lines: An Analysis of DissenterPreprint
Rye, E. C., Blackburn, J., & Beverly, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01772 · Cited by 3
Confronting Structural Inequities in AI for Education.Preprint
Madaio, M., Blodgett, S. L., Mayfield, E., & Dixon‐Román, E. J. (2021) · arXiv (Cornell University) · Cited by 3
Guetler, V. F. (2022) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.11253 · Cited by 3
Williams, N. W., Casas, A., Aslett, K., & Wilkerson, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4540742 · Cited by 3
Feature Attribution-Guided Contrastive Learning: Mitigating Lexical Bias in Toxic Speech Detection
Peng, Z., Ren, Y., Wang, D., Zhang, L., Yuan, L., & Ji, Y. (2023) · International Conference on New Trends in Computational Intelligence (NTCI) · doi:10.1109/ntci60157.2023.10403665 · Cited by 2
A Deep Learning Framework for Classifying and Mitigating Bias in News Reporting
Mitra, A., Das, R., Paul, J., Majumder, R., Saha, A., Sengupta, N., & Sil, J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-73125-9_27 · Cited by 2
Collaborative Growth: When Large Language Models Meet Sociolinguistics
Nguyen, D. (2025) · Language and Linguistics Compass · doi:10.1111/lnc3.70010 · Cited by 8
High risk of political bias in black box emotion inference models
Plisiecki, H., Lenartowicz, P., Flakus, M., & Pokropek, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-86766-6 · Cited by 2
Putica, A., Yurtbasi, M., & Khanna, R. (2025) · AI & Society · doi:10.1007/s00146-025-02336-4 · Cited by 5
Quantifying the spread of racist content on fringe social media: A case study of Parler
Kolluri, A., Murthy, D., & Vinton, K. (2025) · Big Data & Society · doi:10.1177/20539517251321752 · Cited by 2
SoK: What Makes Private Learning Unfair?
Yao, K., & Juarez, M. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00052 · Cited by 6
A Comprehensive Survey on Bias and Fairness in Large Language Models
Haque, F., Xu, D., & Niu, X. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8197-6_7 · Cited by 5
Confusing the Map for the Territory
Qadri, R., Madaio, M., & Gray, M. L. (2025) · Communications of the ACM · doi:10.1145/3731655 · Cited by 2
Rizvi, N., Flores, A. M., Rizvi, M., Ousidhoum, N. D., & Munyaka, I. N. S. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757478 · Cited by 3
From Culture to Code: An Intersectional Analysis of AAVE Slang in Large Language Models
Nias, J., Brandon, D. T., Douglass, T., Haynes, A., Patterson, N., & Cooper, K. (2025) · African Human Computer Interaction Conference (AfriCHI) · doi:10.1145/3757232.3757243 · Cited by 2
Guerra, R., Carvalho, P., Marques, C. M. V. A., Carmona, M., Sarroeira, R., Batista, F., Ribeiro, R., Fonseca, A. J. F., Moro, S., & Silva, C. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05392-9 · Cited by 2
Udechukwu, L. M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01069-4 · Cited by 2
Beyond Euphemisms: Rethinking LLMs for SRH in Conservative Contexts
Humayun, A., Zubair, B., & Mustafa, M. (2026) · International Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791315 · Cited by 3
Mining the online infosphere: A survey
Adak, S., Chakraborty, S., Das, P., Das, M., Dash, A., Hazra, R., Mathew, B., Saha, P., Sarkar, S., & Mukherjee, A. (2022) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1453 · Cited by 3
Suum Cuique: Studying Bias in Taboo Detection with a Community Perspective
Khalid, O., Rusert, J., & Srinivasan, P. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.227 · Cited by 2
Analysis of Bias in NLP Models With Regression and Effect Sizes
Dayanık, E., Vu, N. T., & Padó, S. (2022) · Northern European Journal of Language Technology · doi:10.3384/nejlt.2000-1533.2022.3505 · Cited by 3
Supporting Online Toxicity Detection with Knowledge Graphs
Lobo, P. R., Daga, E., & Alani, H. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19398 · Cited by 2
Hate speech detection on Indonesian text using word embedding method-global vector
Hayaty, M., Laksito, A. D., & Adi, S. (2023) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v12.i4.pp1928-1937 · Cited by 2
Cross-Platform and Cross-Domain Abusive Language Detection with Supervised Contrastive Learning
Khondaker, M. T. I., Abdul-Mageed, M., & Lakshmanan, V. S. L. (2023) · doi:10.18653/v1/2023.woah-1.9 · Cited by 3
Reward Gaming in Conditional Text Generation
Pang, R. Y., Padmakumar, V., Sellam, T., Parikh, A. P., & He, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.262 · Cited by 19
Molamohammadi, M., Taïk, A., Roux, N. L., & Farnadi, G. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623256 · Cited by 2
Dorpe, J. V., Yang, Z., Grenon‐Godbout, N., & Winterstein, G. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.26 · Cited by 2
A Machine Learning Approach for Moderating Toxic Hinglish Comments of YouTube Videos
Singh, A. K., Vaibhav, K., & Arora, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-99-7817-5_14 · Cited by 2
Recourse for Reclamation: Chatting with Generative Language Models
Chien, J., McKee, K. R., Kay, J., & Isaac, W. S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650999 · Cited by 3
Semi-Automated Nonresponse Detection for Open-Text Survey Data
Hibben, K. C., Smith, Z. R., Rogers, B., Ryan, V. M., Scanlon, P., & Hoppe, T. A. (2024) · Social Science Computer Review · doi:10.1177/08944393241249720 · Cited by 3
Xenophobia Meter: Defining and Measuring Online Sentiment toward Foreigners on Twitter
Umarova, K., Okorafor, O., Lu, P., Shan, S., Xu, A., Zhou, R., Otiono, J., Lyon, B., & Leshed, G. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31406 · Cited by 2
Mingo, H. (2024) · International Symposium on Networks, Computers and Communications · doi:10.1109/isncc62547.2024.10759007 · Cited by 2
AI-Cybersecurity Education Through Designing AI-based Cyberharassment Detection Lab
Okpala, E., Vishwamitra, N., Guo, K., Liao, S., Cheng, L., Hu, H., Yuan, X., Wade, J., & Khorsandroo, S. (2025) · Journal of The Colloquium for Information Systems Security Education · doi:10.53735/cisse.v12i1.194 · Cited by 4
How to analyze cyberbullying on social media platforms
Lekscha, J., & Mirbabaie, M. (2025) · i-com · doi:10.1515/icom-2025-0005 · Cited by 3
Machlovi, N., Saleki, M., Ababio, I. B., & Amin, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13184-3_24 · Cited by 2
Von Hass-Sprache zur Kriminalität
Spitzer, M. (2019) · Nervenheilkunde · doi:10.1055/a-0952-6895 · Cited by 2
Govor mržnje u hrvatskom medijskom prostoru
Poljak, M., Hadžić, J., & Martinić, M. (2020) · In medias res · doi:10.46640/imr.9.17.8 · Cited by 2
Richardson, S. (2021) · Business Information Review · doi:10.1177/02663821211020194 · Cited by 2
Takano, M., Taka, F., Morishita, S., Nishi, T., & Ogawa, Y. (2021) · PLoS ONE · doi:10.1371/journal.pone.0255101 · Cited by 2
Keyword-Enhanced Multi-Expert Framework for Hate Speech Detection
Zhong, W., Wu, Q., Lu, G., Xue, Y., & Hu, X. (2022) · Mathematics · doi:10.3390/math10244706 · Cited by 2
7. Rewriting Algorithms for Just Recognition: From Digital Aural Redlining to Accent Activism
Eidsheim, N. S. (2023) · University of California Press eBooks · doi:10.1525/9780520389748-012 · Cited by 2
Measuring the Effect of Influential Messages on Varying Personas
Sun, C., Li, J., Chan, H. P., Zhai, C., & Ji, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.48 · Cited by 3
Robustness Analysis uncovers Language Proficiency Bias in Emotion Recognition Systems
Tran, Q., Shpileuskaya, K., Zaunseder, E., Salg, J., Putzar, L., & Blankenburg, S. (2023) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii59096.2023.10388123 · Cited by 3
Combating high variance in Data-Scarce Implicit Hate Speech Classification
Pal, D., Chaudhari, K., & Sharma, H. (2022) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon55691.2022.9977681 · Cited by 2
Measure Utility, Gain Trust: Practical Advice for XAI ResearcherPreprint
Davis, B., Glenski, M., Sealy, W. I. N., & Arendt, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12924 · Cited by 2
Algorithmic Censorship by Social Platforms: Power and ResistancePreprint
Cobbe, J. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3437304 · Cited by 2
How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social ImpactPreprint
Jin, Z., Chauhan, G., Tse, B., Sachan, M., & Mihalcea, R. F. (2021) · arXiv (Cornell University) · doi:10.3929/ethz-b-000527311 · Cited by 3
Speech Toxicity Analysis: A New Spoken Language Processing Task.Preprint
Ghosh, S., Lepcha, S., Sakshi, S., & Shah, R. R. (2021) · arXiv (Cornell University) · Cited by 2
Competency Problems: On Finding and Removing Artifacts in Language DataPreprint
Gardner, M., Merrill, W., Dodge, J., Peters, M. E., Ross, A., Singh, S., & Smith, N. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08646 · Cited by 25
Self-citation
Metadata
- Authors
- Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A.
- Affiliations
- University of Washington (US)
- Carnegie Mellon University (US)
- Allen Institute for Artificial Intelligence (US)
- Corresponding author
- Sap, Maarten
- Venue
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Published
- 2019
- Pages
- 1668-1678
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2949678053
- Cited by
- 817
- References
- 40
- Citations by year
- 2026: 59 · 2025: 96 · 2024: 86 · 2023: 139 · 2022: 142 · 2021: 178 · 2020: 105 · 2019: 12
- FWCI
- 40.99
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Funders
- National Science Foundation (1714566)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- hate speech detection, racial bias, African American English, dialects, annotation bias, hate speech datasets, priming, minority groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
