The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection
Open accessAbstract
Hate speech is a challenging issue plaguing the online social media. While better models for hate speech detection are continuously being developed, there is little research on the bias and interpretability aspects of hate speech. In this paper, we introduce HateXplain, the first benchmark hate speech dataset covering multiple aspects of the issue. Each post in our dataset is annotated from three different perspectives: the basic, commonly used 3-class classification (i.e., hate, offensive or normal), the target community (i.e., the community that has been the victim of hate speech/offensive speech in the post), and the rationales, i.e., the portions of the post on which their labelling decision (as hate, offensive or normal) is based. We utilize existing state-of-the-art models and observe that even models that perform very well in classification do not score high on explainability metrics like model plausibility and faithfulness. We also observe that models, which utilize the human rationales for training, perform better in reducing unintended bias towards target communities. We have made our code and dataset public for other researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
(2016) · Cited by 11,679
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655
A Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241
SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter
Basile, V., Bosco, C., Fersini, E., Nozza, D., Patti, V., Rangel Pardo, F. M., Rosso, P., & Sanguinetti, M. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2007 · Cited by 864
The Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777
Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
Liu, B., & Lane, I. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1352 · Cited by 709
Measuring and Mitigating Unintended Bias in Text Classification
Dixon, L., Li, J., Sorensen, J., Thain, N., & Vasserman, L. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278729 · Cited by 674
Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network
Zhang, Z., Robinson, D., & Tepper, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_48 · Cited by 638
Hate Me, Hate Me Not: Hate Speech Detection on Facebook.
Vigna, F. D., Cimino, A., Dell’Orletta⋄, F., Petrocchi, M., & Tesconi, M. (2017) · CNR ExploRA · Cited by 629
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., Stringhini, G., Vakali, A., Sirivianos, M., & Kourtellis, N. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.14991 · Cited by 596
ERASER: A Benchmark to Evaluate Rationalized NLP Models
DeYoung, J., Jain, S., Rajani, N. F., Lehman, E., Xiong, C., Socher, R., & Wallace, B. C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.408 · Cited by 561
Hate Speech Dataset from a White Supremacy Forum
de Gibert, O., Perez, N., García-Pablos, A., & Cuadros, M. (2018) · Proceedings of the 2nd Workshop on Abusive Language Online (ALW2) · doi:10.18653/v1/w18-5102 · Cited by 425
Racial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414
Us and them: identifying cyber hate on Twitter across multiple protected characteristics
Burnap, P., & Williams, M. L. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0072-6 · Cited by 396
Using “annotator rationales” to improve machine learning for text categorization
Zaidan, O. F., Eisner, J. M., & Piatko, C. (2007) · Cited by 393
Explain Yourself! Leveraging Language Models for Commonsense Reasoning
Rajani, N. F., McCann, B., Xiong, C., & Socher, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1487 · Cited by 385
e-SNLI: Natural language inference with natural language explanations
Camburu, O.-M., Rocktäschel, T., Lukasiewicz, T., & Blunsom, P. (2018) · arXiv · doi:10.48550/arxiv.1812.01193 · Cited by 367 · cited 2×
“Such rationales have been used in common-sense explanations (Rajani et al. 2019), e-SNLI (Camburu et al. 2018) and several other tasks (DeYoung et al. 2020).”
BackgroundSpread of Hate Speech in Online Social Media
Mathew, B., Dutt, R., Goyal, P., & Mukherjee, A. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326034 · Cited by 348
Self-citationExposure to hate speech increases prejudice through desensitization
Soral, W., Bilewicz, M., & Winiewski, M. (2018) · Aggressive Behavior · doi:10.1002/ab.21737 · Cited by 320
Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification
Borkan, D., Dixon, L., Sorensen, J., Thain, N., & Vasserman, L. (2019) · Companion Proceedings of The 2019 World Wide Web Conference · doi:10.1145/3308560.3317593 · Cited by 309
Multilingual and Multi-Aspect Hate Speech Analysis
Ousidhoum, N., Lin, Z., Zhang, H., Song, Y., & Yeung, D.-Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1474 · Cited by 276
Williams, M. L., Burnap, P., Javed, A., Liu, H., & Ozalp, S. (2019) · The British Journal of Criminology · doi:10.1093/bjc/azz049 · Cited by 257
Hate Speech Detection is Not as Easy as You May Think: A Closer Look at Model Validation
Arango, A., Pérez, J. E. P., & Poblete, B. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331262 · Cited by 236
Characterizing and Detecting Hateful Users on Twitter
Ribeiro, M., Calais, P., Santos, Y., Almeida, V., & Meira Jr., W. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15057 · Cited by 221
All You Need is "Love": Evading Hate Speech Detection
Gröndahl, T., Pajola, L., Juuti, M., Conti, M., & Asokan, N. (2018) · Proceedings of the 11th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3270101.3270103 · Cited by 203
What is Gab? A Bastion of Free Speech or an Alt-Right Echo Chamber?
Zannettou, S., Bradlyn, B., Cristofaro, E. D., Kwak, H., Sirivianos, M., Stringhini, G., & Blackburn, J. (2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.1802.05287 · Cited by 202
Deep Learning Models for Multilingual Hate Speech DetectionPreprint
Aluru, S. S., Mathew, B., Saha, P., & Mukherjee, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.06465 · Cited by 201
Self-citationThe effect of an overheard ethnic slur on evaluations of the target: How to spread a social disease
Greenberg, J., & Pyszczynski, T. (1985) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(85)90006-x · Cited by 188
A Benchmark Dataset for Learning to Intervene in Online Hate Speech
Qian, J., Bethke, A., Liu, Y., Belding, E., & Wang, W. Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1482 · Cited by 179
The Effect of Extremist Violence on Hateful Speech Online
Olteanu, A., Castillo, C., Boy, J., & Varshney, K. R. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15040 · Cited by 173
Wang, W., Chen, L., Thirunarayan, K., & Sheth, A. P. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531734 · Cited by 170
An Italian Twitter Corpus of Hate Speech against Immigrants
Sanguinetti, M., Poletto, F., Bosco, C., Patti, V., & Stranisci, M. A. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/26vnss59hfcq · Cited by 168
Thou Shalt Not Hate: Countering Online Hate Speech
Mathew, B., Saha, P., Tharad, H., Rajgaria, S., Singhania, P., Maity, S. K., Goyal, P., & Mukherjee, A. (2019) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v13i01.3237 · Cited by 165
Self-citationOverview of the EVALITA 2018 Hate Speech Detection Task
Bosco, C., Dell’Orletta, F., Poletto, F., Sanguinetti, M., & Tesconi, M. (2018) · EVALITA Evaluation of NLP and Speech Tools for Italian · doi:10.4000/books.aaccademia.4503 · Cited by 164
Analyzing the Targets of Hate in Online Social Media
da Silva, L. H. G., Mondal, M., Correa, D., Benevenuto, F., & Weber, I. G. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v10i1.14811 · Cited by 151
Inside the Right-Leaning Echo Chambers: Characterizing Gab, an Unmoderated Social System
Lima, L., Reis, J. C. S., Melo, P. D. F., Murai, F., Araújo, L., Vikatos, P., & Benevenuto, F. (2018) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2018.8508809 · Cited by 145
Hate begets Hate: A Temporal Study of Hate Speech
Mathew, B., Illendula, A., Saha, P., Sarkar, S., Goyal, P., & Mukherjee, A. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415163 · Cited by 144
Self-citationLeveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech Detection
Qian, J., ElSherief, M., Belding, E., & Wang, W. Y. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2019 · Cited by 101
Author Profiling for Abuse Detection
Mishra, P., Tredici, M. D., Yannakoudakis, H., & Shutova, E. (2018) · UvA-DARE (University of Amsterdam) · Cited by 70
Automatically Generating Annotator Rationales to Improve Sentiment Classification
Yessenalina, A., Choi, Y., & Cardie, C. (2010) · Cited by 65
A Benchmark Dataset for Learning to Intervene in Online Hate SpeechPreprint
Qian, J., Bethke, A., Liu, Y., Belding, E., & Wang, W. Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04251 · Cited by 56
Hierarchical CVAE for Fine-Grained Hate Speech Classification
Qian, J., ElSherief, M., Belding, E., & Wang, W. Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1391 · Cited by 54
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A.-M., Djouvas, C., Chatzakou, D., Ilias Leontiadis, A., Blackburn, J., Stringhini, G., Vakali, A. I., Sirivianos, M., & Kourtellis, N. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1443347 · Cited by 54
Thou shalt not hate: Countering Online Hate Speech
Mathew, B., Tharad, H., Rajgaria, S., Singhania, P., Maity, S. K., Goyal, P., & Mukherjee, A. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.13140/rg.2.2.31128.85765 · Cited by 27
Self-citationThe Effect of Extremist Violence on Hateful Speech Online
Olteanu, A., Castillo, C., Boy, J., et al. (2018) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1804.05704 · Cited by 20
Learning to Decipher Hate Symbols
Qian, J., ElSherief, M., Belding, E., & Wang, W. Y. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1305 · Cited by 19
Leveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech DetectionPreprint
Qian, J., ElSherief, M., Belding, E., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03124 · Cited by 7
Cited by
Parameter-efficient fine-tuning of large-scale pre-trained language models
Ding, N., Qin, Y., Yang, G., Wei, F., Yang, Z., Su, Y., Hu, S., Chen, Y., Chan, C.-M., Chen, W., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00626-4 · Cited by 1,191
Explainability for Large Language Models: A Survey
Zhao, H., Chen, H., Yang, F., Liu, N., Deng, H., Cai, H., Wang, S., Yin, D., & Du, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3639372 · Cited by 681
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Development Functional Testing [164, 235, 381] Performance Benchmarking [40, 56, 88, 93, 123, 127, 153, 238, 248, 307, 327]”
BackgroundExplainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F. (2022) · IEEE Access · doi:10.1109/access.2022.3204051 · Cited by 450
A systematic review of hate speech automatic detection using natural language processing
Jahan, M. S., & Oussalah, M. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126232 · Cited by 279
Metadata
- Authors
- Mathew, B., Saha, P., Yimam, S. M., Biemann, C., Goyal, P., & Mukherjee, A.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2021-05-18
- Volume
- 35
- Issue
- 17
- Pages
- 14867-14875
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W3115453555
- Cited by
- 513
- References
- 57
- FWCI
- 40.97
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.