A Survey on Automatic Detection of Hate Speech in Text
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Abstract
The scientific study of hate speech, from a computer science point of view, is recent. This survey organizes and describes the current state of the field, providing a structured overview of previous approaches, including core algorithms, methods, and main features used. This work also discusses the complexity of the concept of hate speech, defined in many platforms and contexts, and provides a unifying definition. This area has an unquestionable potential for societal impact, particularly in online communities and digital media platforms. The development and systematization of shared resources, such as guidelines, annotated datasets in multiple languages, and algorithms, is a crucial step in advancing the automatic detection of hate speech.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent studies(Jurgens etal. 2019; Fortuna and Nunes 2018) that have looked into tackling and proposing subtle hate detection suggest the consideration of making all subtle forms of discrimination, even jokes, as hate speech since they negatively affect some people psychological even though they are considered harmless(Douglass etal. 2016).”
From Misogynoir: challenges in detecting intersectional hate (2022) · cites this paper as Fortuna and Nunes 2018
Citations
Cites
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655 · cited 1×
“Nevertheless, detecting hate speech is a very important task, because it is connected with actual hate crimes [42, 65, 77], and automatic hate speech detection in text can also provide data about this phenomenon.”
BackgroundA Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w17-1101 · Cited by 1,395 · cited 4×
“A problem that is referred in hate speech detection is that sentences must be classified and not words [66].”
BackgroundInfluentialAbusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122 · cited 9×
“[10], abusive language [58], discrimination [69], profanity [23], toxicity [43], flaming [35], extremism [55, 62], and radicalization [2].”
BackgroundMethodInfluentialDetecting Hate Speech on the World Wide Web
Warner, W. B., & Hirschberg, J. (2012) · Cited by 964
Deep Learning for Hate Speech Detection in Tweets
Badjatiya, P., Gupta, S., Gupta, M., & Varma, V. (2017) · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion · doi:10.1145/3041021.3054223 · Cited by 849 · cited 2×
“N-grams are one of the most used techniques in hate speech automatic detection and related tasks [4, 9, 19, 33, 52, 58, 77].”
MethodStanford typed dependencies manual
de Marnee, M.-C., & Manning, C. D. (2010) · Cited by 717
Hate Speech Detection with Comment Embeddings
Djuric, N., Zhou, J., Morris, R., Grbovic, M., Radosavljevic, V., & Bhamidipati, N. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742760 · Cited by 712 · cited 2×
“Some authors [25] use a paragraph2vec approach to classify language on user comments as abusive or clean and also to predict the central word in the message [25].”
Background
Research works printed but not linked: 18
- ACL., ALW1: 1st workshop on abusive language online.
- Burnap Peter, Proceedings of the Conference on the Internet, Policy 8 Politics. 1--18
- CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http://social.umd.edu/woh/. CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http://social.umd.edu/woh/.
- CONTACT., 2017, Interdisciplinary conference on Hate speech. Definitions, Interpretations and Practices.
- Davidson Thomas, 2017, Automated hate speech detection and the problem of offensive language. arXiv Preprint arXiv:1703.04009 · arXiv
- De Marneffe Marie-Catherine, 2008, Manning
- Pauw Guy De, 2016, First workshop on text analytics for cybersecurity and online safety (TA-COS
- Vigna Fabio Del, 2017, Proceedings of the 1st Italian Conference on Cybersecurity. 86--95
- Cambridge Dictionary. 2017. Profanity. Retrieved from https://dictionary.cambridge.org/dictionary/english/profanity. Cambridge Dictionary. 2017. Profanity. Retrieved from https://dictionary.cambridge.org/dictionary/english/profanity.
- Giblietto Fabio, 2015, Proceedings of the 4th Workshop on Making Sense of Microposts (#Microposts’14)
- Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http://reportinghate.eu/contact2017/. Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http://reportinghate.eu/contact2017/.
- Kwok Irene, 2013, Proceedings of the Association for the Advancement of Artificial Intelligence.
- Ross Bjorn, 2017, Measuring the reliability of hate speech annotations: The case of the european refugee crisis. arXiv Preprint arXiv:1701.08118 · arXiv
- Silva Leandro, 2016, Analyzing the targets of hate in online social media. arXiv Preprint arXiv:1603.07709 · arXiv
- Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master’s thesis. Uppsala Universitet. Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master’s thesis. Uppsala Universitet.
- Tulkens Stéphan, 2016, A dictionary-based approach to racism detection in dutch social media. arXiv Preprint arXiv:1608.08738 · arXiv
- Warner William, 2012, Proceedings of the Second Workshop on Language in Social Media. Association for Computational Linguistics, 19--26
- Yuan Shuhan, 2016, Proceedings of the International Conference on Extending Database Technology. 696--697
Cited by
Items 601–700 of 1,004
Neighbours and Kinsmen: Hateful Users Detection with Graph Neural Network
Li, S., Zaidi, N. A., Liu, Q., & Li, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75762-5_35 · Cited by 7
A Deep Hybrid Approach for Hate Speech Analysis
Shah, V., Udmale, S. S., Sambhe, V., & Bhole, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89128-2_41 · Cited by 7
Montariol, S., Riabi, A., & Seddah, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.13029 · Cited by 7
“Given the impact social media hate speech can have on our society as a whole – leading to many small-scale Overton window effects – the NLP community has devoted considerable efforts to automatic hate speech detection using machine learning-based approaches, and proposed different benchmarks and datasets to evaluate t…”
BackgroundGao, Z., Jing, S., & Zhang, L. (2025) · Symmetry · doi:10.3390/sym17081310 · Cited by 7
I’m not Welcome Here – Uma Revisão de Escopo sobre Toxicidade e Discurso de Ódio em Jogos Digitais
Gibrim, P. T. M., Ribeiro, M. V. G., Moreira, L. S., Melo, P. D. F., & Reis, J. C. S. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.15998 · Cited by 6
“Embora amplamente discutido, o discurso de ódio ainda carece de uma definição universalmente aceita [32] e levanta bastante debate na sociedade.”
Human-Centered AI for Migrant Integration Through LLM and RAG Optimization
Castellanos–Nieves, D., & García-Forte, L. (2024) · Applied Sciences · doi:10.3390/app15010325 · Cited by 7
Online Learning for Noisy Labeled Streams
Qiu, J., Zhuo, S., Yu, P. S., Wang, C., & Huang, S. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3734875 · Cited by 8
“Online streaming data is continuously advancing real-time analysis and decision-making processes across various fields, such as multimedia retrieval [55, 78], online speech analysis [12, 15], and recommendation systems [4, 61].”
Bäumler, J., Blöcher, L., Frey, L.-J., Chen, X., Bayer, M., & Reuter, C. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3820778 · Cited by 8
“…we created two separate spreadsheets in Excel to collect data for both datasets and models on key dimensions of interest to our study, which were initially generated by screening related survey papers (e.g., [38, 49, 82, 113]), and then revised inductively during engagement with the publications.”
InfluentialA Multi-Task Benchmark for Abusive Language Detection in Low-Resource Settings
Gaim, F., Song, H., Lee, H., Ko, C., Hwang, E. J., & Park, J. C. (2025) · neural information processing systems · doi:10.52202/085713-5387 · Cited by 6
Automatic Detection of Toxic South African Tweets Using Support Vector Machines with N-Gram Features
Oriola, O., & Kotzé, E. (2019) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi47871.2019.9004298 · Cited by 6
“Because of the varying performances of both word and character n-grams in previous works, we extracted word ngram and character n-gram features [2].”
BackgroundMethodInfluentialCombining Textual Features for the Detection of Hateful and Offensive Language
Hakimov, S., & Ewerth, R. (2021) · Institutional Repository of Leibniz Universität Hannover (Leibniz Universität Hannover) · doi:10.15488/16881 · Cited by 6
Online to Offline Crossover of White Supremacist Propaganda
Diab, A., Jagdagdorj, B.-E., Ng, L. H. X., Lin, Y., & Yoder, M. M. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543873.3587569 · Cited by 6
“Online hate speech is a frequent topic of attention in the cyber social threat space [2, 13, 22].”
BackgroundHarmful Terms in Computing: Towards Widespread Detection and Correction
Winchester, H., Boyd, A. E., & Johnson, B. (2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1109/icse-seis58686.2023.00018 · Cited by 6
Exploring the Distinctive Tweeting Patterns of Toxic Twitter Users
Qayyum, H., Ikram, M., Zhao, B. Z. H., Wood, I. D., Kourtellis, N., & Kâafar, M. A. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386402 · Cited by 7
Ibrahim, Y. M., Essameldin, R., & Darwish, S. M. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.047840 · Cited by 17
Use of Natural Language Processing for the Detection of Hate Speech on Social Media
Shohan, M. H., Ahmed, K. R., Kahar, N. F., Jahan, N., Hassan, M. M., Ahmad, R. B., Yaakob, N., Ong, B.-L., & Islam, N. (2024) · Journal of Advanced Research in Applied Sciences and Engineering Technology · doi:10.37934/araset.51.2.8696 · Cited by 6
“Repression of minorities, terrorist acts, and suicide attempts might happen as a consequence [9].”
BackgroundPropaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-agent LLMs
Alam, F., Biswas, M. R., Shah, U., Zaghouani, W., & Mikros, G. K. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0576-7_28 · Cited by 6
Herath, M., Atapattu, T., Dung, H. A., Treude, C., & Falkner, K. E. K. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.198 · Cited by 6
“…social media and online communities has attracted attention from researchers in related fields such as cyberbullying (Rosa et al., 2018), aggression (Kumar et al., 2018), hate speech (Fortuna and Nunes, 2018), abusive language (Waseem et al., 2017), and offensive language (Zampieri et al., 2019).”
BackgroundOriola, O., & Kotzé, E. (2020) · South African Computer Journal · doi:10.18489/sacj.v32i2.847 · Cited by 9
“We handcrafted syntactical features to create a sparse vector space and used word and character n-gram features as well as part-of-speech (PoS) features derived from Penn Treebank in NLTK (Bird et al., 2009), for their performances in (Fortuna & Nunes, 2018).”
MethodMIN_PT: An European Portuguese Lexicon for Minorities Related Terms
Fortuna, P., Cortez, V., Ramalho, M. S., & Pérez-Mayos, L. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.8 · Cited by 6
“Dictionaries and lexicons are commonly used in the field of hate speech automatic detection (Fortuna and Nunes, 2018), with applications ranging”
BackgroundSelf-citationWeb Based Multilingual Real Time Speech Transcription Transliteration and Translation System
Gupta, A. K., Somkunwar, R. K., Kumari, A., Kumari, A., Godhke, K., & Repale, J. (2021) · International Conference on Information Systems and Computer Networks (ISCON) · doi:10.1109/iscon52037.2021.9702481 · Cited by 6
Lindenmayr, M., Kircher, T., Stolte, A., & Foerderer, J. (2022) · Progress in IS · doi:10.1007/978-3-031-06543-9_7 · Cited by 7
Li, K. (2022) · International Conference on Computers, Information Processing and Advanced Education (CIPAE) · doi:10.1109/cipae55637.2022.00058 · Cited by 6
“Specifically, in order to precisely portray the new misogyny detection(included but not limited to AMI) and other supplementary technologies, special attention will be given to the evaluation and usage of neural network methods misogyny detection and graph convolutional networks[4].”
BackgroundMethodResultInfluentialSilva, C., & Carvalho, P. C. Q. D. F. (2023) · Comunicação e Sociedade · doi:10.17231/comsoc.43(2023).4135 · Cited by 6
Hate Speech Detection in Social Media Using the Ensemble Learning Technique
Haque, A., & Chowdhury, M. N.-U.-R. (2023) · International Journal of Advanced Networking and Applications · doi:10.35444/ijana.2023.15111 · Cited by 6
Dilkes, J. (2023) · Discourse & Society · doi:10.1177/09579265231190344 · Cited by 6
“The most common computer science approach is supervised machine learning (Fortuna and Nunes, 2019; Schmidt and Wiegand, 2017), which is dependent on human annotators, such that there may be limited data, and inconsistency of classification (Ross et al., 2016; Waseem, 2016).”
BackgroundImpact of Data Augmentation on Hate Speech Detection
Batarfi, H. A., Alsaedi, O. A., Wali, A. M., & Jamal, A. T. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-40852-6_10 · Cited by 8
Hate Speech Detection in Audio Using SHAP - An Explainable AI
Imbwaga, J. L., Chittaragi, N. B., & Koolagudi, S. G. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-64064-3_21 · Cited by 6
Gender biases and hate speech: Promoters and targets in the Argentinean political context
Burin, L. D., Pérez, J. M., Rosati, G., Pires, M. R., Nanton, M. C., & Kozlowski, D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0317001 · Cited by 6
RECAST: Interactive Auditing of Automatic Toxicity Detection Models
Wright, A. P., Shaikh, O., Park, H., Epperson, W., Ahmed, M., Pinel, S., Yang, D., & Chau, D. H. (2020) · doi:10.1145/3403676.3403691 · Cited by 7
“There is a growing desire to moderate and remove toxic language from social media and public forums, a result of increasing online interactions [7].”
BackgroundThe Expression of Moral Values in the Twitter Debate: a Corpus of Conversations
Stranisci, M. A., Leonardis, M. D., Bosco, C., & Patti, V. (2021) · Italian Journal of Computational Linguistics · doi:10.4000/ijcol.880 · Cited by 6
“…linguistic resources developed in the last few years for detecting hate speech and a wide range of related phenomena (Poletto et al. 2021; Fortuna and Nunes 2018; Schmidt and Wiegand 2017), to the best of our knowledge, the joint observation of conversational aspects and moral values…”
BackgroundTeamOtter at SemEval-2022 Task 5: Detecting Misogynistic Content in Multimodal Memes
Maheshwari, P., & Nangi, S. R. (2022) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2022.semeval-1.88 · Cited by 6
“While there has been a lot of work on identifying hateful content in unimodal data (Gandhi et al., 2019; Fortuna and Nunes, 2018), there is little work on multimodal hate detection.”
BackgroundDealing with Evaluative Expressions and Hate Speech Metaphors with Fuzzy Property Grammar Systems
Urrutia, A. T., Jiménez‐López, M. D., & Muñoz, S. C. (2023) · Axioms · doi:10.3390/axioms12050484 · Cited by 6
Contextual Lexicon-Based Approach for Hate Speech and Offensive Language Detection.Preprint
Vargas, F., de Góes, F. R., Carvalho, I., Benevenuto, F., & Pardo, T. A. S. (2021) · arXiv (Cornell University) · Cited by 6
Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media
Kameswari, L., Sravani, D., Mamidi, R., Hiware, K., Dutt, R., Sinha, S., Patro, S., Ghosh, K., Ghosh, S., Helbig, D., et al. (2020) · doi:10.18653/v1/2020.socialnlp-1 · Cited by 2
Akram, A. (2024) · arXiv · doi:10.48550/arxiv.2403.13812 · Cited by 6
“When it comes to content moderation and other similar applications, this is crucial for detecting and removing harmful information and automated spam [6].”
BackgroundCross-Domain Toxic Spans Detection
Schouten, S. F., Barbarestani, B., Tufa, W. T., Vossen, P. T. J. M., & Markov, I. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35320-8_40 · Cited by 5
“The rise of social media over the past decade and a half and the accompanying increase in exposure to toxic language has motivated much research into the automated detection of such language [6,13].”
BackgroundDeveloping continuous toxicity detection against increasing types of perturbed toxic text
Kang, H., Chen, J., Li, Y., Miao, X., Xu, M., Zhou, S., Zhong, M. J., Zhu, Y., & Qian, T. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104470 · Cited by 7
Guerra, R., Carvalho, P. C. Q. D. F., Marques, C. M. V. A., Carmona, M., Sarroeira, R., Batista, F., Ribeiro, R., Fonseca, A. J. F., Moro, S., & Silva, C. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05392-9 · Cited by 5
Multi-platform analysis of sexual harassment networks: gender dynamics and digital amplification
Basit, L., Santoso, P., & Rizky, F. (2025) · Social Network Analysis and Mining · doi:10.1007/s13278-025-01563-3 · Cited by 5
“…for coordinated regulatory responses following frameworks established by Gagliar-done et al. (2015) and technical recommendations for developing network-aware detection and intervention systems that build upon advances demonstrated by Gutiérrez-Batista et al. (2024) and Fortuna and Nunes (2018).”
Ideology-Based LLMs for Content Moderation
Civelli, S., Bernardelle, P., Pratama, N., & Demartini, G. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3810946 · Cited by 5
“Fortuna and Nunes [13] further emphasized the lack of universal definitions of hate speech and annotator inconsistencies, while also proposing a multi-view SVM to improve interpretability.”
USF at SemEval-2019 Task 6: Offensive Language Detection Using LSTM With Word Embeddings
Goel, B., & Sharma, R. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2139 · Cited by 5
“The features include the bag of words (Greevy and Smeaton, 2004; Kwok and Wang, 2013), dictionaries, distance metrics, N-grams, IF-IDF scores, and profanity windows (Fortuna and Nunes, 2018).”
BackgroundInfluentialVocabulary of Hatred in Social Media: An Example from Italian
Dyda, A., & Paleta, A. (2023) · Neuphilologische Mitteilungen · doi:10.51814/nm.130138 · Cited by 5
Hate speech detection on Indonesian text using word embedding method-global vector
Hayaty, M., Laksito, A. D., & Adi, S. (2023) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v12.i4.pp1928-1937 · Cited by 5
“Nowadays, Hate speech is not only done face-to-face but also through online communication [3].”
La fabrique discursive de la haine: Affects, agitation fasciste et « politique du ressentiment »
Voirol, O., & Martini, É. (2023) · Réseaux · doi:10.3917/res.241.0039 · Cited by 6
Semi-Automatic Dataset Annotation Applied to Automatic Violent Message Detection
Botella-Gil, B., Sepúlveda-Torres, R., Bonet-Jover, A., Martínez-Barco, P., & Saquete, E. (2024) · IEEE Access · doi:10.1109/access.2024.3361404 · Cited by 5
“In recent years a large volume of work by NLP researchers has been done to generate these resources [14], [15], [16], [17], [18].”
BackgroundDIVERSE: A Dataset of YouTube Video Comment Stances with a Data Programming Model
Cruickshank, I. J., Ng, L. H. X., & Soofi, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825480 · Cited by 5
“Several machine learning algorithms ranging from logistic regression to neural network models have been constructed to perform automatic hate speech detection Fortuna and Nunes (2018).”
BackgroundMethodEnglish Offensive Text Detection Using CNN Based Bi-GRU Model
Roy, T., Islam, M. R., Miazee, A. A., Antara, A., Amin, A., & Hossain, S. (2024) · doi:10.1109/icict64387.2024.10839709 · Cited by 5
“They are developing practical frameworks and creating automatic classifiers that rely on supervised machine learning models [2].”
Assis, G., Amorim, A., Carvalho, J., Ferro, M., de Oliveira, D., Vianna, D., & Paes, A. (2024) · Linguamática · doi:10.21814/lm.16.2.446 · Cited by 6
Zain, M., Hussain, N., Qasim, A., Mehak, G., Ahmad, F., Sidorov, G., & Gelbukh, A. F. (2025) · Algorithms · doi:10.3390/a18070396 · Cited by 5
“More recently, extensive surveys on methodologies for hate speech detection have highlighted the progress of automatic techniques to classify text as hate speech, acknowledging the significance of dataset quality, feature engineering, and model interpretability [24].”
Niemann, M. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78635-9_73 · Cited by 6
Toxic Text in Personas: An Experiment on User Perceptions
Salminen, J. O., Jung, S., Santos, J. M., de Lisboa, I. U., & Jansen, B. J. (2021) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00157 · Cited by 5
No Time like the Present: Effects of Language Change on Automated Comment Moderation
Justen, L. J., Müller, K., Niemann, M., & Becker, J. (2022) · IEEE Conference on Business Informatics · doi:10.1109/cbi54897.2022.00012 · Cited by 5
“Since then, various scholars around the world have primarily focused on creating machine learning models that could improve the detection quality, which is reflected in a growing number of (meta-) studies [10], [14]–[16].”
BackgroundLammerts, P., Lippmann, P., Hsu, Y.-C., Casati, F., & Yang, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604655 · Cited by 7
Hate Speech in The Context of Digital Violence in Türkiye: Perceptions and Biases on Afghan Identity
Subay, Ö. Ö., & Gökalp, B. (2023) · Liberal Düşünce Dergisi · doi:10.36484/liberal.1314063 · Cited by 5
Deep One-Class Fine-Tuning for Imbalanced Short Text Classification in Transfer Learning
Bose, S., Su, G., & Liu, L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46661-8_23 · Cited by 6
Xiao, Y., & Alam, F. (2023) · Arabic Natural Language Processing Conference (ArabicNLP) · doi:10.18653/v1/2023.arabicnlp-1.58 · Cited by 5
Threatening Expression and Target Identification in Under-Resource Languages Using NLP Techniques
Malik, M. S. I. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-54534-4_1 · Cited by 5
Shades of incivility in Reddit: A comparison between echo chambers and plural spaces
Salgado, S., Fernández‐García, B., & Biscaia, A. (2024) · International Social Science Journal · doi:10.1111/issj.12536 · Cited by 5
la Peña, G. L. D., & Rosso, P. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2104 · Cited by 5
“It is the case of recent works (Waseem et al., 2017; ElSherief et al., 2018; Gamb¨ack and Sikdar, 2017; Zhang et al., 2018) and surveys (Schmidt and Wie-gand, 2017) and (Fortuna and Nunes, 2018).”
SAJA at TRAC 2020 Shared Task: Transfer Learning for Aggressive Identification with XGBoost.
Tawalbeh, S. K., Hammad, M., & AL-Smadi, M. (2020) · Cited by 5
Saroj, A., Chanda, S., & Pal, S. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.265 · Cited by 5
“Recently two surveys by Schmitdt and Wiegand (2017) and Fortuna and Nunes (2018) show how to tag an offensive tweet from features like sentiment, linguistic features, different lexical resources.”
BackgroundInfluentialUsing Cross Lingual Learning for Detecting Hate Speech in Portuguese
Firmino, A. A., Baptista, C. D. S., & de Paiva, A. C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86475-0_17 · Cited by 5
LeaningTower@LT-EDI-ACL2022: When Hope and Hate Collide
Muti, A., Manerba, M. M., Korre, K., & Barrón‐Cedeño, A. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.46 · Cited by 7
Red Pilled - The Allure of Digital Hate
Munn, L. (2023) · Bielefeld University Press / transcript Verlag eBooks · doi:10.14361/9783839466735 · Cited by 9
Hate Speech Detection on Twitter through Natural Language Processing using LSTM Model
Arbaatun, C. N., Nurjanah, D., & Nurrahmi, H. (2022) · Building of Informatics Technology and Science (BITS) · doi:10.47065/bits.v4i3.2718 · Cited by 6
Revisiting Hate Speech Benchmarks: From Data Curation to System Deployment
Kulkarni, A., Masud, S., Goyal, V., & Chakraborty, T. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599896 · Cited by 14
“Due to their democratized nature, social media platforms serve as breeding grounds for the unwarranted spread of hate speech [10, 18, 34], opprobrious offensive opinions [62], and provocative propaganda [12].”
Background“Why do I feel offended?” - Korean Dataset for Offensive Language Identification
Park, S.-H., Kim, K.-M., Lee, O., Kang, Y., Lee, J., Lee, S., & Lee, S. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.85 · Cited by 5
“Sentiment indicates an average Krippendorff’s α of 0.45, indicating moderate agreement (Hughes, 2021; Sap et al., 2020b).”
ResultInfluentialWhen Sarcasm Hurts: Irony-Aware Models for Abusive Language Detection
Frenda, S., Patti, V., & Rosso, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42448-9_4 · Cited by 5
Haters in the spotlight: Gender and socially unacceptable Facebook comments
de Maiti, K. P., Franza, J., & Fišer, D. (2023) · Internet Pragmatics · doi:10.1075/ip.00093.pah · Cited by 5
LaSTUS/TALN at TRAC - 2020 Trolling, Aggression and Cyberbullying
Altın, L. S. M., Bravo, Á., & Saggion, H. (2020) · Repositori digital de la UPF (Universitat Pompeu Fabra) · Cited by 5
Using Twitter to Track Immigration Sentiment During Early Stages of the COVID-19 PandemicPreprint
Rowe, F., Mahony, M., Graells-Garrido, E., Rango, M., & Sievers, N. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/pc3za · Cited by 5
Modes of toxic behavior and game design considerations in online multiplayer games
Ng, L. H. X., Lim, A. X. W., & Yoder, M. M. (2025) · First Monday · doi:10.5210/fm.v30i6.13851 · Cited by 4
Bolatbek, M., Sagynay, M., Mussiraliyeva, S., & Yeltay, Z. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3027 · Cited by 4
“…forest and others — are widely recognized as strong baseline algorithms in text classi fi cation tasks, particularly in the domains of hate speech detection, cyberbullying identi fi cation, and toxic content moderation ( Schmidt & Wiegand, 2017 ; Fortuna & Nunes, 2018 ; Badjatiya et al., 2017 ).”
Gender-Based Violence as a Cyberthreat: The Impact of Social Media on Digital Security
Zambrano, P., Torres, J., Anchundia, C. E., & Illicachi, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-94953-1_20 · Cited by 4
Hagedorn, L., Schmid, U., Winter, S., & Woltran, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11108-1 · Cited by 4
Arabic hate speech detection based on BERT models variants
Duridi, T., Jaber, A., & Martínez, P. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100845 · Cited by 4
Wang, K., Clarke, L., Dreue, C.-C. J., Zhou, G., & Jacques, J. T. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3799442 · Cited by 5
“Such systems can detect subtler forms of policy violations (e.g., identifying hate speech [41, 84], harassment [51], or other toxic content by analysing linguistic patterns) and have even been tailored to high-stakes scenarios like detecting signs of self-harm or suicidal intent in user posts [16,…”
An Evaluation of the Automatic Detection of Hate Speech in Social Media Networks
Omar, A., & Hashem, M. E. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130228 · Cited by 4
“Fortuna and Nunes [24] similarly argue that automatic detection methods are effective mapping tools for tracking the diffusion of hate speech on a large scale across regions.”
BackgroundA Comparative Analysis on AI-Driven Speech Protection Approaches
Vijayaraj, A., Shaikumar, R., Pradeep, K., Santhosh, V., N, S. P. A., & Tinku Abenas, T. (2024) · International Conference on Data Intelligence and Cognitive Informatics (ICDICI) · doi:10.1109/icdici62993.2024.10810982 · Cited by 4
Reasoning based on symbolic and parametric knowledge bases: A survey
Xu, M., Ning, Y., Li, Y., Chen, J., Wen, J., Xiao, Y., Zhou, S., Pan, B., Bao, Z., Miao, X., et al. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104880 · Cited by 4
Exploring Multi-modal Hate Speech Detection Using Machine Learning and Deep Learning Models
Khera, S., Anuradha, Singh, A., & Singh, K. K. (2025) · Springer eBooks · doi:10.1007/978-981-96-2355-6_11 · Cited by 4
Large Language Model Annotation Bias in Hate Speech Detection
Okpala, E., & Cheng, L. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35879 · Cited by 13
BERT of all trades, master of some
Gordeev, D., & Lykova, O. (2020) · Cited by 7
Salemi, A., Sabri, N., Kebriaei, E., Bahrak, B., & Shakery, A. (2021) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2021.semeval-1.136 · Cited by 4
Salminen, J. O., Linarez, M. J., Jung, S., & Jansen, B. J. J. (2021) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.1109/besc53957.2021.9635436 · Cited by 7
“At the same time, this implies that datasets and feature representation need to be frequently updated to reflect changes in linguistic expressions of hate [9] as well as novel feature representations.”
BackgroundInfluentialDarkness can not drive out darkness: Investigating Bias in Hate SpeechDetection Models
Elsafoury, F. (2022) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/2022.acl-srw.4 · Cited by 8
“…hate against groups, based on specific characteristics such as physical appearance, re-ligion, descent, national or ethnic origin, sexual orientation, gender identity or other, and it can occur with different linguistic styles, even in subtle forms or when humor is used ” (Fortuna and Nunes, 2018).”
Advanced Deep Learning Approaches for Hate Speech Detection
Wang, Q. (2023) · Highlights in Science Engineering and Technology · doi:10.54097/hset.v41i.6801 · Cited by 4
“The main types of hate speech include: General hate speech, Racism, Sexism, Religion Anti-semitism, Nationality, Other Physical/mental handicap, Politics, Sectarianism Socio-economical status [5].”
BackgroundOnline Hate Speech and the Representations of Refugees in #VatanimdaMülteci (#RefugeeinMyCountry)
Demirdiş, S. (2023) · Advances in media, entertainment and the arts (AMEA) book series · doi:10.4018/978-1-6684-8427-2.ch013 · Cited by 5
Role of Artificial Intelligence in Cyberbullying and Cyberhate Detection
Kaur, M., & Saini, M. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10308090 · Cited by 4
“…The most cited paper with maximum NCII is “A Survey on automatic detection of hate speech in Text,” published by “ACM Computing Surveys” [22], followed by “Common sense reasoning for Detection, prevention, and Mitigation of Cyberbullying” by “ACM Transactions on Interactive Intelligent…”
BackgroundA Fine-Grained Taxonomy of Replies to Hate Speech
Yu, X., Zhao, A., Blanco, E., & Hong, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.450 · Cited by 4
“Sarcasm and humor refers to language that uses sarcasm (Waseem and Hovy, 2016; Justo et al., 2014) or humor (Fortuna and Nunes, 2018; Gof-fredo et al., 2022) to address the author of the hate-ful comment.”
BackgroundEmpathy and Hate Speech in Social Media: The Case of Indonesia
Rahmi, K. H. (2024) · International Journal of Social Science and Human Research · doi:10.47191/ijsshr/v7-i03-29 · Cited by 4
Deep Learning for Hate Speech Detection: A Personality-based Approach
Lee, K., & Ram, S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3652502 · Cited by 4
“Within the context of automated hate speech detection, a dominant approach used in prior literature is machine learning (ML) [3].”
Abusive Language Detection in Khasi Social Media Comments
Baruah, A., Wahlang, L., Jyrwa, F., Shadap, F., Barbhuiya, F. A., & Dey, K. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3664285 · Cited by 4
“[Fortuna and Nunes 2018; Schmidt and Wiegand 2017] discussed the diferent approaches, algorithms, and features that have been used for the automated detection of abusive languages.”
BackgroundCharacterization of Political Polarized Users Attacked by Language Toxicity on Twitter
Xu, W. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3681849 · Cited by 4
“When social media platforms bring people freedom of communication, studies identified language toxicity emerging across platforms, such as Twitter (Now, X) [5, 12], Facebook [9, 19], Reddit [16], YouTube [20], Telegram [36], and Whisper [33].”
Sennary, H. A., Abozaid, G. Y., Hemeida, A., & Mikhaylov, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-76632-2 · Cited by 4
“Abusive language has a strong intentionality component, even though the definitions of both 12 include the phrase "strongly impolite, rude" and the potential for profanity 13 .”
RetractedTowards Reflexive AI: A Comprehensive Exploration of Enhancing Social Science Research Through NLP
Shan, S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-84460-7_49 · Cited by 7
Semi-Supervised Annotation of Portuguese Hate Speech Across Social Media Domains
Santos, R. B., Matos, B. C., Carvalho, P. C. Q. D. F., Batista, F., & Ribeiro, R. (2022) · Repositório do ISCTE-IUL · doi:10.4230/oasics.slate.2022.11 · Cited by 4
“Due to the anonymity allowed on the Internet, people feel more ease at expressing themselves and engaging in hostile behaviors [12].”
BackgroundEnsemble Learning to Detect Aggressiveness in Mexican Spanish Tweets.
Molina-González, M. D., Plaza-del-Arco, F. M., Valdivia, M. T. M., & López, L. A. U. (2019) · IberLEF@SEPLN · Cited by 4
Metadata
- Authors
- Fortuna, P., & Nunes, S.
- Affiliations
- INESC TEC (PT)
- Universidade do Porto (PT)
- Venue
- ACM Computing Surveys
- Published
- 2018-07-31
- Volume
- 51
- Issue
- 4
- Pages
- 1-30
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2887782043
- Cited by
- 1,241
- References
- 52
- Citations by year
- 2026: 139 · 2025: 195 · 2024: 141 · 2023: 185 · 2022: 158 · 2021: 199 · 2020: 144 · 2019: 71 · 2018: 8
- FWCI
- 59.53
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- FourEyes, a research line within project TEC4Growth—Pervasive Intelligence
- North Portugal Regional Operational Programme
- European Regional Development Fund
- Enhancers and Proofs of Concept with Industrial (Impact/NORTE-01- 0145-FEDER-000020)
- PORTUGAL 2020 Partnership Agreement
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- hate speech detection, text classification, definition of hate speech, annotated dataset, multilingual dataset, online communities, digital media platforms, social impact
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.