A Survey on Automatic Detection of Hate Speech in Text
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Abstract
The scientific study of hate speech, from a computer science point of view, is recent. This survey organizes and describes the current state of the field, providing a structured overview of previous approaches, including core algorithms, methods, and main features used. This work also discusses the complexity of the concept of hate speech, defined in many platforms and contexts, and provides a unifying definition. This area has an unquestionable potential for societal impact, particularly in online communities and digital media platforms. The development and systematization of shared resources, such as guidelines, annotated datasets in multiple languages, and algorithms, is a crucial step in advancing the automatic detection of hate speech.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent studies(Jurgens etal. 2019; Fortuna and Nunes 2018) that have looked into tackling and proposing subtle hate detection suggest the consideration of making all subtle forms of discrimination, even jokes, as hate speech since they negatively affect some people psychological even though they are considered harmless(Douglass etal. 2016).”
From Misogynoir: challenges in detecting intersectional hate (2022) · cites this paper as Fortuna and Nunes 2018
Citations
Cites
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655 · cited 1×
“Nevertheless, detecting hate speech is a very important task, because it is connected with actual hate crimes [42, 65, 77], and automatic hate speech detection in text can also provide data about this phenomenon.”
BackgroundA Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w17-1101 · Cited by 1,395 · cited 4×
“A problem that is referred in hate speech detection is that sentences must be classified and not words [66].”
BackgroundInfluentialAbusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122 · cited 9×
“[10], abusive language [58], discrimination [69], profanity [23], toxicity [43], flaming [35], extremism [55, 62], and radicalization [2].”
BackgroundMethodInfluentialDetecting Hate Speech on the World Wide Web
Warner, W. B., & Hirschberg, J. (2012) · Cited by 964
Deep Learning for Hate Speech Detection in Tweets
Badjatiya, P., Gupta, S., Gupta, M., & Varma, V. (2017) · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion · doi:10.1145/3041021.3054223 · Cited by 849 · cited 2×
“N-grams are one of the most used techniques in hate speech automatic detection and related tasks [4, 9, 19, 33, 52, 58, 77].”
MethodStanford typed dependencies manual
de Marnee, M.-C., & Manning, C. D. (2010) · Cited by 717
Hate Speech Detection with Comment Embeddings
Djuric, N., Zhou, J., Morris, R., Grbovic, M., Radosavljevic, V., & Bhamidipati, N. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742760 · Cited by 712 · cited 2×
“Some authors [25] use a paragraph2vec approach to classify language on user comments as abusive or clean and also to predict the central word in the message [25].”
Background
Research works printed but not linked: 18
- ACL., ALW1: 1st workshop on abusive language online.
- Burnap Peter, Proceedings of the Conference on the Internet, Policy 8 Politics. 1--18
- CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http://social.umd.edu/woh/. CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http://social.umd.edu/woh/.
- CONTACT., 2017, Interdisciplinary conference on Hate speech. Definitions, Interpretations and Practices.
- Davidson Thomas, 2017, Automated hate speech detection and the problem of offensive language. arXiv Preprint arXiv:1703.04009 · arXiv
- De Marneffe Marie-Catherine, 2008, Manning
- Pauw Guy De, 2016, First workshop on text analytics for cybersecurity and online safety (TA-COS
- Vigna Fabio Del, 2017, Proceedings of the 1st Italian Conference on Cybersecurity. 86--95
- Cambridge Dictionary. 2017. Profanity. Retrieved from https://dictionary.cambridge.org/dictionary/english/profanity. Cambridge Dictionary. 2017. Profanity. Retrieved from https://dictionary.cambridge.org/dictionary/english/profanity.
- Giblietto Fabio, 2015, Proceedings of the 4th Workshop on Making Sense of Microposts (#Microposts’14)
- Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http://reportinghate.eu/contact2017/. Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http://reportinghate.eu/contact2017/.
- Kwok Irene, 2013, Proceedings of the Association for the Advancement of Artificial Intelligence.
- Ross Bjorn, 2017, Measuring the reliability of hate speech annotations: The case of the european refugee crisis. arXiv Preprint arXiv:1701.08118 · arXiv
- Silva Leandro, 2016, Analyzing the targets of hate in online social media. arXiv Preprint arXiv:1603.07709 · arXiv
- Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master’s thesis. Uppsala Universitet. Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master’s thesis. Uppsala Universitet.
- Tulkens Stéphan, 2016, A dictionary-based approach to racism detection in dutch social media. arXiv Preprint arXiv:1608.08738 · arXiv
- Warner William, 2012, Proceedings of the Second Workshop on Language in Social Media. Association for Computational Linguistics, 19--26
- Yuan Shuhan, 2016, Proceedings of the International Conference on Extending Database Technology. 696--697
Cited by
Items 701–800 of 1,004
Valle-Nunes, L. H. (2020) · Matraga - Revista do Programa de Pós-Graduação em Letras da UERJ · doi:10.12957/matraga.2020.44154 · Cited by 4
Hate Speech Detection Using Genetic Programming
Aljero, M. K. A., & Dimililer, N. (2020) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase51841.2020.9436621 · Cited by 4
“Research in the text mining field has focused on the use of supervised machine learning algorithms such as Support Vector Machine, Random Forest, Decision Trees and Logistic Regression [1].”
MethodDetection of Hate Speech Spreaders with BERT.
Dukić, D., & Kržić, A. S. (2021) · Cited by 4
A Comprehensive Study and Detailed Review On Hate Speech Classification : A Systematic Analysis
Shah, P., & Patel, A. (2021) · International Conference on Advances in Computing, Communication and Control (ICAC3) · doi:10.1109/icac353642.2021.9697110 · Cited by 4
Cattin, T., Molina-Villegas, A., Fuentes-Carrera, J., & Siordia, O. S. (2022) · Lecture notes in geoinformation and cartography · doi:10.1007/978-3-030-98096-2_4 · Cited by 4
Salminen, J. O., Jung, S., & Jansen, B. J. J. (2022) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3546155.3546647 · Cited by 4
“Previous research in HCI has featured surprisingly little discussion on this matter, even though toxicity is regarded as a serious matter of human interaction via computing systems [22, 78, 82].”
BackgroundDefersha, N. B., Abawajy, J., & Kekeba, K. (2022) · IEEE International Conference on Current Development in Engineering and Technology (CCET) · doi:10.1109/ccet56606.2022.10080837 · Cited by 4
“Classical machine learning approaches, many studies have conducted by utilizing feature such as bag of words (BOW), n-grams, and POS (part-of-speech) as main approaches to select important features [2].”
BackgroundInfluentialNot All Counterhate Tweets Elicit the Same Replies: A Fine-Grained Analysis
Albanyan, A., Hassan, A. E., & Blanco, E. (2023) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2023.starsem-1.8 · Cited by 13
“Recently, considerable literature has grown around identifying hateful content in user-generated content (Fortuna and Nunes, 2018).”
BackgroundHate Speech Detection for a low level language (Assamese)
Baruah, N., Gogoi, A., Phukan, R., & Goutom, P. J. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10307931 · Cited by 4
“For instance, Fortuna and Nunes [11] have defined some of the essential standards for identifying hate speech.”
BackgroundFaria, R. (2023) · Springer eBooks · doi:10.1007/978-3-031-38248-2_11 · Cited by 5
Garg, N., Singh, A. K., & Manchanda, M. (2024) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct60090.2024.10486236 · Cited by 4
YNU-HPCC at SemEval-2019 Task 6: Identifying and Categorising Offensive Language on Twitter
Zhou, C., Wang, J., & Zhang, X. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2142 · Cited by 4
“However, through this method, we may erroneously classify many people as hate speakers by failing to differentiate be-tween commonplace offensive language and genuine hate speech (Davidson et al., 2017; Fortuna and Nunes, 2018).”
MethodPascucci, A., Manna, R., Masucci, V., & Monti, J. (2020) · ARCHIVIO ISTITUZIONALE DELLA RICERCA-UNIVERSITA DEGLI STUDI DI NAPOLI "LORIENTALE" · Cited by 4
TeamX@DravidianLangTech-ACL2022: A Comparative Analysis for Troll-Based Meme Classification
Nandi, R. N., Alam, F., & Nakov, P. (2022) · Workshop on Speech, Vision, and Language Technologies for Dravidian Languages (DravidianLangTech) · doi:10.18653/v1/2022.dravidianlangtech-1.13 · Cited by 4
Das, S., Mandal, P., & Chatterji, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.12939 · Cited by 4
“In the need to counter the online hate content, the NLP research community is continuing prominent contributions and findings for the same [1, 2, 3].”
BackgroundAdvances in Machine Learning & Artificial Intelligence
Akram, A. (2021) · Advances in Machine Learning & Artificial Intelligence · doi:10.33140/amlai · Cited by 4
“This is of the utmost importance in applications such as content moderation, where it is important to identify and remove hazardous information and automated spam [11].”
BackgroundAliyu, S. M., Wajiga, G. M., & Murtala, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.02169 · Cited by 4
“One of the most common definition of hate speech is any form of communication, verbal or written that attacks an individuals or groups based on characteristics like race, religion, gender, ethnicity, nationality, disability and political affiliations [18], [19], [20], [21].”
BackgroundHe, Y., Zhao, J. F., Yuan, Y., Zhang, T., Cai, W., Cheng, H., Shi, Z., Zhu, M., Tang, H., Zhang, C., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.02530 · Cited by 4
“Rule-based systems, such as keyword blocklists and regular expressions, were widely adopted for their simplicity and high inference speed [13, 27].”
Detecting Hate Speech in the Digital Age: AI Solutions for Real-Time Moderation
Babu, C. V. S., & Darshini, S. D. (2025) · Advances in social networking and online communities book series · doi:10.4018/979-8-3693-9904-0.ch012 · Cited by 3
Bypassing Guardrails: Lessons Learned from Red Teaming ChatGPT
Zhuo, T. Y., Huang, Y., Chen, C., Du, X., & Xing, Z. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3747288 · Cited by 6
“Toxic Language [25, 33, 70].”
Breaking the silence: the rise of hate speech in Spanish politics
Picazo‐Sanchez, P. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-025-00413-8 · Cited by 4
“With the recent advances in AI and more concretely in the area of NLP, tedious tasks like analysis of vast of documents and text became more common and pleasant [18, 23].”
Multi-task Learning with Active Learning for Arabic Offensive Speech Detection
Alansari, A., & Luqman, H. (2026) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3848627 · Cited by 3
“In contrast, hate speech refers to derogatory language that specifically targets individuals (such as politicians or celebrities) or particular groups (such as those defined by gender, religion, or nationality) [3].”
Zhang, R., & Horvát, E.-Á. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757510 · Cited by 4
“…facets of offensive language have been researched, such as the development of natural language processing models that perform automatic detection of offensive language on social media [15, 17, 93] and closely related automatic detection of hate speech [17, 28, 70, 93] and cyberbullying [16].”
Baider, F. H., Szczepaniak-Kozak, A., Strani, K., & Jaszczyk-Grzyb, M. (2025) · Applied Linguistics Review · doi:10.1515/applirev-2024-0129 · Cited by 3
“For the purposes of this paper, we adopt Fortuna and Nunes ’ s (2018: 5) de fi nition of hate speech as “ any language that attacks or diminishes, that incites violence or hate against groups, based on speci fi c characteristics such as physical appearance, religion, descent, national or ethnic…”
Fuse-MD: A culturally-aware multimodal model for detecting misogyny memes
Ponnusamy, R., Saranya, R., Sivagnanam, B., Kizhakkeparambil, A., Sharma, D., Buitelaar, P., & Chakravarthi, B. R. (2026) · Natural Language Processing Journal · doi:10.1016/j.nlp.2026.100197 · Cited by 4
Husain, F. (2026) · Social Network Analysis and Mining · doi:10.1007/s13278-026-01580-w · Cited by 3
“Studies in affective computing (Poria et al. 2017 ) and abusive language detection (Fortuna and Nunes 2018 ) have suggested that emotional and empa - thetic cues may provide early signals for identifying offen - sive intent, while conversely, offense markers can inform sentiment polarity estimation.”
Identifying, Explaining, and Correcting Ableist Language with AI
Smith, K. S., Chilton, L., & Bragg, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790533 · Cited by 4
“A substantial body of work addresses toxicity, hate speech, and bias classification [16, 21, 39].”
InfluentialEnhancing Hate Speech Detection with a Distil BERT and BiLSTM Hybrid Mode
Goswami, P., & Daniel, A. (2026) · SN Computer Science · doi:10.1007/s42979-026-04913-w · Cited by 3
Poblete, B., & Pérez, J. E. P. (2020) · Communications of the ACM · doi:10.1145/3416969 · Cited by 3
A Survey of Online Hate Speech through the Causal Lens
Founta, A.-M., & Specia, L. (2021) · doi:10.18653/v1/2021.cinlp-1.6 · Cited by 7
Is this Question Real? Dataset Collection on Perceived Intentions and Implicit Attack Detection
Mirzaei, M. S., Meshgi, K., & Sekine, S. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512005 · Cited by 5
“A large and growing body of research has investigated explicit attacks, abusive language detection [20], toxicity in comments [52] and hate speech [15].”
BackgroundWang, C.-S., Yang, H., Li, B., & Chen, H.-Y. (2023) · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia59966.2023.10326404 · Cited by 3
“Furthermore, Fortuna and Nunes [10] emphasized that abusive language includes hate speech.”
BackgroundMethodSingh, G. V., Ghosh, S. K., Verma, A., Painkra, C., & Ekbal, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.275 · Cited by 3
“Due to the low prevalence of hate speech on social media (approximately 3% of messages are hateful), (Fortuna and Nunes, 2018)), we scrape posts by searching for hate words to increase the likelihood of encountering hate-offensive content.”
BackgroundSmith, G. M., Licata, G., & Rustagi, I. (2024) · Business and Professional Communication Quarterly · doi:10.1177/23294906231226211 · Cited by 4
“It can occur with different linguistic styles and be done subtly (Fortuna & Nunes, 2018).”
Capturing the Spectrum of Social Media Conflict: A Novel Multi-objective Classification Model
Warke, O., Jose, J. M., Breitsohl, J., & Wang, J. (2024) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3664190.3672510 · Cited by 3
Hate Speech Detection of Roman Urdu Using Transformer Models
Ullah, R., Khan, W. U., Marwat, S. N. K., Ullah, J., & Irshad, F. (2024) · International Conference on Emerging Technologies · doi:10.1109/icet63392.2024.10935087 · Cited by 3
Classifying Genetic Essentialist Biases using Large Language Models
Reimann, R., Lynch, K. E., Gawronski, S. A., Chan, J., & Griffiths, P. E. (2025) · Review of Philosophy and Psychology · doi:10.1007/s13164-025-00770-3 · Cited by 3
“At one end, domain-specific classifiers trained on binary tasks–such as categorising an article as containing racist slurs or not–regularly achieve scores in the range of 0.7–0.9 across key performance metrics (for review, see Fortuna & Nunes 2019).”
InfluentialExamining inferred author and textual correlates of harmful language annotation
Korre, K., Yenikent, S., Basile, A., Spallaccia, B., Franco-Salvador, M., & Barrón‐Cedeño, A. (2025) · Language Resources and Evaluation · doi:10.1007/s10579-025-09822-7 · Cited by 3
“…that the social media company (e.g., Facebook or Twitter) owns and removing it given a certain degree of similarity, a solution with limited applications since it is dependent on the variation of database instances, as well as being language dependent (Fortuna et al., 2021; Fortuna & Nunes, 2018).”
Sargeant, H., Waldetoft, H., & Magnusson, M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732016 · Cited by 4
“Considerableresearchhasbeendedicatedtodetectinghatespeech, particularly focusing on overtly abusive language found on social media platforms and other digital channels [37, 56, 67, 72, 80].”
Target Oriented Investigation of Online Abusive Attack
Pittala, R. B., Raju, B. S. T., Babu, G. L. A., Reddy, G. S., Hemanth, S., & Sai, B. (2025) · International Conference on Intelligent Technologies (CONIT) · doi:10.1109/conit65521.2025.11167016 · Cited by 3
“Others because of gender or racial or ethnic or religious or political affiliations or other background characteristics[2][12].”
KTCR: Improving Implicit Hate Detection with Knowledge Transfer driven Concept Refinement
Garg, S., Kavuri, V. H., Shroff, G., & Mishra, R. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227639 · Cited by 4
“Detecting hate speech is a well-established task in natural language processing, but most existing methods focus on explicit expressions of hate [19], [20].”
de Mendonça, R. R., Rosa, F. D. F., & Bonacin, R. (2019) · Conferência Ibero-Americana WWW/Internet (CIAWI) · doi:10.33965/ciawi2019_201914l004 · Cited by 3
“Síntese dos Trabalhos Relacionados Referência Objetivo Aplicação A R D 1 2 3 4 5 6 7 8 (Ravi & Ravi, 2015) X X X X (Salawu et al., 2017) X X (Fortuna & Nunes, 2018) X X X (Omar et al., 2018) X X X (Kumar & Sachdeva, 2019) X X X (Rosa et al., 2019) X X X Este Estudo X X X X X X X Legenda: Objetivos:…”
BackgroundDuluth at SemEval-2020 Task 12: Offensive Tweet Identification in English with Logistic Regression
Pedersen, T. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.255 · Cited by 4
Rahman, M. R., Arefin, M. S., Hossain, M. B., Habib, M. A., & Kayes, A. S. M. (2020) · Complexity · doi:10.1155/2020/5639787 · Cited by 3
“So, it can contribute to misclassification if the words are used to represent different contexts [16].”
BackgroundInfluentialKotyushev, M., Glazkova, A. V., & Morozov, D. A. (2021) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2021.semeval-1.124 · Cited by 3
Social Science for Natural Language Processing: A Hostile Narrative Analysis Prototype
Anning, S., Konstantinidis, G., & Webber, C. (2021) · ACM Web Science Conference (WebSci) · doi:10.1145/3447535.3462489 · Cited by 3
“While this differentiation is a reoccurring theme in social scientific theories of intergroup relations, hate speech detection seems only concerned with detecting othering language (see [27], [34], [9], [1], [29], [5], [42]).”
BackgroundDetecting Hate Speech Spreaders on Twitter using LSTM and BERT in English and Spanish.
Uzan, M., & HaCohen‐Kerner, Y. (2021) · CLEF (Working Notes) · Cited by 3
Niemann, M., Müller, K., Kelm, C., Assenmacher, D., & Becker, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87031-7_8 · Cited by 3
Phonetic Detection for Hate Speech Spreaders on Twitter.
Castillo, E., & Martínez-Santos, J. C. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 3
BERT-BU12 Hate Speech Detection Using Bidirectional Encoder-Decoder
Gupta, S., Kaur, M., & Lakra, S. (2021) · International Journal of System Dynamics Applications · doi:10.4018/ijsda.20220701.oa4 · Cited by 4
“In brief as termed by Fortuna & Nunes, (2018), “hate” has specific targets and is used to promote violence or hate.”
BackgroundOriola, O., & Kotzé, E. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-10522-7_44 · Cited by 3
Getting Around the Semantics Challenge in Hateful Memes
Kiran, A., Shetty, M., Shukla, S., Kerenalli, V., & Das, B. (2022) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-19-3391-2_26 · Cited by 3
Identification of Political Hate Speech Using Machine Learning-Based Text Toxicity Analysis
Priya, & Gupta, S. K. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-5221-0_22 · Cited by 4
Niebuhr, O., & Neitsch, J. (2022) · Journal of Speech Sciences · doi:10.20396/joss.v11i00.16153 · Cited by 3
Shibly, F. H. A., Sharma, U., & Naleer, H. M. M. (2022) · Journal of Pharmaceutical Negative Results · doi:10.47750/pnr.2022.13.s03.072 · Cited by 6
The Effects Of Hate Speech On Social Media: The Case Of Syrian Refugees In Türkiye
Sipahioğlu, B. Ö. (2023) · Erciyes İletişim Dergisi · doi:10.17680/erciyesiletisim.1159037 · Cited by 3
Red Pilled - The Allure of Digital Hate
Munn, L. (2023) · Bielefeld University Press eBooks · doi:10.1515/9783839466735 · Cited by 8
Stefanelli, F., Menesini, E., Nocentini, A., & Palladino, B. E. (2023) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2022.0198 · Cited by 3
Target-Oriented Investigation of Online Abusive Attacks: A Dataset and Analysis
Alharthi, R., Alharthi, R., Shekhar, R., & Zubiaga, A. (2023) · IEEE Access · doi:10.1109/access.2023.3289148 · Cited by 6
“language detection models [12], [13], [14], [15], [16] as well”
BackgroundMultimodal Hateful Memes Detection via Image Caption Supervision
Fang, H., Zhu, F., Han, J., & Hu, S. (2022) · IEEE Smart World Congress (SWC) · doi:10.1109/smartworld-uic-atc-scalcom-digitaltwin-pricomp-metaverse56740.2022.00221 · Cited by 3
“For hateful text detection, some significant research works [3], [4] have been proposed.”
BackgroundSánchez, A. M. S., Ruiz‐Muñoz, D., & Sánchez‐Sánchez, F. J. (2023) · Cuadernos info · doi:10.7764/cdi.56.60093 · Cited by 3
Multilingual Hate Speech Detection Using Semi-supervised Generative Adversarial Network
Mnassri, K., Farahbakhsh, R., & Crespi, N. (2024) · Studies in computational intelligence · doi:10.1007/978-3-031-53503-1_16 · Cited by 3
Proactive Blocking through the Automated Identification of Likely Harassers
Gazia, I., Hubbard, T., Scalona, T., Kang, Y., & Zuckerman, E. (2024) · Journal of Online Trust and Safety · doi:10.54501/jots.v2i3.175 · Cited by 3
“Most previous attempts at algorithmic content moderation have been focused on textual content (Fortuna and Nunes 2018).”
BackgroundMethodFetahi, E., Hamiti, M., Susuri, A., Zenuni, X., & Ajdari, J. (2024) · SEEU Review · doi:10.2478/seeur-2024-0025 · Cited by 3
Tavares, V., & Melo‐Pfeifer, S. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192869203.013.41 · Cited by 7
JTML at SemEval-2019 Task 6: Offensive Tweets Identification using Convolutional Neural Networks
Torres, J., & Vaca, C. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2117 · Cited by 3
“Recent surveys by (Schmidt and Wiegand, 2017) and (Fortuna and Nunes, 2018) summarizes the taxonomies and methods proposed for detecting abusive language.”
BackgroundThenmozhi, D., Kumar, B. S., Sharavanan, S., & Aravindan, C. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2130 · Cited by 3
“Schmidt and Wiegand (2017) & Fortuna and Nunes (2018) reviewed the approaches used for hate speech detection.”
BackgroundMukherjee, P., Pal, M., Banerjee, S., & Naskar, S. K. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2118 · Cited by 3
“Papers published in the last two years include the surveys by (Schmidt and Wiegand, 2017) and (Fortuna and Nunes, 2018), the paper by (Davidson et al., 2017) presenting the Hate Speech Detection dataset used in (Malmasi and Zampieri, 2017) and a few other recent papers such as (ElSherief et al.,…”
Methodbhanodaig at SemEval-2019 Task 6: Categorizing Offensive Language in social media
Kumar, R., Bhanodai, G., Pamula, R., & Chennuru, M. R. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2098 · Cited by 3
“For a recent and more comprehensive survey on hate speech detection we recommend (Schmidt and Wiegand, 2017) and (Fortuna and Nunes, 2018).”
BackgroundA Novel IN-Gram Technique for Improving the Hate Speech Detection for Larger Datasets
Gupta, B., Goel, N., Jain, D., & Gupta, N. (2020) · Lecture notes in networks and systems · doi:10.1007/978-981-15-2329-8_62 · Cited by 3
Dependency-Based Embedding for Distinguishing Between Hate Speech and Offensive Language
Madukwe, K. J., Gao, X., & Xue, B. (2020) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wiiat50758.2020.00132 · Cited by 4
“This bias would manifest in real life scenarios causing human right and freedom of speech infringement because offensive language does not qualify to be classified as hate speech as determined by the different definitions of hate speech [1, 3, 4].”
BackgroundA Large-scale Comprehensive Abusiveness Detection Dataset with Multifaceted Labels from Reddit
Song, H., Ryu, S. H., Lee, H., & Park, J. C. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.43 · Cited by 16
Performance Comparison of Word2Vec Models for Detecting Arabic Hate Speech on Social Networks
Al-Saqqa, S., Awajan, A., & HAMMO, B. H. (2022) · International Conference on Emerging Trends in Computing and Engineering Applications (ETCEA) · doi:10.1109/etcea57049.2022.10009734 · Cited by 3
“Significant efforts have been made to detect hate speech using word embedding in English [10].”
BackgroundAlsamman, A., Schmitz, A., & Wimmer, M. A. (2023) · Annual International Conference on Digital Government Research · doi:10.1145/3598469.3598473 · Cited by 3
“Especially the combination of the different disruptive technologies like text mining, natural language processing, and machine learning in general promise to handle hate speech in an efficient manner [17].”
BackgroundVargas, F., Carvalho, I., de Góes, F. R., Benevenuto, F., & Pardo, T. A. S. (2021) · arXiv (Cornell University) · Cited by 3
Contextual-Aware and Expert Data Resources for Brazilian Portuguese Hate Speech DetectionPreprint
Vargas, F., Carvalho, I., Pardo, T. A. S., & Benevenuto, F. (2023) · Research Square · doi:10.21203/rs.3.rs-2050376/v2 · Cited by 3
TweetBLM: A Hate Speech Dataset and Analysis of BlackLivesMatter-related Microblogs on Twitter
Pranesh, R. R., Kumar, S., & Shekhar, A. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4000383 · Cited by 3
Challenges for Real-Time Toxicity Detection in Online GamesPreprint
Ng, L. H. X., Lim, A. X. W., & Yoder, M. M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.04383 · Cited by 3
Context-Aware Content Moderation for German Newspaper CommentsPreprint
Krejca, F., Kietreiber, T., Buchelt, A., & Neumaier, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20963 · Cited by 3
A Language-Free Hate Speech Identification on Code-mixed Conversational Tweets
Canbay, P., & Bölücü, N. (2023) · Engineering cyber-physical systems and critical infrastructures · doi:10.1007/978-3-031-31956-3_8 · Cited by 2
Züfle, M., Dankers, V., & Titov, I. (2023) · GenBench Workshop on Generalisation (Benchmarking) in NLP (GenBench) · doi:10.18653/v1/2023.genbench-1.9 · Cited by 3
Grounding Toxicity in Real-World Events Across Languages
Tufa, W. T., Markov, I., & Vossen, P. T. J. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70239-6_14 · Cited by 4
GASCOM: Graph-based Attentive Semantic Context Modeling for Online Conversation Understanding
Agarwal, V., Chen, Y., & Sastry, N. (2024) · Online Social Networks and Media · doi:10.1016/j.osnem.2024.100290 · Cited by 2
Dark Side of the Metaverse and User Protection
Duggal, G., Garg, M., & Nigam, A. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83797-524-220241016 · Cited by 2
Hate Speech Detection in Portuguese Using BERTimbau
Frediani, J. O. R. F., Garcia, G. L., Paiola, P. H., Júnior, L. A. P., Papa, J. P., & Marana, A. N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76607-7_18 · Cited by 2
Bias mitigation in text classification through cGAN and LLMs
Kumar, G., & Singh, J. P. (2024) · Proceedings of the Indian National Science Academy · doi:10.1007/s43538-024-00371-1 · Cited by 3
“Hate speech classification (HSC) models have been found to suffer from gender bias (Fortuna and Nunes 2018; Mozafari et al. 2020).”
Court Case Dataset for Japanese Online Offensive Language Detection
Hisada, S., Wakamiya, S., & Aramaki, E. (2024) · Journal of Natural Language Processing · doi:10.5715/jnlp.31.1598 · Cited by 3
Technical Analysis: The Downfall of Microsoft’s AI Chatbot “Tay”
Bitra, S. K. (2025) · European Journal of Computer Science and Information Technology · doi:10.37745/ejcsit.2013/vol13n17111 · Cited by 2
Advancements in NLP for social media analytics
Hadi, H., & Ibrahim, I. M. (2025) · International Journal of Scientific World · doi:10.14419/y6d9jv30 · Cited by 2
Extreme Speech Classification in the Era of LLMs: Exploring Open-Source and Proprietary Models
Mahajan, S., & Rangaswamy, N. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-95017-9_15 · Cited by 2
Toxic language detection on social media: a critical linguistic approach to online hate speech
Kusuma, A. P., & Rahmawati, N. K. (2025) · Journal of Life-Span Psychology Linguistics and Media Studies · doi:10.64268/jllm.v1i01.4 · Cited by 2
“As awareness of the destructive impact of hate speech in digital spaces grows, the development of technologies for automated detection of toxic language has become a primary focus of recent research (Fortuna & Nunes, 2018; Vidgen et al., 2019; Zampieri et al., 2019).”
The COVID-19 Infodemic: A Survey
Al-Qahtani, A. F., Abbas, H., Cresci, S., & Pietro, R. D. (2025) · IEEE Access · doi:10.1109/access.2025.3618510 · Cited by 3
“…[9], [10]; the spread of AI-manipulated multimedia [11]; the widespread presence of fake personas, social bots [12], and trolls [13]; the formation of echo chambers and polarized communities [14]; and the emergence of various forms of online abuse (e.g., cyberbullying and hate speech) [15].”
Drummond, R., & Ryan, S. J. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192869203.013.33 · Cited by 3
Matras, Y. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192869203.013.13 · Cited by 2
O que torna uma frase tóxica? Uma análise crítica de modelos especialistas em detecção de toxicidade
Melo, G., & Figueredo, F. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.15684 · Cited by 2
“A linguagem abusiva é abordada na literatura sob diferentes cate-gorias, como discurso de ódio, cyberbullying, agressão e incivili-dade [8, 11, 22].”
Hofmann, S., Sommermann, C., Kraus, M., Zschech, P., & Rosenberger, J. (2026) · Lecture notes in information systems and organisation · doi:10.1007/978-3-032-08489-7_18 · Cited by 2
Guidotti, R., Schmid, U., & Longo, L. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08330-2 · Cited by 2
Automated Online Detection of Harmful and Dangerous Content in Social Networks: a Systematic Review
Ostrovska, O., & Lyashkevych, V. (2025) · Artificial Intelligence · doi:10.15407/jai2025.04.108 · Cited by 3
Internet meme on social media: A comprehensive review and new perspectives
Wang, B., Lin, J., Bai, Z., Wang, Z., Sun, S., Jin, Z., Wen, Z., Tu, G., Li, J., Cambria, E., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.104102 · Cited by 2
Parafino, C., Tomaszewski, J. P., de Freitas, L. A., & Santana, B. S. (2025) · Escola Regional de Aprendizado de Máquina e Inteligência Artificial da Região Sul (ERAMIA-RS) · doi:10.5753/eramiars.2025.16783 · Cited by 2
Metadata
- Authors
- Fortuna, P., & Nunes, S.
- Affiliations
- INESC TEC (PT)
- Universidade do Porto (PT)
- Venue
- ACM Computing Surveys
- Published
- 2018-07-31
- Volume
- 51
- Issue
- 4
- Pages
- 1-30
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2887782043
- Cited by
- 1,241
- References
- 52
- Citations by year
- 2026: 139 · 2025: 195 · 2024: 141 · 2023: 185 · 2022: 158 · 2021: 199 · 2020: 144 · 2019: 71 · 2018: 8
- FWCI
- 59.53
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- FourEyes, a research line within project TEC4Growth—Pervasive Intelligence
- North Portugal Regional Operational Programme
- European Regional Development Fund
- Enhancers and Proofs of Concept with Industrial (Impact/NORTE-01- 0145-FEDER-000020)
- PORTUGAL 2020 Partnership Agreement
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- hate speech detection, text classification, definition of hate speech, annotated dataset, multilingual dataset, online communities, digital media platforms, social impact
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.