The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
A systematic review of hate speech automatic detection using natural language processing
Open accessAbstract
With the multiplication of social media platforms, which offer anonymity, easy access and online community formation and online debate, the issue of hate speech detection and tracking becomes a growing challenge to society, individual, policy-makers and researchers. Despite efforts for leveraging automatic techniques for automatic detection and monitoring, their performances are still far from satisfactory, which constantly calls for future research on the issue. This paper provides a systematic review of literature in this field, with a focus on natural language processing and deep learning technologies, highlighting the terminology, processing pipeline, core methods employed, with a focal point on deep learning architecture. From a methodological perspective, we adopt PRISMA guideline of systematic review of the last 10 years literature from ACM Digital Library and Google Scholar. In the sequel, existing surveys, limitations, and future research directions are extensively discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Bullies Move Beyond the Schoolyard: A Preliminary Look at Cyberbullying
Patchin, J. W., & Hinduja, S. (2006) · Youth Violence and Juvenile Justice · doi:10.1177/1541204006286288 · Cited by 1,701
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w17-1101 · Cited by 1,395
Text Classification Algorithms: A Survey
Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019) · Information · doi:10.3390/info10040150 · Cited by 1,312
A Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241
VisualBERT: A Simple and Performant Baseline for Vision and Language
Li, L. H., Yatskar, M., Yin, D., Hsieh, C.-J., & Chang, K.-W. (2019) · arXiv · doi:10.48550/arxiv.1908.03557 · Cited by 1,198
Abusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation
Zhang, Y., Sun, S., Galley, M., Chen, Y.-C., Brockett, C., Gao, X., Gao, J., Liu, J., & Dolan, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/2020.acl-demos.30 · Cited by 1,076
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., D., M., Châtel, G., Chaumond, J., Rault, T., Voss, C., Wang, F., et al. (2019) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3385997 · Cited by 1,037
The Handbook of Culture and Psychology
(2019) · doi:10.1093/oso/9780190679743.001.0001 · Cited by 952
SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter
Basile, V., Bosco, C., Fersini, E., Nozza, D., Patti, V., Rangel Pardo, F. M., Rosso, P., & Sanguinetti, M. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2007 · Cited by 864
Comparative Study of CNN and RNN for Natural Language Processing
Yin, W., Kann, K., Yu, M., & Schütze, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01923 · Cited by 861
Deep Learning for Hate Speech Detection in Tweets
Badjatiya, P., Gupta, S., Gupta, M., & Varma, V. (2017) · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion · doi:10.1145/3041021.3054223 · Cited by 849
BERTweet: A pre-trained language model for English Tweets
Nguyen, D. Q., Vu, T., & Tuan Nguyen, A. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.2 · Cited by 843
CamemBERT: a Tasty French Language Model
Martin, L., Muller, B., Ortiz Suárez, P. J., Dupont, Y., Romary, L., de la Clergerie, É., Seddah, D., & Sagot, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.645 · Cited by 754
Predicting the Type and Target of Offensive Posts in Social Media
Zampieri, M., Malmasi, S., Nakov, P., Rosenthal, S., Farra, N., & Kumar, R. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1144 · Cited by 720
Hate Speech Detection with Comment Embeddings
Djuric, N., Zhou, J., Morris, R., Grbovic, M., Radosavljevic, V., & Bhamidipati, N. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742760 · Cited by 712
SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)
Zampieri, M., Malmasi, S., Nakov, P., Rosenthal, S., Farra, N., & Kumar, R. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2010 · Cited by 701
AraBERT: Transformer-based Model for Arabic Language Understanding
Antoun, W., Baly, F., & Hajj, H. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00104 · Cited by 680
Detecting Offensive Language in Social Media to Protect Adolescent Online Safety
Chen, Y., Zhou, Y., Zhu, S., & Xu, H. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.55 · Cited by 637
Ex Machina: Personal Attacks Seen at Scale
Wulczyn, E., Thain, N., & Dixon, L. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052591 · Cited by 636
FinBERT: Financial Sentiment Analysis with Pre-trained Language Models
Araci, D. (2019) · arXiv · Cited by 602
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., Stringhini, G., Vakali, A., Sirivianos, M., & Kourtellis, N. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.14991 · Cited by 596
Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter
Waseem, Z. (2016) · Proceedings of the First Workshop on NLP and Computational Social Science · doi:10.18653/v1/w16-5618 · Cited by 569
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection
Mathew, B., Saha, P., Yimam, S. M., Biemann, C., Goyal, P., & Mukherjee, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17745 · Cited by 513
A Lexicon-based Approach for Hate Speech Detection
Gitari, N. D., Zhang, Z., Damien, H., & Long, J. (2015) · International Journal of Multimedia and Ubiquitous Engineering · doi:10.14257/ijmue.2015.10.4.21 · Cited by 502
Watanabe, H., Bouazizi, M., & Ohtsuki, T. (2018) · IEEE Access · doi:10.1109/access.2018.2806394 · Cited by 467
Locate the Hate: Detecting Tweets against Blacks
Kwok, I., & Wang, Y. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8539 · Cited by 446
Common Sense Reasoning for Detection, Prevention, and Mitigation of Cyberbullying
Dinakar, K., Jones, B., Havasi, C., Lieberman, H., & Picard, R. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2362394.2362400 · Cited by 432
Hate Speech Dataset from a White Supremacy Forum
de Gibert, O., Perez, N., García-Pablos, A., & Cuadros, M. (2018) · Proceedings of the 2nd Workshop on Abusive Language Online (ALW2) · doi:10.18653/v1/w18-5102 · Cited by 425
Williams, M. L., Burnap, P., & Sloan, L. (2017) · Sociology · doi:10.1177/0038038517708140 · Cited by 423
Resources and benchmark corpora for hate speech detection: a systematic review
Poletto, F., Basile, V., Sanguinetti, M., Bosco, C., & Patti, V. (2021) · Language Resources and Evaluation · doi:10.1007/s10579-020-09502-8 · Cited by 385
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Proceedings of the Fourteenth Workshop on Semantic Evaluation · doi:10.18653/v1/2020.semeval-1.188 · Cited by 378
Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model
Cai, Y., Cai, H., & Wan, X. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1239 · Cited by 377
One-step and Two-step Classification for Abusive Language Detection on Twitter
Park, J. H., & Fung, P. (2017) · Proceedings of the First Workshop on Abusive Language Online · doi:10.18653/v1/w17-3006 · Cited by 353
The hateful memes challenge: Detecting hate speech in multimodal memes
Kiela, D., Firooz, H., Mohan, A., Goswami, V., Singh, A., Ringshia, P., & Testuggine, D. (2020) · arXiv · doi:10.48550/arxiv.2005.04790 · Cited by 352
Spread of Hate Speech in Online Social Media
Mathew, B., Dutt, R., Goyal, P., & Mukherjee, A. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326034 · Cited by 348
Effective hate-speech detection in Twitter data using recurrent neural networks
Pitsilis, G. K., Ramampiaro, H., & Langseth, H. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1242-y · Cited by 347
Hate speech detection: A solved problem? The challenging case of long tail on Twitter
Zhang, Z., & Luo, L. (2019) · Semantic Web · doi:10.3233/sw-180338 · Cited by 325
Directions in abusive language training data, a systematic review: Garbage in, garbage out
Vidgen, B., & Derczynski, L. (2020) · PLOS ONE · doi:10.1371/journal.pone.0243300 · Cited by 318
AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on Tweets.
Polignano, M., Basile, P., de Gemmis, M., Semeraro, G. M., & Basile, V. (2019) · Institutional Research Information System University of Turin (University of Turin) · Cited by 311
HateBERT: Retraining BERT for Abusive Language Detection in English
Caselli, T., Basile, V., Mitrović, J., & Granitzer, M. (2021) · Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021) · doi:10.18653/v1/2021.woah-1.3 · Cited by 307
Abusive Language Detection on Arabic Social Media
Mubarak, H., Darwish, K., & Magdy, W. (2017) · Proceedings of the First Workshop on Abusive Language Online · doi:10.18653/v1/w17-3008 · Cited by 295
Mandl, T., Modha, S., Majumder, P., Patel, D., Dave, M., Mandlia, C., & Patel, A. (2019) · Proceedings of the 11th Forum for Information Retrieval Evaluation · doi:10.1145/3368567.3368584 · Cited by 279
Multilingual and Multi-Aspect Hate Speech Analysis
Ousidhoum, N., Lin, Z., Zhang, H., Song, Y., & Yeung, D.-Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1474 · Cited by 276
Detecting offensive tweets via topical feature discovery over a large scale twitter corpus
Xiang, G., Fan, B., Wang, L., Hong, J., & Rose, C. (2012) · Proceedings of the 21st ACM international conference on Information and knowledge management · doi:10.1145/2396761.2398556 · Cited by 267
A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection
Bohra, A., Vijay, D., Singh, V., Akhtar, S. S., & Shrivastava, M. (2018) · Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media · doi:10.18653/v1/w18-1105 · Cited by 265
Challenges in discriminating profanity from hate speech
Malmasi, S., & Zampieri, M. (2018) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2017.1409284 · Cited by 264
A Literature Review of Textual Hate Speech Detection Methods and Datasets
Alkomah, F., & Ma, X. (2022) · Information · doi:10.3390/info13060273 · Cited by 254
Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language
Kuratov, Y., & Arkhipov, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07213 · Cited by 250
Exploring Hate Speech Detection in Multimodal Publications
Gomez, R., Gibert, J., Gomez, L., & Karatzas, D. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093414 · Cited by 250
Multi-label Hate Speech and Abusive Language Detection in Indonesian Twitter
Ibrohim, M. O., & Budi, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3506 · Cited by 239
Detecting Online Hate Speech Using Context Aware Models
Texas A&M University, U., Gao, L., & Huang, R. (2017) · RANLP 2017 - Recent Advances in Natural Language Processing Meet Deep Learning · doi:10.26615/978-954-452-049-6_036 · Cited by 235
Overview of the GermEval 2018 Shared Task on the Identification of Offensive Language
Wiegand, M., Siegel, M., & Ruppenhofer, J. (2019) · Publication Server of the Institute for German Language (Institute for German Language) · Cited by 232
Are they Our Brothers? Analysis and Detection of Religious Hate Speech in the Arabic Twittersphere
Albadi, N., Kurdi, M., & Mishra, S. (2018) · 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2018.8508247 · Cited by 228
Characterizing and Detecting Hateful Users on Twitter
Ribeiro, M., Calais, P., Santos, Y., Almeida, V., & Meira Jr., W. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15057 · Cited by 221
Hate speech detection in the Indonesian language: A dataset and preliminary study
Alfina, I., Mulia, R., Fanany, M. I., & Ekanata, Y. (2017) · 2017 International Conference on Advanced Computer Science and Information Systems (ICACSIS) · doi:10.1109/icacsis.2017.8355039 · Cited by 221
Towards generalisable hate speech detection: a review on obstacles and solutions
Yin, W., & Zubiaga, A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.598 · Cited by 207
A Large Labeled Corpus for Online Harassment Research
Golbeck, J., Ashktorab, Z., Banjo, R. O., Berlinger, A., Bhagwan, S., Buntain, C., Cheakalos, P., Geller, A. A., Gergory, Q., Gnanasekaran, R. K., et al. (2017) · Proceedings of the 2017 ACM on Web Science Conference · doi:10.1145/3091478.3091509 · Cited by 201
Deep Learning Models for Multilingual Hate Speech DetectionPreprint
Aluru, S. S., Mathew, B., Saha, P., & Mukherjee, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.06465 · Cited by 201
de Vries, W., van Cranenburgh, A., Bisazza, A., Caselli, T., van Noord, G., & Nissim, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09582 · Cited by 195
Thirty years of research into hate speech: topics of interest and their evolution
Tontodimamma, A., Nissi, E., Sarra, A., & Fontanella, L. (2020) · Scientometrics · doi:10.1007/s11192-020-03737-6 · Cited by 195
L-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language
Mulki, H., Haddad, H., Bechikh Ali, C., & Alshabani, H. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3512 · Cited by 187
A deep neural network based multi-task learning approach to hate speech detection
Kapil, P., & Ekbal, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106458 · Cited by 184
DETECTION OF HATE SPEECH IN SOCIAL NETWORKS: A SURVEY ON MULTILINGUAL CORPUS
Al-Hassan, A., & Al-Dossari, H. (2019) · Computer Science & Information Technology(CS & IT) · doi:10.5121/csit.2019.90208 · Cited by 179
A Benchmark Dataset for Learning to Intervene in Online Hate Speech
Qian, J., Bethke, A., Liu, Y., Belding, E., & Wang, W. Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1482 · Cited by 179
Portuguese Named Entity Recognition using BERT-CRF
Souza, F., Nogueira, R. F., & Lotufo, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10649 · Cited by 174
Liu, P., Li, W., & Zou, L. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2011 · Cited by 171
Jha, A., & Mamidi, R. (2017) · Proceedings of the Second Workshop on NLP and Computational Social Science · doi:10.18653/v1/w17-2902 · Cited by 169
Peer to Peer Hate: Hate Speech Instigators and Their Targets
ElSherief, M., Nilizadeh, S., Nguyen, D., Vigna, G., & Belding, E. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15038 · Cited by 169
An Italian Twitter Corpus of Hate Speech against Immigrants
Sanguinetti, M., Poletto, F., Bosco, C., Patti, V., & Stranisci, M. A. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/26vnss59hfcq · Cited by 168
Cross-Lingual Natural Language Generation via Pre-Training
Chi, Z., Li, D., Wei, F., Wang, W., Mao, X.-L., & Huang, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6256 · Cited by 166
A Hierarchically-Labeled Portuguese Hate Speech Dataset
Fortuna, P., Rocha da Silva, J., Soler-Company, J., Wanner, L., & Nunes, S. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3510 · Cited by 161
Aggression-annotated Corpus of Hindi-English Code-mixed Data
Kumar, R., Reganti, A., Bhatia, A., & Maheshwari, T. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2otsapvt2qu9 · Cited by 160
Inducing a Lexicon of Abusive Words – a Feature-Based Approach
Wiegand, M., Ruppenhofer, J., Schmidt, A. G., & Greenberg, C. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1095 · Cited by 159
Offensive Language and Hate Speech Detection for DanishPreprint
Sigurbergsson, G. I., & Derczynski, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.04531 · Cited by 155
Disentangling Hate in Online Memes
Lee, R. K.-W., Cao, R., Fan, Z., Jiang, J., & Chong, W.-H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475625 · Cited by 155
Naseem, U., Razzak, I., & Eklund, P. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10082-6 · Cited by 150
Alatawi, H. S., Alhothali, A., & Moria, K. M. (2021) · IEEE Access · doi:10.1109/access.2021.3100435 · Cited by 145
A Dataset and Preliminaries Study for Abusive Language Detection in Indonesian Social Media
Ibrohim, M. O., & Budi, I. D. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.08.169 · Cited by 136
Chung, Y.-L., Kuzmenko, E., Tekiroglu, S. S., & Guerini, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1271 · Cited by 135
Cyberbullying in social networking sites: An adolescent victim’s perspective
Dredge, R., Gleeson, J., & de la Piedad Garcia, X. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.026 · Cited by 133
Offensive Language Identification in GreekPreprint
Pitenis, Z., Zampieri, M., & Ranasinghe, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07459 · Cited by 131
Hate Speech Detection in the Bengali Language: A Dataset and Its Baseline Evaluation
Romim, N., Ahmed, M., Talukder, H., & Islam, M. S. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-16-0586-4_37 · Cited by 131
Using KNN and SVM Based One-Class Classifier for Detecting Online Radicalization on Twitter
Agarwal, S., & Sureka, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-14977-6_47 · Cited by 130
Did you offend me? Classification of Offensive Tweets in Hinglish Language
Mathur, P., Sawhney, R., Ayyar, M. P., & Shah, R. R. (2018) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w18-5118 · Cited by 129
Hateful Speech Detection in Public Facebook Pages for the Bengali Language
Ishmam, A. M., & Sharmin, S. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00104 · Cited by 128
#FailedRevolutions: Using Twitter to study the antecedents of ISIS support
Magdy, W., Darwish, K. M., & Weber, I. G. (2016) · First Monday · doi:10.5210/fm.v21i2.6372 · Cited by 125
Detection of hate speech in Arabic tweets using deep learning
Alhassan, A., & Al-Dossari, H. Z. (2021) · Multimedia Systems · doi:10.1007/s00530-020-00742-w · Cited by 123
Deep Learning Based Fusion Approach for Hate Speech Detection
Zhou, Y., Yang, Y., Liu, H., Liu, X., & Savage, N. (2020) · IEEE Access · doi:10.1109/access.2020.3009244 · Cited by 121
Unsupervised cyber bullying detection in social networks
Capua, M. D., Nardo, E. D., & Petrosino, A. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899672 · Cited by 120
Augment to Prevent: Short-Text Data Augmentation in Deep Learning for Hate-Speech Classification
Rizos, G., Hemker, K., & Schuller, B. W. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358040 · Cited by 119
A Multilingual System for Cyberbullying Detection: Arabic Content Detection using Machine Learning
Haidar, B. R., Chamoun, M., & Serhrouchni, A. (2017) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj020634 · Cited by 117
Towards Accurate Detection of Offensive Language in Online Communication in Arabic
Alakrot, A., Murray, L., & Nikolov, N. S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.491 · Cited by 116
Automatic Detection of Offensive Language for Urdu and Roman Urdu
Akhter, M. P., Zheng, J., Naqvi, I. R., Abdelmajeed, M., & Sadiq, M. T. (2020) · IEEE Access · doi:10.1109/access.2020.2994950 · Cited by 113
Hate-Speech and Offensive Language Detection in Roman Urdu
Rizwan, H., Shakeel, M. H., & Karim, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.197 · Cited by 111
Burnap, P., & Williams, M. L. (2014) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 108
Karim, M. R., Chakravarthi, B. R., McCrae, J. P., & Cochez, M. (2020) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa49011.2020.00053 · Cited by 108
Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee CrisisPreprint
Roß, B., Rist, M., Carbonell, G., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08118 · Cited by 106
Generating Counter Narratives against Online Hate Speech: Data and Strategies
Tekiroğlu, S. S., Chung, Y.-L., & Guerini, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.110 · Cited by 103
Fortuna, P., Juan Soler-Company, & Wanner, L. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4529173 · Cited by 101
Detection of cyberbullying on social media messages in Turkish
Özel, S. A., Eşsiz, E. S., Akdemir, S., & Aksu, H. (2017) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2017.8093411 · Cited by 100
Dataset Construction for the Detection of Anti-Social Behaviour in Online Communication in Arabic
Alakrot, A., Murray, L., & Nikolov, N. S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.473 · Cited by 99
Multimodal Hate Speech Detection from Bengali Memes and Texts
Karim, M. R., Dey, S. K., Islam, T., Shajalal, M., & Chakravarthi, B. R. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-33231-9_21 · Cited by 96
Tackling Online Abuse: A Survey of Automated Abuse Detection MethodsPreprint
Mishra, P., Yannakoudakis, H., & Shutova, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06024 · Cited by 94
Towards Knowledge-Grounded Counter Narrative Generation for Hate Speech
Chung, Y.-L., Tekiroğlu, S. S., & Guerini, M. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.79 · Cited by 94
Wiedemann, G., Yimam, S. M., & Biemann, C. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.213 · Cited by 93
Offensive Comments in the Brazilian Web: a dataset and baseline results
de Pelle, R. P., & Moreira, V. P. (2017) · Anais do Brazilian Workshop on Social Network Analysis and Mining (BraSNAM) · doi:10.5753/brasnam.2017.3260 · Cited by 91
BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection
Moon, J., Cho, W. I., & Lee, J. (2020) · International Workshop on Natural Language Processing for Social Media (SocialNLP) · doi:10.18653/v1/2020.socialnlp-1.4 · Cited by 86
Characterizing and Detecting Hateful Users on TwitterPreprint
Ribeiro, M. H., Calais, P., Santos, Y. A., Almeida, V. A. F., & Meira, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08977 · Cited by 81
Right-wing German Hate Speech on Twitter: Analysis and Automatic DetectionPreprint
Jaki, S., & Smedt, T. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07518 · Cited by 79
A Deep Learning Framework for Automatic Detection of Hate Speech Embedded in Arabic Tweets
Duwairi, R., Hayajneh, A., & Quwaider, M. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-05383-3 · Cited by 79
Fanton, M., Bonaldi, H., Tekiroğlu, S. S., & Guerini, M. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.250 · Cited by 75
Nikolov-Radivchev at SemEval-2019 Task 6: Offensive Tweet Classification with BERT and Ensembles
Nikolov, A., & Radivchev, V. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2123 · Cited by 72
Building a Bridge: A Method for Image-Text Sarcasm Detection Without Pretraining on Image-Text Data
Wang, X., Sun, X., Yang, T., & Wang, H. (2020) · doi:10.18653/v1/2020.nlpbt-1.3 · Cited by 72
Countering Dangerous Speech: New Ideas for Genocide PreventionPreprint
Benesch, S. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.3686876 · Cited by 71
Hate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning ModelsPreprint
Satyajit, K., & Joshi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05145 · Cited by 70
TWilBert: Pre-trained deep bidirectional transformers for Spanish Twitter
González, J. Á., Hurtado, L.-F., & Plà, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.078 · Cited by 69
Detecting Multipliers of Jihadism on Twitter
Kaati, L., Omer, E., Prucha, N., & Shrestha, A. (2015) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2015.9 · Cited by 68
Detecting Offensive Statements towards Foreigners in Social Media
Bretschneider, U., & Peters, R. (2017) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2017.268 · Cited by 68
A “Deeper” Look at Detecting Cyberbullying in Social Networks
Rosa, H., de Matos, D. M., Ribeiro, R., Coheur, L., & Carvalho, J. P. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489211 · Cited by 67
Comment toxicity detection via a multichannel convolutional bidirectional gated recurrent unit
Ashok Kumar, J., Abirami, S., Trueman, T. E., & Cambria, E. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.023 · Cited by 66
Tekiroğlu, S. S., Bonaldi, H., Fanton, M., & Guerini, M. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.245 · Cited by 62
Multimodal Hate Speech Detection via Cross-Domain Knowledge Transfer
Yang, C., Zhu, F., Liu, G., Han, J., & Hu, S. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548255 · Cited by 60
Rephrasing Profanity in Chinese Text
Su, H.-P., Huang, Z., Chang, H.-T., et al. (2017) · doi:10.18653/v1/w17-3003 · Cited by 57
A Benchmark Dataset for Learning to Intervene in Online Hate SpeechPreprint
Qian, J., Bethke, A., Liu, Y., Belding, E., & Wang, W. Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04251 · Cited by 56
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A.-M., Djouvas, C., Chatzakou, D., Ilias Leontiadis, A., Blackburn, J., Stringhini, G., Vakali, A. I., Sirivianos, M., & Kourtellis, N. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1443347 · Cited by 54
A Quality Type-aware Annotated Corpus and Lexicon for Harassment Research
Rezvan, M., Shekarpour, S., Balasuriya, L., Thirunarayan, K., Shalin, V. L., & Sheth, A. (2018) · ACM Web Science Conference (WebSci) · doi:10.1145/3201064.3201103 · Cited by 46
A Review on Offensive Language Detection
Pradhan, R., Chaturvedi, A., Tripathi, A., & Sharma, D. K. (2020) · Lecture notes in networks and systems · doi:10.1007/978-981-15-0694-9_41 · Cited by 46
Ranasinghe, T., Zampieri, M., & Hettiarachchi, H. (2019) · Lancaster EPrints (Lancaster University) · Cited by 46
Wang, S., Liu, J., Ouyang, X., & Sun, Y. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.189 · Cited by 42
A Statistical Learning Approach to Detect Abusive Twitter Accounts
Abozinadah, E., & Jones, J. H. (2017) · International Conference on Compute and Data Analysis (ICCDA) · doi:10.1145/3093241.3093281 · Cited by 37
AlBERTo: Modeling Italian Social Media Language with BERT
Polignano, M., Basile, V., Basile, P., de Gemmis, M., & Semeraro, G. M. (2019) · Italian Journal of Computational Linguistics · doi:10.4000/ijcol.472 · Cited by 37
Ghanghor, N., Ponnusamy, R., Kumaresan, P. K., Priyadharshini, R., Thavareesan, S., & Chakravarthi, B. R. (2021) · Cited by 34
MIDAS at SemEval-2019 Task 6: Identifying Offensive Posts and Targeted Offense from Twitter
Mahata, D., Zhang, H., Uppal, K., Kumar, Y., Shah, R. R., Shahid, S., Mehnaz, L., & Anand, S. (2019) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s19-2122 · Cited by 31
Multi-Task Learning using AraBert for Offensive Language Detection
Djandji, M., Baly, F., Antoun, W., & Hajj, H. M. (2020) · Cited by 31
A Quality Type-Aware Annotated Corpus and Lexicon for Harassment Research
Rezvan, M., Shekarpour, S., Balasuriya, L., Thirunarayan, K., Shalin, V. L., & Sheth, A. (2019) · Journal of Bioresource Management · Cited by 30
Arora, G. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02094 · Cited by 30
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3950378 · Cited by 27
Unsupervised Detection of Violent Content in Arabic Social Media
Abdelfatah, K. E., Terejanu, G., & Alhelbawy, A. (2017) · doi:10.5121/csit.2017.70401 · Cited by 26
ALT at SemEval-2020 Task 12: Arabic and English Offensive Language Identification in Social Media
Hassan, S., Samih, Y., Mubarak, H., & Abdelalí, A. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.249 · Cited by 26
Cyberbullying Detection System with Multiple Server Configurations
Pawar, R., Agrawal, Y., Joshi, A., Gorrepati, R., & Raje, R. R. (2018) · IEEE International Conference on Electro Information Technology · doi:10.1109/eit.2018.8500110 · Cited by 25
Peer to Peer Hate: Hate Speech Instigators and Their TargetsPreprint
ElSherief, M., Nilizadeh, S., Nguyen, D., Vigna, G., & Belding, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04649 · Cited by 25
NLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfer
Ahn, H., Sun, J., Park, C. Y., & Seo, J. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.206 · Cited by 24
Alami, H., Alaoui, S. O. E., Benlahbib, A., & En-Nahnahi, N. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.275 · Cited by 24
Explorative Application of Fusion Techniques for Multimodal Hate Speech Detection
Sai, S., Srivastava, N. D., & Sharma, Y. (2022) · SN Computer Science · doi:10.1007/s42979-021-01007-7 · Cited by 24
Ptaszynski, M. E., Pieciukiewicz, A., & Dybała, P. (2019) · Jagiellonian University Repository (Jagiellonian University) · Cited by 24
Abusive Text Detection Using Neural Networks
Chen, H., Delany, S. J., & McKeever, S. (2017) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/d7pb64 · Cited by 22
Team Rouges at SemEval-2020 Task 12: Cross-lingual Inductive Transfer to Detect Offensive Language
Dadu, T., & Pant, K. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.290 · Cited by 20
LT@Helsinki at SemEval-2020 Task 12: Multilingual or Language-specific BERT?
Pàmies, M., Ohman, E. S., Kajava, K., & Tiedemann, J. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.205 · Cited by 18
Detection of Abusive Speech for Mixed Sociolects of Russian and Ukrainian Languages.
Andrusyak, B., Rimel, M., & Kern, R. (2018) · RASLAN · Cited by 17
SU-NLP at SemEval-2020 Task 12: Offensive Language IdentifiCation in Turkish Tweets
Ozdemir, A., & Yeniterzi, R. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.288 · Cited by 16
A Survey of Recent Neural Network Models on Code-Mixed Indian Hate Speech Data
Dowlagar, S., & Mamidi, R. (2021) · Forum for Information Retrieval Evaluation · doi:10.1145/3503162.3503168 · Cited by 15
Cyberbullies in Twitter: A focused review
Tsapatsoulis, N., & Anastasopoulou, V. (2019) · International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP) · doi:10.1109/smap.2019.8864918 · Cited by 12
Socha, K. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.270 · Cited by 12
HASOCOne@FIRE-HASOC2020: Using BERT and Multilingual BERT models for Hate Speech DetectionPreprint
Dowlagar, S., & Mamidi, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09007 · Cited by 5
Cited by
Cyberbullying detection: Exploring datasets, technologies, and approaches on social media platforms
Philipo, A. G., Sarwatt, D. S., Ding, J., Daneshmand, M., & Ning, H. (2026) · ACM Computing Surveys · doi:10.1145/3785654 · Cited by 14
Metadata
- Authors
- Jahan, M. S., & Oussalah, M.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2023-08
- Volume
- 546
- Pages
- 126232
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W3172559340
- Cited by
- 279
- References
- 165
- FWCI
- 7.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.