The DOI matches its Crossref record; 164 of the 173 references it cites were found in a registry or an index.
Offensive, aggressive, and hate speech analysis: From data-centric to human-centered approach
Open accessAbstract
Analysis of subjective texts like offensive content or hate speech is a great challenge, especially regarding annotation process. Most of current annotation procedures are aimed at achieving a high level of agreement in order to generate a high quality reference source. However, the annotation guidelines for subjective content may restrict the annotators’ freedom of decision making . Motivated by a moderate annotation agreement in offensive content datasets, we hypothesize that personalized approaches to offensive content identification should be in place. Thus, we propose two novel perspectives of perception: group-based and individual. Using demographics of annotators as well as embeddings of their previous decisions (annotated texts), we are able to train multimodal models (including transformer-based) adjusted to personal or community profiles. Based on the agreement of individuals and groups, we experimentally showed that annotator group agreeability strongly correlates with offensive content recognition quality. The proposed personalized approaches enabled us to create models adaptable to personal user beliefs rather than to agreed offensiveness understanding. Overall, our individualized approaches to offensive content classification outperform classic data-centric methods that generalize offensiveness perception and it refers to all six tested models. Additionally, we developed requirements for annotation procedures, personalization and content processing to make the solutions human-centered.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“At the same time, it is difficult to identify universal ground truth in tasks such as predicting emotions or offensiveness of text, especially in the personalized context [20, 21, 22].”
From ChatGPT: Jack of all trades, master of none (2023) · cites this paper as [20]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
An Analysis of Variance Test for Normality (Complete Samples)
Shapiro, S. S., & Wilk, M. B. (1965) · Biometrika · doi:10.2307/2333709 · Cited by 23,469
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,759
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Research works printed but not linked: 5
- Breckheimer, 2001, A haven for hate: The foreign and domestic implications of protecting Internet hate speech under the first amendment, Southern California Law Review, 75, 1493
- Buczynski, A., & Wawer, A. (2008). Shallow parsing in sentiment analysis of product reviews. In Proceedings of the partial parsing workshop at LREC (vol. 2008) (pp. 14–18).
- Marcinczuk, M., Kocon, J., & Gawor, M. (2018). Recognition of named entities for Polish - comparison of deep learning and conditional random fields approaches. In Proceedings of the PolEval 2018 workshop (pp. 77–92).
- Ptaszyński, M., Masui, F., Janz, A., Kocoń, J., Piasecki, M., & Zaśko-Zielińska, M., et al. (2017). Three attempts in PolEval 2017 sentiment analysis task. In LTC’17 the 8th language & technology conference (pp. 117–121).
- Troszyński, 2017, Czy komputer rozpozna hejtera? Wykorzystanie uczenia maszynowego (ML) w jakościowej analizie danych. [Can a Computer Recognize Hate Speech? Machine Learning (ML) in Qualitative Data Analysis], Przegla̧d Socjologii Jakościowej, XIII, 62
Cited by
Sorted by citations
ChatGPT: Jack of all trades, master of none
Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D., Baran, J., Bielaniewicz, J., Gruza, M., Janz, A., Kanclerz, K., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101861 · Cited by 758
Self-citationTaxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
“Mitigation is further complicated by the context dependency of what constitutes profoundly offensive speech [80, 92, 105].”
BackgroundEthical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
A Literature Review of Textual Hate Speech Detection Methods and Datasets
Alkomah, F., & Ma, X. (2022) · Information · doi:10.3390/info13060273 · Cited by 167
Subramanian, M., Easwaramoorthy, S. V., Deepalakshmi, G., Cho, J., & Manikandan, G. (2023) · Alexandria Engineering Journal · doi:10.1016/j.aej.2023.08.038 · Cited by 116
Toward a Perspectivist Turn in Ground Truthing for Predictive Computing
Cabitza, F., Campagner, A., & Basile, V. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25840 · Cited by 114
Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation
Goyal, N., Kivlichan, I. D., Rosen, R., & Vasserman, L. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555088 · Cited by 76
EnsMulHateCyb: Multilingual hate speech and cyberbully detection in online social media
Mahajan, E., Mahajan, H., & Kumar, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121228 · Cited by 59
Human-centered neural reasoning for subjective content processing: Hate speech, emotions, and humor
Kazienko, P., Bielaniewicz, J., Gruza, M., Kanclerz, K., Karanowski, K., Miłkowski, P., & Kocoń, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.01.010 · Cited by 38
Self-citationKocoń, J., Gruza, M., Bielaniewicz, J., Grimling, D., Kanclerz, K., Miłkowski, P., & Kazienko, P. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00140 · Cited by 38
Self-citationDeep learning approach to detect cyberbullying on twitter
Oğuz, Ç., & Yağanoğlu, M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19869-3 · Cited by 38
Personal Bias in Prediction of Emotions Elicited by Textual Opinions
Miłkowski, P., Gruza, M., Kanclerz, K., Kazienko, P., Grimling, D., & Kocoń, J. (2021) · doi:10.18653/v1/2021.acl-srw.26 · Cited by 34
Self-citationDetecting abusive comments at a fine-grained level in a low-resource language
Chakravarthi, B. R., Priyadharshini, R., Banerjee, S., Jagadeeshan, M. B., Kumaresan, P. K., Ponnusamy, R., Benhur, S., & McCrae, J. P. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100006 · Cited by 36
Saifullah, S., Dreżewski, R., Dwiyanto, F. A., Aribowo, A. S., Fauziah, Y., & Cahyana, N. H. (2024) · Applied Sciences · doi:10.3390/app14031078 · Cited by 32
Controversy and Conformity: from Generalized to Personalized Aggressiveness Detection
Kanclerz, K., Figas, A., Gruza, M., Kajdanowicz, T. J., Kocoń, J., Puchalska, D., & Kazienko, P. (2021) · doi:10.18653/v1/2021.acl-long.460 · Cited by 32
Self-citationPredicting the Hate: A GSTM Model based on COVID-19 Hate Speech Datasets
Wu, X.-K., Zhao, T.-F., Lu, L., & Chen, W. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102998 · Cited by 34
Why Don’t You Do It Right? Analysing Annotators’ Disagreement in Subjective Tasks
Sandri, M., Leonardelli, E., Tonelli, S., & Jezek, E. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.178 · Cited by 31
Personalized Large Language Models
Woźniak, S., Koptyra, B., Janz, A., Kazienko, P., & Kocoń, J. (2024) · 2024 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw65004.2024.00071 · Cited by 28
Self-citationPerspectivist approaches to natural language processing: a survey
Frenda, S., Abercrombie, G., Basile, V., Pedrani, A., Panizzon, R., Cignarella, A. T., Marco, C. S., & Bernardi, D. (2024) · Language Resources and Evaluation · doi:10.1007/s10579-024-09766-4 · Cited by 31
The language and targets of online trolling: A psycholinguistic approach for social cybersecurity
Uyheng, J., Moffitt, J. D., & Carley, K. M. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103012 · Cited by 32
Recognizing misogynous memes: Biased models and tricky archetypes
Rizzi, G., Gasparini, F., Saibene, A., Rosso, P., & Fersini, E. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103474 · Cited by 30
Hate speech detection in the Bengali language: a comprehensive survey
Maruf, A. A., Abidin, A. J., Haque, M. M., Jiyad, Z. M., Golder, A., Alubady, R., & Aung, Z. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-00956-z · Cited by 30
Yin, W., Agarwal, V., Jiang, A., Zubiaga, A., & Sastry, N. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22198 · Cited by 25
Multitask Personalized Recognition of Emotions Evoked by Textual Content
Miłkowski, P., Saganowski, S., Gruza, M., Kazienko, P., Piasecki, M., & Kocoń, J. (2022) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops53856.2022.9767502 · Cited by 20
Self-citationWoźniak, S., & Kocoń, J. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00108 · Cited by 23
Self-citationMireshghallah, F., Shrivastava, V., Shokouhi, M., Berg-Kirkpatrick, T., Sim, R., & Dimitriadis, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.252 · Cited by 23
Şenel, L. K., Şahi̇nuç, F., Yücesoy, V., Schütze, H., Çukur, T., & Koç, A. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102925 · Cited by 20
Tamil Offensive Language Detection: Supervised versus Unsupervised Learning Approaches
Balakrishnan, V., Govindan, V., & Govaichelvan, K. N. (2022) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3575860 · Cited by 16
Pathos in Natural Language Argumentation: Emotional Appeals and Reactions
Konat, B., Gajewska, E., & Rossa, W. (2024) · Argumentation · doi:10.1007/s10503-024-09631-2 · Cited by 21
Sang, Y., & Stanton, J. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-96957-8_36 · Cited by 15
Kocoń, J., Baran, J., Kanclerz, K., Kajstura, M., & Kazienko, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35995-8_11 · Cited by 14
Self-citationKar, P., & Debbarma, S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107143 · Cited by 13
A web framework for information aggregation and management of multilingual hate speech
Kotsakis, R., Vrysis, L., Vryzas, N., Saridou, T. A., Matsiola, M., Veglis, A. A., & Dimoulas, C. A. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e16084 · Cited by 13
Towards a systematic approach to manual annotation of code smells
Сливка, Ј., Luburić, N., Prokić, S., Grujić, K.-G., Kovačević, A., Sladić, G., & Vidaković, D. (2023) · Science of Computer Programming · doi:10.1016/j.scico.2023.102999 · Cited by 13
Ngo, A., & Kocoń, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102966 · Cited by 14
Self-citationAddressing Challenges in Hate Speech Detection Using BERT-Based Models: A Review
Aljawazeri, J. A., & Jasim, M. N. (2024) · Iraqi Journal for Computer Science and Mathematics · doi:10.52866/ijcsm.2024.05.02.001 · Cited by 13
Hettiachchi, D., Holcombe-James, I., Livingstone, S., de Silva, A., Lease, M., Salim, F. D., & Sanderson, M. (2023) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v11i1.27546 · Cited by 13
Deep-SHEEP: Sense of Humor Extraction from Embeddings in the Personalized Context
Bielaniewicz, J., Kanclerz, K., Miłkowski, P., Gruza, M., Karanowski, K., Kazienko, P., & Kocoń, J. (2022) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw58026.2022.00125 · Cited by 10
Self-citationBilingual hate speech detection on social media: Amharic and Afaan Oromo
Ababu, T. M., Woldeyohannis, M. M., & Getaneh, E. B. (2025) · Journal Of Big Data · doi:10.1186/s40537-024-01044-y · Cited by 13
Modeling Uncertainty in Personalized Emotion Prediction with Normalizing Flows
Miłkowski, P., Karanowski, K., Wielopolski, P., Kocoń, J., Kazienko, P., & Zięba, M. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00103 · Cited by 10
Self-citationWanniarachchi, V. U., Scogings, C. J., Sušnjak, T., & Mathrani, A. (2023) · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · doi:10.3127/ajis.v27i0.3929 · Cited by 9
AspectEmo: Multi-Domain Corpus of Consumer Reviews for Aspect-Based Sentiment Analysis
Kocoń, J., Radom, J., Kaczmarz-Wawryk, E., Wabnic, K., Zajaczkowska, A., & Zaśko-Zielińska, M. (2021) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw53433.2021.00027 · Cited by 9
Self-citationFederated Learning for Exploiting Annotators’ Disagreements in Natural Language Processing
Rodríguez-Barroso, N., Martínez‐Cámara, E., Camacho-Collados, J., Luzón, M. V., & Herrera, F. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00664 · Cited by 8
Dynamics of hate speech in social media: insights from Indonesia
Margono, H., Saud, M., & Ashfaq, A. (2024) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-11-2023-0464 · Cited by 25
Sentir el odio: análisis de la gravedad percibida de los discursos de odio en la población española
Brändle, G., Zapatero, M. D. C., & Rebollo, M. A. P. (2024) · Revista Española de Sociología · doi:10.22325/fes/res.2024.219 · Cited by 10
Prokopowicz, D. (2023) · International Journal of Legal Studies ( IJOLS ) · doi:10.5604/01.3001.0054.2699 · Cited by 8
Ünlü, A., Truong, S., Sawhney, N., Tammi, T., & Kotonen, T. (2025) · New Media & Society · doi:10.1177/14614448241312900 · Cited by 11
Confront hate with AI: how AI-generated counter speech helps against hate speech on social Media?
Wu, C., Wang, Y., Zhang, Y., Wang, H., & Pang, Y. (2025) · Telematics and Informatics · doi:10.1016/j.tele.2025.102304 · Cited by 9
Fortifying NLP models against poisoning attacks: The power of personalized prediction architectures
Ferdinan, T., & Kocoń, J. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102692 · Cited by 9
Self-citationSengupta, K., & Srivast, P. R. (2023) · Research Square · doi:10.21203/rs.3.rs-2509731/v1 · Cited by 8
Kirchmair, T., Koban, K., & Matthes, J. (2024) · Communications · doi:10.1515/commun-2023-0133 · Cited by 6
Kar, P., & Debbarma, S. (2023) · The Journal of Supercomputing · doi:10.1007/s11227-023-05361-6 · Cited by 6
RetractedYafooz, W. M. S., & Alsaeedi, A. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.048270 · Cited by 6
MultiEmo: Language-Agnostic Sentiment Analysis
Miłkowski, P., Gruza, M., Kazienko, P., Szołomicka, J., Woźniak, S., & Kocoń, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-08754-7_10 · Cited by 6
Self-citationKocoń, J., Miłkowski, P., Wierzba, M., Konat, B., Klessa, K., Janz, A., Riegel, M., Juszczyk, K., Grimling, D., Marchewka, A., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05328-3_14 · Cited by 5
Self-citationTowards Model-Based Data Acquisition for Subjective Multi-Task NLP Problems
Kanclerz, K., Bielaniewicz, J., Gruza, M., Kocoń, J., Woźniak, S., & Kazienko, P. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00099 · Cited by 5
Self-citationÜnlü, A., Truong, S., & Kotonen, T. (2024) · International Journal of Data Science and Analytics · doi:10.1007/s41060-024-00571-4 · Cited by 5
Improving LLM-Based Recommender Systems with User-Controllable Profiles
Woźniak, S., Duszenko, J., Kocoń, J., & Kazienko, P. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717734 · Cited by 7
Self-citationHidden Hate: Analysis of Hate Speech on a Darknet Forum
Logie, K., Cohen, N. D., Taylor, E., & Perry, K. (2025) · Justice Quarterly · doi:10.1080/07418825.2025.2501544 · Cited by 4
Architectural Concepts for Integrating Fundamental Drives and Emotions Into Artificial Intelligence
Ferdinan, T., Mieleszczenko-Kowszewicz, W., Kocoń, J., & Kazienko, P. (2025) · IEEE Intelligent Systems · doi:10.1109/mis.2025.3622004 · Cited by 4
Self-citationDeep Neural Language-agnostic Multi-task Text Classifier
Gawron, K., Pogoda, M., Ropiak, N., Swędrowski, M., & Kocoń, J. (2021) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw53433.2021.00023 · Cited by 4
Self-citationMulti-model Analysis of Language-Agnostic Sentiment Classification on MultiEmo Data
Miłkowski, P., Gruza, M., Kazienko, P., Szołomicka, J., Woźniak, S., & Kocoń, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16014-1_14 · Cited by 4
Self-citationCima, L., Tessa, B., Trujillo, A., Cresci, S., & Avvenuti, M. (2025) · Online Social Networks and Media · doi:10.1016/j.osnem.2025.100320 · Cited by 5
Language-based machine perception: linguistic perspectives on the compilation of captioning datasets
Hekanaho, L., Hirvonen, M., & Virtanen, T. I. (2024) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqae029 · Cited by 4
See the words through my eyes: The role of personal traits in abusive language detection
Yao, T., Binnewies, S., Foo, E., & Alavi, M. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127188 · Cited by 4
CLARIN-PL: a user centred language technology infrastructure
Piasecki, M., Dziob, A., Janz, A., Kocoń, J., Naskręt, T., Oleksy, M., Rudnicka, E. K., Walkowiak, T., Wieczorek, J., & Hwaszcz, K. (2025) · Language Resources and Evaluation · doi:10.1007/s10579-025-09839-y · Cited by 4
Self-citationToxic Text in Personas: An Experiment on User Perceptions
Salminen, J. O., Jung, S., Santos, J. M., de Lisboa, I. U., & Jansen, B. J. (2021) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00157 · Cited by 3
Confidence-based Ensembling of Perspective-aware Models
Casola, S., Lo, S. M., Basile, V., Frenda, S., Cignarella, A. T., Patti, V., & Bosco, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.212 · Cited by 4
Zhao, Z., Zhang, Z., & Hopfgartner, F. (2021) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.2109.02691 · Cited by 3
Personalization of Affective State Recognition from Physiological Signals: A Review
Perz, B., & Kazienko, P. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-5881-7_12 · Cited by 2
Self-citationExplainable AI: Transformer-based Bangla Hate Speech Detection
Sultana, R., Tabassum, N., & Arefin, M. S. (2024) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit64611.2024.11022118 · Cited by 2
Tempska, P., Urbaniak, R., Dowgiałło, M., Ptaszynski, M. E., Zajączkowski, A., Milewska, M., Leliwa, G., Marcińczuk, M., Brochocki, M., & Wroczyński, M. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104316 · Cited by 3
Supporting Online Toxicity Detection with Knowledge Graphs
Lobo, P. R., Daga, E., & Alani, H. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19398 · Cited by 2
Palazón-Fernández, J. L., Mata-Pérez, C., Gilart, E., Cotobal-Calvo, E. M., Cruz-Barrientos, A., & Bocchino, A. (2023) · Healthcare · doi:10.3390/healthcare11111564 · Cited by 2
Hate Speech in the Comments’ Column Instagram: A Discourse Analysis
Mubarok, Y., Sudana, D., & Gunawan, W. (2024) · Journal of Languages and Language Teaching · doi:10.33394/jollt.v12i1.9050 · Cited by 2
Model and evaluation: towards fairness in multilingual text classification
Lin, N., He, J., Tang, Z., Fang, J., Zhou, D., & Yang, A. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02824-5 · Cited by 4
Kang, R., & Rau, P. P. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae034 · Cited by 1
Pihulski, D., & Kocoń, J. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00261 · Cited by 1
Self-citationTroll Meme Classification for Tamil Memes Using Convolutional Neural Network
Nithya, K., Sathyapriya, S., Sulochana, M., Thaarini, S., & Dhivyaa, C. R. (2023) · Applied and Computational Engineering · doi:10.54254/2755-2721/2/20220636 · Cited by 1
Bielaniewicz, J., & Kazienko, P. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00098 · Cited by 1
Self-citationDiscurso de ódio na Espanha. Pesquisa sobre a percepção e a experiência da população
Barbosa, M. P. G., Blanco‐Herrero, D., Calderón, C. A., & Holgado, P. S. (2024) · Observatorio (OBS*) · doi:10.15847/obsobs18220242304 · Cited by 1
Understanding the low inter-rater agreement on aggressiveness on the Linux Kernel Mailing List
Bock, T., Schneider, N., Schmid, A., Apel, S., & Siegmund, J. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112339 · Cited by 1
PCROD: Context Aware Role based Offensive Detection using NLP/ DL Approaches
Purnima, T., & Ch, K. (2023) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v11i1.5981 · Cited by 1
eevvgg at SemEval-2023 Task 11: Offensive Language Classification with Rater-based Information
Gajewska, E. (2023) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2023.semeval-1.24 · Cited by 1
Is it possible for ChatGPT to mimic human annotator?Preprint
Kaszyca, O., Kazienko, P., Kocoń, J., Cichecki, I., Kochanek, M., & Szydło, D. (2023) · doi:10.36227/techrxiv.170259175.55207879/v1 · Cited by 1
Self-citationBroadening the ontology of threats verbalized in written communication on the Internet
Komalova, L., & Kalyuzhnaya, L. V. (2022) · Russian Journal of Linguistics · doi:10.22363/2687-0088-29939
Playing HAVOK on the Chaos Caused by Internet TrollsPreprint
Martynova, E., Golino, H. F., & Boker, S. M. (2023) · Research Square · doi:10.21203/rs.3.rs-2843058/v1
Astuti, V. P. M., & Haryanto, S. (2023) · Advances in Social Science, Education and Humanities Research/Advances in social science, education and humanities research · doi:10.2991/978-2-38476-086-2_186
Obare, S., Ade-Ibijola, A., Okeyo, G., & Ogada, K. (2023) · International Journal of Data Science and Big Data Analytics · doi:10.51483/ijdsbda.3.1.2023.25-44
Improved Hierarchical Attention Networks for Cyberbullying Detection via Social Media Data
Qian, W., Yu, S., Nie, Z., Lu, X. S., Liu, H., & Huang, B. (2023) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc58704.2023.10319023
See the Words Through My Eyes: The Role of Personality Traits in Abusive Language DetectionPreprint
Yao, T., Binnewies, S., Foo, E., & Alavi, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4880454
Discursos contrarios a la educación sexual en España
González, S. C., & Barbadillo, G. T. (2024) · Revista ICONO14 · doi:10.7195/ri14.v22i2.2086 · Cited by 3
Exploring the Potential of an AI-Based Twitch Moderation and Toxicity Detection Bot
Huth, J., Eichhorn, C., Plecher, D. A., & Pirker, J. (2025) · IEEE Conference on Games (CoG) · doi:10.1109/cog64752.2025.11114410
Annotated Slovak Datasets for Toxicity, Hate Speech, and Sentiment Analysis
Sokolová, Z., Harahus, M., Hládek, D., & Staš, J. (2025) · Journal of Linguistics/Jazykovedný casopis · doi:10.2478/jazcas-2025-0025
Baider, F. H., Szczepaniak-Kozak, A., Strani, K., & Jaszczyk-Grzyb, M. (2025) · Applied Linguistics Review · doi:10.1515/applirev-2024-0129
Semantic Aggregated Adversarial Training Framework for Hate Speech Detection
Zhang, X., Tian, H., Zheng, X. B., Peng, J., & Zeng, D. D. (2026) · INFORMS journal on computing · doi:10.1287/ijoc.2023.0508
Kosman, M. (2026) · East European Politics · doi:10.1080/21599165.2026.2666801
Nadeem, M., & Hongsong, C. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.101009
Sustainable AI solutions: A review of green technology for hate speech detection in vídeos
Setyawan, R. A., Surjono, H. D., & Wardani, R. (2026) · Multidisciplinary Reviews · doi:10.31893/multirev.2027014
Metadata
- Authors
- Kocoń, J., Figas, A., Gruza, M., Puchalska, D., Kajdanowicz, T., & Kazienko, P.
- Affiliations
- Wrocław University of Science and Technology (PL)
- Corresponding author
- Kocoń, Jan
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 58
- Issue
- 5
- Pages
- 102643
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W3171716568
- Cited by
- 103
- References
- 173
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 21 · 2023: 32 · 2022: 17 · 2021: 7
- FWCI
- 6.81
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Information Processing & Management (publishedVersion, cc-by)
- Funders
- Narodowe Centrum Nauki
- Wroclaw University of Science and Technology
- Polish Ministry of Science and Higher Education
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Keywords
- offensive content detection, hate speech, annotation agreement, annotator demographics, personalized classification, individualized models, multimodal models, transformer models, human-centered AI, annotation guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review