CoChat
Sign Up
Cited by 104Hate Speech and Cyberbullying DetectionSentiment Analysis and Opinion MiningText and Document Classification Technologies

The DOI matches its Crossref record; 164 of the 173 references it cites were found in a registry or an index.

Offensive, aggressive, and hate speech analysis: From data-centric to human-centered approach

Open access
Kocoń, Jan, Figas, Alicja, Gruza, Marcin, Puchalska, Daria, Kajdanowicz, Tomasz, Kazienko, Przemysław·2021·Information Processing & Management
DOI 10.1016/j.ipm.2021.102643
Open this paper in CoChat — free account

Abstract

Analysis of subjective texts like offensive content or hate speech is a great challenge, especially regarding annotation process. Most of current annotation procedures are aimed at achieving a high level of agreement in order to generate a high quality reference source. However, the annotation guidelines for subjective content may restrict the annotators’ freedom of decision making . Motivated by a moderate annotation agreement in offensive content datasets, we hypothesize that personalized approaches to offensive content identification should be in place. Thus, we propose two novel perspectives of perception: group-based and individual. Using demographics of annotators as well as embeddings of their previous decisions (annotated texts), we are able to train multimodal models (including transformer-based) adjusted to personal or community profiles. Based on the agreement of individuals and groups, we experimentally showed that annotator group agreeability strongly correlates with offensive content recognition quality. The proposed personalized approaches enabled us to create models adaptable to personal user beliefs rather than to agreed offensiveness understanding. Overall, our individualized approaches to offensive content classification outperform classic data-centric methods that generalize offensiveness perception and it refers to all six tested models. Additionally, we developed requirements for annotation procedures, personalization and content processing to make the solutions human-centered.

Overview

Integrity signals

Registry

Crossref · 10.1016/j.ipm.2021.102643

Cites

164 of 164 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 5

  1. Breckheimer, 2001, A haven for hate: The foreign and domestic implications of protecting Internet hate speech under the first amendment, Southern California Law Review, 75, 1493
  2. Buczynski, A., & Wawer, A. (2008). Shallow parsing in sentiment analysis of product reviews. In Proceedings of the partial parsing workshop at LREC (vol. 2008) (pp. 14–18).
  3. Marcinczuk, M., Kocon, J., & Gawor, M. (2018). Recognition of named entities for Polish - comparison of deep learning and conditional random fields approaches. In Proceedings of the PolEval 2018 workshop (pp. 77–92).
  4. Ptaszyński, M., Masui, F., Janz, A., Kocoń, J., Piasecki, M., & Zaśko-Zielińska, M., et al. (2017). Three attempts in PolEval 2017 sentiment analysis task. In LTC’17 the 8th language & technology conference (pp. 117–121).
  5. Troszyński, 2017, Czy komputer rozpozna hejtera? Wykorzystanie uczenia maszynowego (ML) w jakościowej analizie danych. [Can a Computer Recognize Hate Speech? Machine Learning (ML) in Qualitative Data Analysis], Przegla̧d Socjologii Jakościowej, XIII, 62

Cited by

Sorted by citations

See all 104

Related

See all

Metadata

Authors
Kocoń, J., Figas, A., Gruza, M., Puchalska, D., Kajdanowicz, T., & Kazienko, P.
Affiliations
Wrocław University of Science and Technology (PL)
Corresponding author
Kocoń, Jan
ORCID
Venue
Information Processing & Management
Publisher
Elsevier BV
Published
2021-09
Volume
58
Issue
5
Pages
102643
ISSN
  • 0020-0271 (ISSN-L)
  • 0306-4573
DOI
10.1016/j.ipm.2021.102643
OpenAlex
W3171716568
Cited by
103
References
173
Citations by year
2026: 9 · 2025: 17 · 2024: 21 · 2023: 32 · 2022: 17 · 2021: 7
FWCI
6.81
Type
journal article
Language
en
Open access
Licence
Locations
Information Processing & Management (publishedVersion, cc-by)
Funders
  • Narodowe Centrum Nauki
  • Wroclaw University of Science and Technology
  • Polish Ministry of Science and Higher Education
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
Keywords
offensive content detection, hate speech, annotation agreement, annotator demographics, personalized classification, individualized models, multimodal models, transformer models, human-centered AI, annotation guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review