Investigating Annotator Bias with a Graph-Based Approach
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
A challenge that many online platforms face is hate speech or any other form of online abuse.To cope with this, hate speech detection systems are developed based on machine learning to reduce manual work for monitoring these platforms.Unfortunately, machine learning is vulnerable to unintended bias in training data, which could have severe consequences, such as a decrease in classification performance or unfair behavior (e.g., discriminating minorities).In the scope of this study, we want to investigate annotator bias -a form of bias that annotators cause due to different knowledge in regards to the task and their subjective perception.Our goal is to identify annotation bias based on similarities in the annotation behavior from annotators.To do so, we build a graph based on the annotations from the different annotators, apply a community detection algorithm to group the annotators, and train for each group classifiers whose performances we compare.By doing so, we are able to identify annotator bias within a data set.The proposed method and collected insights can contribute to developing fairer and more reliable hate speech classification models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · cited 2×
“Cohen’s Kappa (Cohen, 1960): It is often used as a measure for inter-rater reliability. where p 0 is the ”proportion of observed agree-ments” (Sim and Wright, 2005, p.258) among the data records annotated by both annotators and p e is ”proportion of agreements expected by chance” (Sim and Wright,…”
BackgroundMethodA Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241 · cited 1×
“The advances in machine learning and deep learning have improved these systems tremen-dously, but there is still much space for enhancements because it is a challenging and complex task (Fortuna and Nunes, 2018; Schmidt and Wiegand, 2017).”
BackgroundThe Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817 · cited 2×
“Existing approaches, such as Binns et al. (2017), who investigated gender bias, or Sap et al. (2019) and Davidson et al. (2019), who examined racial bias, defined in their hypothesis which kind of bias they want to uncover.”
BackgroundSmith, L. N. (2018) · arXiv · doi:10.48550/arxiv.1803.09820 · Cited by 790 · cited 1×
“To fine-tune the model for our task, we apply the 1cycle learning rate policy suggested by Smith (2018) with a learning rate of 5e-6 for 2 epochs.”
MethodMeasuring and Mitigating Unintended Bias in Text Classification
Dixon, L., Li, J., Sorensen, J., Thain, N., & Vasserman, L. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278729 · Cited by 674 · cited 3×
“A weakness of these systems is their vulnerability towards unintended bias that can cause an unfair behavior of the systems (e.g., discrimination of minorities) (Dixon et al., 2018; Vidgen et al., 2019).”
BackgroundMethodEx Machina: Personal Attacks Seen at Scale
Wulczyn, E., Thain, N., & Dixon, L. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052591 · Cited by 636
Racial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414 · cited 2×
“Existing approaches, such as Binns et al. (2017), who investigated gender bias, or Sap et al. (2019) and Davidson et al. (2019), who examined racial bias, defined in their hypothesis which kind of bias they want to uncover.”
BackgroundGeva, M., Goldberg, Y., & Berant, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1107 · Cited by 284
Cited by
Offensive, aggressive, and hate speech analysis: From data-centric to human-centered approach
Kocoń, J., Figas, A., Gruza, M., Puchalska, D., Kajdanowicz, T., & Kazienko, P. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102643 · Cited by 103
Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation
Goyal, N., Kivlichan, I. D., Rosen, R., & Vasserman, L. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555088 · Cited by 76
Designing Toxic Content Classification for a Diversity of Perspectives
Kumar, D., Kelley, P. G., Consolvo, S., Mason, J., Bursztein, E., Durumeric, Z., Thomas, K., & Bailey, M. (2021) · arXiv · doi:10.48550/arxiv.2106.04511 · Cited by 28
Sheombar, A. (2025) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-031-93109-3_22 · Cited by 1
Metadata
- Authors
- Wich, M., Al Kuwatly, H., & Groh, G.
- Venue
- Proceedings of the Fourth Workshop on Online Abuse and Harms
- Published
- 2020
- Pages
- 191-199
- OpenAlex
- W3101905815
- Cited by
- 31
- References
- 9
- FWCI
- 2.72
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating Annotator Bias with a Graph-Based Approach. https://app.cochat.ai/papers/10.18653/v1/2020.alw-1.22
- The paper
- Wich, M., Al Kuwatly, H., & Groh, G. (2020). Investigating Annotator Bias with a Graph-Based Approach. Proceedings of the Fourth Workshop on Online Abuse and Harms. https://doi.org/10.18653/v1/2020.alw-1.22
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.