The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
A Measurement Study of Hate Speech in Social Media
Abstract
Social media platforms provide an inexpensive communication medium that allows anyone to quickly reach millions of users. Consequently, in these platforms anyone can publish content and anyone interested in the content can obtain it, representing a transformative revolution in our society. However, this same potential of social media systems brings together an important challenge---these systems provide space for discourses that are harmful to certain groups of people. This challenge manifests itself with a number of variations, including bullying, offensive content, and hate speech. Specifically, authorities of many countries today are rapidly recognizing hate speech as a serious problem, specially because it is hard to create barriers on the Internet to prevent the dissemination of hate across countries or minorities. In this paper, we provide the first of a kind systematic large scale measurement and analysis study of hate speech in online social media. We aim to understand the abundance of hate speech in online social media, the most common hate expressions, the effect of anonymity on hate speech and the most hated groups across regions. In order to achieve our objectives, we gather traces from two social media systems: Whisper and Twitter. We then develop and validate a methodology to identify hate speech on both of these systems. Our results identify hate speech forms and unveil a set of important patterns, providing not only a broader understanding of online hate speech, but also offering directions for detection and prevention approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“We ensure a clean matching by eliminating tokens from Twitter account names that contain stopwords or those that belong to WordNet [20], a database that contains common English words.”
MethodThe online disinhibition effect
Suler, J. (2004) · CyberPsychology & Behavior · doi:10.1089/1094931041291295 · Cited by 4,375
Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity
Joinson, A. N. (2001) · European Journal of Social Psychology · doi:10.1002/ejsp.36 · Cited by 1,458
Detecting Hate Speech on the World Wide Web
Warner, W. B., & Hirschberg, J. (2012) · Cited by 964
Detecting Offensive Language in Social Media to Protect Adolescent Online Safety
Chen, Y., Zhou, Y., Zhu, S., & Xu, H. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.55 · Cited by 637
A Lexicon-based Approach for Hate Speech Detection
Gitari, N. D., Zhang, Z., Damien, H., & Long, J. (2015) · International Journal of Multimedia and Ubiquitous Engineering · doi:10.14257/ijmue.2015.10.4.21 · Cited by 502
Locate the Hate: Detecting Tweets against Blacks
Kwok, I., & Wang, Y. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8539 · Cited by 446
Improving Cyberbullying Detection with User Context
Dadvar, M., Trieschnigg, D., Ordelman, R., & de Jong, F. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-36973-5_62 · Cited by 376
Facebook bullying: an extension of battles in school
Kwan, G. C. E., & Skoric, M. M. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.07.014 · Cited by 322
Analyzing Labeled Cyberbullying Incidents on the Instagram Social Network
Hosseinmardi, H., Mattson, S. A., Ibn Rafiq, R., Han, R., Lv, Q., & Mishra, S. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-27433-1_4 · Cited by 254
Analyzing the Targets of Hate in Online Social MediaPreprint
da Silva, L. H. G., Mondal, M., Correa, D., Benevenuto, F., & Weber, I. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07709 · Cited by 204
Self-citationClassifying racist texts using a support vector machine
Greevy, E., & Smeaton, A. F. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009074 · Cited by 194
Pinsonneault, A., & Heppel, N. (1997) · Journal of Management Information Systems · doi:10.1080/07421222.1997.11518176 · Cited by 165
Using KNN and SVM Based One-Class Classifier for Detecting Online Radicalization on Twitter
Agarwal, S., & Sureka, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-14977-6_47 · Cited by 130
Whispers in the dark: analysis of an anonymous social network
Wang, G., Wang, B., Wang, T., Nika, A., Zheng, H.-T., & Zhao, B. Y. (2014) · ACM Internet Measurement Conference (IMC) · doi:10.1145/2663716.2663728 · Cited by 125
Breaking the News: First Impressions Matter on Online NewsPreprint
Reis, J. C. S., Benevenuto, F., de Melo, P. O. S. V., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.07921 · Cited by 111
Self-citationThe Many Shades of Anonymity: Characterizing Anonymous Social Media Content
Correa, D., da Silva, L. H. G., Mondal, M., Benevenuto, F., & Gummadi, K. P. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14635 · Cited by 94
Self-citationWhen is it biased?: assessing the representativeness of twitter's streaming API
Morstatter, F., Pfeffer, J., & Liu, H. (2014) · Proceedings of the 23rd International Conference on World Wide Web · doi:10.1145/2567948.2576952 · Cited by 90
Understanding words that wound
Delgado, R., & Stefancic, J. (2004) · Choice Reviews Online · doi:10.5860/choice.42-1071 · Cited by 87
#Hashtagging hate: Using Twitter to track racism online
Chaudhry, I. (2015) · First Monday · doi:10.5210/fm.v20i2.5450 · Cited by 87
How Community Feedback Shapes User Behavior
Cheng, J., Danescu-Niculescu-Mizil, C., & Leskovec, J. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14518 · Cited by 70
Bartlett, J., Reffin, J., Rumball, N., & Williamson, S. (2014) · Cited by 64
An Approach for Hate Groups Detection in Facebook
Ting, I., Chi, H.-M., Wu, J.-S., & Wang, S.-L. (2013) · Springer proceedings in complexity · doi:10.1007/978-94-007-7293-9_11 · Cited by 15
Investigating Factors Influencing the Latency of Cyberbullying DetectionPreprint
Rafiq, R. I., Hosseinmardi, H., Han, R. Y., Lv, Q., & Mishra, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05419 · Cited by 6
Cited by
Hate speech detection: Challenges and solutions
MacAvaney, S., Yao, H.-R., Yang, E., Russell, K., Goharian, N., & Frieder, O. (2019) · PLOS ONE · doi:10.1371/journal.pone.0221152 · Cited by 566
Racism, Hate Speech, and Social Media: A Systematic Review and Critique
Matamoros-Fernández, A., & Farkas, J. (2021) · Television & New Media · doi:10.1177/1527476420982230 · Cited by 415
Spread of Hate Speech in Online Social Media
Mathew, B., Dutt, R., Goyal, P., & Mukherjee, A. (2019) · Proceedings of the 10th ACM Conference on Web Science · doi:10.1145/3292522.3326034 · Cited by 348
Developing an online hate classifier for multiple social media platforms
Salminen, J., Hopf, M., Chowdhury, S. A., Jung, S.-G., Almerekhi, H., & Jansen, B. J. (2020) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-019-0205-6 · Cited by 286
Jiang, S., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274351 · Cited by 125
Metadata
- Authors
- Mondal, M., Silva, L. A., & Benevenuto, F.
- Venue
- Proceedings of the 28th ACM Conference on Hypertext and Social Media
- Publisher
- ACM
- Published
- 2017-07-04
- Pages
- 85-94
- OpenAlex
- W2729412353
- Cited by
- 357
- References
- 24
- FWCI
- 12.58
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.