The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Cyber Hate Speech on Twitter: An Application of Machine Classification and Statistical Modeling for Policy and Decision Making
Open accessAbstract
The use of “Big Data” in policy and decision making is a current topic of debate. The 2013 murder of Drummer Lee Rigby in Woolwich, London, UK led to an extensive public reaction on social media, providing the opportunity to study the spread of online hate speech (cyber hate) on Twitter. Human annotated Twitter data was collected in the immediate aftermath of Rigby's murder to train and test a supervised machine learning text classifier that distinguishes between hateful and/or antagonistic responses with a focus on race, ethnicity, or religion; and more general responses. Classification features were derived from the content of each tweet, including grammatical dependencies between words to recognize “othering” phrases, incitement to respond with antagonistic action, and claims of well‐founded or justified discrimination against social groups. The results of the classifier were optimal using a combination of probabilistic, rule‐based, and spatial‐based classifiers with a voted ensemble meta‐classifier. We demonstrate how the results of the classifier can be robustly utilized in a statistical model used to forecast the likely spread of cyber hate in a sample of Twitter data. The applications to policy and decision making are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
Sentiment strength detection in short informal text
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21416 · Cited by 1,449
Thelwall, M., Buckley, K., & Paltoglou, G. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21462 · Cited by 822
Some consequences of de-individuation in a group.
Festinger, L., Pepitone, A., & Newcomb, T. (1952) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057906 · Cited by 718
Up and Down With Ecology: The "Issue-Attention Cycle"
(2016) · Agenda Setting · doi:10.4324/9781315538389-9 · Cited by 648
Detecting Offensive Language in Social Media to Protect Adolescent Online Safety
Chen, Y., Zhou, Y., Zhu, S., & Xu, H. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.55 · Cited by 637
Common Sense Reasoning for Detection, Prevention, and Mitigation of Cyberbullying
Dinakar, K., Jones, B., Havasi, C., Lieberman, H., & Picard, R. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2362394.2362400 · Cited by 432
Terrorist Events and Attitudes toward Immigrants: A Natural Experiment
Legewie, J. (2013) · American Journal of Sociology · doi:10.1086/669605 · Cited by 322
Data mining emotion in social network communication: Gender differences in MySpace
Thelwall, M., Wilkinson, D., & Uppal, S. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21180 · Cited by 281
Happiness Is Assortative in Online Social Networks
Bollen, J., Gonçalves, B., Ruan, G., & Mao, H. (2011) · Artificial Life · doi:10.1162/artl_a_00034 · Cited by 257
Tweeting the terror: modelling the social media reaction to the Woolwich terrorist attack
Burnap, P., Williams, M. L., Sloan, L., Rana, O., Housley, W., Edwards, A., Knight, V., Procter, R., & Voss, A. (2014) · Social Network Analysis and Mining · doi:10.1007/s13278-014-0206-4 · Cited by 240
Self-citationSmokey: Automatic Recognition of Hostile Messages
Ellen, & Spertus (1997) · Cited by 217
Smokey: automatic recognition of hostile messages
Spertus, E. (1997) · Cited by 189
Detecting tension in online communities with computational Twitter analysis
Burnap, P., Rana, O. F., Avis, N., Williams, M., Housley, W., Edwards, A., Morgan, J., & Sloan, L. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2013.04.013 · Cited by 170
Self-citationClassifying racist texts using a support vector machine
Greevy, E., & Smeaton, A. F. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009074 · Cited by 169
Social science in the era of big data
González‐Bailón, S. (2013) · Policy & Internet · doi:10.1002/1944-2866.poi328 · Cited by 161
HIGH TIMES FOR HATE CRIMES: EXPLAINING THE TEMPORAL CLUSTERING OF HATE‐MOTIVATED OFFENDING
King, R. D., & Sutton, G. M. (2013) · Criminology · doi:10.1111/1745-9125.12022 · Cited by 156
The Los Angeles riots: lessons for the urban future
(1995) · Choice Reviews Online · doi:10.5860/choice.32-5952 · Cited by 102
Citizen social science and citizen data? Methodological and ethical challenges for social research
Purdam, K. (2014) · Current Sociology · doi:10.1177/0011392114527997 · Cited by 92
Policing cyber-neighbourhoods: tension monitoring and social media networks
Williams, M. L., Edwards, A., Housley, W., Burnap, P., RANA, O. F., Avis, N. J., Morgan, J., & Sloan, L. (2013) · Policing & Society · doi:10.1080/10439463.2013.780225 · Cited by 83
Self-citationAirplane Accidents, Murder, and the Mass Media: Towards a Theory of Imitation and Suggestion
Phillips, D. R. (1980) · Social Forces · doi:10.1093/sf/58.4.1001 · Cited by 79
Toward spotting the pedophile telling victim from predator in text chats
Pendar, N. (2007) · International Conference on Semantic Computing (ICSC 2007) · doi:10.1109/icsc.2007.32 · Cited by 77
Reliability of human annotation of semantic roles in noisy text
Higgins, D. (2007) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2007.102 · Cited by 73
Hate Crime Victimization in Wales
Williams, M. L., & Tregidga, J. (2014) · The British Journal of Criminology · doi:10.1093/bjc/azu043 · Cited by 64
Self-citationDetecting flames and insults in text
Mahmud, A., Ahmed, K. Z., & Khan, M. (2008) · BRAC University Institutional Repository (BRAC University) · Cited by 43
Expert knowledge for automatic detection of bullies in social networks
Dadvar, M., Trieschnigg, D., & Jong, D. F. (2013) · University of Twente Research Information · Cited by 33
Interpreting Anaphoric Shell Nouns using Antecedents of Cataphoric Shell Nouns as Training Data
Kolhatkar, V., Zinsmeister, H., & Hirst, G. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1030 · Cited by 20
Cited by
Automated Hate Speech Detection and the Problem of Offensive Language
Davidson, T., Warmsley, D., Macy, M., & Weber, I. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14955 · Cited by 2,610
A Survey on Hate Speech Detection using Natural Language Processing
Schmidt, A., & Wiegand, M. (2017) · Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w17-1101 · Cited by 1,395
A Survey on Automatic Detection of Hate Speech in Text
Fortuna, P., & Nunes, S. (2019) · ACM Computing Surveys · doi:10.1145/3232676 · Cited by 1,241
The Risk of Racial Bias in Hate Speech Detection
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1163 · Cited by 817
Predicting the Type and Target of Offensive Posts in Social Media
Zampieri, M., Malmasi, S., Nakov, P., Rosenthal, S., Farra, N., & Kumar, R. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1144 · Cited by 720
Metadata
- Authors
- Burnap, P., & Williams, M. L.
- Venue
- Policy & Internet
- Publisher
- Wiley
- Published
- 2015-04-22
- Volume
- 7
- Issue
- 2
- Pages
- 223-242
- ISSN
- 1944-2866 (ISSN-L)
- OpenAlex
- W1871142974
- Cited by
- 616
- References
- 29
- FWCI
- 33.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.