The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Mean Birds: Detecting Aggression and Bullying on Twitter
Abstract
In recent years, bullying and aggression against social media users have grown significantly, causing serious consequences to victims of all demographics. Nowadays, cyberbullying affects more than half of young social media users worldwide, suffering from prolonged and/or coordinated digital harassment. Also, tools and technologies geared to understand and mitigate it are scarce and mostly ineffective. In this paper, we present a principled and scalable approach to detect bullying and aggressive behavior on Twitter. We propose a robust methodology for extracting text, user, and network-based attributes, studying the properties of bullies and aggressors, and what features distinguish them from regular users. We find that bullies post less, participate in fewer online communities, and are less popular than normal users. Aggressors are relatively popular and tend to include more negativity in their posts. We evaluate our methodology using a corpus of 1.6M tweets posted over 3 months, and show that machine learning classification algorithms can accurately detect users exhibiting bullying and aggressive behavior, with over 90% AUC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“(based on SMOTE [8], which creates synthetic instances of the minority class) and under-sample (a resampling technique without replacement) at the same time, as it has proven to result in better Long Session I: Aggression, Controversy, Crime WebSci '17, June 25-28, 2017, Troy, NY, USA”
MethodEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Cyberbullying: Its nature and impact in secondary school pupils
Smith, P. K., Mahdavi, J., Carvalho, M., Fisher, S., Russell, S., & Tippett, N. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01846.x · Cited by 3,639 · cited 2×
“Based on previous research [19, 46, 52], workers are provided with the following de nitions of aggressive, bullying, and spam behaviors:”
BackgroundMethodTokunaga, R. S. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.11.014 · Cited by 2,566
A guided tour to approximate string matching
Navarro, G. (2001) · ACM Computing Surveys · doi:10.1145/375360.375365 · Cited by 2,561
Massanari, A. (2017) · New Media & Society · doi:10.1177/1461444815608807 · Cited by 1,264 · cited 1×
“The GamerGate controversy [23] is one of the most well documented large-scale instances of bullying/aggressive behavior that we are aware of.”
BackgroundAbusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122
Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap
Kim, J.-H. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.04.009 · Cited by 792
Detecting spammers on social networks
Stringhini, G., Kruegel, C., & Vigna, G. (2010) · Proceedings of the 26th Annual Computer Security Applications Conference · doi:10.1145/1920261.1920263 · Cited by 791 · cited 1×
“Third, despite extensive work on spam detection in social media [12, 34, 39], Twitter is still full of spammy accounts [5], often using vulgar language and exhibiting behavior (repeated posts with similar content, mentions, or hash-tags) that could also be considered as aggressive or bullying.”
BackgroundSelf-citationHate Speech Detection with Comment Embeddings
Djuric, N., Zhou, J., Morris, R., Grbovic, M., Radosavljevic, V., & Bhamidipati, N. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742760 · Cited by 712
Detecting Offensive Language in Social Media to Protect Adolescent Online Safety
Chen, Y., Zhou, Y., Zhu, S., & Xu, H. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.55 · Cited by 637
Understanding online firestorms: Negative word-of-mouth dynamics in social media networks
Pfeffer, J., Zorbach, T., & Carley, K. M. (2014) · Journal of Marketing Communications · doi:10.1080/13527266.2013.797778 · Cited by 554
Modeling the Detection of Textual Cyberbullying
Dinakar, K., Reichart, R., & Lieberman, H. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i3.14209 · Cited by 512
Hubs, authorities, and communities
Kleinberg, J. M. (1999) · ACM Computing Surveys · doi:10.1145/345966.345982 · Cited by 506
DON’T FOLLOW ME - Spam Detection in Twitter
(2010) · Proceedings of the International Conference on Security and Cryptography · doi:10.5220/0002996201420151 · Cited by 462
Cyber-aggression: definition and concept of cyberbullying
Grigg, D. W. (2010) · Australian Journal of Guidance and Counselling · doi:10.1375/ajgc.20.2.143 · Cited by 396
Epidemiological modeling of news and rumors on Twitter
Jin, F., Dougherty, E., Saraf, P., Cao, Y., & Ramakrishnan, N. (2013) · Proceedings of the 7th Workshop on Social Network Mining and Analysis · doi:10.1145/2501025.2501027 · Cited by 342
Analyzing Labeled Cyberbullying Incidents on the Instagram Social Network
Hosseinmardi, H., Mattson, S. A., Ibn Rafiq, R., Han, R., Lv, Q., & Mishra, S. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-27433-1_4 · Cited by 254
Corcoran, L., Guckin, C., & Prentice, G. (2015) · Societies · doi:10.3390/soc5020245 · Cited by 201
Hine, G., Onaolapo, J., De Cristofaro, E., Kourtellis, N., Leontiadis, I., Samaras, R., Stringhini, G., & Blackburn, J. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14893 · Cited by 181
Self-citation6 million spam tweets: A large ground truth for timely Twitter spam detection
Chen, C., Zhang, J., Chen, X., Xiang, Y., & Zhou, W. (2015) · International Conference on Communications · doi:10.1109/icc.2015.7249453 · Cited by 154
Experts and Machines against Bullies: A Hybrid Approach to Detect Cyberbullies
Dadvar, M., Trieschnigg, D., & de Jong, F. M. G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-06483-3_25 · Cited by 142
Relevant dimensions of cyberbullying — Results from two experimental studies
Pieschl, S., Porsch, T., Kahl, T., & Klockenbusch, R. (2013) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2013.04.002 · Cited by 136
Automatic Detection and Prevention of Cyberbullying
Hee, C. V., Lefever, E., Verhoeven, B., Mennes, J., Desmet, B., Pauw, G. D., Daelemans, W. M. P., & Hoste, V. (2015) · Ghent University Academic Bibliography (Ghent University) · Cited by 89
Sentiment Analysis for Effective Detection of Cyber Bullying
Nahar, V., Unankard, S., Li, X., & Pang, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29253-8_75 · Cited by 85
Fast learning for sentiment analysis on bullying
Xu, J., Zhu, X., & Bellmore, A. D. (2012) · International Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM) · doi:10.1145/2346676.2346686 · Cited by 83
Towards understanding cyberbullying behavior in a semi-anonymous social network
Hosseinmardi, H., Ghasemian, A., Han, R. Y., Lv, Q., & Mishra, S. (2014) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2014.6921591 · Cited by 81
Chatzakou, D., Kourtellis, N., Blackburn, J., Cristofaro, E. D., Stringhini, G., & Vakali, A. I. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3053890 · Cited by 80
Self-citationThe Social World of Content Abusers in Community Question Answering
Kayes, I., Kourtellis, N., Quercia, D., Iamnitchi, A., & Bonchi, F. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2736277.2741674 · Cited by 79
Self-citationRetweeting Activity on Twitter: Signs of Deception
Γιάτσογλου, Μ., Chatzakou, D., Shah, N., Faloutsos, C., & Vakali, A. I. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18038-0_10 · Cited by 61
Self-citationBullying Among Young Children: The Influence of Peers and Teachers
Hanish, L. D., Ladd, G. W., Fabes, R. A., Martin, C. L., & Denning, D. J. (2004) · Routledge eBooks · doi:10.4324/9781410609700-18 · Cited by 61
Chatzakou, D., Kourtellis, N., Blackburn, J., Cristofaro, E. D., Stringhini, G., & Vakali, A. I. (2017) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3078714.3078721 · Cited by 58
Self-citationTowards understanding cyberbullying behavior in a semianonymous social network
Hosseinmardi, H., Han, R. Y., Lv, Q., Mishra, S., & Ghasemian, A. (2014) · Cited by 40
Branded with a scarlet "C": cheaters in a gaming social network
Blackburn, J., Simha, R., Kourtellis, N., Zuo, X., Ripeanu, M., Skvoretz, J. V., & Iamnitchi, A. (2012) · International World Wide Web Conference (WWW) · doi:10.1145/2187836.2187848 · Cited by 35
Self-citationDetecting bullying on Twitter using emotion lexicons
Patch, J. A. (2015) · Cited by 5
Cited by
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior
Founta, A., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., Stringhini, G., Vakali, A., Sirivianos, M., & Kourtellis, N. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.14991 · Cited by 596
Self-citationAutomatic detection of cyberbullying in social media text
Van Hee, C., Jacobs, G., Emmery, C., Desmet, B., Lefever, E., Verhoeven, B., De Pauw, G., Daelemans, W., & Hoste, V. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203794 · Cited by 385
Social Media, Echo Chambers, and Political Polarization
Barberá, P. (2020) · Social Media and Democracy · doi:10.1017/9781108890960.004 · Cited by 373
Directions in abusive language training data, a systematic review: Garbage in, garbage out
Vidgen, B., & Derczynski, L. (2020) · PLOS ONE · doi:10.1371/journal.pone.0243300 · Cited by 318
Automatic cyberbullying detection: A systematic review
Rosa, H., Pereira, N., Ribeiro, R., Ferreira, P. C., Carvalho, J. P., Oliveira, S., Coheur, L., Paulino, P., Veiga Simão, A. M., & Trancoso, I. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.021 · Cited by 307
Metadata
- Authors
- Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., & Vakali, A.
- Venue
- Proceedings of the 2017 ACM on Web Science Conference
- Publisher
- ACM
- Published
- 2017-06-25
- Pages
- 13-22
- OpenAlex
- W2594902547
- Cited by
- 369
- References
- 40
- FWCI
- 21.85
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.