Predicting Cyberbullying on Social Media in the Big Data Era Using Machine Learning Algorithms: Review of Literature and Open Challenges
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Prior to the innovation of information communication technologies (ICT), social interactions evolved within small cultural boundaries such as geo spatial locations. The recent developments of communication technologies have considerably transcended the temporal and spatial limitations of traditional communications. These social technologies have created a revolution in user-generated information, online human networks, and rich human behavior-related data. However, the misuse of social technologies such as social media (SM) platforms, has introduced a new form of aggression and violence that occurs exclusively online. A new means of demonstrating aggressive behavior in SM websites are highlighted in this paper. The motivations for the construction of prediction models to fight aggressive behavior in SM are also outlined. We comprehensively review cyberbullying prediction models and identify the main issues related to the construction of cyberbullying prediction models in SM. This paper provides insights on the overall process for cyberbullying detection and most importantly overviews the methodology. Though data collection and feature engineering process has been elaborated, yet most of the emphasis is on feature selection algorithms and then using various machine learning algorithms for prediction of cyberbullying behaviors. Finally, the issues and challenges have been highlighted as well, which present new research directions for researchers to explore.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667
Random forests for classification in ecology
Cutler, D. R., Edwards, T. C., Beard, K. H., Cutler, A., Hess, K. T., Gibson, J., & Lawler, J. J. (2007) · Ecology · doi:10.1890/07-0539.1 · Cited by 4,950
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326
Kowalski, R. M., Giumetti, G. W., Schroeder, A. N., & Lattanner, M. R. (2014) · Psychological Bulletin · doi:10.1037/a0035618 · Cited by 3,266
Tokunaga, R. S. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.11.014 · Cited by 2,566
An introduction to MCMC for machine learning.
Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. I. (2003) · Machine Learning · doi:10.1023/a:1020281327116 · Cited by 2,451
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Bullying, Cyberbullying, and Suicide
Hinduja, S., & Patchin, J. W. (2010) · Archives of Suicide Research · doi:10.1080/13811118.2010.494133 · Cited by 2,078
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
The Impact of Social Media on Children, Adolescents, and Families
O'Keeffe, G. S., Clarke-Pearson, K., & Council on Communications and Media (2011) · Pediatrics · doi:10.1542/peds.2011-0054 · Cited by 1,987
Cyberbullying: Another main type of bullying?
SLONJE, R., & SMITH, P. K. (2008) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.2007.00611.x · Cited by 1,844
Psychological, Physical, and Academic Correlates of Cyberbullying and Traditional Bullying
Kowalski, R. M., & Limber, S. P. (2013) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2012.09.018 · Cited by 1,295
The nature of cyberbullying, and strategies for prevention
Slonje, R., Smith, P. K., & Frisén, A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.05.024 · Cited by 940
Cyberbullying Versus Face-to-Face Bullying: A Theoretical and Conceptual Review
Dooley, J. J., Pyżalski, J., & Cross, D. (2009) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.217.4.182 · Cited by 790
Evaluating Learning Algorithms: A Classification Perspective
Japkowicz, N., & Shah, M. (2011) · doi:10.1017/cbo9780511921803 · Cited by 767
Cyberbullying in adolescents: Modalities and aggressors’ profile
Calvete, E., Orue, I., Estévez, A., Villardón, L., & Padilla, P. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.03.017 · Cited by 686
Cyberbullying among youngsters: profiles of bullies and victims
Vandebosch, H., & Van Cleemput, K. (2009) · New Media & Society · doi:10.1177/1461444809341263 · Cited by 555
Cyberbullying Via Social Media
Whittaker, E., & Kowalski, R. M. (2015) · Journal of School Violence · doi:10.1080/15388220.2014.949377 · Cited by 498
Sticca, F., & Perren, S. (2013) · Journal of Youth and Adolescence · doi:10.1007/s10964-012-9867-3 · Cited by 485
Twitter spammer detection using data stream clustering
Miller, Z., Dickinson, B., Deitrick, W., Hu, W., & Wang, A. H. (2014) · Information Sciences · doi:10.1016/j.ins.2013.11.016 · Cited by 332
Yang, C., Harkreader, R., Zhang, J., Shin, S., & Gu, G. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187847 · Cited by 299
Predicting age and gender in online social networks
Peersman, C., Daelemans, W., & Van Vaerenbergh, L. (2011) · Proceedings of the 3rd international workshop on Search and mining user-generated contents · doi:10.1145/2065023.2065035 · Cited by 260
Assessing the bias in samples of large online networks
González-Bailón, S., Wang, N., Rivero, A., Borge-Holthoefer, J., & Moreno, Y. (2014) · Social Networks · doi:10.1016/j.socnet.2014.01.004 · Cited by 238
Cyberbullying among young adults in Malaysia: the roles of gender, age and Internet frequency
Balakrishnan, V. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.021 · Cited by 204
Detection of Cyberbullying Incidents on the Instagram Social Network
Hosseinmardi, H., Mattson, S. A., Rafiq, R. I., Han, R., Lv, Q., & Mishra, S. (2015) · arXiv · doi:10.48550/arxiv.1503.03909 · Cited by 126
Research works printed but not linked: 105
- 10.1145/2661126.2661133 · DOI · Paper page
- 10.1007/978-3-319-01854-6_43 · DOI
- 10.1007/978-3-642-13739-6_25 · DOI · Paper page
- 10.1007/978-3-642-45252-9_9 · DOI
- 10.1007/978-3-642-23496-5_13 · DOI · Paper page
- 10.1007/s13222-016-0221-x · DOI
- sood, 2012, Using crowdsourcing to improve profanity detection, Proc AAAI Spring Symp Wisdom of the Crowd, 69
- 10.1145/2187980.2187995 · DOI · Paper page
- 10.1145/2362394.2362400 · DOI · Paper page
- 10.1016/j.neucom.2015.02.047 · DOI · Paper page
- jiang, 2017, KDD 2017 tutorial: Data-driven approaches towards malicious behavior modeling, Dimensions, 19, 42
- 10.1007/978-3-319-42996-0_12 · DOI
- dong, 2016, Leading effect of social media for financial fraud disclosure: A text mining based analytics, Proc AMCIS
- 10.1109/MC.2011.222 · DOI
- 10.1145/2413176.2413213 · DOI
- patchin, 2013, Words Wound Delete Cyberbullying and Make Kindness Go Viral
- 10.1145/2184319.2184338 · DOI · Paper page
- 10.1109/ACSAT.2014.29 · DOI
- 10.1145/2897845.2897928 · DOI
- 10.1007/978-1-4757-3982-4_2 · doi:10.1007/978-1-4757-3982-4_2
- cheng, 2015, Antisocial behavior in online discussion communities, Proc 9th Int AAAI Conf Web Social Media
- 10.1109/TPDS.2013.2297115 · DOI
- 10.1016/j.tele.2014.04.002 · DOI
- 10.1016/j.inffus.2017.10.006 · DOI · Paper page
- 10.1016/B978-0-12-805394-2.00001-5 · DOI
- 10.1155/2015/297672 · doi:10.1155/2015/297672
- 10.1016/j.chb.2005.10.005 · DOI · Paper page
- 10.1016/j.childyouth.2016.02.024 · DOI
- kowalski, 2012, Cyberbullying bullying in the digital age
- phillips, 2017, Using social media to predict the future: A systematic literature review, arXiv 1706 06134
- 10.1016/j.chb.2016.05.051 · DOI · Paper page
- peterson, 2016, Is social media a gang? Toward a selection, facilitation, or enhancement explanation of cyber violence, Aggression and Violent Behavior 10
- 10.1201/b11271-22 · DOI
- 10.1007/978-3-642-35362-8_7 · doi:10.1007/978-3-642-35362-8_7
- 2012, Huge Rise in Social Media
- 10.1109/COMST.2014.2321628 · DOI · Paper page
- 10.1371/journal.pone.0102145 · DOI · Paper page
- 10.1109/ICSC.2016.111 · DOI
- xu, 2012, Learning from bullying traces in social media, Proc Conf North Amer Chapter Assoc Comput Linguistics Hum Lang Technol, 656
- smith, 1999, The Nature of School Bullying A Cross-National Perspective
- 10.1109/EIT.2015.7293405 · DOI · Paper page
- van hee, 2015, Detection and fine-grained classification of cyberbullying events, Proc Int Conf Recent Adv Natural Lang Process (RANLP), 672
- 2014, From IHML (I Hate My Life) to MOS (Mum Over Shoulder) Why This Guide to Cyber-Bullying Slang May Save Your Child’s Life
- nahar, 2013, An effective approach for cyberbullying detection, Commun Inf Sci Manage Eng, 3, 238
- morstatter, 2013, Is the sample good enough? Comparing data from twitter’s streaming API with Twitter’s firehose, arXiv 1306 5204
- 10.1109/ICMLA.2011.152 · DOI · Paper page
- 10.1038/nrg3920 · DOI · Paper page
- 10.1080/02732173.2012.628560 · DOI · Paper page
- 10.1145/219717.219768 · DOI · Paper page
- 10.1016/j.patcog.2012.09.022 · DOI
- nguyen, 2013, ‘How old do you think I Am?’ A study of language and age in Twitter, Proc Int'l AAAI Conf Weblogs and Social Media, 439
- korde, 2012, Text classification and classifiers: A survey, Int Journal Appl Art Intell, 3, 85
- 10.1145/505282.505283 · DOI · Paper page
- fernández-delgado, 2014, Do we need hundreds of classifiers to solve real world classification problems?, J Mach Learn Res, 15, 3133
- 10.1109/ICDM.2006.158 · DOI · Paper page
- dadvar, 2012, Improved cyberbullying detection using gender information, Proc 25th Dutch-Belgian Inf Retr Workshop, 1
- forman, 2003, An extensive empirical study of feature selection metrics for text classification, J Mach Learn Res, 1289
- turney, 2002, Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews, Proc ACL, 417
- tong, 2001, An operational system for detecting and tracking opinions in on-line discussion, Proc Notes ACM SIGIR Workshop Oper Text Classification
- 10.1080/1369118X.2012.678878 · DOI · Paper page
- hatzivassiloglou, 1997, Predicting the semantic orientation of adjectives, Proc 8th Conf Eur Chapter Assoc Comput Linguistics, 174
- 10.1109/ISDA.2013.6920758 · DOI · Paper page
- 10.1145/2464464.2464499 · DOI · Paper page
- 10.1109/MIC.2010.25 · DOI
- 10.1007/978-3-319-46562-3_12 · DOI
- 10.1126/science.aam7032 · DOI · Paper page
- tong, 2001, Support vector machine active learning with applications to text classification, J Mach Learn Res, 2, 45
- dinakar, 2011, Modeling the detection of textual cyberbullying, Proc 5th Int AAAI Conf Weblogs Social Media, 11
- 10.1080/03033910.2012.677995 · DOI · Paper page
- 10.1007/BFb0026683 · DOI · Paper page
- 10.1016/S0191-8869(02)00218-0 · DOI · Paper page
- ar?cak, 2009, Psychiatric symptomatology as a predictor of cyberbullying among University Students, European Journal of Research on Education, 34, 169
- 10.1016/j.jadohealth.2007.08.018 · DOI · Paper page
- 10.1145/1007730.1007741 · DOI · Paper page
- hall, 2000, Correlation-based feature selection for discrete and numeric class machine learning, Proc 17th Int Conf Mach Learn, 359
- 10.1007/978-3-642-00296-0_5 · DOI · Paper page
- mccallum, 1998, A comparison of event models for naive Bayes text classification, Proc AAAI Workshop Learn Text Categorization, 1
- vapnik, 2013, The Nature of Statistical Learning Theory
- raisi, 2016, Cyberbullying identification using participant-vocabulary consistency, arXiv 1606 08084
- 10.1145/2808797.2809398 · DOI · Paper page
- yin, 2009, Detection of harassment on Web 2.0, Proceedings of the Content Analysis in the WEB, 1
- ptaszynski, 2010, Machine learning and affect analysis against cyber-bullying, Proc 36th AISB'10, 7
- 10.1109/ICICES.2016.7518887 · DOI
- ratkiewicz, 2011, Detecting and tracking political abuse in social media, Proc 5th Int AAAI Conf Weblogs Social Media, 297
- 10.1109/eCrime.2012.6489521 · DOI
- 10.5210/fm.v15i1.2793 · DOI · Paper page
- 10.1016/j.istr.2011.09.008 · DOI
- 10.3390/admsci2020148 · DOI · Paper page
- 10.1371/journal.pone.0097807 · DOI · Paper page
- 10.1145/2517312.2517314 · DOI
- 10.1007/978-3-642-36973-5_62 · DOI · Paper page
- 10.1109/SocialCom-PASSAT.2012.55 · DOI · Paper page
- margono, 2014, Mining Indonesian cyber bullying patterns in social networks, Proc 37th Australas Comput Sci Conf, 147, 115
- 10.1109/ICACCI.2015.7275970 · DOI · Paper page
- 10.1016/j.chb.2014.11.052 · DOI
- zhang, 2004, The optimality of naive Bayes, Proc IAAI, 1, 3
- wang, 2010, Don’t follow me: Spam detection in Twitter, Proc Int Conf Sec Cryptogr (SECRYPT), 1
- liu, 2014, The tweets they are a-changin’: Evolution of twitter users and behavior, Proc of the 5th Int AAAI Conf on Weblogs and Social Media (ICWSM), 305
- 10.1109/SocialCom.2013.21 · doi:10.1109/socialcom.2013.21
- 10.1109/ICDM.2001.989592 · DOI · Paper page
- 10.1016/j.neucom.2015.08.112 · DOI · Paper page
- 10.1006/jbin.2001.1004 · DOI · Paper page
- 10.1145/2833312.2849567 · DOI · Paper page
- 10.1145/2872518.2888600 · DOI
- anzai, 2012, Pattern Recognition and Machine Learning
Cited by
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103
“In this paper, we have reviewed the research works that focus on automated cyberbul-lying detection using either DL models [26–29] or supervised learning techniques [30,31].”
BackgroundMethodCyberbullying Detection in Social Networks Using Bi-GRU with Self-Attention Mechanism
Fang, Y., Yang, S., Zhao, B., & Huang, C. (2021) · Information · doi:10.3390/info12040171 · Cited by 74
“In the last few years, online communication tends to be more and more userdriven, and social network platforms have become the hardest hit area of cyberbullying due to millions of users worldwide, efficient communication and “24/7/365” services [6].”
BackgroundMethodSession-based cyberbullying detection in social media: A survey
Yi, P., & Zubiaga, A. (2023) · Online Social Networks and Media · doi:10.1016/j.osnem.2023.100250 · Cited by 55
Artificial Intelligence-Enabled Cyberbullying-Free Online Social Networks in Smart Cities
Al-Marghilani, A. (2022) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-022-00063-y · Cited by 38
“Conventional ML methods are broadly utilized in recognizing negative forms of human behavior, the more general classifier adapted by scientists are support vector machine (SVM), and the more general feature extraction methods are the Bag-of-words (BoW) approach [12].”
MethodKahate, S. A., & Raut, A. D. (2023) · 2023 4th International Conference on Innovative Trends in Information Technology (ICITIIT) · doi:10.1109/icitiit57246.2023.10068711 · Cited by 4
Metadata
- Authors
- Al-Garadi, M. A., Hussain, M. R., Khan, N., Murtaza, G., Nweke, H. F., Ali, I., Mujtaba, G., Chiroma, H., Khattak, H. A., & Gani, A.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 70701-70718
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2945434935
- Cited by
- 177
- References
- 34
- FWCI
- 8.29
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- King Khalid University (R.G.P. 1/166/40)
- Universiti Malaya (PG035-2016A)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.